-
Hotho, A.; Bloehdorn, S.: Data Mining 2004 : Text classification by boosting weak learners based on terms and concepts (2004)
0.36
0.36031273 = product of:
0.6305472 = sum of:
0.047687992 = product of:
0.14306398 = sum of:
0.14306398 = weight(_text_:3a in 562) [ClassicSimilarity], result of:
0.14306398 = score(doc=562,freq=2.0), product of:
0.25455406 = queryWeight, product of:
8.478011 = idf(docFreq=24, maxDocs=44218)
0.03002521 = queryNorm
0.56201804 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
8.478011 = idf(docFreq=24, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.33333334 = coord(1/3)
0.14306398 = weight(_text_:2f in 562) [ClassicSimilarity], result of:
0.14306398 = score(doc=562,freq=2.0), product of:
0.25455406 = queryWeight, product of:
8.478011 = idf(docFreq=24, maxDocs=44218)
0.03002521 = queryNorm
0.56201804 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
8.478011 = idf(docFreq=24, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.03496567 = weight(_text_:classification in 562) [ClassicSimilarity], result of:
0.03496567 = score(doc=562,freq=6.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.3656675 = fieldWeight in 562, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.07153199 = product of:
0.14306398 = sum of:
0.14306398 = weight(_text_:3a in 562) [ClassicSimilarity], result of:
0.14306398 = score(doc=562,freq=2.0), product of:
0.25455406 = queryWeight, product of:
8.478011 = idf(docFreq=24, maxDocs=44218)
0.03002521 = queryNorm
0.56201804 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
8.478011 = idf(docFreq=24, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.5 = coord(1/2)
0.14306398 = weight(_text_:2f in 562) [ClassicSimilarity], result of:
0.14306398 = score(doc=562,freq=2.0), product of:
0.25455406 = queryWeight, product of:
8.478011 = idf(docFreq=24, maxDocs=44218)
0.03002521 = queryNorm
0.56201804 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
8.478011 = idf(docFreq=24, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.03496567 = weight(_text_:classification in 562) [ClassicSimilarity], result of:
0.03496567 = score(doc=562,freq=6.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.3656675 = fieldWeight in 562, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.14306398 = weight(_text_:2f in 562) [ClassicSimilarity], result of:
0.14306398 = score(doc=562,freq=2.0), product of:
0.25455406 = queryWeight, product of:
8.478011 = idf(docFreq=24, maxDocs=44218)
0.03002521 = queryNorm
0.56201804 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
8.478011 = idf(docFreq=24, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.0122040035 = product of:
0.024408007 = sum of:
0.024408007 = weight(_text_:22 in 562) [ClassicSimilarity], result of:
0.024408007 = score(doc=562,freq=2.0), product of:
0.10514317 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.03002521 = queryNorm
0.23214069 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.5 = coord(1/2)
0.5714286 = coord(8/14)
- Abstract
- Document representations for text classification are typically based on the classical Bag-Of-Words paradigm. This approach comes with deficiencies that motivate the integration of features on a higher semantic level than single words. In this paper we propose an enhancement of the classical document representation through concepts extracted from background knowledge. Boosting is used for actual classification. Experimental evaluations on two well known text corpora support our approach through consistent improvement of the results.
- Content
- Vgl.: http://www.google.de/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&ved=0CEAQFjAA&url=http%3A%2F%2Fciteseerx.ist.psu.edu%2Fviewdoc%2Fdownload%3Fdoi%3D10.1.1.91.4940%26rep%3Drep1%26type%3Dpdf&ei=dOXrUMeIDYHDtQahsIGACg&usg=AFQjCNHFWVh6gNPvnOrOS9R3rkrXCNVD-A&sig2=5I2F5evRfMnsttSgFF9g7Q&bvm=bv.1357316858,d.Yms.
- Date
- 8. 1.2013 10:22:32
-
Ko, Y.: ¬A new term-weighting scheme for text classification using the odds of positive and negative class probabilities (2015)
0.02
0.024449104 = product of:
0.11409582 = sum of:
0.028549349 = weight(_text_:classification in 2339) [ClassicSimilarity], result of:
0.028549349 = score(doc=2339,freq=4.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.29856625 = fieldWeight in 2339, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.046875 = fieldNorm(doc=2339)
0.05699712 = product of:
0.11399424 = sum of:
0.11399424 = weight(_text_:schemes in 2339) [ClassicSimilarity], result of:
0.11399424 = score(doc=2339,freq=8.0), product of:
0.16067243 = queryWeight, product of:
5.3512506 = idf(docFreq=569, maxDocs=44218)
0.03002521 = queryNorm
0.7094823 = fieldWeight in 2339, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
5.3512506 = idf(docFreq=569, maxDocs=44218)
0.046875 = fieldNorm(doc=2339)
0.5 = coord(1/2)
0.028549349 = weight(_text_:classification in 2339) [ClassicSimilarity], result of:
0.028549349 = score(doc=2339,freq=4.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.29856625 = fieldWeight in 2339, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.046875 = fieldNorm(doc=2339)
0.21428572 = coord(3/14)
- Abstract
- Text classification (TC) is a core technique for text mining and information retrieval. It has been applied to many applications in many different research and industrial areas. Term-weighting schemes assign an appropriate weight to each term to obtain a high TC performance. Although term weighting is one of the important modules for TC and TC has different peculiarities from those in information retrieval, many term-weighting schemes used in information retrieval, such as term frequency-inverse document frequency (tf-idf), have been used in TC in the same manner. The peculiarity of TC that differs most from information retrieval is the existence of class information. This article proposes a new term-weighting scheme that uses class information using positive and negative class distributions. As a result, the proposed scheme, log tf-TRR, consistently performs better than do other schemes using class information as well as traditional schemes such as tf-idf.
-
Ibekwe-SanJuan, F.; SanJuan, E.: From term variants to research topics (2002)
0.02
0.01774993 = product of:
0.08283301 = sum of:
0.023791125 = weight(_text_:classification in 1853) [ClassicSimilarity], result of:
0.023791125 = score(doc=1853,freq=4.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.24880521 = fieldWeight in 1853, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.0390625 = fieldNorm(doc=1853)
0.023791125 = weight(_text_:classification in 1853) [ClassicSimilarity], result of:
0.023791125 = score(doc=1853,freq=4.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.24880521 = fieldWeight in 1853, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.0390625 = fieldNorm(doc=1853)
0.035250753 = product of:
0.07050151 = sum of:
0.07050151 = weight(_text_:texts in 1853) [ClassicSimilarity], result of:
0.07050151 = score(doc=1853,freq=4.0), product of:
0.16460659 = queryWeight, product of:
5.4822793 = idf(docFreq=499, maxDocs=44218)
0.03002521 = queryNorm
0.42830306 = fieldWeight in 1853, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
5.4822793 = idf(docFreq=499, maxDocs=44218)
0.0390625 = fieldNorm(doc=1853)
0.5 = coord(1/2)
0.21428572 = coord(3/14)
- Abstract
- In a scientific and technological watch (STW) task, an expert user needs to survey the evolution of research topics in his area of specialisation in order to detect interesting changes. The majority of methods proposing evaluation metrics (bibliometrics and scientometrics studies) for STW rely solely an statistical data analysis methods (Co-citation analysis, co-word analysis). Such methods usually work an structured databases where the units of analysis (words, keywords) are already attributed to documents by human indexers. The advent of huge amounts of unstructured textual data has rendered necessary the integration of natural language processing (NLP) techniques to first extract meaningful units from texts. We propose a method for STW which is NLP-oriented. The method not only analyses texts linguistically in order to extract terms from them, but also uses linguistic relations (syntactic variations) as the basis for clustering. Terms and variation relations are formalised as weighted di-graphs which the clustering algorithm, CPCL (Classification by Preferential Clustered Link) will seek to reduce in order to produces classes. These classes ideally represent the research topics present in the corpus. The results of the classification are subjected to validation by an expert in STW.
-
Peng, F.; Huang, X.: Machine learning for Asian language text classification (2007)
0.02
0.015199591 = product of:
0.10639714 = sum of:
0.05319857 = weight(_text_:classification in 831) [ClassicSimilarity], result of:
0.05319857 = score(doc=831,freq=20.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.55634534 = fieldWeight in 831, product of:
4.472136 = tf(freq=20.0), with freq of:
20.0 = termFreq=20.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.0390625 = fieldNorm(doc=831)
0.05319857 = weight(_text_:classification in 831) [ClassicSimilarity], result of:
0.05319857 = score(doc=831,freq=20.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.55634534 = fieldWeight in 831, product of:
4.472136 = tf(freq=20.0), with freq of:
20.0 = termFreq=20.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.0390625 = fieldNorm(doc=831)
0.14285715 = coord(2/14)
- Abstract
- Purpose - The purpose of this research is to compare several machine learning techniques on the task of Asian language text classification, such as Chinese and Japanese where no word boundary information is available in written text. The paper advocates a simple language modeling based approach for this task. Design/methodology/approach - Naïve Bayes, maximum entropy model, support vector machines, and language modeling approaches were implemented and were applied to Chinese and Japanese text classification. To investigate the influence of word segmentation, different word segmentation approaches were investigated and applied to Chinese text. A segmentation-based approach was compared with the non-segmentation-based approach. Findings - There were two findings: the experiments show that statistical language modeling can significantly outperform standard techniques, given the same set of features; and it was found that classification with word level features normally yields improved classification performance, but that classification performance is not monotonically related to segmentation accuracy. In particular, classification performance may initially improve with increased segmentation accuracy, but eventually classification performance stops improving, and can in fact even decrease, after a certain level of segmentation accuracy. Practical implications - Apply the findings to real web text classification is ongoing work. Originality/value - The paper is very relevant to Chinese and Japanese information processing, e.g. webpage classification, web search.
-
Sebastiani, F.: Machine learning in automated text categorization (2002)
0.02
0.015061316 = product of:
0.07028614 = sum of:
0.02018744 = weight(_text_:classification in 3389) [ClassicSimilarity], result of:
0.02018744 = score(doc=3389,freq=2.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.21111822 = fieldWeight in 3389, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.046875 = fieldNorm(doc=3389)
0.02018744 = weight(_text_:classification in 3389) [ClassicSimilarity], result of:
0.02018744 = score(doc=3389,freq=2.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.21111822 = fieldWeight in 3389, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.046875 = fieldNorm(doc=3389)
0.029911257 = product of:
0.059822515 = sum of:
0.059822515 = weight(_text_:texts in 3389) [ClassicSimilarity], result of:
0.059822515 = score(doc=3389,freq=2.0), product of:
0.16460659 = queryWeight, product of:
5.4822793 = idf(docFreq=499, maxDocs=44218)
0.03002521 = queryNorm
0.36342722 = fieldWeight in 3389, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
5.4822793 = idf(docFreq=499, maxDocs=44218)
0.046875 = fieldNorm(doc=3389)
0.5 = coord(1/2)
0.21428572 = coord(3/14)
- Abstract
- The automated categorization (or classification) of texts into predefined categories has witnessed a booming interest in the last 10 years, due to the increased availability of documents in digital form and the ensuing need to organize them. In the research community the dominant approach to this problem is based an machine learning techniques: a general inductive process automatically builds a classifier by learning, from a set of preclassified documents, the characteristics of the categories. The advantages of this approach over the knowledge engineering approach (consisting in the manual definition of a classifier by domain experts) are a very good effectiveness, considerable savings in terms of expert labor power, and straightforward portability to different domains. This survey discusses the main approaches to text categorization that fall within the machine learning paradigm. We will discuss in detail issues pertaining to three different problems, namely, document representation, classifier construction, and classifier evaluation.
-
Sebastiani, F.: ¬A tutorial an automated text categorisation (1999)
0.02
0.015061316 = product of:
0.07028614 = sum of:
0.02018744 = weight(_text_:classification in 3390) [ClassicSimilarity], result of:
0.02018744 = score(doc=3390,freq=2.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.21111822 = fieldWeight in 3390, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.046875 = fieldNorm(doc=3390)
0.02018744 = weight(_text_:classification in 3390) [ClassicSimilarity], result of:
0.02018744 = score(doc=3390,freq=2.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.21111822 = fieldWeight in 3390, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.046875 = fieldNorm(doc=3390)
0.029911257 = product of:
0.059822515 = sum of:
0.059822515 = weight(_text_:texts in 3390) [ClassicSimilarity], result of:
0.059822515 = score(doc=3390,freq=2.0), product of:
0.16460659 = queryWeight, product of:
5.4822793 = idf(docFreq=499, maxDocs=44218)
0.03002521 = queryNorm
0.36342722 = fieldWeight in 3390, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
5.4822793 = idf(docFreq=499, maxDocs=44218)
0.046875 = fieldNorm(doc=3390)
0.5 = coord(1/2)
0.21428572 = coord(3/14)
- Abstract
- The automated categorisation (or classification) of texts into topical categories has a long history, dating back at least to 1960. Until the late '80s, the dominant approach to the problem involved knowledge-engineering automatic categorisers, i.e. manually building a set of rules encoding expert knowledge an how to classify documents. In the '90s, with the booming production and availability of on-line documents, automated text categorisation has witnessed an increased and renewed interest. A newer paradigm based an machine learning has superseded the previous approach. Within this paradigm, a general inductive process automatically builds a classifier by "learning", from a set of previously classified documents, the characteristics of one or more categories; the advantages are a very good effectiveness, a considerable savings in terms of expert manpower, and domain independence. In this tutorial we look at the main approaches that have been taken towards automatic text categorisation within the general machine learning paradigm. Issues of document indexing, classifier construction, and classifier evaluation, will be touched upon.
-
Ruiz, M.E.; Srinivasan, P.: Combining machine learning and hierarchical indexing structures for text categorization (2001)
0.01
0.009516451 = product of:
0.06661515 = sum of:
0.033307575 = weight(_text_:classification in 1595) [ClassicSimilarity], result of:
0.033307575 = score(doc=1595,freq=4.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.34832728 = fieldWeight in 1595, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.0546875 = fieldNorm(doc=1595)
0.033307575 = weight(_text_:classification in 1595) [ClassicSimilarity], result of:
0.033307575 = score(doc=1595,freq=4.0), product of:
0.09562149 = queryWeight, product of:
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.03002521 = queryNorm
0.34832728 = fieldWeight in 1595, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.1847067 = idf(docFreq=4974, maxDocs=44218)
0.0546875 = fieldNorm(doc=1595)
0.14285715 = coord(2/14)
- Source
- Advances in classification research, vol.10: proceedings of the 10th ASIS SIG/CR Classification Research Workshop. Ed.: Albrechtsen, H. u. J.E. Mai
