-
Hotho, A.; Bloehdorn, S.: Data Mining 2004 : Text classification by boosting weak learners based on terms and concepts (2004)
0.49
0.4895892 = product of:
0.62947184 = sum of:
0.046703033 = product of:
0.14010909 = sum of:
0.14010909 = weight(_text_:3a in 562) [ClassicSimilarity], result of:
0.14010909 = score(doc=562,freq=2.0), product of:
0.24929643 = queryWeight, product of:
8.478011 = idf(docFreq=24, maxDocs=44218)
0.02940506 = queryNorm
0.56201804 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
8.478011 = idf(docFreq=24, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.33333334 = coord(1/3)
0.14010909 = weight(_text_:2f in 562) [ClassicSimilarity], result of:
0.14010909 = score(doc=562,freq=2.0), product of:
0.24929643 = queryWeight, product of:
8.478011 = idf(docFreq=24, maxDocs=44218)
0.02940506 = queryNorm
0.56201804 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
8.478011 = idf(docFreq=24, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.010380501 = product of:
0.020761002 = sum of:
0.020761002 = weight(_text_:web in 562) [ClassicSimilarity], result of:
0.020761002 = score(doc=562,freq=2.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.21634221 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.5 = coord(1/2)
0.14010909 = weight(_text_:2f in 562) [ClassicSimilarity], result of:
0.14010909 = score(doc=562,freq=2.0), product of:
0.24929643 = queryWeight, product of:
8.478011 = idf(docFreq=24, maxDocs=44218)
0.02940506 = queryNorm
0.56201804 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
8.478011 = idf(docFreq=24, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.14010909 = weight(_text_:2f in 562) [ClassicSimilarity], result of:
0.14010909 = score(doc=562,freq=2.0), product of:
0.24929643 = queryWeight, product of:
8.478011 = idf(docFreq=24, maxDocs=44218)
0.02940506 = queryNorm
0.56201804 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
8.478011 = idf(docFreq=24, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.14010909 = weight(_text_:2f in 562) [ClassicSimilarity], result of:
0.14010909 = score(doc=562,freq=2.0), product of:
0.24929643 = queryWeight, product of:
8.478011 = idf(docFreq=24, maxDocs=44218)
0.02940506 = queryNorm
0.56201804 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
8.478011 = idf(docFreq=24, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.011951938 = product of:
0.023903877 = sum of:
0.023903877 = weight(_text_:22 in 562) [ClassicSimilarity], result of:
0.023903877 = score(doc=562,freq=2.0), product of:
0.10297151 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.02940506 = queryNorm
0.23214069 = fieldWeight in 562, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046875 = fieldNorm(doc=562)
0.5 = coord(1/2)
0.7777778 = coord(7/9)
- Content
- Vgl.: http://www.google.de/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&ved=0CEAQFjAA&url=http%3A%2F%2Fciteseerx.ist.psu.edu%2Fviewdoc%2Fdownload%3Fdoi%3D10.1.1.91.4940%26rep%3Drep1%26type%3Dpdf&ei=dOXrUMeIDYHDtQahsIGACg&usg=AFQjCNHFWVh6gNPvnOrOS9R3rkrXCNVD-A&sig2=5I2F5evRfMnsttSgFF9g7Q&bvm=bv.1357316858,d.Yms.
- Date
- 8. 1.2013 10:22:32
-
Doszkocs, T.E.; Zamora, A.: Dictionary services and spelling aids for Web searching (2004)
0.01
0.0064596576 = product of:
0.029068459 = sum of:
0.014982964 = product of:
0.029965928 = sum of:
0.029965928 = weight(_text_:web in 2541) [ClassicSimilarity], result of:
0.029965928 = score(doc=2541,freq=6.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.3122631 = fieldWeight in 2541, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0390625 = fieldNorm(doc=2541)
0.5 = coord(1/2)
0.014085495 = product of:
0.02817099 = sum of:
0.02817099 = weight(_text_:22 in 2541) [ClassicSimilarity], result of:
0.02817099 = score(doc=2541,freq=4.0), product of:
0.10297151 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.02940506 = queryNorm
0.27358043 = fieldWeight in 2541, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=2541)
0.5 = coord(1/2)
0.22222222 = coord(2/9)
- Abstract
- The Specialized Information Services Division (SIS) of the National Library of Medicine (NLM) provides Web access to more than a dozen scientific databases on toxicology and the environment on TOXNET . Search queries on TOXNET often include misspelled or variant English words, medical and scientific jargon and chemical names. Following the example of search engines like Google and ClinicalTrials.gov, we set out to develop a spelling "suggestion" system for increased recall and precision in TOXNET searching. This paper describes development of dictionary technology that can be used in a variety of applications such as orthographic verification, writing aid, natural language processing, and information storage and retrieval. The design of the technology allows building complex applications using the components developed in the earlier phases of the work in a modular fashion without extensive rewriting of computer code. Since many of the potential applications envisioned for this work have on-line or web-based interfaces, the dictionaries and other computer components must have fast response, and must be adaptable to open-ended database vocabularies, including chemical nomenclature. The dictionary vocabulary for this work was derived from SIS and other databases and specialized resources, such as NLM's Unified Medical Language Systems (UMLS) . The resulting technology, A-Z Dictionary (AZdict), has three major constituents: 1) the vocabulary list, 2) the word attributes that define part of speech and morphological relationships between words in the list, and 3) a set of programs that implements the retrieval of words and their attributes, and determines similarity between words (ChemSpell). These three components can be used in various applications such as spelling verification, spelling aid, part-of-speech tagging, paraphrasing, and many other natural language processing functions.
- Date
- 14. 8.2004 17:22:56
- Source
- Online. 28(2004) no.3, S.22-29
-
Bian, G.-W.; Chen, H.-H.: Cross-language information access to multilingual collections on the Internet (2000)
0.01
0.005918263 = product of:
0.026632184 = sum of:
0.014680246 = product of:
0.029360492 = sum of:
0.029360492 = weight(_text_:web in 4436) [ClassicSimilarity], result of:
0.029360492 = score(doc=4436,freq=4.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.3059541 = fieldWeight in 4436, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=4436)
0.5 = coord(1/2)
0.011951938 = product of:
0.023903877 = sum of:
0.023903877 = weight(_text_:22 in 4436) [ClassicSimilarity], result of:
0.023903877 = score(doc=4436,freq=2.0), product of:
0.10297151 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.02940506 = queryNorm
0.23214069 = fieldWeight in 4436, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.046875 = fieldNorm(doc=4436)
0.5 = coord(1/2)
0.22222222 = coord(2/9)
- Abstract
- Language barrier is the major problem that people face in searching for, retrieving, and understanding multilingual collections on the Internet. This paper deals with query translation and document translation in a Chinese-English information retrieval system called MTIR. Bilingual dictionary and monolingual corpus-based approaches are adopted to select suitable tranlated query terms. A machine transliteration algorithm is introduced to resolve proper name searching. We consider several design issues for document translation, including which material is translated, what roles the HTML tags play in translation, what the tradeoff is between the speed performance and the translation performance, and what from the translated result is presented in. About 100.000 Web pages translated in the last 4 months of 1997 are used for quantitative study of online and real-time Web page translation
- Date
- 16. 2.2000 14:22:39
-
Yang, C.C.; Luk, J.: Automatic generation of English/Chinese thesaurus based on a parallel corpus in laws (2003)
0.00
0.004240567 = product of:
0.01908255 = sum of:
0.012110585 = product of:
0.02422117 = sum of:
0.02422117 = weight(_text_:web in 1616) [ClassicSimilarity], result of:
0.02422117 = score(doc=1616,freq=8.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.25239927 = fieldWeight in 1616, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02734375 = fieldNorm(doc=1616)
0.5 = coord(1/2)
0.006971964 = product of:
0.013943928 = sum of:
0.013943928 = weight(_text_:22 in 1616) [ClassicSimilarity], result of:
0.013943928 = score(doc=1616,freq=2.0), product of:
0.10297151 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.02940506 = queryNorm
0.1354154 = fieldWeight in 1616, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.02734375 = fieldNorm(doc=1616)
0.5 = coord(1/2)
0.22222222 = coord(2/9)
- Abstract
- The information available in languages other than English in the World Wide Web is increasing significantly. According to a report from Computer Economics in 1999, 54% of Internet users are English speakers ("English Will Dominate Web for Only Three More Years," Computer Economics, July 9, 1999, http://www.computereconomics. com/new4/pr/pr990610.html). However, it is predicted that there will be only 60% increase in Internet users among English speakers verses a 150% growth among nonEnglish speakers for the next five years. By 2005, 57% of Internet users will be non-English speakers. A report by CNN.com in 2000 showed that the number of Internet users in China had been increased from 8.9 million to 16.9 million from January to June in 2000 ("Report: China Internet users double to 17 million," CNN.com, July, 2000, http://cnn.org/2000/TECH/computing/07/27/ china.internet.reut/index.html). According to Nielsen/ NetRatings, there was a dramatic leap from 22.5 millions to 56.6 millions Internet users from 2001 to 2002. China had become the second largest global at-home Internet population in 2002 (US's Internet population was 166 millions) (Robyn Greenspan, "China Pulls Ahead of Japan," Internet.com, April 22, 2002, http://cyberatias.internet.com/big-picture/geographics/article/0,,5911_1013841,00. html). All of the evidences reveal the importance of crosslingual research to satisfy the needs in the near future. Digital library research has been focusing in structural and semantic interoperability in the past. Searching and retrieving objects across variations in protocols, formats and disciplines are widely explored (Schatz, B., & Chen, H. (1999). Digital libraries: technological advances and social impacts. IEEE Computer, Special Issue an Digital Libraries, February, 32(2), 45-50.; Chen, H., Yen, J., & Yang, C.C. (1999). International activities: development of Asian digital libraries. IEEE Computer, Special Issue an Digital Libraries, 32(2), 48-49.). However, research in crossing language boundaries, especially across European languages and Oriental languages, is still in the initial stage. In this proposal, we put our focus an cross-lingual semantic interoperability by developing automatic generation of a cross-lingual thesaurus based an English/Chinese parallel corpus. When the searchers encounter retrieval problems, Professional librarians usually consult the thesaurus to identify other relevant vocabularies. In the problem of searching across language boundaries, a cross-lingual thesaurus, which is generated by co-occurrence analysis and Hopfield network, can be used to generate additional semantically relevant terms that cannot be obtained from dictionary. In particular, the automatically generated cross-lingual thesaurus is able to capture the unknown words that do not exist in a dictionary, such as names of persons, organizations, and events. Due to Hong Kong's unique history background, both English and Chinese are used as official languages in all legal documents. Therefore, English/Chinese cross-lingual information retrieval is critical for applications in courts and the government. In this paper, we develop an automatic thesaurus by the Hopfield network based an a parallel corpus collected from the Web site of the Department of Justice of the Hong Kong Special Administrative Region (HKSAR) Government. Experiments are conducted to measure the precision and recall of the automatic generated English/Chinese thesaurus. The result Shows that such thesaurus is a promising tool to retrieve relevant terms, especially in the language that is not the same as the input term. The direct translation of the input term can also be retrieved in most of the cases.
- Footnote
- Teil eines Themenheftes: "Web retrieval and mining: A machine learning perspective"
-
Boleda, G.; Evert, S.: Multiword expressions : a pain in the neck of lexical semantics (2009)
0.00
0.0026559862 = product of:
0.023903877 = sum of:
0.023903877 = product of:
0.047807753 = sum of:
0.047807753 = weight(_text_:22 in 4888) [ClassicSimilarity], result of:
0.047807753 = score(doc=4888,freq=2.0), product of:
0.10297151 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.02940506 = queryNorm
0.46428138 = fieldWeight in 4888, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.09375 = fieldNorm(doc=4888)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Date
- 1. 3.2013 14:56:22
-
Wang, F.L.; Yang, C.C.: Mining Web data for Chinese segmentation (2007)
0.00
0.0021492138 = product of:
0.019342924 = sum of:
0.019342924 = product of:
0.038685847 = sum of:
0.038685847 = weight(_text_:web in 604) [ClassicSimilarity], result of:
0.038685847 = score(doc=604,freq=10.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.40312994 = fieldWeight in 604, product of:
3.1622777 = tf(freq=10.0), with freq of:
10.0 = termFreq=10.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0390625 = fieldNorm(doc=604)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Abstract
- Modern information retrieval systems use keywords within documents as indexing terms for search of relevant documents. As Chinese is an ideographic character-based language, the words in the texts are not delimited by white spaces. Indexing of Chinese documents is impossible without a proper segmentation algorithm. Many Chinese segmentation algorithms have been proposed in the past. Traditional segmentation algorithms cannot operate without a large dictionary or a large corpus of training data. Nowadays, the Web has become the largest corpus that is ideal for Chinese segmentation. Although most search engines have problems in segmenting texts into proper words, they maintain huge databases of documents and frequencies of character sequences in the documents. Their databases are important potential resources for segmentation. In this paper, we propose a segmentation algorithm by mining Web data with the help of search engines. On the other hand, the Romanized pinyin of Chinese language indicates boundaries of words in the text. Our algorithm is the first to utilize the Romanized pinyin to segmentation. It is the first unified segmentation algorithm for the Chinese language from different geographical areas, and it is also domain independent because of the nature of the Web. Experiments have been conducted on the datasets of a recent Chinese segmentation competition. The results show that our algorithm outperforms the traditional algorithms in terms of precision and recall. Moreover, our algorithm can effectively deal with the problems of segmentation ambiguity, new word (unknown word) detection, and stop words.
- Footnote
- Beitrag eines Themenschwerpunktes "Mining Web resources for enhancing information retrieval"
-
Radev, D.; Fan, W.; Qu, H.; Wu, H.; Grewal, A.: Probabilistic question answering on the Web (2005)
0.00
0.0019977288 = product of:
0.017979559 = sum of:
0.017979559 = product of:
0.035959117 = sum of:
0.035959117 = weight(_text_:web in 3455) [ClassicSimilarity], result of:
0.035959117 = score(doc=3455,freq=6.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.37471575 = fieldWeight in 3455, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=3455)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Abstract
- Web-based search engines such as Google and NorthernLight return documents that are relevant to a user query, not answers to user questions. We have developed an architecture that augments existing search engines so that they support natural language question answering. The process entails five steps: query modulation, document retrieval, passage extraction, phrase extraction, and answer ranking. In this article, we describe some probabilistic approaches to the last three of these stages. We show how our techniques apply to a number of existing search engines, and we also present results contrasting three different methods for question answering. Our algorithm, probabilistic phrase reranking (PPR), uses proximity and question type features and achieves a total reciprocal document rank of .20 an the TREC8 corpus. Our techniques have been implemented as a Web-accessible system, called NSIR.
-
Thelwall, M.; Price, L.: Language evolution and the spread of ideas on the Web : a procedure for identifying emergent hybrid word (2006)
0.00
0.0019977288 = product of:
0.017979559 = sum of:
0.017979559 = product of:
0.035959117 = sum of:
0.035959117 = weight(_text_:web in 5896) [ClassicSimilarity], result of:
0.035959117 = score(doc=5896,freq=6.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.37471575 = fieldWeight in 5896, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=5896)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Abstract
- Word usage is of interest to linguists for its own sake as well as to social scientists and others who seek to track the spread of ideas, for example, in public debates over political decisions. The historical evolution of language can be analyzed with the tools of corpus linguistics through evolving corpora and the Web. But word usage statistics can only be gathered for known words. In this article, techniques are described and tested for identifying new words from the Web, focusing on the case when the words are related to a topic and have a hybrid form with a common sequence of letters. The results highlight the need to employ a combination of search techniques and show the wide potential of hybrid word family investigations in linguistics and social science.
-
Airio, E.: Who benefits from CLIR in web retrieval? (2008)
0.00
0.0019977288 = product of:
0.017979559 = sum of:
0.017979559 = product of:
0.035959117 = sum of:
0.035959117 = weight(_text_:web in 2342) [ClassicSimilarity], result of:
0.035959117 = score(doc=2342,freq=6.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.37471575 = fieldWeight in 2342, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=2342)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Abstract
- Purpose - The aim of the current paper is to test whether query translation is beneficial in web retrieval. Design/methodology/approach - The language pairs were Finnish-Swedish, English-German and Finnish-French. A total of 12-18 participants were recruited for each language pair. Each participant performed four retrieval tasks. The author's aim was to compare the performance of the translated queries with that of the target language queries. Thus, the author asked participants to formulate a source language query and a target language query for each task. The source language queries were translated into the target language utilizing a dictionary-based system. In English-German, also machine translation was utilized. The author used Google as the search engine. Findings - The results differed depending on the language pair. The author concluded that the dictionary coverage had an effect on the results. On average, the results of query-translation were better than in the traditional laboratory tests. Originality/value - This research shows that query translation in web is beneficial especially for users with moderate and non-active language skills. This is valuable information for developers of cross-language information retrieval systems.
-
Li, Q.; Chen, Y.P.; Myaeng, S.-H.; Jin, Y.; Kang, B.-Y.: Concept unification of terms in different languages via web mining for Information Retrieval (2009)
0.00
0.0019223152 = product of:
0.017300837 = sum of:
0.017300837 = product of:
0.034601673 = sum of:
0.034601673 = weight(_text_:web in 4215) [ClassicSimilarity], result of:
0.034601673 = score(doc=4215,freq=8.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.36057037 = fieldWeight in 4215, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0390625 = fieldNorm(doc=4215)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Abstract
- For historical and cultural reasons, English phrases, especially proper nouns and new words, frequently appear in Web pages written primarily in East Asian languages such as Chinese, Korean, and Japanese. Although such English terms and their equivalences in these East Asian languages refer to the same concept, they are often erroneously treated as independent index units in traditional Information Retrieval (IR). This paper describes the degree to which the problem arises in IR and proposes a novel technique to solve it. Our method first extracts English terms from native Web documents in an East Asian language, and then unifies the extracted terms and their equivalences in the native language as one index unit. For Cross-Language Information Retrieval (CLIR), one of the major hindrances to achieving retrieval performance at the level of Mono-Lingual Information Retrieval (MLIR) is the translation of terms in search queries which can not be found in a bilingual dictionary. The Web mining approach proposed in this paper for concept unification of terms in different languages can also be applied to solve this well-known challenge in CLIR. Experimental results based on NTCIR and KT-Set test collections show that the high translation precision of our approach greatly improves performance of both Mono-Lingual and Cross-Language Information Retrieval.
-
Kuo, J.-S.; Li, H.; Yang, Y.-K.: Active learning for constructing transliteration lexicons from the Web (2008)
0.00
0.001902995 = product of:
0.017126955 = sum of:
0.017126955 = product of:
0.03425391 = sum of:
0.03425391 = weight(_text_:web in 1345) [ClassicSimilarity], result of:
0.03425391 = score(doc=1345,freq=4.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.35694647 = fieldWeight in 1345, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0546875 = fieldNorm(doc=1345)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Abstract
- This article presents an adaptive learning framework for Phonetic Similarity Modeling (PSM) that supports the automatic construction of transliteration lexicons. The learning algorithm starts with minimum prior knowledge about machine transliteration and acquires knowledge iteratively from the Web. We study the unsupervised learning and the active learning strategies that minimize human supervision in terms of data labeling. The learning process refines the PSM and constructs a transliteration lexicon at the same time. We evaluate the proposed PSM and its learning algorithm through a series of systematic experiments, which show that the proposed framework is reliably effective on two independent databases.
-
Hammwöhner, R.: TransRouter revisited : Decision support in the routing of translation projects (2000)
0.00
0.0015493254 = product of:
0.013943928 = sum of:
0.013943928 = product of:
0.027887857 = sum of:
0.027887857 = weight(_text_:22 in 5483) [ClassicSimilarity], result of:
0.027887857 = score(doc=5483,freq=2.0), product of:
0.10297151 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.02940506 = queryNorm
0.2708308 = fieldWeight in 5483, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0546875 = fieldNorm(doc=5483)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Date
- 10.12.2000 18:22:35
-
Schneider, J.W.; Borlund, P.: ¬A bibliometric-based semiautomatic approach to identification of candidate thesaurus terms : parsing and filtering of noun phrases from citation contexts (2005)
0.00
0.0015493254 = product of:
0.013943928 = sum of:
0.013943928 = product of:
0.027887857 = sum of:
0.027887857 = weight(_text_:22 in 156) [ClassicSimilarity], result of:
0.027887857 = score(doc=156,freq=2.0), product of:
0.10297151 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.02940506 = queryNorm
0.2708308 = fieldWeight in 156, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0546875 = fieldNorm(doc=156)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Date
- 8. 3.2007 19:55:22
-
Paolillo, J.C.: Linguistics and the information sciences (2009)
0.00
0.0015493254 = product of:
0.013943928 = sum of:
0.013943928 = product of:
0.027887857 = sum of:
0.027887857 = weight(_text_:22 in 3840) [ClassicSimilarity], result of:
0.027887857 = score(doc=3840,freq=2.0), product of:
0.10297151 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.02940506 = queryNorm
0.2708308 = fieldWeight in 3840, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0546875 = fieldNorm(doc=3840)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Date
- 27. 8.2011 14:22:33
-
Olsen, K.A.; Williams, J.G.: Spelling and grammar checking using the Web as a text repository (2004)
0.00
0.0015378521 = product of:
0.013840669 = sum of:
0.013840669 = product of:
0.027681338 = sum of:
0.027681338 = weight(_text_:web in 2891) [ClassicSimilarity], result of:
0.027681338 = score(doc=2891,freq=8.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.2884563 = fieldWeight in 2891, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.03125 = fieldNorm(doc=2891)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Abstract
- Natural languages are both complex and dynamic. They are in part formalized through dictionaries and grammar. Dictionaries attempt to provide definitions and examples of various usages for all the words in a language. Grammar, on the other hand, is the system of rules that defines the structure of a language and is concerned with the correct use and application of the language in speaking or writing. The fact that these two mechanisms lag behind the language as currently used is not a serious problem for those living in a language culture and talking their native language. However, the correct choice of words, expressions, and word relationships is much more difficult when speaking or writing in a foreign language. The basics of the grammar of a language may have been learned in school decades ago, and even then there were always several choices for the correct expression for an idea, fact, opinion, or emotion. Although many different parts of speech and their relationships can make for difficult language decisions, prepositions tend to be problematic for nonnative speakers of English, and, in reality, prepositions are a major problem in most languages. Does a speaker or writer say "in the West Coast" or "on the West Coast," or perhaps "at the West Coast"? In Norwegian, we are "in" a city, but "at" a place. But the distinction between cities and places is vague. To be absolutely correct, one really has to learn the right preposition for every single place. A simplistic way of resolving these language issues is to ask a native speaker. But even native speakers may disagree about the right choice of words. If there is disagreement, then one will have to ask more than one native speaker, treat his/her response as a vote for a particular choice, and perhaps choose the majority choice as the best possible alternative. In real life, such a procedure may be impossible or impractical, but in the electronic world, as we shall see, this is quite easy to achieve. Using the vast text repository of the Web, we may get a significant voting base for even the most detailed and distinct phrases. We shall start by introducing a set of examples to present our idea of using the text repository an the Web to aid in making the best word selection, especially for the use of prepositions. Then we will present a more general discussion of the possibilities and limitations of using the Web as an aid for correct writing.
-
Peng, F.; Huang, X.: Machine learning for Asian language text classification (2007)
0.00
0.0013592821 = product of:
0.012233539 = sum of:
0.012233539 = product of:
0.024467077 = sum of:
0.024467077 = weight(_text_:web in 831) [ClassicSimilarity], result of:
0.024467077 = score(doc=831,freq=4.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.25496176 = fieldWeight in 831, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0390625 = fieldNorm(doc=831)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Abstract
- Purpose - The purpose of this research is to compare several machine learning techniques on the task of Asian language text classification, such as Chinese and Japanese where no word boundary information is available in written text. The paper advocates a simple language modeling based approach for this task. Design/methodology/approach - Naïve Bayes, maximum entropy model, support vector machines, and language modeling approaches were implemented and were applied to Chinese and Japanese text classification. To investigate the influence of word segmentation, different word segmentation approaches were investigated and applied to Chinese text. A segmentation-based approach was compared with the non-segmentation-based approach. Findings - There were two findings: the experiments show that statistical language modeling can significantly outperform standard techniques, given the same set of features; and it was found that classification with word level features normally yields improved classification performance, but that classification performance is not monotonically related to segmentation accuracy. In particular, classification performance may initially improve with increased segmentation accuracy, but eventually classification performance stops improving, and can in fact even decrease, after a certain level of segmentation accuracy. Practical implications - Apply the findings to real web text classification is ongoing work. Originality/value - The paper is very relevant to Chinese and Japanese information processing, e.g. webpage classification, web search.
-
Jurafsky, D.; Martin, J.H.: Speech and language processing : ani ntroduction to natural language processing, computational linguistics and speech recognition (2009)
0.00
0.0013592821 = product of:
0.012233539 = sum of:
0.012233539 = product of:
0.024467077 = sum of:
0.024467077 = weight(_text_:web in 1081) [ClassicSimilarity], result of:
0.024467077 = score(doc=1081,freq=4.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.25496176 = fieldWeight in 1081, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.0390625 = fieldNorm(doc=1081)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Abstract
- For undergraduate or advanced undergraduate courses in Classical Natural Language Processing, Statistical Natural Language Processing, Speech Recognition, Computational Linguistics, and Human Language Processing. An explosion of Web-based language techniques, merging of distinct fields, availability of phone-based dialogue systems, and much more make this an exciting time in speech and language processing. The first of its kind to thoroughly cover language technology at all levels and with all modern technologies this text takes an empirical approach to the subject, based on applying statistical and other machine-learning algorithms to large corporations. The authors cover areas that traditionally are taught in different courses, to describe a unified vision of speech and language processing. Emphasis is on practical applications and scientific evaluation. An accompanying Website contains teaching materials for instructors, with pointers to language processing resources on the Web. The Second Edition offers a significant amount of new and extended material.
-
Nait-Baha, L.; Jackiewicz, A.; Djioua, B.; Laublet, P.: Query reformulation for information retrieval on the Web using the point of view methodology : preliminary results (2001)
0.00
0.001153389 = product of:
0.010380501 = sum of:
0.010380501 = product of:
0.020761002 = sum of:
0.020761002 = weight(_text_:web in 249) [ClassicSimilarity], result of:
0.020761002 = score(doc=249,freq=2.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.21634221 = fieldWeight in 249, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=249)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
-
Abdelali, A.: Localization in modern standard Arabic (2004)
0.00
0.001153389 = product of:
0.010380501 = sum of:
0.010380501 = product of:
0.020761002 = sum of:
0.020761002 = weight(_text_:web in 2066) [ClassicSimilarity], result of:
0.020761002 = score(doc=2066,freq=2.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.21634221 = fieldWeight in 2066, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=2066)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Abstract
- Modern Standard Arabic (MSA) is the official language used in all Arabic countries. In this paper we describe an investigation of the uniformity of MSA across different countries. Many studies have been carried out locally or regionally an Arabic and its dialects. Here we look an a more global scale by studying language variations between countries. The source material used in this investigation was derived from national newspapers available an the Web, which provided samples of common media usage in each country. This corpus has been used to investigate the lexical characteristics of Modern Standard Arabic as found in 10 different Arabic speaking countries. We describe our collection methods, the types of lexical analysis performed, and the results of our investigations. With respect to newspaper articles, MSA seems to be very uniform across all the countries included in the study, but we have detected various types of differences, with implications for computational processing of MSA.
-
Peis, E.; Herrera-Viedma, E.; Herrera, J.C.: On the evaluation of XML documents using Fuzzy linguistic techniques (2003)
0.00
0.001153389 = product of:
0.010380501 = sum of:
0.010380501 = product of:
0.020761002 = sum of:
0.020761002 = weight(_text_:web in 2778) [ClassicSimilarity], result of:
0.020761002 = score(doc=2778,freq=2.0), product of:
0.09596372 = queryWeight, product of:
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.02940506 = queryNorm
0.21634221 = fieldWeight in 2778, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.2635105 = idf(docFreq=4597, maxDocs=44218)
0.046875 = fieldNorm(doc=2778)
0.5 = coord(1/2)
0.11111111 = coord(1/9)
- Abstract
- Recommender systems evaluate and filter the great amount of information available an the Web to assist people in their search processes. A fuzzy evaluation method of XML documents based an computing with words is presented. Given an XML document type (e.g. scientific article), we consider that its elements are not equally informative. This is indicated by the use of a DTD and defining linguistic importance attributes to the more meaningful elements of the DTD designed. Then, the evaluation method generates linguistic recommendations from linguistic evaluation judgements provided by different recommenders an meaningful elements of DTD.
