-
Dolin, R.; Agrawal, D.; El Abbadi, A.; Pearlman, J.: Using automated classification for summarizing and selecting heterogeneous information sources (1998)
0.05
0.053437054 = product of:
0.0712494 = sum of:
0.036556147 = weight(_text_:digital in 1253) [ClassicSimilarity], result of:
0.036556147 = score(doc=1253,freq=4.0), product of:
0.19770671 = queryWeight, product of:
3.944552 = idf(docFreq=2326, maxDocs=44218)
0.050121464 = queryNorm
0.18490088 = fieldWeight in 1253, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.944552 = idf(docFreq=2326, maxDocs=44218)
0.0234375 = fieldNorm(doc=1253)
0.019893762 = weight(_text_:library in 1253) [ClassicSimilarity], result of:
0.019893762 = score(doc=1253,freq=6.0), product of:
0.1317883 = queryWeight, product of:
2.6293786 = idf(docFreq=8668, maxDocs=44218)
0.050121464 = queryNorm
0.15095241 = fieldWeight in 1253, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
2.6293786 = idf(docFreq=8668, maxDocs=44218)
0.0234375 = fieldNorm(doc=1253)
0.014799493 = product of:
0.029598987 = sum of:
0.029598987 = weight(_text_:project in 1253) [ClassicSimilarity], result of:
0.029598987 = score(doc=1253,freq=2.0), product of:
0.21156175 = queryWeight, product of:
4.220981 = idf(docFreq=1764, maxDocs=44218)
0.050121464 = queryNorm
0.13990708 = fieldWeight in 1253, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.220981 = idf(docFreq=1764, maxDocs=44218)
0.0234375 = fieldNorm(doc=1253)
0.5 = coord(1/2)
0.75 = coord(3/4)
- Abstract
- Information retrieval over the Internet increasingly requires the filtering of thousands of heterogeneous information sources. Important sources of information include not only traditional databases with structured data and queries, but also increasing numbers of non-traditional, semi- or unstructured collections such as Web sites, FTP archives, etc. As the number and variability of sources increases, new ways of automatically summarizing, discovering, and selecting collections relevant to a user's query are needed. One such method involves the use of classification schemes, such as the Library of Congress Classification (LCC), within which a collection may be represented based on its content, irrespective of the structure of the actual data or documents. For such a system to be useful in a large-scale distributed environment, it must be easy to use for both collection managers and users. As a result, it must be possible to classify documents automatically within a classification scheme. Furthermore, there must be a straightforward and intuitive interface with which the user may use the scheme to assist in information retrieval (IR). Our work with the Alexandria Digital Library (ADL) Project focuses on geo-referenced information, whether text, maps, aerial photographs, or satellite images. As a result, we have emphasized techniques which work with both text and non-text, such as combined textual and graphical queries, multi-dimensional indexing, and IR methods which are not solely dependent on words or phrases. Part of this work involves locating relevant online sources of information. In particular, we have designed and are currently testing aspects of an architecture, Pharos, which we believe will scale up to 1.000.000 heterogeneous sources. Pharos accommodates heterogeneity in content and format, both among multiple sources as well as within a single source. That is, we consider sources to include Web sites, FTP archives, newsgroups, and full digital libraries; all of these systems can include a wide variety of content and multimedia data formats. Pharos is based on the use of hierarchical classification schemes. These include not only well-known 'subject' (or 'concept') based schemes such as the Dewey Decimal System and the LCC, but also, for example, geographic classifications, which might be constructed as layers of smaller and smaller hierarchical longitude/latitude boxes. Pharos is designed to work with sophisticated queries which utilize subjects, geographical locations, temporal specifications, and other types of information domains. The Pharos architecture requires that hierarchically structured collection metadata be extracted so that it can be partitioned in such a way as to greatly enhance scalability. Automated classification is important to Pharos because it allows information sources to extract the requisite collection metadata automatically that must be distributed.
We are currently experimenting with newsgroups as collections. We have built an initial prototype which automatically classifies and summarizes newsgroups within the LCC. (The prototype can be tested below, and more details may be found at http://pharos.alexandria.ucsb.edu/). The prototype uses electronic library catalog records as a `training set' and Latent Semantic Indexing (LSI) for IR. We use the training set to build a rich set of classification terminology, and associate these terms with the relevant categories in the LCC. This association between terms and classification categories allows us to relate users' queries to nodes in the LCC so that users can select appropriate query categories. Newsgroups are similarly associated with classification categories. Pharos then matches the categories selected by users to relevant newsgroups. In principle, this approach allows users to exclude newsgroups that might have been selected based on an unintended meaning of a query term, and to include newsgroups with relevant content even though the exact query terms may not have been used. This work is extensible to other types of classification, including geographical, temporal, and image feature. Before discussing the methodology of the collection summarization and selection, we first present an online demonstration below. The demonstration is not intended to be a complete end-user interface. Rather, it is intended merely to offer a view of the process to suggest the "look and feel" of the prototype. The demo works as follows. First supply it with a few keywords of interest. The system will then use those terms to try to return to you the most relevant subject categories within the LCC. Assuming that the system recognizes any of your terms (it has over 400,000 terms indexed), it will give you a list of 15 LCC categories sorted by relevancy ranking. From there, you have two choices. The first choice, by clicking on the "News" links, is to get a list of newsgroups which the system has identified as relevant to the LCC category you select. The other choice, by clicking on the LCC ID links, is to enter the LCC hierarchy starting at the category of your choice and navigate the tree until you locate the best category for your query. From there, again, you can get a list of newsgroups by clicking on the "News" links. After having shown this demonstration to many people, we would like to suggest that you first give it easier examples before trying to break it. For example, "prostate cancer" (discussed below), "remote sensing", "investment banking", and "gershwin" all work reasonably well.
-
Koch, T.; Vizine-Goetz, D.: DDC and knowledge organization in the digital library : Research and development. Demonstration pages (1999)
0.05
0.052799337 = product of:
0.10559867 = sum of:
0.073112294 = weight(_text_:digital in 942) [ClassicSimilarity], result of:
0.073112294 = score(doc=942,freq=4.0), product of:
0.19770671 = queryWeight, product of:
3.944552 = idf(docFreq=2326, maxDocs=44218)
0.050121464 = queryNorm
0.36980176 = fieldWeight in 942, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.944552 = idf(docFreq=2326, maxDocs=44218)
0.046875 = fieldNorm(doc=942)
0.032486375 = weight(_text_:library in 942) [ClassicSimilarity], result of:
0.032486375 = score(doc=942,freq=4.0), product of:
0.1317883 = queryWeight, product of:
2.6293786 = idf(docFreq=8668, maxDocs=44218)
0.050121464 = queryNorm
0.24650425 = fieldWeight in 942, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
2.6293786 = idf(docFreq=8668, maxDocs=44218)
0.046875 = fieldNorm(doc=942)
0.5 = coord(2/4)
- Content
- 1. Increased Importance of Knowledge Organization in Internet Services - 2. Quality Subject Service and the role of classification - 3. Developing the DDC into a knowledge organization instrument for the digital library. OCLC site - 4. DESIRE's Barefoot Solutions of Automatic Classification - 5. Advanced Classification Solutions in DESIRE and CORC - 6. Future directions of research and development - 7. General references
-
Shafer, K.E.: Evaluating Scorpion results (1998)
0.04
0.0438086 = product of:
0.0876172 = sum of:
0.03828556 = weight(_text_:library in 1569) [ClassicSimilarity], result of:
0.03828556 = score(doc=1569,freq=2.0), product of:
0.1317883 = queryWeight, product of:
2.6293786 = idf(docFreq=8668, maxDocs=44218)
0.050121464 = queryNorm
0.29050803 = fieldWeight in 1569, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
2.6293786 = idf(docFreq=8668, maxDocs=44218)
0.078125 = fieldNorm(doc=1569)
0.049331643 = product of:
0.098663285 = sum of:
0.098663285 = weight(_text_:project in 1569) [ClassicSimilarity], result of:
0.098663285 = score(doc=1569,freq=2.0), product of:
0.21156175 = queryWeight, product of:
4.220981 = idf(docFreq=1764, maxDocs=44218)
0.050121464 = queryNorm
0.4663569 = fieldWeight in 1569, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.220981 = idf(docFreq=1764, maxDocs=44218)
0.078125 = fieldNorm(doc=1569)
0.5 = coord(1/2)
0.5 = coord(2/4)
- Abstract
- Scorpion is a research project at OCLC that builds tools for automatic subject assignment by combining library science and information retrieval techniques. A thesis of Scorpion is that the Dewey Decimal Classification (Dewey) can be used to perform automatic subject assignment for electronic items.
-
Subramanian, S.; Shafer, K.E.: Clustering (1998)
0.01
0.012332911 = product of:
0.049331643 = sum of:
0.049331643 = product of:
0.098663285 = sum of:
0.098663285 = weight(_text_:project in 1103) [ClassicSimilarity], result of:
0.098663285 = score(doc=1103,freq=2.0), product of:
0.21156175 = queryWeight, product of:
4.220981 = idf(docFreq=1764, maxDocs=44218)
0.050121464 = queryNorm
0.4663569 = fieldWeight in 1103, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.220981 = idf(docFreq=1764, maxDocs=44218)
0.078125 = fieldNorm(doc=1103)
0.5 = coord(1/2)
0.25 = coord(1/4)
- Abstract
- This article presents our exploration of computer science clustering algorithms as they relate to the Scorpion system. Scorpion is a research project at OCLC that explores the indexing and cataloging of electronic resources. For a more complete description of the Scorpion, please visit the Scorpion Web site at <http://purl.oclc.org/scorpion>
-
Koch, T.; Vizine-Goetz, D.: Automatic classification and content navigation support for Web services : DESIRE II cooperates with OCLC (1998)
0.01
0.006699973 = product of:
0.026799891 = sum of:
0.026799891 = weight(_text_:library in 1568) [ClassicSimilarity], result of:
0.026799891 = score(doc=1568,freq=2.0), product of:
0.1317883 = queryWeight, product of:
2.6293786 = idf(docFreq=8668, maxDocs=44218)
0.050121464 = queryNorm
0.20335563 = fieldWeight in 1568, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
2.6293786 = idf(docFreq=8668, maxDocs=44218)
0.0546875 = fieldNorm(doc=1568)
0.25 = coord(1/4)
- Abstract
- Emerging standards in knowledge representation and organization are preparing the way for distributed vocabulary support in Internet search services. NetLab researchers are exploring several innovative solutions for searching and browsing in the subject-based Internet gateway, Electronic Engineering Library, Sweden (EELS). The implementation of the EELS service is described, specifically, the generation of the robot-gathered database 'All' engineering and the automated application of the Ei thesaurus and classification scheme. NetLab and OCLC researchers are collaborating to investigate advanced solutions to automated classification in the DESIRE II context. A plan for furthering the development of distributed vocabulary support in Internet search services is offered.
-
Dolin, R.; Agrawal, D.; El Abbadi, A.; Pearlman, J.: Using automated classification for summarizing and selecting heterogeneous information sources (1998)
0.01
0.0057428335 = product of:
0.022971334 = sum of:
0.022971334 = weight(_text_:library in 316) [ClassicSimilarity], result of:
0.022971334 = score(doc=316,freq=2.0), product of:
0.1317883 = queryWeight, product of:
2.6293786 = idf(docFreq=8668, maxDocs=44218)
0.050121464 = queryNorm
0.17430481 = fieldWeight in 316, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
2.6293786 = idf(docFreq=8668, maxDocs=44218)
0.046875 = fieldNorm(doc=316)
0.25 = coord(1/4)
- Abstract
- Information retrieval over the Internet increasingly requires the filtering of thousands of heterogeneous information sources. Important sources of information include not only traditional databases with structured data and queries, but also increasing numbers of non-traditional, semi- or unstructured collections such as Web sites, FTP archives, etc. As the number and variability of sources increases, new ways of automatically summarizing, discovering, and selecting collections relevant to a user's query are needed. One such method involves the use of classification schemes, such as the Library of Congress Classification (LCC) [10], within which a collection may be represented based on its content, irrespective of the structure of the actual data or documents. For such a system to be useful in a large-scale distributed environment, it must be easy to use for both collection managers and users. As a result, it must be possible to classify documents automatically within a classification scheme. Furthermore, there must be a straightforward and intuitive interface with which the user may use the scheme to assist in information retrieval (IR).
-
Koch, T.; Ardö, A.; Brümmer, A.: ¬The building and maintenance of robot based internet search services : A review of current indexing and data collection methods. Prepared to meet the requirements of Work Package 3 of EU Telematics for Research, project DESIRE. Version D3.11v0.3 (Draft version 3) (1996)
0.00
0.0049331645 = product of:
0.019732658 = sum of:
0.019732658 = product of:
0.039465316 = sum of:
0.039465316 = weight(_text_:project in 1669) [ClassicSimilarity], result of:
0.039465316 = score(doc=1669,freq=2.0), product of:
0.21156175 = queryWeight, product of:
4.220981 = idf(docFreq=1764, maxDocs=44218)
0.050121464 = queryNorm
0.18654276 = fieldWeight in 1669, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.220981 = idf(docFreq=1764, maxDocs=44218)
0.03125 = fieldNorm(doc=1669)
0.5 = coord(1/2)
0.25 = coord(1/4)
