Search (5 results, page 1 of 1)

0.018639714 = product of:
  0.037279427 = sum of:
    0.037279427 = product of:
      0.074558854 = sum of:
        0.074558854 = weight(_text_:p in 448) [ClassicSimilarity], result of:
          0.074558854 = score(doc=448,freq=8.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.39725178 = fieldWeight in 448, product of:
              2.828427 = tf(freq=8.0), with freq of:
                8.0 = termFreq=8.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.0390625 = fieldNorm(doc=448)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

A distributed memory parallel version of the group average hierarchical agglomerative clustering algorithm is proposed to enable scaling the document clustering problem to large collections. Using standard message passing operations reduces interprocess communication while maintaining efficient load balancing. In a series of experiments using a subset of a standard Text REtrieval Conference (TREC) test collection, our parallel hierarchical clustering algorithm is shown to be scalable in terms of processors efficiently used and the collection size. Results show that our algorithm performs close to the expected O(n**2/p) time on p processors rather than the worst-case O(n**3/p) time. Furthermore, the O(n**2/p) memory complexity per node allows larger collections to be clustered as the number of nodes increases. While partitioning algorithms such as k-means are trivially parallelizable, our results confirm those of other studies which showed that hierarchical algorithms produce significantly tighter clusters in the document clustering task. Finally, we show how our parallel hierarchical agglomerative clustering algorithm can be used as the clustering subroutine for a parallel version of the buckshot algorithm to cluster the complete TREC collection at near theoretical runtime expectations.

0.013180269 = product of:
  0.026360538 = sum of:
    0.026360538 = product of:
      0.052721076 = sum of:
        0.052721076 = weight(_text_:p in 2380) [ClassicSimilarity], result of:
          0.052721076 = score(doc=2380,freq=4.0), product of:
            0.18768665 = queryWeight, product of:
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.052200247 = queryNorm
            0.28089944 = fieldWeight in 2380, product of:
              2.0 = tf(freq=4.0), with freq of:
                4.0 = termFreq=4.0
              3.5955126 = idf(docFreq=3298, maxDocs=44218)
              0.0390625 = fieldNorm(doc=2380)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

We explore unsupervised learning techniques for extracting semantic information about biomedical concepts and topics, and introduce a passage retrieval model for using these semantics in context to improve genomics literature search. Our contributions include a new passage retrieval model based on an undirected graphical model (Markov Random Fields), and new methods for modeling passage-concepts, document-topics, and passage-terms as potential functions within the model. Each potential function includes distributional evidence to disambiguate topics, concepts, and terms in context. The joint distribution across potential functions in the graph represents the probability of a passage being relevant to a biologist's information need. Relevance ranking within each potential function simplifies normalization across potential functions and eliminates the need for tuning of passage retrieval model parameters. Our dimensional indexing model facilitates efficient aggregation of topic, concept, and term distributions. The proposed passage-retrieval model improves search results in the presence of varying levels of semantic evidence, outperforming models of query terms, concepts, or document topics alone. Our results exceed the state-of-the-art for automatic document retrieval by 14.46% (0.3554 vs. 0.3105) and passage retrieval by 15.57% (0.1128 vs. 0.0976) as assessed by the TREC 2007 Genomics Track, and automatic document retrieval by 18.56% (0.3424 vs. 0.2888) as assessed by the TREC 2005 Genomics Track. Automatic document retrieval results for TREC 2007 and TREC 2005 are statistically significant at the 95% confidence level (p = .0359 and .0253, respectively). Passage retrieval is significant at the 90% confidence level (p = 0.0893).

0.012975438 = product of:
  0.025950875 = sum of:
    0.025950875 = product of:
      0.1038035 = sum of:
        0.1038035 = weight(_text_:authors in 60) [ClassicSimilarity], result of:
          0.1038035 = score(doc=60,freq=6.0), product of:
            0.23797122 = queryWeight, product of:
              4.558814 = idf(docFreq=1258, maxDocs=44218)
              0.052200247 = queryNorm
            0.43620193 = fieldWeight in 60, product of:
              2.4494898 = tf(freq=6.0), with freq of:
                6.0 = termFreq=6.0
              4.558814 = idf(docFreq=1258, maxDocs=44218)
              0.0390625 = fieldNorm(doc=60)
      0.25 = coord(1/4)
  0.5 = coord(1/2)

Abstract

The authors review a log of billions of Web queries that constituted the total query traffic for a 6-month period of a general-purpose commercial Web search service. Previously, query logs were studied from a single, cumulative view. In contrast, this study builds on the authors' previous work, which showed changes in popularity and uniqueness of topically categorized queries across the hours in a day. To further their analysis, they examine query traffic on a daily, weekly, and monthly basis by matching it against lists of queries that have been topically precategorized by human editors. These lists represent 13% of the query traffic. They show that query traffic from particular topical categories differs both from the query stream as a whole and from other categories. Additionally, they show that certain categories of queries trend differently over varying periods. The authors key contribution is twofold: They outline a method for studying both the static and topical properties of a very large query log over varying periods, and they identify and examine topical trends that may provide valuable insight for improving both retrieval effectiveness and efficiency.

0.010608619 = product of:
  0.021217238 = sum of:
    0.021217238 = product of:
      0.042434476 = sum of:
        0.042434476 = weight(_text_:22 in 5289) [ClassicSimilarity], result of:
          0.042434476 = score(doc=5289,freq=2.0), product of:
            0.18279637 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.052200247 = queryNorm
            0.23214069 = fieldWeight in 5289, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.046875 = fieldNorm(doc=5289)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Date

22. 7.2006 17:20:20

0.00847552 = product of:
  0.01695104 = sum of:
    0.01695104 = product of:
      0.06780416 = sum of:
        0.06780416 = weight(_text_:authors in 1486) [ClassicSimilarity], result of:
          0.06780416 = score(doc=1486,freq=4.0), product of:
            0.23797122 = queryWeight, product of:
              4.558814 = idf(docFreq=1258, maxDocs=44218)
              0.052200247 = queryNorm
            0.28492588 = fieldWeight in 1486, product of:
              2.0 = tf(freq=4.0), with freq of:
                4.0 = termFreq=4.0
              4.558814 = idf(docFreq=1258, maxDocs=44218)
              0.03125 = fieldNorm(doc=1486)
      0.25 = coord(1/4)
  0.5 = coord(1/2)

Abstract

Interested in how an efficient search engine works? Want to know what algorithms are used to rank resulting documents in response to user requests? The authors answer these and other key information on retrieval design and implementation questions is provided. This book is not yet another high level text. Instead, algorithms are thoroughly described, making this book ideally suited for both computer science students and practitioners who work on search-related applications. As stated in the foreword, this book provides a current, broad, and detailed overview of the field and is the only one that does so. Examples are used throughout to illustrate the algorithms. The authors explain how a query is ranked against a document collection using either a single or a combination of retrieval strategies, and how an assortment of utilities are integrated into the query processing scheme to improve these rankings. Methods for building and compressing text indexes, querying and retrieving documents in multiple languages, and using parallel or distributed processing to expedite the search are likewise described. This edition is a major expansion of the one published in 1998. Neuaufl. 2005: Besides updating the entire book with current techniques, it includes new sections on language models, cross-language information retrieval, peer-to-peer processing, XML search, mediators, and duplicate document detection.