Document (#16041)

Author

Kelledy, F.
Smeaton, A.F.

Title

Signature files and beyond

Source

Information retrieval: new systems and current research. Proceedings of the 16th Research Colloquium of the British Computer Society Information Retrieval Specialist Group, Drymen, Scotland, 22-23 Mar 94. Ed.: R. Leon

Imprint

London : Taylor Graham

Year

1996

Pages

S.124-144

Abstract

Proposes that signature files be used as a viable alternative to other indexing strategies such as inverted files for searching through large volumes of text. Demonstrates through simulation, that search times can be further reduced by enhancing the basic signature file concept using deterministic partitioning algorithms which eliminate the need for an exhaustive search of the entire signature file. Reports research to evaluate the performance of some deterministic partitioning algorithms in a non simulated environment using 276 MB of raw newspaper text (taken from the Wall Street Journal) and real user queries. Presents a selection of results to illustrate trends and highlight important aspects of the performance of these methods under realistic rather than simulated operating conditions. As a result of the research reported here certain aspects of this approach to signature files are shown to be found wanting and require improvement. Suggests lines of future research on the partitioning of signature files

Theme

Retrievalalgorithmen

Similar documents (author)

1. Smeaton, A.F.: Prospects for intelligent, language-based information retrieval (1991) 5.37

   5.369225 = sum of:
     5.369225 = weight(author_txt:smeaton in 3700) [ClassicSimilarity], result of:
       5.369225 = fieldWeight in 3700, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.59076 = idf(docFreq=21, maxDocs=43556)
         0.625 = fieldNorm(doc=3700)
   

2. Smeaton, A.F.: Retrieving information from hypertext : issues and problems (1991) 5.37

   5.369225 = sum of:
     5.369225 = weight(author_txt:smeaton in 4277) [ClassicSimilarity], result of:
       5.369225 = fieldWeight in 4277, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.59076 = idf(docFreq=21, maxDocs=43556)
         0.625 = fieldNorm(doc=4277)
   

3. Smeaton, A.F.: Progress in the application of natural language processing to information retrieval tasks (1992) 5.37

   5.369225 = sum of:
     5.369225 = weight(author_txt:smeaton in 7077) [ClassicSimilarity], result of:
       5.369225 = fieldWeight in 7077, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.59076 = idf(docFreq=21, maxDocs=43556)
         0.625 = fieldNorm(doc=7077)
   

4. Smeaton, A.F.: Information retrieval and hypertext : competing technologies or complementary access methods (1992) 5.37

   5.369225 = sum of:
     5.369225 = weight(author_txt:smeaton in 7500) [ClassicSimilarity], result of:
       5.369225 = fieldWeight in 7500, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.59076 = idf(docFreq=21, maxDocs=43556)
         0.625 = fieldNorm(doc=7500)
   

5. Smeaton, A.F.: Natural language processing used in information retrieval tasks : an overview of achievements to date (1995) 5.37

   5.369225 = sum of:
     5.369225 = weight(author_txt:smeaton in 1331) [ClassicSimilarity], result of:
       5.369225 = fieldWeight in 1331, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.59076 = idf(docFreq=21, maxDocs=43556)
         0.625 = fieldNorm(doc=1331)
   

Similar documents (content)

1. Lam, W.; Wong, K.-F.; Wong, C.-Y.: Chinese document indexing based on new partitioned signature file : model and evaluation (2001) 0.44

   0.43790868 = sum of:
     0.43790868 = product of:
       1.5639596 = sum of:
         0.014089342 = weight(abstract_txt:search in 1301) [ClassicSimilarity], result of:
           0.014089342 = score(doc=1301,freq=2.0), product of:
             0.043616377 = queryWeight, product of:
               1.0299387 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.011587563 = queryNorm
             0.3230287 = fieldWeight in 1301, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.0625 = fieldNorm(doc=1301)
         0.013552207 = weight(abstract_txt:text in 1301) [ClassicSimilarity], result of:
           0.013552207 = score(doc=1301,freq=1.0), product of:
             0.05354749 = queryWeight, product of:
               1.1411853 = boost
               4.0494018 = idf(docFreq=2063, maxDocs=43556)
               0.011587563 = queryNorm
             0.2530876 = fieldWeight in 1301, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0494018 = idf(docFreq=2063, maxDocs=43556)
               0.0625 = fieldNorm(doc=1301)
         0.020347914 = weight(abstract_txt:performance in 1301) [ClassicSimilarity], result of:
           0.020347914 = score(doc=1301,freq=1.0), product of:
             0.07021216 = queryWeight, product of:
               1.3067508 = boost
               4.6368976 = idf(docFreq=1146, maxDocs=43556)
               0.011587563 = queryNorm
             0.2898061 = fieldWeight in 1301, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6368976 = idf(docFreq=1146, maxDocs=43556)
               0.0625 = fieldNorm(doc=1301)
         0.078879915 = weight(abstract_txt:file in 1301) [ClassicSimilarity], result of:
           0.078879915 = score(doc=1301,freq=5.0), product of:
             0.10132581 = queryWeight, product of:
               1.5698084 = boost
               5.5703354 = idf(docFreq=450, maxDocs=43556)
               0.011587563 = queryNorm
             0.778478 = fieldWeight in 1301, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.5703354 = idf(docFreq=450, maxDocs=43556)
               0.0625 = fieldNorm(doc=1301)
         0.30616942 = weight(abstract_txt:partitioning in 1301) [ClassicSimilarity], result of:
           0.30616942 = score(doc=1301,freq=2.0), product of:
             0.38880104 = queryWeight, product of:
               3.7661355 = boost
               8.909214 = idf(docFreq=15, maxDocs=43556)
               0.011587563 = queryNorm
             0.7874707 = fieldWeight in 1301, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.909214 = idf(docFreq=15, maxDocs=43556)
               0.0625 = fieldNorm(doc=1301)
         0.13473815 = weight(abstract_txt:files in 1301) [ClassicSimilarity], result of:
           0.13473815 = score(doc=1301,freq=2.0), product of:
             0.266704 = queryWeight, product of:
               4.0269046 = boost
               5.715656 = idf(docFreq=389, maxDocs=43556)
               0.011587563 = queryNorm
             0.50519735 = fieldWeight in 1301, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.715656 = idf(docFreq=389, maxDocs=43556)
               0.0625 = fieldNorm(doc=1301)
         0.9961826 = weight(abstract_txt:signature in 1301) [ClassicSimilarity], result of:
           0.9961826 = score(doc=1301,freq=7.0), product of:
             0.70843416 = queryWeight, product of:
               7.1894712 = boost
               8.503749 = idf(docFreq=23, maxDocs=43556)
               0.011587563 = queryNorm
             1.4061753 = fieldWeight in 1301, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               8.503749 = idf(docFreq=23, maxDocs=43556)
               0.0625 = fieldNorm(doc=1301)
       0.28 = coord(7/25)
   

2. Lee, D.L.; Ren, L.: Document ranking on weight-partitioned signature files (1996) 0.31

   0.31141958 = sum of:
     0.31141958 = product of:
       1.5570978 = sum of:
         0.014944004 = weight(abstract_txt:search in 3415) [ClassicSimilarity], result of:
           0.014944004 = score(doc=3415,freq=1.0), product of:
             0.043616377 = queryWeight, product of:
               1.0299387 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.011587563 = queryNorm
             0.34262368 = fieldWeight in 3415, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.09375 = fieldNorm(doc=3415)
         0.030521868 = weight(abstract_txt:performance in 3415) [ClassicSimilarity], result of:
           0.030521868 = score(doc=3415,freq=1.0), product of:
             0.07021216 = queryWeight, product of:
               1.3067508 = boost
               4.6368976 = idf(docFreq=1146, maxDocs=43556)
               0.011587563 = queryNorm
             0.43470913 = fieldWeight in 3415, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6368976 = idf(docFreq=1146, maxDocs=43556)
               0.09375 = fieldNorm(doc=3415)
         0.105828516 = weight(abstract_txt:file in 3415) [ClassicSimilarity], result of:
           0.105828516 = score(doc=3415,freq=4.0), product of:
             0.10132581 = queryWeight, product of:
               1.5698084 = boost
               5.5703354 = idf(docFreq=450, maxDocs=43556)
               0.011587563 = queryNorm
             1.0444379 = fieldWeight in 3415, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.5703354 = idf(docFreq=450, maxDocs=43556)
               0.09375 = fieldNorm(doc=3415)
         0.14291139 = weight(abstract_txt:files in 3415) [ClassicSimilarity], result of:
           0.14291139 = score(doc=3415,freq=1.0), product of:
             0.266704 = queryWeight, product of:
               4.0269046 = boost
               5.715656 = idf(docFreq=389, maxDocs=43556)
               0.011587563 = queryNorm
             0.5358427 = fieldWeight in 3415, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.715656 = idf(docFreq=389, maxDocs=43556)
               0.09375 = fieldNorm(doc=3415)
         1.262892 = weight(abstract_txt:signature in 3415) [ClassicSimilarity], result of:
           1.262892 = score(doc=3415,freq=5.0), product of:
             0.70843416 = queryWeight, product of:
               7.1894712 = boost
               8.503749 = idf(docFreq=23, maxDocs=43556)
               0.011587563 = queryNorm
             1.7826526 = fieldWeight in 3415, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               8.503749 = idf(docFreq=23, maxDocs=43556)
               0.09375 = fieldNorm(doc=3415)
       0.2 = coord(5/25)
   

3. Carterette, B.; Can, F.: Comparing inverted files and signature files for searching a large lexicon (2005) 0.25

   0.24755038 = sum of:
     0.24755038 = product of:
       1.54719 = sum of:
         0.099867254 = weight(abstract_txt:inverted in 3027) [ClassicSimilarity], result of:
           0.099867254 = score(doc=3027,freq=3.0), product of:
             0.096166566 = queryWeight, product of:
               1.0813932 = boost
               7.6744695 = idf(docFreq=54, maxDocs=43556)
               0.011587563 = queryNorm
             1.0384821 = fieldWeight in 3027, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.6744695 = idf(docFreq=54, maxDocs=43556)
               0.078125 = fieldNorm(doc=3027)
         0.08819043 = weight(abstract_txt:file in 3027) [ClassicSimilarity], result of:
           0.08819043 = score(doc=3027,freq=4.0), product of:
             0.10132581 = queryWeight, product of:
               1.5698084 = boost
               5.5703354 = idf(docFreq=450, maxDocs=43556)
               0.011587563 = queryNorm
             0.8703649 = fieldWeight in 3027, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.5703354 = idf(docFreq=450, maxDocs=43556)
               0.078125 = fieldNorm(doc=3027)
         0.20627484 = weight(abstract_txt:files in 3027) [ClassicSimilarity], result of:
           0.20627484 = score(doc=3027,freq=3.0), product of:
             0.266704 = queryWeight, product of:
               4.0269046 = boost
               5.715656 = idf(docFreq=389, maxDocs=43556)
               0.011587563 = queryNorm
             0.77342236 = fieldWeight in 3027, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.715656 = idf(docFreq=389, maxDocs=43556)
               0.078125 = fieldNorm(doc=3027)
         1.1528574 = weight(abstract_txt:signature in 3027) [ClassicSimilarity], result of:
           1.1528574 = score(doc=3027,freq=6.0), product of:
             0.70843416 = queryWeight, product of:
               7.1894712 = boost
               8.503749 = idf(docFreq=23, maxDocs=43556)
               0.011587563 = queryNorm
             1.6273319 = fieldWeight in 3027, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.503749 = idf(docFreq=23, maxDocs=43556)
               0.078125 = fieldNorm(doc=3027)
       0.16 = coord(4/25)
   

4. MacFarlane, A.; McCann, J.A.; Robertson, S.E.: Parallel methods for the update of partitioned inverted files (2007) 0.15

   0.1510896 = sum of:
     0.1510896 = product of:
       0.755448 = sum of:
         0.11298691 = weight(abstract_txt:inverted in 2817) [ClassicSimilarity], result of:
           0.11298691 = score(doc=2817,freq=6.0), product of:
             0.096166566 = queryWeight, product of:
               1.0813932 = boost
               7.6744695 = idf(docFreq=54, maxDocs=43556)
               0.011587563 = queryNorm
             1.1749084 = fieldWeight in 2817, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.6744695 = idf(docFreq=54, maxDocs=43556)
               0.0625 = fieldNorm(doc=2817)
         0.019165713 = weight(abstract_txt:text in 2817) [ClassicSimilarity], result of:
           0.019165713 = score(doc=2817,freq=2.0), product of:
             0.05354749 = queryWeight, product of:
               1.1411853 = boost
               4.0494018 = idf(docFreq=2063, maxDocs=43556)
               0.011587563 = queryNorm
             0.35791993 = fieldWeight in 2817, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0494018 = idf(docFreq=2063, maxDocs=43556)
               0.0625 = fieldNorm(doc=2817)
         0.03527617 = weight(abstract_txt:file in 2817) [ClassicSimilarity], result of:
           0.03527617 = score(doc=2817,freq=1.0), product of:
             0.10132581 = queryWeight, product of:
               1.5698084 = boost
               5.5703354 = idf(docFreq=450, maxDocs=43556)
               0.011587563 = queryNorm
             0.34814596 = fieldWeight in 2817, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5703354 = idf(docFreq=450, maxDocs=43556)
               0.0625 = fieldNorm(doc=2817)
         0.37497944 = weight(abstract_txt:partitioning in 2817) [ClassicSimilarity], result of:
           0.37497944 = score(doc=2817,freq=3.0), product of:
             0.38880104 = queryWeight, product of:
               3.7661355 = boost
               8.909214 = idf(docFreq=15, maxDocs=43556)
               0.011587563 = queryNorm
             0.9644507 = fieldWeight in 2817, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.909214 = idf(docFreq=15, maxDocs=43556)
               0.0625 = fieldNorm(doc=2817)
         0.21303973 = weight(abstract_txt:files in 2817) [ClassicSimilarity], result of:
           0.21303973 = score(doc=2817,freq=5.0), product of:
             0.266704 = queryWeight, product of:
               4.0269046 = boost
               5.715656 = idf(docFreq=389, maxDocs=43556)
               0.011587563 = queryNorm
             0.7987872 = fieldWeight in 2817, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.715656 = idf(docFreq=389, maxDocs=43556)
               0.0625 = fieldNorm(doc=2817)
       0.2 = coord(5/25)
   

5. Robertson, A.M.; Willett, P.: Applications of n-grams in textual information systems (1998) 0.15

   0.15038472 = sum of:
     0.15038472 = product of:
       0.9399046 = sum of:
         0.08072174 = weight(abstract_txt:inverted in 713) [ClassicSimilarity], result of:
           0.08072174 = score(doc=713,freq=1.0), product of:
             0.096166566 = queryWeight, product of:
               1.0813932 = boost
               7.6744695 = idf(docFreq=54, maxDocs=43556)
               0.011587563 = queryNorm
             0.8393951 = fieldWeight in 713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.6744695 = idf(docFreq=54, maxDocs=43556)
               0.109375 = fieldNorm(doc=713)
         0.03354 = weight(abstract_txt:text in 713) [ClassicSimilarity], result of:
           0.03354 = score(doc=713,freq=2.0), product of:
             0.05354749 = queryWeight, product of:
               1.1411853 = boost
               4.0494018 = idf(docFreq=2063, maxDocs=43556)
               0.011587563 = queryNorm
             0.6263599 = fieldWeight in 713, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0494018 = idf(docFreq=2063, maxDocs=43556)
               0.109375 = fieldNorm(doc=713)
         0.16672996 = weight(abstract_txt:files in 713) [ClassicSimilarity], result of:
           0.16672996 = score(doc=713,freq=1.0), product of:
             0.266704 = queryWeight, product of:
               4.0269046 = boost
               5.715656 = idf(docFreq=389, maxDocs=43556)
               0.011587563 = queryNorm
             0.62514985 = fieldWeight in 713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.715656 = idf(docFreq=389, maxDocs=43556)
               0.109375 = fieldNorm(doc=713)
         0.65891284 = weight(abstract_txt:signature in 713) [ClassicSimilarity], result of:
           0.65891284 = score(doc=713,freq=1.0), product of:
             0.70843416 = queryWeight, product of:
               7.1894712 = boost
               8.503749 = idf(docFreq=23, maxDocs=43556)
               0.011587563 = queryNorm
             0.9300975 = fieldWeight in 713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.503749 = idf(docFreq=23, maxDocs=43556)
               0.109375 = fieldNorm(doc=713)
       0.16 = coord(4/25)