Document (#34459)

Author

MacFarlane, A.
Tuson, A.

Title

Local search : a guide for the information retrieval practitioner

Source

Information processing and management. 45(2009) no.1, S.159-174

Year

2009

Abstract

There are a number of combinatorial optimisation problems in information retrieval in which the use of local search methods are worthwhile. The purpose of this paper is to show how local search can be used to solve some well known tasks in information retrieval (IR), how previous research in the field is piecemeal, bereft of a structure and methodologically flawed, and to suggest more rigorous ways of applying local search methods to solve IR problems. We provide a query based taxonomy for analysing the use of local search in IR tasks and an overview of issues such as fitness functions, statistical significance and test collections when conducting experiments on combinatorial optimisation problems. The paper gives a guide on the pitfalls and problems for IR practitioners who wish to use local search to solve their research issues, and gives practical advice on the use of such methods. The query based taxonomy is a novel structure which can be used by the IR practitioner in order to examine the use of local search in IR.

Similar documents (author)

1. MacFarlane, A.: On open source IR (2003) 5.45

   5.4490323 = sum of:
     5.4490323 = weight(author_txt:macfarlane in 3011) [ClassicSimilarity], result of:
       5.4490323 = fieldWeight in 3011, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.7184515 = idf(docFreq=18, maxDocs=42740)
         0.625 = fieldNorm(doc=3011)
   

2. MacFarlane, A.: Evaluation of web search for the information practitioner (2007) 5.45

   5.4490323 = sum of:
     5.4490323 = weight(author_txt:macfarlane in 2818) [ClassicSimilarity], result of:
       5.4490323 = fieldWeight in 2818, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.7184515 = idf(docFreq=18, maxDocs=42740)
         0.625 = fieldNorm(doc=2818)
   

3. MacFarlane, A.: Knowledge organisation and its role in multimedia information retrieval (2016) 5.45

   5.4490323 = sum of:
     5.4490323 = weight(author_txt:macfarlane in 4912) [ClassicSimilarity], result of:
       5.4490323 = fieldWeight in 4912, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.7184515 = idf(docFreq=18, maxDocs=42740)
         0.625 = fieldNorm(doc=4912)
   

4. MacFarlane, A.; Robertson, S.E.; McCann, J.A.: Parallel computing for passage retrieval (2004) 3.27

   3.2694192 = sum of:
     3.2694192 = weight(author_txt:macfarlane in 5177) [ClassicSimilarity], result of:
       3.2694192 = fieldWeight in 5177, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.7184515 = idf(docFreq=18, maxDocs=42740)
         0.375 = fieldNorm(doc=5177)
   

5. MacFarlane, A.; Robertson, S.E.; McCann, J.A.: Parallel computing in information retrieval : an updated review (1997) 3.27

   3.2694192 = sum of:
     3.2694192 = weight(author_txt:macfarlane in 520) [ClassicSimilarity], result of:
       3.2694192 = fieldWeight in 520, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.7184515 = idf(docFreq=18, maxDocs=42740)
         0.375 = fieldNorm(doc=520)
   

Similar documents (content)

1. Wollf, J.G.: ¬A scalable technique for best-match retrieval of sequential information using metrics-guided search (1994) 0.09

   0.08831725 = sum of:
     0.08831725 = product of:
       0.36798856 = sum of:
         0.04261751 = weight(abstract_txt:query in 250) [ClassicSimilarity], result of:
           0.04261751 = score(doc=250,freq=1.0), product of:
             0.09603865 = queryWeight, product of:
               1.2979807 = boost
               4.7333736 = idf(docFreq=1021, maxDocs=42740)
               0.01563173 = queryNorm
             0.44375378 = fieldWeight in 250, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7333736 = idf(docFreq=1021, maxDocs=42740)
               0.09375 = fieldNorm(doc=250)
         0.025072748 = weight(abstract_txt:retrieval in 250) [ClassicSimilarity], result of:
           0.025072748 = score(doc=250,freq=1.0), product of:
             0.077188455 = queryWeight, product of:
               1.425171 = boost
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.01563173 = queryNorm
             0.3248251 = fieldWeight in 250, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.09375 = fieldNorm(doc=250)
         0.060654413 = weight(abstract_txt:gives in 250) [ClassicSimilarity], result of:
           0.060654413 = score(doc=250,freq=1.0), product of:
             0.12151472 = queryWeight, product of:
               1.4600228 = boost
               5.3242965 = idf(docFreq=565, maxDocs=42740)
               0.01563173 = queryNorm
             0.49915278 = fieldWeight in 250, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3242965 = idf(docFreq=565, maxDocs=42740)
               0.09375 = fieldNorm(doc=250)
         0.07724753 = weight(abstract_txt:guide in 250) [ClassicSimilarity], result of:
           0.07724753 = score(doc=250,freq=1.0), product of:
             0.14277221 = queryWeight, product of:
               1.582585 = boost
               5.7712464 = idf(docFreq=361, maxDocs=42740)
               0.01563173 = queryNorm
             0.54105437 = fieldWeight in 250, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7712464 = idf(docFreq=361, maxDocs=42740)
               0.09375 = fieldNorm(doc=250)
         0.04378371 = weight(abstract_txt:methods in 250) [ClassicSimilarity], result of:
           0.04378371 = score(doc=250,freq=1.0), product of:
             0.11193333 = queryWeight, product of:
               1.7162104 = boost
               4.172361 = idf(docFreq=1790, maxDocs=42740)
               0.01563173 = queryNorm
             0.39115882 = fieldWeight in 250, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.172361 = idf(docFreq=1790, maxDocs=42740)
               0.09375 = fieldNorm(doc=250)
         0.11861264 = weight(abstract_txt:search in 250) [ClassicSimilarity], result of:
           0.11861264 = score(doc=250,freq=3.0), product of:
             0.2000431 = queryWeight, product of:
               3.5046206 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.01563173 = queryNorm
             0.59293544 = fieldWeight in 250, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.09375 = fieldNorm(doc=250)
       0.24 = coord(6/25)
   

2. Bjorner, S.: DIALOG's RANK command for rank and file searchers (1993) 0.09

   0.08661243 = sum of:
     0.08661243 = product of:
       0.5413277 = sum of:
         0.05837828 = weight(abstract_txt:methods in 6267) [ClassicSimilarity], result of:
           0.05837828 = score(doc=6267,freq=1.0), product of:
             0.11193333 = queryWeight, product of:
               1.7162104 = boost
               4.172361 = idf(docFreq=1790, maxDocs=42740)
               0.01563173 = queryNorm
             0.5215451 = fieldWeight in 6267, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.172361 = idf(docFreq=1790, maxDocs=42740)
               0.125 = fieldNorm(doc=6267)
         0.084803745 = weight(abstract_txt:problems in 6267) [ClassicSimilarity], result of:
           0.084803745 = score(doc=6267,freq=1.0), product of:
             0.158021 = queryWeight, product of:
               2.3546026 = boost
               4.2932897 = idf(docFreq=1586, maxDocs=42740)
               0.01563173 = queryNorm
             0.5366612 = fieldWeight in 6267, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2932897 = idf(docFreq=1586, maxDocs=42740)
               0.125 = fieldNorm(doc=6267)
         0.1291291 = weight(abstract_txt:search in 6267) [ClassicSimilarity], result of:
           0.1291291 = score(doc=6267,freq=2.0), product of:
             0.2000431 = queryWeight, product of:
               3.5046206 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.01563173 = queryNorm
             0.6455064 = fieldWeight in 6267, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.125 = fieldNorm(doc=6267)
         0.26901656 = weight(abstract_txt:local in 6267) [ClassicSimilarity], result of:
           0.26901656 = score(doc=6267,freq=1.0), product of:
             0.4111215 = queryWeight, product of:
               5.0241694 = boost
               5.234785 = idf(docFreq=618, maxDocs=42740)
               0.01563173 = queryNorm
             0.65434813 = fieldWeight in 6267, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.234785 = idf(docFreq=618, maxDocs=42740)
               0.125 = fieldNorm(doc=6267)
       0.16 = coord(4/25)
   

3. Glassco, R.A.: Evaluating commercial text search-and-retrieval packages (1993) 0.09

   0.08645462 = sum of:
     0.08645462 = product of:
       0.43227312 = sum of:
         0.05682335 = weight(abstract_txt:query in 7414) [ClassicSimilarity], result of:
           0.05682335 = score(doc=7414,freq=1.0), product of:
             0.09603865 = queryWeight, product of:
               1.2979807 = boost
               4.7333736 = idf(docFreq=1021, maxDocs=42740)
               0.01563173 = queryNorm
             0.5916717 = fieldWeight in 7414, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7333736 = idf(docFreq=1021, maxDocs=42740)
               0.125 = fieldNorm(doc=7414)
         0.033430334 = weight(abstract_txt:retrieval in 7414) [ClassicSimilarity], result of:
           0.033430334 = score(doc=7414,freq=1.0), product of:
             0.077188455 = queryWeight, product of:
               1.425171 = boost
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.01563173 = queryNorm
             0.43310016 = fieldWeight in 7414, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4648013 = idf(docFreq=3633, maxDocs=42740)
               0.125 = fieldNorm(doc=7414)
         0.08087255 = weight(abstract_txt:gives in 7414) [ClassicSimilarity], result of:
           0.08087255 = score(doc=7414,freq=1.0), product of:
             0.12151472 = queryWeight, product of:
               1.4600228 = boost
               5.3242965 = idf(docFreq=565, maxDocs=42740)
               0.01563173 = queryNorm
             0.66553706 = fieldWeight in 7414, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3242965 = idf(docFreq=565, maxDocs=42740)
               0.125 = fieldNorm(doc=7414)
         0.1029967 = weight(abstract_txt:guide in 7414) [ClassicSimilarity], result of:
           0.1029967 = score(doc=7414,freq=1.0), product of:
             0.14277221 = queryWeight, product of:
               1.582585 = boost
               5.7712464 = idf(docFreq=361, maxDocs=42740)
               0.01563173 = queryNorm
             0.7214058 = fieldWeight in 7414, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7712464 = idf(docFreq=361, maxDocs=42740)
               0.125 = fieldNorm(doc=7414)
         0.1581502 = weight(abstract_txt:search in 7414) [ClassicSimilarity], result of:
           0.1581502 = score(doc=7414,freq=3.0), product of:
             0.2000431 = queryWeight, product of:
               3.5046206 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.01563173 = queryNorm
             0.79058063 = fieldWeight in 7414, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.125 = fieldNorm(doc=7414)
       0.2 = coord(5/25)
   

4. Johnson, P.: Selecting electronic resources : developing a local decision-making matrix (1996) 0.09

   0.08593662 = sum of:
     0.08593662 = product of:
       0.5371039 = sum of:
         0.037565045 = weight(abstract_txt:issues in 550) [ClassicSimilarity], result of:
           0.037565045 = score(doc=550,freq=1.0), product of:
             0.07966705 = queryWeight, product of:
               1.1821826 = boost
               4.3110905 = idf(docFreq=1558, maxDocs=42740)
               0.01563173 = queryNorm
             0.47152552 = fieldWeight in 550, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3110905 = idf(docFreq=1558, maxDocs=42740)
               0.109375 = fieldNorm(doc=550)
         0.039195944 = weight(abstract_txt:structure in 550) [ClassicSimilarity], result of:
           0.039195944 = score(doc=550,freq=1.0), product of:
             0.08195652 = queryWeight, product of:
               1.199049 = boost
               4.3725977 = idf(docFreq=1465, maxDocs=42740)
               0.01563173 = queryNorm
             0.4782529 = fieldWeight in 550, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3725977 = idf(docFreq=1465, maxDocs=42740)
               0.109375 = fieldNorm(doc=550)
         0.12745191 = weight(abstract_txt:guide in 550) [ClassicSimilarity], result of:
           0.12745191 = score(doc=550,freq=2.0), product of:
             0.14277221 = queryWeight, product of:
               1.582585 = boost
               5.7712464 = idf(docFreq=361, maxDocs=42740)
               0.01563173 = queryNorm
             0.8926941 = fieldWeight in 550, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7712464 = idf(docFreq=361, maxDocs=42740)
               0.109375 = fieldNorm(doc=550)
         0.33289102 = weight(abstract_txt:local in 550) [ClassicSimilarity], result of:
           0.33289102 = score(doc=550,freq=2.0), product of:
             0.4111215 = queryWeight, product of:
               5.0241694 = boost
               5.234785 = idf(docFreq=618, maxDocs=42740)
               0.01563173 = queryNorm
             0.8097145 = fieldWeight in 550, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.234785 = idf(docFreq=618, maxDocs=42740)
               0.109375 = fieldNorm(doc=550)
       0.16 = coord(4/25)
   

5. Schwarz, K.: Domain model enhanced search : a comparison of taxonomy, thesaurus and ontology (2005) 0.08

   0.08445597 = sum of:
     0.08445597 = product of:
       0.35189986 = sum of:
         0.016099306 = weight(abstract_txt:issues in 1570) [ClassicSimilarity], result of:
           0.016099306 = score(doc=1570,freq=1.0), product of:
             0.07966705 = queryWeight, product of:
               1.1821826 = boost
               4.3110905 = idf(docFreq=1558, maxDocs=42740)
               0.01563173 = queryNorm
             0.20208237 = fieldWeight in 1570, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3110905 = idf(docFreq=1558, maxDocs=42740)
               0.046875 = fieldNorm(doc=1570)
         0.030327206 = weight(abstract_txt:gives in 1570) [ClassicSimilarity], result of:
           0.030327206 = score(doc=1570,freq=1.0), product of:
             0.12151472 = queryWeight, product of:
               1.4600228 = boost
               5.3242965 = idf(docFreq=565, maxDocs=42740)
               0.01563173 = queryNorm
             0.24957639 = fieldWeight in 1570, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3242965 = idf(docFreq=565, maxDocs=42740)
               0.046875 = fieldNorm(doc=1570)
         0.05441833 = weight(abstract_txt:taxonomy in 1570) [ClassicSimilarity], result of:
           0.05441833 = score(doc=1570,freq=1.0), product of:
             0.17943373 = queryWeight, product of:
               1.7741781 = boost
               6.4699335 = idf(docFreq=179, maxDocs=42740)
               0.01563173 = queryNorm
             0.30327815 = fieldWeight in 1570, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4699335 = idf(docFreq=179, maxDocs=42740)
               0.046875 = fieldNorm(doc=1570)
         0.06360281 = weight(abstract_txt:problems in 1570) [ClassicSimilarity], result of:
           0.06360281 = score(doc=1570,freq=4.0), product of:
             0.158021 = queryWeight, product of:
               2.3546026 = boost
               4.2932897 = idf(docFreq=1586, maxDocs=42740)
               0.01563173 = queryNorm
             0.40249592 = fieldWeight in 1570, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.2932897 = idf(docFreq=1586, maxDocs=42740)
               0.046875 = fieldNorm(doc=1570)
         0.08473063 = weight(abstract_txt:solve in 1570) [ClassicSimilarity], result of:
           0.08473063 = score(doc=1570,freq=1.0), product of:
             0.27592942 = queryWeight, product of:
               2.6945722 = boost
               6.550903 = idf(docFreq=165, maxDocs=42740)
               0.01563173 = queryNorm
             0.30707356 = fieldWeight in 1570, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.550903 = idf(docFreq=165, maxDocs=42740)
               0.046875 = fieldNorm(doc=1570)
         0.10272158 = weight(abstract_txt:search in 1570) [ClassicSimilarity], result of:
           0.10272158 = score(doc=1570,freq=9.0), product of:
             0.2000431 = queryWeight, product of:
               3.5046206 = boost
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.01563173 = queryNorm
             0.51349723 = fieldWeight in 1570, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.6515355 = idf(docFreq=3014, maxDocs=42740)
               0.046875 = fieldNorm(doc=1570)
       0.24 = coord(6/25)