Document (#33967)

Author

Oyarce, G.

Title

Using the shape recovery method to evaluate indexing techniques

Source

Journal of the American Society for Information Science and Technology. 59(2008) no.9, S.1479-1492

Year

2008

Abstract

Text representation, central to information processing, must be descriptive and discriminative. Although some of the many techniques to construct document representations may outperform others for certain tasks, no one is consistently better than others. Representations are still problematic. Evaluation techniques are needed to penetrate foundational questions about term behavior in representation. A study that applies the shape recovery analysis method is reported here as an evaluative tool to compare different indexing schemes. Three weight coefficients are used to rank indexing terms and are compared to the documents' full text. Two of the weight coefficients are novel and the third relies on the chi-squared distribution. Multidimensional scaling reduces the dimensional space of the document surrogates into a two-dimensional Cartesian space. Ten concentric circles evenly separated at 10% intervals of relevant data points starting at the centroid are used to construct a precision-recall curve. ANOVA is used for a straightforward computation of the 4 × 11 matrix of test data to see whether the four treatments yield the same P-R result. A post hoc HSD Tukey multiple comparisons test among pairwise treatments is also used to discover homogeneous groups. The findings show the value of the methodology to study term weighting schemes, and their descriptiveness and discriminative power, as well as the potential strength of the novel coefficients introduced.

Similar documents (content)

1. Burgin, R.: ¬The effect of indexing exhaustivity on retrieval performance (1991) 0.21

   0.20767957 = sum of:
     0.20767957 = product of:
       0.6489987 = sum of:
         0.062195044 = weight(abstract_txt:term in 5262) [ClassicSimilarity], result of:
           0.062195044 = score(doc=5262,freq=3.0), product of:
             0.09573151 = queryWeight, product of:
               1.032629 = boost
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.019309025 = queryNorm
             0.64968204 = fieldWeight in 5262, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.078125 = fieldNorm(doc=5262)
         0.054848984 = weight(abstract_txt:representation in 5262) [ClassicSimilarity], result of:
           0.054848984 = score(doc=5262,freq=2.0), product of:
             0.10077679 = queryWeight, product of:
               1.0594907 = boost
               4.926098 = idf(docFreq=871, maxDocs=44218)
               0.019309025 = queryNorm
             0.54426205 = fieldWeight in 5262, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.926098 = idf(docFreq=871, maxDocs=44218)
               0.078125 = fieldNorm(doc=5262)
         0.058973674 = weight(abstract_txt:test in 5262) [ClassicSimilarity], result of:
           0.058973674 = score(doc=5262,freq=2.0), product of:
             0.10576783 = queryWeight, product of:
               1.0854096 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.019309025 = queryNorm
             0.55757666 = fieldWeight in 5262, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.078125 = fieldNorm(doc=5262)
         0.071947396 = weight(abstract_txt:space in 5262) [ClassicSimilarity], result of:
           0.071947396 = score(doc=5262,freq=2.0), product of:
             0.120760486 = queryWeight, product of:
               1.1597899 = boost
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.019309025 = queryNorm
             0.5957859 = fieldWeight in 5262, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.078125 = fieldNorm(doc=5262)
         0.070309654 = weight(abstract_txt:representations in 5262) [ClassicSimilarity], result of:
           0.070309654 = score(doc=5262,freq=1.0), product of:
             0.14983092 = queryWeight, product of:
               1.2918664 = boost
               6.006528 = idf(docFreq=295, maxDocs=44218)
               0.019309025 = queryNorm
             0.46925998 = fieldWeight in 5262, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.006528 = idf(docFreq=295, maxDocs=44218)
               0.078125 = fieldNorm(doc=5262)
         0.07596722 = weight(abstract_txt:construct in 5262) [ClassicSimilarity], result of:
           0.07596722 = score(doc=5262,freq=1.0), product of:
             0.15776439 = queryWeight, product of:
               1.3256271 = boost
               6.163498 = idf(docFreq=252, maxDocs=44218)
               0.019309025 = queryNorm
             0.48152328 = fieldWeight in 5262, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.163498 = idf(docFreq=252, maxDocs=44218)
               0.078125 = fieldNorm(doc=5262)
         0.06936502 = weight(abstract_txt:indexing in 5262) [ClassicSimilarity], result of:
           0.06936502 = score(doc=5262,freq=3.0), product of:
             0.11785332 = queryWeight, product of:
               1.4032447 = boost
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.019309025 = queryNorm
             0.5885708 = fieldWeight in 5262, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.078125 = fieldNorm(doc=5262)
         0.18539171 = weight(abstract_txt:weight in 5262) [ClassicSimilarity], result of:
           0.18539171 = score(doc=5262,freq=2.0), product of:
             0.22697343 = queryWeight, product of:
               1.5900266 = boost
               7.3928223 = idf(docFreq=73, maxDocs=44218)
               0.019309025 = queryNorm
             0.81679916 = fieldWeight in 5262, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3928223 = idf(docFreq=73, maxDocs=44218)
               0.078125 = fieldNorm(doc=5262)
       0.32 = coord(8/25)
   

2. Bordogna, G.; Pagani, M.: ¬A flexible content-based image retrieval model and a customizable system for the retrieval of shapes (2010) 0.11

   0.10783227 = sum of:
     0.10783227 = product of:
       0.5391613 = sum of:
         0.03102727 = weight(abstract_txt:representation in 3450) [ClassicSimilarity], result of:
           0.03102727 = score(doc=3450,freq=1.0), product of:
             0.10077679 = queryWeight, product of:
               1.0594907 = boost
               4.926098 = idf(docFreq=871, maxDocs=44218)
               0.019309025 = queryNorm
             0.30788112 = fieldWeight in 3450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.926098 = idf(docFreq=871, maxDocs=44218)
               0.0625 = fieldNorm(doc=3450)
         0.040699594 = weight(abstract_txt:space in 3450) [ClassicSimilarity], result of:
           0.040699594 = score(doc=3450,freq=1.0), product of:
             0.120760486 = queryWeight, product of:
               1.1597899 = boost
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.019309025 = queryNorm
             0.3370274 = fieldWeight in 3450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.0625 = fieldNorm(doc=3450)
         0.0795463 = weight(abstract_txt:representations in 3450) [ClassicSimilarity], result of:
           0.0795463 = score(doc=3450,freq=2.0), product of:
             0.14983092 = queryWeight, product of:
               1.2918664 = boost
               6.006528 = idf(docFreq=295, maxDocs=44218)
               0.019309025 = queryNorm
             0.5309071 = fieldWeight in 3450, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.006528 = idf(docFreq=295, maxDocs=44218)
               0.0625 = fieldNorm(doc=3450)
         0.16002496 = weight(abstract_txt:shape in 3450) [ClassicSimilarity], result of:
           0.16002496 = score(doc=3450,freq=4.0), product of:
             0.18951195 = queryWeight, product of:
               1.4528983 = boost
               6.7552447 = idf(docFreq=139, maxDocs=44218)
               0.019309025 = queryNorm
             0.8444056 = fieldWeight in 3450, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.7552447 = idf(docFreq=139, maxDocs=44218)
               0.0625 = fieldNorm(doc=3450)
         0.22786321 = weight(abstract_txt:coefficients in 3450) [ClassicSimilarity], result of:
           0.22786321 = score(doc=3450,freq=1.0), product of:
             0.43585768 = queryWeight, product of:
               2.6985774 = boost
               8.364683 = idf(docFreq=27, maxDocs=44218)
               0.019309025 = queryNorm
             0.5227927 = fieldWeight in 3450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.364683 = idf(docFreq=27, maxDocs=44218)
               0.0625 = fieldNorm(doc=3450)
       0.2 = coord(5/25)
   

3. AlQenaei, Z.M.; Monarchi, D.E.: ¬The use of learning techniques to analyze the results of a manual classification system (2016) 0.11

   0.107333794 = sum of:
     0.107333794 = product of:
       0.3354181 = sum of:
         0.028726662 = weight(abstract_txt:term in 2836) [ClassicSimilarity], result of:
           0.028726662 = score(doc=2836,freq=1.0), product of:
             0.09573151 = queryWeight, product of:
               1.032629 = boost
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.019309025 = queryNorm
             0.3000753 = fieldWeight in 2836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.0625 = fieldNorm(doc=2836)
         0.03102727 = weight(abstract_txt:representation in 2836) [ClassicSimilarity], result of:
           0.03102727 = score(doc=2836,freq=1.0), product of:
             0.10077679 = queryWeight, product of:
               1.0594907 = boost
               4.926098 = idf(docFreq=871, maxDocs=44218)
               0.019309025 = queryNorm
             0.30788112 = fieldWeight in 2836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.926098 = idf(docFreq=871, maxDocs=44218)
               0.0625 = fieldNorm(doc=2836)
         0.03336055 = weight(abstract_txt:test in 2836) [ClassicSimilarity], result of:
           0.03336055 = score(doc=2836,freq=1.0), product of:
             0.10576783 = queryWeight, product of:
               1.0854096 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.019309025 = queryNorm
             0.315413 = fieldWeight in 2836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=2836)
         0.057557914 = weight(abstract_txt:space in 2836) [ClassicSimilarity], result of:
           0.057557914 = score(doc=2836,freq=2.0), product of:
             0.120760486 = queryWeight, product of:
               1.1597899 = boost
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.019309025 = queryNorm
             0.47662872 = fieldWeight in 2836, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.0625 = fieldNorm(doc=2836)
         0.03203833 = weight(abstract_txt:indexing in 2836) [ClassicSimilarity], result of:
           0.03203833 = score(doc=2836,freq=1.0), product of:
             0.11785332 = queryWeight, product of:
               1.4032447 = boost
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.019309025 = queryNorm
             0.27184922 = fieldWeight in 2836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.0625 = fieldNorm(doc=2836)
         0.019679341 = weight(abstract_txt:used in 2836) [ClassicSimilarity], result of:
           0.019679341 = score(doc=2836,freq=1.0), product of:
             0.093730696 = queryWeight, product of:
               1.4450165 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.019309025 = queryNorm
             0.2099562 = fieldWeight in 2836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=2836)
         0.05117903 = weight(abstract_txt:techniques in 2836) [ClassicSimilarity], result of:
           0.05117903 = score(doc=2836,freq=2.0), product of:
             0.12782425 = queryWeight, product of:
               1.4614002 = boost
               4.5298495 = idf(docFreq=1295, maxDocs=44218)
               0.019309025 = queryNorm
             0.40038592 = fieldWeight in 2836, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5298495 = idf(docFreq=1295, maxDocs=44218)
               0.0625 = fieldNorm(doc=2836)
         0.081848994 = weight(abstract_txt:dimensional in 2836) [ClassicSimilarity], result of:
           0.081848994 = score(doc=2836,freq=1.0), product of:
             0.19240087 = queryWeight, product of:
               1.4639302 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.019309025 = queryNorm
             0.42540863 = fieldWeight in 2836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.0625 = fieldNorm(doc=2836)
       0.32 = coord(8/25)
   

4. Wolfram, D.; Zhang, J.: ¬An investigation of the influence of indexing exhaustivity and term distributions on a document space (2002) 0.10

   0.10052531 = sum of:
     0.10052531 = product of:
       0.4188555 = sum of:
         0.15734175 = weight(abstract_txt:centroid in 5238) [ClassicSimilarity], result of:
           0.15734175 = score(doc=5238,freq=2.0), product of:
             0.18738757 = queryWeight, product of:
               1.0215797 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.019309025 = queryNorm
             0.83965945 = fieldWeight in 5238, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.0625 = fieldNorm(doc=5238)
         0.057453323 = weight(abstract_txt:term in 5238) [ClassicSimilarity], result of:
           0.057453323 = score(doc=5238,freq=4.0), product of:
             0.09573151 = queryWeight, product of:
               1.032629 = boost
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.019309025 = queryNorm
             0.6001506 = fieldWeight in 5238, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.0625 = fieldNorm(doc=5238)
         0.070493765 = weight(abstract_txt:space in 5238) [ClassicSimilarity], result of:
           0.070493765 = score(doc=5238,freq=3.0), product of:
             0.120760486 = queryWeight, product of:
               1.1597899 = boost
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.019309025 = queryNorm
             0.5837486 = fieldWeight in 5238, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.0625 = fieldNorm(doc=5238)
         0.03203833 = weight(abstract_txt:indexing in 5238) [ClassicSimilarity], result of:
           0.03203833 = score(doc=5238,freq=1.0), product of:
             0.11785332 = queryWeight, product of:
               1.4032447 = boost
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.019309025 = queryNorm
             0.27184922 = fieldWeight in 5238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.0625 = fieldNorm(doc=5238)
         0.019679341 = weight(abstract_txt:used in 5238) [ClassicSimilarity], result of:
           0.019679341 = score(doc=5238,freq=1.0), product of:
             0.093730696 = queryWeight, product of:
               1.4450165 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.019309025 = queryNorm
             0.2099562 = fieldWeight in 5238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=5238)
         0.081848994 = weight(abstract_txt:dimensional in 5238) [ClassicSimilarity], result of:
           0.081848994 = score(doc=5238,freq=1.0), product of:
             0.19240087 = queryWeight, product of:
               1.4639302 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.019309025 = queryNorm
             0.42540863 = fieldWeight in 5238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.0625 = fieldNorm(doc=5238)
       0.24 = coord(6/25)
   

5. Wolfram, D.; Zhang, J.: ¬The influence of indexing practices and weighting algorithms on document spaces (2008) 0.10

   0.09859676 = sum of:
     0.09859676 = product of:
       0.41081983 = sum of:
         0.028726662 = weight(abstract_txt:term in 1963) [ClassicSimilarity], result of:
           0.028726662 = score(doc=1963,freq=1.0), product of:
             0.09573151 = queryWeight, product of:
               1.032629 = boost
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.019309025 = queryNorm
             0.3000753 = fieldWeight in 1963, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.0625 = fieldNorm(doc=1963)
         0.08139919 = weight(abstract_txt:space in 1963) [ClassicSimilarity], result of:
           0.08139919 = score(doc=1963,freq=4.0), product of:
             0.120760486 = queryWeight, product of:
               1.1597899 = boost
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.019309025 = queryNorm
             0.6740548 = fieldWeight in 1963, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.0625 = fieldNorm(doc=1963)
         0.06407666 = weight(abstract_txt:indexing in 1963) [ClassicSimilarity], result of:
           0.06407666 = score(doc=1963,freq=4.0), product of:
             0.11785332 = queryWeight, product of:
               1.4032447 = boost
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.019309025 = queryNorm
             0.54369843 = fieldWeight in 1963, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.0625 = fieldNorm(doc=1963)
         0.019679341 = weight(abstract_txt:used in 1963) [ClassicSimilarity], result of:
           0.019679341 = score(doc=1963,freq=1.0), product of:
             0.093730696 = queryWeight, product of:
               1.4450165 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.019309025 = queryNorm
             0.2099562 = fieldWeight in 1963, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=1963)
         0.03618904 = weight(abstract_txt:techniques in 1963) [ClassicSimilarity], result of:
           0.03618904 = score(doc=1963,freq=1.0), product of:
             0.12782425 = queryWeight, product of:
               1.4614002 = boost
               4.5298495 = idf(docFreq=1295, maxDocs=44218)
               0.019309025 = queryNorm
             0.2831156 = fieldWeight in 1963, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5298495 = idf(docFreq=1295, maxDocs=44218)
               0.0625 = fieldNorm(doc=1963)
         0.18074895 = weight(abstract_txt:discriminative in 1963) [ClassicSimilarity], result of:
           0.18074895 = score(doc=1963,freq=1.0), product of:
             0.32627365 = queryWeight, product of:
               1.906373 = boost
               8.863674 = idf(docFreq=16, maxDocs=44218)
               0.019309025 = queryNorm
             0.55397964 = fieldWeight in 1963, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.863674 = idf(docFreq=16, maxDocs=44218)
               0.0625 = fieldNorm(doc=1963)
       0.24 = coord(6/25)