Document (#21775)

Author
Kwok, K.L.
Title
Employing multiple representations for Chinese information retrieval
Source
Journal of the American Society for Information Science. 50(1999) no.8, S.709-723
Year
1999
Abstract
For information retrieval in the Chinese language, 3 representation methods for texts are popular, namely: 1-gram or character, bigram, and short-word. Each has its advantages as well as drawbacks. Employing more than one method may combine advantages from them and enhance retrieval effectiveness. We investigated 2 ways of using them simultaneously: mixing representations in documents and queries, and combining retrieval lists obtained via different representations. The experiments were done with the 170 MB evaluated Chinese corpora and 54 long and short queries available from the TREC program and using our Probabilistic Indexing and Retrieval Components System (PIRCS retrieval system). Experiments show that good retrieval need not depend on accurate word segmentation; approximate segmentation into short-words will do. Results also show and confirm that bigram representation alone works well; mixing characters with bigram representation boosts effectiveness further, but it is preferable to mix characters with short-word indexing which is more efficient, needs less resource, and gives better retrieval more often. Cobining retrieval lists from short-word with character representation and from bigram indexing provides the best retrieval results but also at a substabtial cost

Similar documents (author)

  1. Kwok, K.L.: ¬The use of titles and cited titles as document representations for automatic classification (1975) 5.60
    5.5967755 = sum of:
      5.5967755 = weight(author_txt:kwok in 4347) [ClassicSimilarity], result of:
        5.5967755 = fieldWeight in 4347, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.954841 = idf(docFreq=14, maxDocs=42740)
          0.625 = fieldNorm(doc=4347)
    
  2. Kwok, K.L.: ¬A network approach to probabilistic information retrieval (1995) 5.60
    5.5967755 = sum of:
      5.5967755 = weight(author_txt:kwok in 612) [ClassicSimilarity], result of:
        5.5967755 = fieldWeight in 612, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.954841 = idf(docFreq=14, maxDocs=42740)
          0.625 = fieldNorm(doc=612)
    
  3. Kwok, K.L.: Improving English and Chinese ad-hoc retrieval : a TIPSTER text phase 3 project report (2000) 5.60
    5.5967755 = sum of:
      5.5967755 = weight(author_txt:kwok in 389) [ClassicSimilarity], result of:
        5.5967755 = fieldWeight in 389, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.954841 = idf(docFreq=14, maxDocs=42740)
          0.625 = fieldNorm(doc=389)
    
  4. Kwok, K.L.; Grunfeld, L.: TREC-4 ad-hoc, routing retrieval and filtering experiments using PIRCS (1996) 4.48
    4.4774203 = sum of:
      4.4774203 = weight(author_txt:kwok in 631) [ClassicSimilarity], result of:
        4.4774203 = fieldWeight in 631, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.954841 = idf(docFreq=14, maxDocs=42740)
          0.5 = fieldNorm(doc=631)
    
  5. Kwok, K.L.; Grunfeld, L.: TREC-5 English and Chinese retrieval experiments using PIRCS (1997) 4.48
    4.4774203 = sum of:
      4.4774203 = weight(author_txt:kwok in 4103) [ClassicSimilarity], result of:
        4.4774203 = fieldWeight in 4103, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.954841 = idf(docFreq=14, maxDocs=42740)
          0.5 = fieldNorm(doc=4103)
    

Similar documents (content)

  1. Wang, F.L.; Yang, C.C.: Mining Web data for Chinese segmentation (2007) 0.35
    0.35480583 = sum of:
      0.35480583 = product of:
        0.88701457 = sum of:
          0.018886762 = weight(abstract_txt:show in 2605) [ClassicSimilarity], result of:
            0.018886762 = score(doc=2605,freq=1.0), product of:
              0.06784205 = queryWeight, product of:
                1.1136659 = boost
                4.4542904 = idf(docFreq=1350, maxDocs=42740)
                0.013676202 = queryNorm
              0.27839315 = fieldWeight in 2605, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4542904 = idf(docFreq=1350, maxDocs=42740)
                0.0625 = fieldNorm(doc=2605)
          0.009645809 = weight(abstract_txt:with in 2605) [ClassicSimilarity], result of:
            0.009645809 = score(doc=2605,freq=2.0), product of:
              0.043346405 = queryWeight, product of:
                1.2589167 = boost
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.013676202 = queryNorm
              0.22252847 = fieldWeight in 2605, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0625 = fieldNorm(doc=2605)
          0.033049766 = weight(abstract_txt:experiments in 2605) [ClassicSimilarity], result of:
            0.033049766 = score(doc=2605,freq=1.0), product of:
              0.098515876 = queryWeight, product of:
                1.3420187 = boost
                5.3676248 = idf(docFreq=541, maxDocs=42740)
                0.013676202 = queryNorm
              0.33547655 = fieldWeight in 2605, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.3676248 = idf(docFreq=541, maxDocs=42740)
                0.0625 = fieldNorm(doc=2605)
          0.009269747 = weight(abstract_txt:from in 2605) [ClassicSimilarity], result of:
            0.009269747 = score(doc=2605,freq=1.0), product of:
              0.05318419 = queryWeight, product of:
                1.3944782 = boost
                2.7887225 = idf(docFreq=7144, maxDocs=42740)
                0.013676202 = queryNorm
              0.17429516 = fieldWeight in 2605, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.7887225 = idf(docFreq=7144, maxDocs=42740)
                0.0625 = fieldNorm(doc=2605)
          0.037069056 = weight(abstract_txt:indexing in 2605) [ClassicSimilarity], result of:
            0.037069056 = score(doc=2605,freq=2.0), product of:
              0.09662483 = queryWeight, product of:
                1.6277791 = boost
                4.34038 = idf(docFreq=1513, maxDocs=42740)
                0.013676202 = queryNorm
              0.38363904 = fieldWeight in 2605, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.34038 = idf(docFreq=1513, maxDocs=42740)
                0.0625 = fieldNorm(doc=2605)
          0.084041946 = weight(abstract_txt:character in 2605) [ClassicSimilarity], result of:
            0.084041946 = score(doc=2605,freq=2.0), product of:
              0.14567378 = queryWeight, product of:
                1.6319098 = boost
                6.527092 = idf(docFreq=169, maxDocs=42740)
                0.013676202 = queryNorm
              0.57691884 = fieldWeight in 2605, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.527092 = idf(docFreq=169, maxDocs=42740)
                0.0625 = fieldNorm(doc=2605)
          0.3364001 = weight(abstract_txt:segmentation in 2605) [ClassicSimilarity], result of:
            0.3364001 = score(doc=2605,freq=10.0), product of:
              0.2147656 = queryWeight, product of:
                1.9814714 = boost
                7.925221 = idf(docFreq=41, maxDocs=42740)
                0.013676202 = queryNorm
              1.5663594 = fieldWeight in 2605, product of:
                3.1622777 = tf(freq=10.0), with freq of:
                  10.0 = termFreq=10.0
                7.925221 = idf(docFreq=41, maxDocs=42740)
                0.0625 = fieldNorm(doc=2605)
          0.2161252 = weight(abstract_txt:chinese in 2605) [ClassicSimilarity], result of:
            0.2161252 = score(doc=2605,freq=7.0), product of:
              0.20615569 = queryWeight, product of:
                2.3776546 = boost
                6.3398805 = idf(docFreq=204, maxDocs=42740)
                0.013676202 = queryNorm
              1.0483592 = fieldWeight in 2605, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                6.3398805 = idf(docFreq=204, maxDocs=42740)
                0.0625 = fieldNorm(doc=2605)
          0.098080814 = weight(abstract_txt:word in 2605) [ClassicSimilarity], result of:
            0.098080814 = score(doc=2605,freq=2.0), product of:
              0.2034464 = queryWeight, product of:
                2.7273788 = boost
                5.4543004 = idf(docFreq=496, maxDocs=42740)
                0.013676202 = queryNorm
              0.48209658 = fieldWeight in 2605, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.4543004 = idf(docFreq=496, maxDocs=42740)
                0.0625 = fieldNorm(doc=2605)
          0.044445414 = weight(abstract_txt:retrieval in 2605) [ClassicSimilarity], result of:
            0.044445414 = score(doc=2605,freq=1.0), product of:
              0.20524313 = queryWeight, product of:
                4.331365 = boost
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.013676202 = queryNorm
              0.21655008 = fieldWeight in 2605, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.0625 = fieldNorm(doc=2605)
        0.4 = coord(10/25)
    
  2. Lee, K.H.; Ng, M.K.M.; Lu, Q.: Text segmentation for Chinese spell checking (1999) 0.28
    0.27815703 = sum of:
      0.27815703 = product of:
        0.7726584 = sum of:
          0.009645809 = weight(abstract_txt:with in 4914) [ClassicSimilarity], result of:
            0.009645809 = score(doc=4914,freq=2.0), product of:
              0.043346405 = queryWeight, product of:
                1.2589167 = boost
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.013676202 = queryNorm
              0.22252847 = fieldWeight in 4914, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0625 = fieldNorm(doc=4914)
          0.018224977 = weight(abstract_txt:more in 4914) [ClassicSimilarity], result of:
            0.018224977 = score(doc=4914,freq=2.0), product of:
              0.06019019 = queryWeight, product of:
                1.2847362 = boost
                3.4256759 = idf(docFreq=3778, maxDocs=42740)
                0.013676202 = queryNorm
              0.30278984 = fieldWeight in 4914, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4256759 = idf(docFreq=3778, maxDocs=42740)
                0.0625 = fieldNorm(doc=4914)
          0.033049766 = weight(abstract_txt:experiments in 4914) [ClassicSimilarity], result of:
            0.033049766 = score(doc=4914,freq=1.0), product of:
              0.098515876 = queryWeight, product of:
                1.3420187 = boost
                5.3676248 = idf(docFreq=541, maxDocs=42740)
                0.013676202 = queryNorm
              0.33547655 = fieldWeight in 4914, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.3676248 = idf(docFreq=541, maxDocs=42740)
                0.0625 = fieldNorm(doc=4914)
          0.016055671 = weight(abstract_txt:from in 4914) [ClassicSimilarity], result of:
            0.016055671 = score(doc=4914,freq=3.0), product of:
              0.05318419 = queryWeight, product of:
                1.3944782 = boost
                2.7887225 = idf(docFreq=7144, maxDocs=42740)
                0.013676202 = queryNorm
              0.30188805 = fieldWeight in 4914, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.7887225 = idf(docFreq=7144, maxDocs=42740)
                0.0625 = fieldNorm(doc=4914)
          0.059426636 = weight(abstract_txt:character in 4914) [ClassicSimilarity], result of:
            0.059426636 = score(doc=4914,freq=1.0), product of:
              0.14567378 = queryWeight, product of:
                1.6319098 = boost
                6.527092 = idf(docFreq=169, maxDocs=42740)
                0.013676202 = queryNorm
              0.40794325 = fieldWeight in 4914, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.527092 = idf(docFreq=169, maxDocs=42740)
                0.0625 = fieldNorm(doc=4914)
          0.084697135 = weight(abstract_txt:characters in 4914) [ClassicSimilarity], result of:
            0.084697135 = score(doc=4914,freq=1.0), product of:
              0.18449011 = queryWeight, product of:
                1.8365046 = boost
                7.3454022 = idf(docFreq=74, maxDocs=42740)
                0.013676202 = queryNorm
              0.45908764 = fieldWeight in 4914, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3454022 = idf(docFreq=74, maxDocs=42740)
                0.0625 = fieldNorm(doc=4914)
          0.2127581 = weight(abstract_txt:segmentation in 4914) [ClassicSimilarity], result of:
            0.2127581 = score(doc=4914,freq=4.0), product of:
              0.2147656 = queryWeight, product of:
                1.9814714 = boost
                7.925221 = idf(docFreq=41, maxDocs=42740)
                0.013676202 = queryNorm
              0.9906526 = fieldWeight in 4914, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                7.925221 = idf(docFreq=41, maxDocs=42740)
                0.0625 = fieldNorm(doc=4914)
          0.20009306 = weight(abstract_txt:chinese in 4914) [ClassicSimilarity], result of:
            0.20009306 = score(doc=4914,freq=6.0), product of:
              0.20615569 = queryWeight, product of:
                2.3776546 = boost
                6.3398805 = idf(docFreq=204, maxDocs=42740)
                0.013676202 = queryNorm
              0.970592 = fieldWeight in 4914, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                6.3398805 = idf(docFreq=204, maxDocs=42740)
                0.0625 = fieldNorm(doc=4914)
          0.13870722 = weight(abstract_txt:word in 4914) [ClassicSimilarity], result of:
            0.13870722 = score(doc=4914,freq=4.0), product of:
              0.2034464 = queryWeight, product of:
                2.7273788 = boost
                5.4543004 = idf(docFreq=496, maxDocs=42740)
                0.013676202 = queryNorm
              0.68178755 = fieldWeight in 4914, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.4543004 = idf(docFreq=496, maxDocs=42740)
                0.0625 = fieldNorm(doc=4914)
        0.36 = coord(9/25)
    
  3. Chau, M.; Lu, Y.; Fang, X.; Yang, C.C.: Characteristics of character usage in Chinese Web searching (2009) 0.27
    0.27159533 = sum of:
      0.27159533 = product of:
        0.84873545 = sum of:
          0.0136412345 = weight(abstract_txt:with in 4457) [ClassicSimilarity], result of:
            0.0136412345 = score(doc=4457,freq=4.0), product of:
              0.043346405 = queryWeight, product of:
                1.2589167 = boost
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.013676202 = queryNorm
              0.31470278 = fieldWeight in 4457, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0625 = fieldNorm(doc=4457)
          0.039837144 = weight(abstract_txt:queries in 4457) [ClassicSimilarity], result of:
            0.039837144 = score(doc=4457,freq=2.0), product of:
              0.08856105 = queryWeight, product of:
                1.2724093 = boost
                5.0892105 = idf(docFreq=715, maxDocs=42740)
                0.013676202 = queryNorm
              0.4498269 = fieldWeight in 4457, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.0892105 = idf(docFreq=715, maxDocs=42740)
                0.0625 = fieldNorm(doc=4457)
          0.018224977 = weight(abstract_txt:more in 4457) [ClassicSimilarity], result of:
            0.018224977 = score(doc=4457,freq=2.0), product of:
              0.06019019 = queryWeight, product of:
                1.2847362 = boost
                3.4256759 = idf(docFreq=3778, maxDocs=42740)
                0.013676202 = queryNorm
              0.30278984 = fieldWeight in 4457, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4256759 = idf(docFreq=3778, maxDocs=42740)
                0.0625 = fieldNorm(doc=4457)
          0.016055671 = weight(abstract_txt:from in 4457) [ClassicSimilarity], result of:
            0.016055671 = score(doc=4457,freq=3.0), product of:
              0.05318419 = queryWeight, product of:
                1.3944782 = boost
                2.7887225 = idf(docFreq=7144, maxDocs=42740)
                0.013676202 = queryNorm
              0.30188805 = fieldWeight in 4457, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.7887225 = idf(docFreq=7144, maxDocs=42740)
                0.0625 = fieldNorm(doc=4457)
          0.084041946 = weight(abstract_txt:character in 4457) [ClassicSimilarity], result of:
            0.084041946 = score(doc=4457,freq=2.0), product of:
              0.14567378 = queryWeight, product of:
                1.6319098 = boost
                6.527092 = idf(docFreq=169, maxDocs=42740)
                0.013676202 = queryNorm
              0.57691884 = fieldWeight in 4457, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.527092 = idf(docFreq=169, maxDocs=42740)
                0.0625 = fieldNorm(doc=4457)
          0.084697135 = weight(abstract_txt:characters in 4457) [ClassicSimilarity], result of:
            0.084697135 = score(doc=4457,freq=1.0), product of:
              0.18449011 = queryWeight, product of:
                1.8365046 = boost
                7.3454022 = idf(docFreq=74, maxDocs=42740)
                0.013676202 = queryNorm
              0.45908764 = fieldWeight in 4457, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3454022 = idf(docFreq=74, maxDocs=42740)
                0.0625 = fieldNorm(doc=4457)
          0.20009306 = weight(abstract_txt:chinese in 4457) [ClassicSimilarity], result of:
            0.20009306 = score(doc=4457,freq=6.0), product of:
              0.20615569 = queryWeight, product of:
                2.3776546 = boost
                6.3398805 = idf(docFreq=204, maxDocs=42740)
                0.013676202 = queryNorm
              0.970592 = fieldWeight in 4457, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                6.3398805 = idf(docFreq=204, maxDocs=42740)
                0.0625 = fieldNorm(doc=4457)
          0.39214426 = weight(abstract_txt:bigram in 4457) [ClassicSimilarity], result of:
            0.39214426 = score(doc=4457,freq=1.0), product of:
              0.6457056 = queryWeight, product of:
                4.8588977 = boost
                9.71698 = idf(docFreq=6, maxDocs=42740)
                0.013676202 = queryNorm
              0.60731125 = fieldWeight in 4457, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.71698 = idf(docFreq=6, maxDocs=42740)
                0.0625 = fieldNorm(doc=4457)
        0.32 = coord(8/25)
    
  4. Yang, C.C.; Li, K.W.: ¬A heuristic method based on a statistical approach for chinese text segmentation (2005) 0.27
    0.26954746 = sum of:
      0.26954746 = product of:
        0.8423359 = sum of:
          0.0118136555 = weight(abstract_txt:with in 581) [ClassicSimilarity], result of:
            0.0118136555 = score(doc=581,freq=3.0), product of:
              0.043346405 = queryWeight, product of:
                1.2589167 = boost
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.013676202 = queryNorm
              0.2725406 = fieldWeight in 581, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0625 = fieldNorm(doc=581)
          0.012887005 = weight(abstract_txt:more in 581) [ClassicSimilarity], result of:
            0.012887005 = score(doc=581,freq=1.0), product of:
              0.06019019 = queryWeight, product of:
                1.2847362 = boost
                3.4256759 = idf(docFreq=3778, maxDocs=42740)
                0.013676202 = queryNorm
              0.21410474 = fieldWeight in 581, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4256759 = idf(docFreq=3778, maxDocs=42740)
                0.0625 = fieldNorm(doc=581)
          0.026211781 = weight(abstract_txt:indexing in 581) [ClassicSimilarity], result of:
            0.026211781 = score(doc=581,freq=1.0), product of:
              0.09662483 = queryWeight, product of:
                1.6277791 = boost
                4.34038 = idf(docFreq=1513, maxDocs=42740)
                0.013676202 = queryNorm
              0.27127376 = fieldWeight in 581, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.34038 = idf(docFreq=1513, maxDocs=42740)
                0.0625 = fieldNorm(doc=581)
          0.084697135 = weight(abstract_txt:characters in 581) [ClassicSimilarity], result of:
            0.084697135 = score(doc=581,freq=1.0), product of:
              0.18449011 = queryWeight, product of:
                1.8365046 = boost
                7.3454022 = idf(docFreq=74, maxDocs=42740)
                0.013676202 = queryNorm
              0.45908764 = fieldWeight in 581, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3454022 = idf(docFreq=74, maxDocs=42740)
                0.0625 = fieldNorm(doc=581)
          0.31913716 = weight(abstract_txt:segmentation in 581) [ClassicSimilarity], result of:
            0.31913716 = score(doc=581,freq=9.0), product of:
              0.2147656 = queryWeight, product of:
                1.9814714 = boost
                7.925221 = idf(docFreq=41, maxDocs=42740)
                0.013676202 = queryNorm
              1.485979 = fieldWeight in 581, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                7.925221 = idf(docFreq=41, maxDocs=42740)
                0.0625 = fieldNorm(doc=581)
          0.24506296 = weight(abstract_txt:chinese in 581) [ClassicSimilarity], result of:
            0.24506296 = score(doc=581,freq=9.0), product of:
              0.20615569 = queryWeight, product of:
                2.3776546 = boost
                6.3398805 = idf(docFreq=204, maxDocs=42740)
                0.013676202 = queryNorm
              1.1887276 = fieldWeight in 581, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                6.3398805 = idf(docFreq=204, maxDocs=42740)
                0.0625 = fieldNorm(doc=581)
          0.098080814 = weight(abstract_txt:word in 581) [ClassicSimilarity], result of:
            0.098080814 = score(doc=581,freq=2.0), product of:
              0.2034464 = queryWeight, product of:
                2.7273788 = boost
                5.4543004 = idf(docFreq=496, maxDocs=42740)
                0.013676202 = queryNorm
              0.48209658 = fieldWeight in 581, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.4543004 = idf(docFreq=496, maxDocs=42740)
                0.0625 = fieldNorm(doc=581)
          0.044445414 = weight(abstract_txt:retrieval in 581) [ClassicSimilarity], result of:
            0.044445414 = score(doc=581,freq=1.0), product of:
              0.20524313 = queryWeight, product of:
                4.331365 = boost
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.013676202 = queryNorm
              0.21655008 = fieldWeight in 581, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4648013 = idf(docFreq=3633, maxDocs=42740)
                0.0625 = fieldNorm(doc=581)
        0.32 = coord(8/25)
    
  5. Khoo, C.S.G.; Dai, D.; Loh, T.E.: Using statistical and contextual information to identify two- and three-character words in Chinese text (2002) 0.26
    0.2562625 = sum of:
      0.2562625 = product of:
        0.80082035 = sum of:
          0.009645809 = weight(abstract_txt:with in 207) [ClassicSimilarity], result of:
            0.009645809 = score(doc=207,freq=2.0), product of:
              0.043346405 = queryWeight, product of:
                1.2589167 = boost
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.013676202 = queryNorm
              0.22252847 = fieldWeight in 207, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.5176222 = idf(docFreq=9369, maxDocs=42740)
                0.0625 = fieldNorm(doc=207)
          0.018224977 = weight(abstract_txt:more in 207) [ClassicSimilarity], result of:
            0.018224977 = score(doc=207,freq=2.0), product of:
              0.06019019 = queryWeight, product of:
                1.2847362 = boost
                3.4256759 = idf(docFreq=3778, maxDocs=42740)
                0.013676202 = queryNorm
              0.30278984 = fieldWeight in 207, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4256759 = idf(docFreq=3778, maxDocs=42740)
                0.0625 = fieldNorm(doc=207)
          0.009269747 = weight(abstract_txt:from in 207) [ClassicSimilarity], result of:
            0.009269747 = score(doc=207,freq=1.0), product of:
              0.05318419 = queryWeight, product of:
                1.3944782 = boost
                2.7887225 = idf(docFreq=7144, maxDocs=42740)
                0.013676202 = queryNorm
              0.17429516 = fieldWeight in 207, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.7887225 = idf(docFreq=7144, maxDocs=42740)
                0.0625 = fieldNorm(doc=207)
          0.14556494 = weight(abstract_txt:character in 207) [ClassicSimilarity], result of:
            0.14556494 = score(doc=207,freq=6.0), product of:
              0.14567378 = queryWeight, product of:
                1.6319098 = boost
                6.527092 = idf(docFreq=169, maxDocs=42740)
                0.013676202 = queryNorm
              0.99925286 = fieldWeight in 207, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                6.527092 = idf(docFreq=169, maxDocs=42740)
                0.0625 = fieldNorm(doc=207)
          0.14669973 = weight(abstract_txt:characters in 207) [ClassicSimilarity], result of:
            0.14669973 = score(doc=207,freq=3.0), product of:
              0.18449011 = queryWeight, product of:
                1.8365046 = boost
                7.3454022 = idf(docFreq=74, maxDocs=42740)
                0.013676202 = queryNorm
              0.7951631 = fieldWeight in 207, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                7.3454022 = idf(docFreq=74, maxDocs=42740)
                0.0625 = fieldNorm(doc=207)
          0.2605744 = weight(abstract_txt:segmentation in 207) [ClassicSimilarity], result of:
            0.2605744 = score(doc=207,freq=6.0), product of:
              0.2147656 = queryWeight, product of:
                1.9814714 = boost
                7.925221 = idf(docFreq=41, maxDocs=42740)
                0.013676202 = queryNorm
              1.2132968 = fieldWeight in 207, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                7.925221 = idf(docFreq=41, maxDocs=42740)
                0.0625 = fieldNorm(doc=207)
          0.14148717 = weight(abstract_txt:chinese in 207) [ClassicSimilarity], result of:
            0.14148717 = score(doc=207,freq=3.0), product of:
              0.20615569 = queryWeight, product of:
                2.3776546 = boost
                6.3398805 = idf(docFreq=204, maxDocs=42740)
                0.013676202 = queryNorm
              0.6863122 = fieldWeight in 207, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.3398805 = idf(docFreq=204, maxDocs=42740)
                0.0625 = fieldNorm(doc=207)
          0.06935361 = weight(abstract_txt:word in 207) [ClassicSimilarity], result of:
            0.06935361 = score(doc=207,freq=1.0), product of:
              0.2034464 = queryWeight, product of:
                2.7273788 = boost
                5.4543004 = idf(docFreq=496, maxDocs=42740)
                0.013676202 = queryNorm
              0.34089378 = fieldWeight in 207, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4543004 = idf(docFreq=496, maxDocs=42740)
                0.0625 = fieldNorm(doc=207)
        0.32 = coord(8/25)