Document (#21772)

Author
Kwok, K.L.
Title
Employing multiple representations for Chinese information retrieval
Source
Journal of the American Society for Information Science. 50(1999) no.8, S.709-723
Year
1999
Abstract
For information retrieval in the Chinese language, 3 representation methods for texts are popular, namely: 1-gram or character, bigram, and short-word. Each has its advantages as well as drawbacks. Employing more than one method may combine advantages from them and enhance retrieval effectiveness. We investigated 2 ways of using them simultaneously: mixing representations in documents and queries, and combining retrieval lists obtained via different representations. The experiments were done with the 170 MB evaluated Chinese corpora and 54 long and short queries available from the TREC program and using our Probabilistic Indexing and Retrieval Components System (PIRCS retrieval system). Experiments show that good retrieval need not depend on accurate word segmentation; approximate segmentation into short-words will do. Results also show and confirm that bigram representation alone works well; mixing characters with bigram representation boosts effectiveness further, but it is preferable to mix characters with short-word indexing which is more efficient, needs less resource, and gives better retrieval more often. Cobining retrieval lists from short-word with character representation and from bigram indexing provides the best retrieval results but also at a substabtial cost

Similar documents (author)

  1. Kwok, K.L.: ¬The use of titles and cited titles as document representations for automatic classification (1975) 5.61
    5.608596 = sum of:
      5.608596 = weight(author_txt:kwok in 4346) [ClassicSimilarity], result of:
        5.608596 = fieldWeight in 4346, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.973753 = idf(docFreq=14, maxDocs=43556)
          0.625 = fieldNorm(doc=4346)
    
  2. Kwok, K.L.: ¬A network approach to probabilistic information retrieval (1995) 5.61
    5.608596 = sum of:
      5.608596 = weight(author_txt:kwok in 694) [ClassicSimilarity], result of:
        5.608596 = fieldWeight in 694, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.973753 = idf(docFreq=14, maxDocs=43556)
          0.625 = fieldNorm(doc=694)
    
  3. Kwok, K.L.: Improving English and Chinese ad-hoc retrieval : a TIPSTER text phase 3 project report (2000) 5.61
    5.608596 = sum of:
      5.608596 = weight(author_txt:kwok in 386) [ClassicSimilarity], result of:
        5.608596 = fieldWeight in 386, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.973753 = idf(docFreq=14, maxDocs=43556)
          0.625 = fieldNorm(doc=386)
    
  4. Kwok, K.L.; Grunfeld, L.: TREC-4 ad-hoc, routing retrieval and filtering experiments using PIRCS (1996) 4.49
    4.4868765 = sum of:
      4.4868765 = weight(author_txt:kwok in 628) [ClassicSimilarity], result of:
        4.4868765 = fieldWeight in 628, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.973753 = idf(docFreq=14, maxDocs=43556)
          0.5 = fieldNorm(doc=628)
    
  5. Kwok, K.L.; Grunfeld, L.: TREC-5 English and Chinese retrieval experiments using PIRCS (1997) 4.49
    4.4868765 = sum of:
      4.4868765 = weight(author_txt:kwok in 4100) [ClassicSimilarity], result of:
        4.4868765 = fieldWeight in 4100, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.973753 = idf(docFreq=14, maxDocs=43556)
          0.5 = fieldNorm(doc=4100)
    

Similar documents (content)

  1. Wang, F.L.; Yang, C.C.: Mining Web data for Chinese segmentation (2007) 0.35
    0.3530688 = sum of:
      0.3530688 = product of:
        0.882672 = sum of:
          0.01860985 = weight(abstract_txt:show in 2602) [ClassicSimilarity], result of:
            0.01860985 = score(doc=2602,freq=1.0), product of:
              0.06715312 = queryWeight, product of:
                1.1129221 = boost
                4.43401 = idf(docFreq=1404, maxDocs=43556)
                0.013608327 = queryNorm
              0.27712563 = fieldWeight in 2602, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.43401 = idf(docFreq=1404, maxDocs=43556)
                0.0625 = fieldNorm(doc=2602)
          0.00953269 = weight(abstract_txt:with in 2602) [ClassicSimilarity], result of:
            0.00953269 = score(doc=2602,freq=2.0), product of:
              0.042991366 = queryWeight, product of:
                1.2593235 = boost
                2.508645 = idf(docFreq=9634, maxDocs=43556)
                0.013608327 = queryNorm
              0.22173499 = fieldWeight in 2602, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.508645 = idf(docFreq=9634, maxDocs=43556)
                0.0625 = fieldNorm(doc=2602)
          0.03253335 = weight(abstract_txt:experiments in 2602) [ClassicSimilarity], result of:
            0.03253335 = score(doc=2602,freq=1.0), product of:
              0.097451866 = queryWeight, product of:
                1.340685 = boost
                5.3414435 = idf(docFreq=566, maxDocs=43556)
                0.013608327 = queryNorm
              0.33384022 = fieldWeight in 2602, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.3414435 = idf(docFreq=566, maxDocs=43556)
                0.0625 = fieldNorm(doc=2602)
          0.009149189 = weight(abstract_txt:from in 2602) [ClassicSimilarity], result of:
            0.009149189 = score(doc=2602,freq=1.0), product of:
              0.05270308 = queryWeight, product of:
                1.3943272 = boost
                2.77758 = idf(docFreq=7362, maxDocs=43556)
                0.013608327 = queryNorm
              0.17359875 = fieldWeight in 2602, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.77758 = idf(docFreq=7362, maxDocs=43556)
                0.0625 = fieldNorm(doc=2602)
          0.083344065 = weight(abstract_txt:character in 2602) [ClassicSimilarity], result of:
            0.083344065 = score(doc=2602,freq=2.0), product of:
              0.14481406 = queryWeight, product of:
                1.6343198 = boost
                6.5113187 = idf(docFreq=175, maxDocs=43556)
                0.013608327 = queryNorm
              0.5755247 = fieldWeight in 2602, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.5113187 = idf(docFreq=175, maxDocs=43556)
                0.0625 = fieldNorm(doc=2602)
          0.037244428 = weight(abstract_txt:indexing in 2602) [ClassicSimilarity], result of:
            0.037244428 = score(doc=2602,freq=2.0), product of:
              0.09689445 = queryWeight, product of:
                1.6372943 = boost
                4.3487797 = idf(docFreq=1529, maxDocs=43556)
                0.013608327 = queryNorm
              0.38438144 = fieldWeight in 2602, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.3487797 = idf(docFreq=1529, maxDocs=43556)
                0.0625 = fieldNorm(doc=2602)
          0.3354498 = weight(abstract_txt:segmentation in 2602) [ClassicSimilarity], result of:
            0.3354498 = score(doc=2602,freq=10.0), product of:
              0.21428378 = queryWeight, product of:
                1.9880456 = boost
                7.920603 = idf(docFreq=42, maxDocs=43556)
                0.013608327 = queryNorm
              1.5654466 = fieldWeight in 2602, product of:
                3.1622777 = tf(freq=10.0), with freq of:
                  10.0 = termFreq=10.0
                7.920603 = idf(docFreq=42, maxDocs=43556)
                0.0625 = fieldNorm(doc=2602)
          0.21487845 = weight(abstract_txt:chinese in 2602) [ClassicSimilarity], result of:
            0.21487845 = score(doc=2602,freq=7.0), product of:
              0.20528817 = queryWeight, product of:
                2.3831933 = boost
                6.3299446 = idf(docFreq=210, maxDocs=43556)
                0.013608327 = queryNorm
              1.0467162 = fieldWeight in 2602, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                6.3299446 = idf(docFreq=210, maxDocs=43556)
                0.0625 = fieldNorm(doc=2602)
          0.09718379 = weight(abstract_txt:word in 2602) [ClassicSimilarity], result of:
            0.09718379 = score(doc=2602,freq=2.0), product of:
              0.20213126 = queryWeight, product of:
                2.7306335 = boost
                5.4395795 = idf(docFreq=513, maxDocs=43556)
                0.013608327 = queryNorm
              0.48079544 = fieldWeight in 2602, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.4395795 = idf(docFreq=513, maxDocs=43556)
                0.0625 = fieldNorm(doc=2602)
          0.04474641 = weight(abstract_txt:retrieval in 2602) [ClassicSimilarity], result of:
            0.04474641 = score(doc=2602,freq=1.0), product of:
              0.2060945 = queryWeight, product of:
                4.3596325 = boost
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.013608327 = queryNorm
              0.21711598 = fieldWeight in 2602, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.0625 = fieldNorm(doc=2602)
        0.4 = coord(10/25)
    
  2. Lee, K.H.; Ng, M.K.M.; Lu, Q.: Text segmentation for Chinese spell checking (1999) 0.28
    0.27669674 = sum of:
      0.27669674 = product of:
        0.768602 = sum of:
          0.00953269 = weight(abstract_txt:with in 4911) [ClassicSimilarity], result of:
            0.00953269 = score(doc=4911,freq=2.0), product of:
              0.042991366 = queryWeight, product of:
                1.2593235 = boost
                2.508645 = idf(docFreq=9634, maxDocs=43556)
                0.013608327 = queryNorm
              0.22173499 = fieldWeight in 4911, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.508645 = idf(docFreq=9634, maxDocs=43556)
                0.0625 = fieldNorm(doc=4911)
          0.017960541 = weight(abstract_txt:more in 4911) [ClassicSimilarity], result of:
            0.017960541 = score(doc=4911,freq=2.0), product of:
              0.0595851 = queryWeight, product of:
                1.2839441 = boost
                3.4102545 = idf(docFreq=3910, maxDocs=43556)
                0.013608327 = queryNorm
              0.30142674 = fieldWeight in 4911, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4102545 = idf(docFreq=3910, maxDocs=43556)
                0.0625 = fieldNorm(doc=4911)
          0.03253335 = weight(abstract_txt:experiments in 4911) [ClassicSimilarity], result of:
            0.03253335 = score(doc=4911,freq=1.0), product of:
              0.097451866 = queryWeight, product of:
                1.340685 = boost
                5.3414435 = idf(docFreq=566, maxDocs=43556)
                0.013608327 = queryNorm
              0.33384022 = fieldWeight in 4911, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.3414435 = idf(docFreq=566, maxDocs=43556)
                0.0625 = fieldNorm(doc=4911)
          0.01584686 = weight(abstract_txt:from in 4911) [ClassicSimilarity], result of:
            0.01584686 = score(doc=4911,freq=3.0), product of:
              0.05270308 = queryWeight, product of:
                1.3943272 = boost
                2.77758 = idf(docFreq=7362, maxDocs=43556)
                0.013608327 = queryNorm
              0.30068186 = fieldWeight in 4911, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.77758 = idf(docFreq=7362, maxDocs=43556)
                0.0625 = fieldNorm(doc=4911)
          0.058933154 = weight(abstract_txt:character in 4911) [ClassicSimilarity], result of:
            0.058933154 = score(doc=4911,freq=1.0), product of:
              0.14481406 = queryWeight, product of:
                1.6343198 = boost
                6.5113187 = idf(docFreq=175, maxDocs=43556)
                0.013608327 = queryNorm
              0.40695742 = fieldWeight in 4911, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.5113187 = idf(docFreq=175, maxDocs=43556)
                0.0625 = fieldNorm(doc=4911)
          0.08526089 = weight(abstract_txt:characters in 4911) [ClassicSimilarity], result of:
            0.08526089 = score(doc=4911,freq=1.0), product of:
              0.18524116 = queryWeight, product of:
                1.848419 = boost
                7.3643146 = idf(docFreq=74, maxDocs=43556)
                0.013608327 = queryNorm
              0.46026966 = fieldWeight in 4911, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3643146 = idf(docFreq=74, maxDocs=43556)
                0.0625 = fieldNorm(doc=4911)
          0.21215709 = weight(abstract_txt:segmentation in 4911) [ClassicSimilarity], result of:
            0.21215709 = score(doc=4911,freq=4.0), product of:
              0.21428378 = queryWeight, product of:
                1.9880456 = boost
                7.920603 = idf(docFreq=42, maxDocs=43556)
                0.013608327 = queryNorm
              0.99007535 = fieldWeight in 4911, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                7.920603 = idf(docFreq=42, maxDocs=43556)
                0.0625 = fieldNorm(doc=4911)
          0.1989388 = weight(abstract_txt:chinese in 4911) [ClassicSimilarity], result of:
            0.1989388 = score(doc=4911,freq=6.0), product of:
              0.20528817 = queryWeight, product of:
                2.3831933 = boost
                6.3299446 = idf(docFreq=210, maxDocs=43556)
                0.013608327 = queryNorm
              0.9690709 = fieldWeight in 4911, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                6.3299446 = idf(docFreq=210, maxDocs=43556)
                0.0625 = fieldNorm(doc=4911)
          0.13743863 = weight(abstract_txt:word in 4911) [ClassicSimilarity], result of:
            0.13743863 = score(doc=4911,freq=4.0), product of:
              0.20213126 = queryWeight, product of:
                2.7306335 = boost
                5.4395795 = idf(docFreq=513, maxDocs=43556)
                0.013608327 = queryNorm
              0.67994744 = fieldWeight in 4911, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.4395795 = idf(docFreq=513, maxDocs=43556)
                0.0625 = fieldNorm(doc=4911)
        0.36 = coord(9/25)
    
  3. Chau, M.; Lu, Y.; Fang, X.; Yang, C.C.: Characteristics of character usage in Chinese Web searching (2009) 0.27
    0.2716336 = sum of:
      0.2716336 = product of:
        0.848855 = sum of:
          0.013481259 = weight(abstract_txt:with in 4454) [ClassicSimilarity], result of:
            0.013481259 = score(doc=4454,freq=4.0), product of:
              0.042991366 = queryWeight, product of:
                1.2593235 = boost
                2.508645 = idf(docFreq=9634, maxDocs=43556)
                0.013608327 = queryNorm
              0.31358063 = fieldWeight in 4454, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.508645 = idf(docFreq=9634, maxDocs=43556)
                0.0625 = fieldNorm(doc=4454)
          0.04000994 = weight(abstract_txt:queries in 4454) [ClassicSimilarity], result of:
            0.04000994 = score(doc=4454,freq=2.0), product of:
              0.088784985 = queryWeight, product of:
                1.2796801 = boost
                5.0983934 = idf(docFreq=722, maxDocs=43556)
                0.013608327 = queryNorm
              0.45063856 = fieldWeight in 4454, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.0983934 = idf(docFreq=722, maxDocs=43556)
                0.0625 = fieldNorm(doc=4454)
          0.017960541 = weight(abstract_txt:more in 4454) [ClassicSimilarity], result of:
            0.017960541 = score(doc=4454,freq=2.0), product of:
              0.0595851 = queryWeight, product of:
                1.2839441 = boost
                3.4102545 = idf(docFreq=3910, maxDocs=43556)
                0.013608327 = queryNorm
              0.30142674 = fieldWeight in 4454, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4102545 = idf(docFreq=3910, maxDocs=43556)
                0.0625 = fieldNorm(doc=4454)
          0.01584686 = weight(abstract_txt:from in 4454) [ClassicSimilarity], result of:
            0.01584686 = score(doc=4454,freq=3.0), product of:
              0.05270308 = queryWeight, product of:
                1.3943272 = boost
                2.77758 = idf(docFreq=7362, maxDocs=43556)
                0.013608327 = queryNorm
              0.30068186 = fieldWeight in 4454, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.77758 = idf(docFreq=7362, maxDocs=43556)
                0.0625 = fieldNorm(doc=4454)
          0.083344065 = weight(abstract_txt:character in 4454) [ClassicSimilarity], result of:
            0.083344065 = score(doc=4454,freq=2.0), product of:
              0.14481406 = queryWeight, product of:
                1.6343198 = boost
                6.5113187 = idf(docFreq=175, maxDocs=43556)
                0.013608327 = queryNorm
              0.5755247 = fieldWeight in 4454, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.5113187 = idf(docFreq=175, maxDocs=43556)
                0.0625 = fieldNorm(doc=4454)
          0.08526089 = weight(abstract_txt:characters in 4454) [ClassicSimilarity], result of:
            0.08526089 = score(doc=4454,freq=1.0), product of:
              0.18524116 = queryWeight, product of:
                1.848419 = boost
                7.3643146 = idf(docFreq=74, maxDocs=43556)
                0.013608327 = queryNorm
              0.46026966 = fieldWeight in 4454, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3643146 = idf(docFreq=74, maxDocs=43556)
                0.0625 = fieldNorm(doc=4454)
          0.1989388 = weight(abstract_txt:chinese in 4454) [ClassicSimilarity], result of:
            0.1989388 = score(doc=4454,freq=6.0), product of:
              0.20528817 = queryWeight, product of:
                2.3831933 = boost
                6.3299446 = idf(docFreq=210, maxDocs=43556)
                0.013608327 = queryNorm
              0.9690709 = fieldWeight in 4454, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                6.3299446 = idf(docFreq=210, maxDocs=43556)
                0.0625 = fieldNorm(doc=4454)
          0.39401263 = weight(abstract_txt:bigram in 4454) [ClassicSimilarity], result of:
            0.39401263 = score(doc=4454,freq=1.0), product of:
              0.64752173 = queryWeight, product of:
                4.887355 = boost
                9.735892 = idf(docFreq=6, maxDocs=43556)
                0.013608327 = queryNorm
              0.60849327 = fieldWeight in 4454, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.735892 = idf(docFreq=6, maxDocs=43556)
                0.0625 = fieldNorm(doc=4454)
        0.32 = coord(8/25)
    
  4. Yang, C.C.; Li, K.W.: ¬A heuristic method based on a statistical approach for chinese text segmentation (2005) 0.27
    0.2687318 = sum of:
      0.2687318 = product of:
        0.8397869 = sum of:
          0.011675113 = weight(abstract_txt:with in 578) [ClassicSimilarity], result of:
            0.011675113 = score(doc=578,freq=3.0), product of:
              0.042991366 = queryWeight, product of:
                1.2593235 = boost
                2.508645 = idf(docFreq=9634, maxDocs=43556)
                0.013608327 = queryNorm
              0.27156878 = fieldWeight in 578, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.508645 = idf(docFreq=9634, maxDocs=43556)
                0.0625 = fieldNorm(doc=578)
          0.012700022 = weight(abstract_txt:more in 578) [ClassicSimilarity], result of:
            0.012700022 = score(doc=578,freq=1.0), product of:
              0.0595851 = queryWeight, product of:
                1.2839441 = boost
                3.4102545 = idf(docFreq=3910, maxDocs=43556)
                0.013608327 = queryNorm
              0.2131409 = fieldWeight in 578, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4102545 = idf(docFreq=3910, maxDocs=43556)
                0.0625 = fieldNorm(doc=578)
          0.026335789 = weight(abstract_txt:indexing in 578) [ClassicSimilarity], result of:
            0.026335789 = score(doc=578,freq=1.0), product of:
              0.09689445 = queryWeight, product of:
                1.6372943 = boost
                4.3487797 = idf(docFreq=1529, maxDocs=43556)
                0.013608327 = queryNorm
              0.27179873 = fieldWeight in 578, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.3487797 = idf(docFreq=1529, maxDocs=43556)
                0.0625 = fieldNorm(doc=578)
          0.08526089 = weight(abstract_txt:characters in 578) [ClassicSimilarity], result of:
            0.08526089 = score(doc=578,freq=1.0), product of:
              0.18524116 = queryWeight, product of:
                1.848419 = boost
                7.3643146 = idf(docFreq=74, maxDocs=43556)
                0.013608327 = queryNorm
              0.46026966 = fieldWeight in 578, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3643146 = idf(docFreq=74, maxDocs=43556)
                0.0625 = fieldNorm(doc=578)
          0.31823564 = weight(abstract_txt:segmentation in 578) [ClassicSimilarity], result of:
            0.31823564 = score(doc=578,freq=9.0), product of:
              0.21428378 = queryWeight, product of:
                1.9880456 = boost
                7.920603 = idf(docFreq=42, maxDocs=43556)
                0.013608327 = queryNorm
              1.485113 = fieldWeight in 578, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                7.920603 = idf(docFreq=42, maxDocs=43556)
                0.0625 = fieldNorm(doc=578)
          0.24364927 = weight(abstract_txt:chinese in 578) [ClassicSimilarity], result of:
            0.24364927 = score(doc=578,freq=9.0), product of:
              0.20528817 = queryWeight, product of:
                2.3831933 = boost
                6.3299446 = idf(docFreq=210, maxDocs=43556)
                0.013608327 = queryNorm
              1.1868646 = fieldWeight in 578, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                6.3299446 = idf(docFreq=210, maxDocs=43556)
                0.0625 = fieldNorm(doc=578)
          0.09718379 = weight(abstract_txt:word in 578) [ClassicSimilarity], result of:
            0.09718379 = score(doc=578,freq=2.0), product of:
              0.20213126 = queryWeight, product of:
                2.7306335 = boost
                5.4395795 = idf(docFreq=513, maxDocs=43556)
                0.013608327 = queryNorm
              0.48079544 = fieldWeight in 578, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.4395795 = idf(docFreq=513, maxDocs=43556)
                0.0625 = fieldNorm(doc=578)
          0.04474641 = weight(abstract_txt:retrieval in 578) [ClassicSimilarity], result of:
            0.04474641 = score(doc=578,freq=1.0), product of:
              0.2060945 = queryWeight, product of:
                4.3596325 = boost
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.013608327 = queryNorm
              0.21711598 = fieldWeight in 578, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.0625 = fieldNorm(doc=578)
        0.32 = coord(8/25)
    
  5. Khoo, C.S.G.; Dai, D.; Loh, T.E.: Using statistical and contextual information to identify two- and three-character words in Chinese text (2002) 0.26
    0.25532907 = sum of:
      0.25532907 = product of:
        0.79790336 = sum of:
          0.00953269 = weight(abstract_txt:with in 204) [ClassicSimilarity], result of:
            0.00953269 = score(doc=204,freq=2.0), product of:
              0.042991366 = queryWeight, product of:
                1.2593235 = boost
                2.508645 = idf(docFreq=9634, maxDocs=43556)
                0.013608327 = queryNorm
              0.22173499 = fieldWeight in 204, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.508645 = idf(docFreq=9634, maxDocs=43556)
                0.0625 = fieldNorm(doc=204)
          0.017960541 = weight(abstract_txt:more in 204) [ClassicSimilarity], result of:
            0.017960541 = score(doc=204,freq=2.0), product of:
              0.0595851 = queryWeight, product of:
                1.2839441 = boost
                3.4102545 = idf(docFreq=3910, maxDocs=43556)
                0.013608327 = queryNorm
              0.30142674 = fieldWeight in 204, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4102545 = idf(docFreq=3910, maxDocs=43556)
                0.0625 = fieldNorm(doc=204)
          0.009149189 = weight(abstract_txt:from in 204) [ClassicSimilarity], result of:
            0.009149189 = score(doc=204,freq=1.0), product of:
              0.05270308 = queryWeight, product of:
                1.3943272 = boost
                2.77758 = idf(docFreq=7362, maxDocs=43556)
                0.013608327 = queryNorm
              0.17359875 = fieldWeight in 204, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.77758 = idf(docFreq=7362, maxDocs=43556)
                0.0625 = fieldNorm(doc=204)
          0.14435616 = weight(abstract_txt:character in 204) [ClassicSimilarity], result of:
            0.14435616 = score(doc=204,freq=6.0), product of:
              0.14481406 = queryWeight, product of:
                1.6343198 = boost
                6.5113187 = idf(docFreq=175, maxDocs=43556)
                0.013608327 = queryNorm
              0.99683803 = fieldWeight in 204, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                6.5113187 = idf(docFreq=175, maxDocs=43556)
                0.0625 = fieldNorm(doc=204)
          0.14767618 = weight(abstract_txt:characters in 204) [ClassicSimilarity], result of:
            0.14767618 = score(doc=204,freq=3.0), product of:
              0.18524116 = queryWeight, product of:
                1.848419 = boost
                7.3643146 = idf(docFreq=74, maxDocs=43556)
                0.013608327 = queryNorm
              0.7972104 = fieldWeight in 204, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                7.3643146 = idf(docFreq=74, maxDocs=43556)
                0.0625 = fieldNorm(doc=204)
          0.2598383 = weight(abstract_txt:segmentation in 204) [ClassicSimilarity], result of:
            0.2598383 = score(doc=204,freq=6.0), product of:
              0.21428378 = queryWeight, product of:
                1.9880456 = boost
                7.920603 = idf(docFreq=42, maxDocs=43556)
                0.013608327 = queryNorm
              1.2125897 = fieldWeight in 204, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                7.920603 = idf(docFreq=42, maxDocs=43556)
                0.0625 = fieldNorm(doc=204)
          0.14067097 = weight(abstract_txt:chinese in 204) [ClassicSimilarity], result of:
            0.14067097 = score(doc=204,freq=3.0), product of:
              0.20528817 = queryWeight, product of:
                2.3831933 = boost
                6.3299446 = idf(docFreq=210, maxDocs=43556)
                0.013608327 = queryNorm
              0.6852366 = fieldWeight in 204, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.3299446 = idf(docFreq=210, maxDocs=43556)
                0.0625 = fieldNorm(doc=204)
          0.06871931 = weight(abstract_txt:word in 204) [ClassicSimilarity], result of:
            0.06871931 = score(doc=204,freq=1.0), product of:
              0.20213126 = queryWeight, product of:
                2.7306335 = boost
                5.4395795 = idf(docFreq=513, maxDocs=43556)
                0.013608327 = queryNorm
              0.33997372 = fieldWeight in 204, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4395795 = idf(docFreq=513, maxDocs=43556)
                0.0625 = fieldNorm(doc=204)
        0.32 = coord(8/25)