Document (#34457)

Author
Chau, M.
Lu, Y.
Fang, X.
Yang, C.C.
Title
Characteristics of character usage in Chinese Web searching
Source
Information processing and management. 45(2009) no.1, S.115-130
Year
2009
Abstract
The use of non-English Web search engines has been prevalent. Given the popularity of Chinese Web searching and the unique characteristics of Chinese language, it is imperative to conduct studies with focuses on the analysis of Chinese Web search queries. In this paper, we report our research on the character usage of Chinese search logs from a Web search engine in Hong Kong. By examining the distribution of search query terms, we found that users tended to use more diversified terms and that the usage of characters in search queries was quite different from the character usage of general online information in Chinese. After studying the Zipf distribution of n-grams with different values of n, we found that the curve of unigram is the most curved one of all while the bigram curve follows the Zipf distribution best, and that the curves of n-grams with larger n (n = 3-6) had similar structures with ?-values in the range of 0.66-0.86. The distribution of combined n-grams was also studied. All the analyses are performed on the data both before and after the removal of function terms and incomplete terms and similar findings are revealed. We believe the findings from this study have provided some insights into further research in non-English Web searching and will assist in the design of more effective Chinese Web search engines.

Similar documents (author)

  1. Chau, M.; Fang, X.; Sheng, O.R.U.: Analysis of the query logs of a Web site search engine (2005) 2.83
    2.826579 = sum of:
      2.826579 = product of:
        4.2398686 = sum of:
          1.842761 = weight(author_txt:fang in 4573) [ClassicSimilarity], result of:
            1.842761 = score(doc=4573,freq=1.0), product of:
              0.58231443 = queryWeight, product of:
                1.17253 = boost
                8.43879 = idf(docFreq=25, maxDocs=44218)
                0.058850937 = queryNorm
              3.1645465 = fieldWeight in 4573, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.43879 = idf(docFreq=25, maxDocs=44218)
                0.375 = fieldNorm(doc=4573)
          2.3971076 = weight(author_txt:chau in 4573) [ClassicSimilarity], result of:
            2.3971076 = score(doc=4573,freq=1.0), product of:
              0.6939101 = queryWeight, product of:
                1.2799612 = boost
                9.211981 = idf(docFreq=11, maxDocs=44218)
                0.058850937 = queryNorm
              3.4544928 = fieldWeight in 4573, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.211981 = idf(docFreq=11, maxDocs=44218)
                0.375 = fieldNorm(doc=4573)
        0.6666667 = coord(2/3)
    
  2. Chau, M.; Fang, X.; Rittman, C.C.: Web searching in Chinese : a study of a search engine in Hong Kong (2007) 2.83
    2.826579 = sum of:
      2.826579 = product of:
        4.2398686 = sum of:
          1.842761 = weight(author_txt:fang in 336) [ClassicSimilarity], result of:
            1.842761 = score(doc=336,freq=1.0), product of:
              0.58231443 = queryWeight, product of:
                1.17253 = boost
                8.43879 = idf(docFreq=25, maxDocs=44218)
                0.058850937 = queryNorm
              3.1645465 = fieldWeight in 336, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.43879 = idf(docFreq=25, maxDocs=44218)
                0.375 = fieldNorm(doc=336)
          2.3971076 = weight(author_txt:chau in 336) [ClassicSimilarity], result of:
            2.3971076 = score(doc=336,freq=1.0), product of:
              0.6939101 = queryWeight, product of:
                1.2799612 = boost
                9.211981 = idf(docFreq=11, maxDocs=44218)
                0.058850937 = queryNorm
              3.4544928 = fieldWeight in 336, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.211981 = idf(docFreq=11, maxDocs=44218)
                0.375 = fieldNorm(doc=336)
        0.6666667 = coord(2/3)
    
  3. Chau, M.Y.: Finding order in a chaotic world : a model for organized research using the World Wide Web (1997) 1.33
    1.3317266 = sum of:
      1.3317266 = product of:
        3.9951794 = sum of:
          3.9951794 = weight(author_txt:chau in 529) [ClassicSimilarity], result of:
            3.9951794 = score(doc=529,freq=1.0), product of:
              0.6939101 = queryWeight, product of:
                1.2799612 = boost
                9.211981 = idf(docFreq=11, maxDocs=44218)
                0.058850937 = queryNorm
              5.7574883 = fieldWeight in 529, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.211981 = idf(docFreq=11, maxDocs=44218)
                0.625 = fieldNorm(doc=529)
        0.33333334 = coord(1/3)
    
  4. Chen, H.; Chau, M.: Web mining : machine learning for Web applications (2003) 1.07
    1.0653812 = sum of:
      1.0653812 = product of:
        3.1961434 = sum of:
          3.1961434 = weight(author_txt:chau in 4242) [ClassicSimilarity], result of:
            3.1961434 = score(doc=4242,freq=1.0), product of:
              0.6939101 = queryWeight, product of:
                1.2799612 = boost
                9.211981 = idf(docFreq=11, maxDocs=44218)
                0.058850937 = queryNorm
              4.6059904 = fieldWeight in 4242, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.211981 = idf(docFreq=11, maxDocs=44218)
                0.5 = fieldNorm(doc=4242)
        0.33333334 = coord(1/3)
    
  5. Fang, L.: ¬A developing search service : heterogeneous resources integration and retrieval system (2004) 1.02
    1.0237561 = sum of:
      1.0237561 = product of:
        3.0712683 = sum of:
          3.0712683 = weight(author_txt:fang in 1193) [ClassicSimilarity], result of:
            3.0712683 = score(doc=1193,freq=1.0), product of:
              0.58231443 = queryWeight, product of:
                1.17253 = boost
                8.43879 = idf(docFreq=25, maxDocs=44218)
                0.058850937 = queryNorm
              5.274244 = fieldWeight in 1193, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.43879 = idf(docFreq=25, maxDocs=44218)
                0.625 = fieldNorm(doc=1193)
        0.33333334 = coord(1/3)
    

Similar documents (content)

  1. Chau, M.; Fang, X.; Rittman, C.C.: Web searching in Chinese : a study of a search engine in Hong Kong (2007) 0.57
    0.5739399 = sum of:
      0.5739399 = product of:
        1.1037307 = sum of:
          0.07335033 = weight(abstract_txt:hong in 336) [ClassicSimilarity], result of:
            0.07335033 = score(doc=336,freq=1.0), product of:
              0.13776597 = queryWeight, product of:
                1.01402 = boost
                8.518833 = idf(docFreq=23, maxDocs=44218)
                0.015948335 = queryNorm
              0.5324271 = fieldWeight in 336, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.518833 = idf(docFreq=23, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
          0.07335033 = weight(abstract_txt:kong in 336) [ClassicSimilarity], result of:
            0.07335033 = score(doc=336,freq=1.0), product of:
              0.13776597 = queryWeight, product of:
                1.01402 = boost
                8.518833 = idf(docFreq=23, maxDocs=44218)
                0.015948335 = queryNorm
              0.5324271 = fieldWeight in 336, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.518833 = idf(docFreq=23, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
          0.012627234 = weight(abstract_txt:that in 336) [ClassicSimilarity], result of:
            0.012627234 = score(doc=336,freq=4.0), product of:
              0.042633016 = queryWeight, product of:
                1.1281804 = boost
                2.3694751 = idf(docFreq=11241, maxDocs=44218)
                0.015948335 = queryNorm
              0.2961844 = fieldWeight in 336, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.3694751 = idf(docFreq=11241, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
          0.03900377 = weight(abstract_txt:characteristics in 336) [ClassicSimilarity], result of:
            0.03900377 = score(doc=336,freq=2.0), product of:
              0.090422876 = queryWeight, product of:
                1.1617955 = boost
                4.8801513 = idf(docFreq=912, maxDocs=44218)
                0.015948335 = queryNorm
              0.4313485 = fieldWeight in 336, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.8801513 = idf(docFreq=912, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
          0.05473238 = weight(abstract_txt:queries in 336) [ClassicSimilarity], result of:
            0.05473238 = score(doc=336,freq=3.0), product of:
              0.099008635 = queryWeight, product of:
                1.2157018 = boost
                5.106586 = idf(docFreq=727, maxDocs=44218)
                0.015948335 = queryNorm
              0.5528041 = fieldWeight in 336, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.106586 = idf(docFreq=727, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
          0.033572722 = weight(abstract_txt:similar in 336) [ClassicSimilarity], result of:
            0.033572722 = score(doc=336,freq=1.0), product of:
              0.103088036 = queryWeight, product of:
                1.240494 = boost
                5.2107263 = idf(docFreq=655, maxDocs=44218)
                0.015948335 = queryNorm
              0.3256704 = fieldWeight in 336, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.2107263 = idf(docFreq=655, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
          0.050007362 = weight(abstract_txt:engines in 336) [ClassicSimilarity], result of:
            0.050007362 = score(doc=336,freq=2.0), product of:
              0.10671608 = queryWeight, product of:
                1.262134 = boost
                5.3016257 = idf(docFreq=598, maxDocs=44218)
                0.015948335 = queryNorm
              0.46860194 = fieldWeight in 336, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.3016257 = idf(docFreq=598, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
          0.09191149 = weight(abstract_txt:english in 336) [ClassicSimilarity], result of:
            0.09191149 = score(doc=336,freq=5.0), product of:
              0.117979646 = queryWeight, product of:
                1.3270707 = boost
                5.574394 = idf(docFreq=455, maxDocs=44218)
                0.015948335 = queryNorm
              0.7790453 = fieldWeight in 336, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.574394 = idf(docFreq=455, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
          0.027999643 = weight(abstract_txt:searching in 336) [ClassicSimilarity], result of:
            0.027999643 = score(doc=336,freq=1.0), product of:
              0.10455608 = queryWeight, product of:
                1.5300683 = boost
                4.284727 = idf(docFreq=1655, maxDocs=44218)
                0.015948335 = queryNorm
              0.26779544 = fieldWeight in 336, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.284727 = idf(docFreq=1655, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
          0.1392073 = weight(abstract_txt:character in 336) [ClassicSimilarity], result of:
            0.1392073 = score(doc=336,freq=2.0), product of:
              0.24173841 = queryWeight, product of:
                2.3265316 = boost
                6.515104 = idf(docFreq=177, maxDocs=44218)
                0.015948335 = queryNorm
              0.57585925 = fieldWeight in 336, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.515104 = idf(docFreq=177, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
          0.0852559 = weight(abstract_txt:usage in 336) [ClassicSimilarity], result of:
            0.0852559 = score(doc=336,freq=1.0), product of:
              0.24175578 = queryWeight, product of:
                2.686544 = boost
                5.642448 = idf(docFreq=425, maxDocs=44218)
                0.015948335 = queryNorm
              0.352653 = fieldWeight in 336, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.642448 = idf(docFreq=425, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
          0.12856111 = weight(abstract_txt:search in 336) [ClassicSimilarity], result of:
            0.12856111 = score(doc=336,freq=10.0), product of:
              0.17781961 = queryWeight, product of:
                3.0479958 = boost
                3.6580524 = idf(docFreq=3098, maxDocs=44218)
                0.015948335 = queryNorm
              0.7229861 = fieldWeight in 336, product of:
                3.1622777 = tf(freq=10.0), with freq of:
                  10.0 = termFreq=10.0
                3.6580524 = idf(docFreq=3098, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
          0.29415104 = weight(abstract_txt:chinese in 336) [ClassicSimilarity], result of:
            0.29415104 = score(doc=336,freq=2.0), product of:
              0.52797115 = queryWeight, product of:
                5.2520595 = boost
                6.30326 = idf(docFreq=219, maxDocs=44218)
                0.015948335 = queryNorm
              0.5571347 = fieldWeight in 336, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.30326 = idf(docFreq=219, maxDocs=44218)
                0.0625 = fieldNorm(doc=336)
        0.52 = coord(13/25)
    
  2. Chung, W.; Zhang, Y.; Huang, Z.; Wang, G.; Ong, T.-H.; Chen, H.: Internet searching and browsing in a multilingual world : an experiment an the Chinese Business Intelligence Portal (CBizPort) (2004) 0.33
    0.3278924 = sum of:
      0.3278924 = product of:
        0.91081214 = sum of:
          0.07335033 = weight(abstract_txt:hong in 2393) [ClassicSimilarity], result of:
            0.07335033 = score(doc=2393,freq=1.0), product of:
              0.13776597 = queryWeight, product of:
                1.01402 = boost
                8.518833 = idf(docFreq=23, maxDocs=44218)
                0.015948335 = queryNorm
              0.5324271 = fieldWeight in 2393, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.518833 = idf(docFreq=23, maxDocs=44218)
                0.0625 = fieldNorm(doc=2393)
          0.07335033 = weight(abstract_txt:kong in 2393) [ClassicSimilarity], result of:
            0.07335033 = score(doc=2393,freq=1.0), product of:
              0.13776597 = queryWeight, product of:
                1.01402 = boost
                8.518833 = idf(docFreq=23, maxDocs=44218)
                0.015948335 = queryNorm
              0.5324271 = fieldWeight in 2393, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.518833 = idf(docFreq=23, maxDocs=44218)
                0.0625 = fieldNorm(doc=2393)
          0.012627234 = weight(abstract_txt:that in 2393) [ClassicSimilarity], result of:
            0.012627234 = score(doc=2393,freq=4.0), product of:
              0.042633016 = queryWeight, product of:
                1.1281804 = boost
                2.3694751 = idf(docFreq=11241, maxDocs=44218)
                0.015948335 = queryNorm
              0.2961844 = fieldWeight in 2393, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.3694751 = idf(docFreq=11241, maxDocs=44218)
                0.0625 = fieldNorm(doc=2393)
          0.07072109 = weight(abstract_txt:engines in 2393) [ClassicSimilarity], result of:
            0.07072109 = score(doc=2393,freq=4.0), product of:
              0.10671608 = queryWeight, product of:
                1.262134 = boost
                5.3016257 = idf(docFreq=598, maxDocs=44218)
                0.015948335 = queryNorm
              0.6627032 = fieldWeight in 2393, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.3016257 = idf(docFreq=598, maxDocs=44218)
                0.0625 = fieldNorm(doc=2393)
          0.07119433 = weight(abstract_txt:english in 2393) [ClassicSimilarity], result of:
            0.07119433 = score(doc=2393,freq=3.0), product of:
              0.117979646 = queryWeight, product of:
                1.3270707 = boost
                5.574394 = idf(docFreq=455, maxDocs=44218)
                0.015948335 = queryNorm
              0.6034459 = fieldWeight in 2393, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.574394 = idf(docFreq=455, maxDocs=44218)
                0.0625 = fieldNorm(doc=2393)
          0.06260911 = weight(abstract_txt:searching in 2393) [ClassicSimilarity], result of:
            0.06260911 = score(doc=2393,freq=5.0), product of:
              0.10455608 = queryWeight, product of:
                1.5300683 = boost
                4.284727 = idf(docFreq=1655, maxDocs=44218)
                0.015948335 = queryNorm
              0.5988088 = fieldWeight in 2393, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.284727 = idf(docFreq=1655, maxDocs=44218)
                0.0625 = fieldNorm(doc=2393)
          0.03138428 = weight(abstract_txt:terms in 2393) [ClassicSimilarity], result of:
            0.03138428 = score(doc=2393,freq=1.0), product of:
              0.12417534 = queryWeight, product of:
                1.9254099 = boost
                4.0438666 = idf(docFreq=2106, maxDocs=44218)
                0.015948335 = queryNorm
              0.25274166 = fieldWeight in 2393, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.0438666 = idf(docFreq=2106, maxDocs=44218)
                0.0625 = fieldNorm(doc=2393)
          0.09958301 = weight(abstract_txt:search in 2393) [ClassicSimilarity], result of:
            0.09958301 = score(doc=2393,freq=6.0), product of:
              0.17781961 = queryWeight, product of:
                3.0479958 = boost
                3.6580524 = idf(docFreq=3098, maxDocs=44218)
                0.015948335 = queryNorm
              0.56002265 = fieldWeight in 2393, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                3.6580524 = idf(docFreq=3098, maxDocs=44218)
                0.0625 = fieldNorm(doc=2393)
          0.4159924 = weight(abstract_txt:chinese in 2393) [ClassicSimilarity], result of:
            0.4159924 = score(doc=2393,freq=4.0), product of:
              0.52797115 = queryWeight, product of:
                5.2520595 = boost
                6.30326 = idf(docFreq=219, maxDocs=44218)
                0.015948335 = queryNorm
              0.7879075 = fieldWeight in 2393, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.30326 = idf(docFreq=219, maxDocs=44218)
                0.0625 = fieldNorm(doc=2393)
        0.36 = coord(9/25)
    
  3. Yang, C.C.; Li, K.W.: ¬A heuristic method based on a statistical approach for chinese text segmentation (2005) 0.30
    0.29930297 = sum of:
      0.29930297 = product of:
        1.0689392 = sum of:
          0.021297293 = weight(abstract_txt:found in 4580) [ClassicSimilarity], result of:
            0.021297293 = score(doc=4580,freq=1.0), product of:
              0.07610856 = queryWeight, product of:
                1.0658774 = boost
                4.4772453 = idf(docFreq=1365, maxDocs=44218)
                0.015948335 = queryNorm
              0.27982783 = fieldWeight in 4580, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4772453 = idf(docFreq=1365, maxDocs=44218)
                0.0625 = fieldNorm(doc=4580)
          0.008928803 = weight(abstract_txt:that in 4580) [ClassicSimilarity], result of:
            0.008928803 = score(doc=4580,freq=2.0), product of:
              0.042633016 = queryWeight, product of:
                1.1281804 = boost
                2.3694751 = idf(docFreq=11241, maxDocs=44218)
                0.015948335 = queryNorm
              0.20943399 = fieldWeight in 4580, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.3694751 = idf(docFreq=11241, maxDocs=44218)
                0.0625 = fieldNorm(doc=4580)
          0.012839955 = weight(abstract_txt:with in 4580) [ClassicSimilarity], result of:
            0.012839955 = score(doc=4580,freq=3.0), product of:
              0.04744923 = queryWeight, product of:
                1.1902004 = boost
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.015948335 = queryNorm
              0.27060407 = fieldWeight in 4580, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.0625 = fieldNorm(doc=4580)
          0.041104067 = weight(abstract_txt:english in 4580) [ClassicSimilarity], result of:
            0.041104067 = score(doc=4580,freq=1.0), product of:
              0.117979646 = queryWeight, product of:
                1.3270707 = boost
                5.574394 = idf(docFreq=455, maxDocs=44218)
                0.015948335 = queryNorm
              0.34839964 = fieldWeight in 4580, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.574394 = idf(docFreq=455, maxDocs=44218)
                0.0625 = fieldNorm(doc=4580)
          0.083193064 = weight(abstract_txt:distribution in 4580) [ClassicSimilarity], result of:
            0.083193064 = score(doc=4580,freq=1.0), product of:
              0.23784022 = queryWeight, product of:
                2.664699 = boost
                5.596568 = idf(docFreq=445, maxDocs=44218)
                0.015948335 = queryNorm
              0.3497855 = fieldWeight in 4580, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.596568 = idf(docFreq=445, maxDocs=44218)
                0.0625 = fieldNorm(doc=4580)
          0.27758747 = weight(abstract_txt:grams in 4580) [ClassicSimilarity], result of:
            0.27758747 = score(doc=4580,freq=2.0), product of:
              0.3829754 = queryWeight, product of:
                2.9283407 = boost
                8.200379 = idf(docFreq=32, maxDocs=44218)
                0.015948335 = queryNorm
              0.724818 = fieldWeight in 4580, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                8.200379 = idf(docFreq=32, maxDocs=44218)
                0.0625 = fieldNorm(doc=4580)
          0.62398857 = weight(abstract_txt:chinese in 4580) [ClassicSimilarity], result of:
            0.62398857 = score(doc=4580,freq=9.0), product of:
              0.52797115 = queryWeight, product of:
                5.2520595 = boost
                6.30326 = idf(docFreq=219, maxDocs=44218)
                0.015948335 = queryNorm
              1.1818612 = fieldWeight in 4580, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                6.30326 = idf(docFreq=219, maxDocs=44218)
                0.0625 = fieldNorm(doc=4580)
        0.28 = coord(7/25)
    
  4. Arsenault, C.: Aggregation consistency and frequency of Chinese words and characters (2006) 0.25
    0.25229132 = sum of:
      0.25229132 = product of:
        0.90104043 = sum of:
          0.014117677 = weight(abstract_txt:that in 609) [ClassicSimilarity], result of:
            0.014117677 = score(doc=609,freq=5.0), product of:
              0.042633016 = queryWeight, product of:
                1.1281804 = boost
                2.3694751 = idf(docFreq=11241, maxDocs=44218)
                0.015948335 = queryNorm
              0.3311442 = fieldWeight in 609, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                2.3694751 = idf(docFreq=11241, maxDocs=44218)
                0.0625 = fieldNorm(doc=609)
          0.01048378 = weight(abstract_txt:with in 609) [ClassicSimilarity], result of:
            0.01048378 = score(doc=609,freq=2.0), product of:
              0.04744923 = queryWeight, product of:
                1.1902004 = boost
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.015948335 = queryNorm
              0.22094731 = fieldWeight in 609, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.0625 = fieldNorm(doc=609)
          0.044384077 = weight(abstract_txt:terms in 609) [ClassicSimilarity], result of:
            0.044384077 = score(doc=609,freq=2.0), product of:
              0.12417534 = queryWeight, product of:
                1.9254099 = boost
                4.0438666 = idf(docFreq=2106, maxDocs=44218)
                0.015948335 = queryNorm
              0.3574307 = fieldWeight in 609, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.0438666 = idf(docFreq=2106, maxDocs=44218)
                0.0625 = fieldNorm(doc=609)
          0.15124194 = weight(abstract_txt:zipf in 609) [ClassicSimilarity], result of:
            0.15124194 = score(doc=609,freq=1.0), product of:
              0.28118926 = queryWeight, product of:
                2.0487545 = boost
                8.6058445 = idf(docFreq=21, maxDocs=44218)
                0.015948335 = queryNorm
              0.5378653 = fieldWeight in 609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.6058445 = idf(docFreq=21, maxDocs=44218)
                0.0625 = fieldNorm(doc=609)
          0.098434426 = weight(abstract_txt:character in 609) [ClassicSimilarity], result of:
            0.098434426 = score(doc=609,freq=1.0), product of:
              0.24173841 = queryWeight, product of:
                2.3265316 = boost
                6.515104 = idf(docFreq=177, maxDocs=44218)
                0.015948335 = queryNorm
              0.407194 = fieldWeight in 609, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.515104 = idf(docFreq=177, maxDocs=44218)
                0.0625 = fieldNorm(doc=609)
          0.16638613 = weight(abstract_txt:distribution in 609) [ClassicSimilarity], result of:
            0.16638613 = score(doc=609,freq=4.0), product of:
              0.23784022 = queryWeight, product of:
                2.664699 = boost
                5.596568 = idf(docFreq=445, maxDocs=44218)
                0.015948335 = queryNorm
              0.699571 = fieldWeight in 609, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.596568 = idf(docFreq=445, maxDocs=44218)
                0.0625 = fieldNorm(doc=609)
          0.4159924 = weight(abstract_txt:chinese in 609) [ClassicSimilarity], result of:
            0.4159924 = score(doc=609,freq=4.0), product of:
              0.52797115 = queryWeight, product of:
                5.2520595 = boost
                6.30326 = idf(docFreq=219, maxDocs=44218)
                0.015948335 = queryNorm
              0.7879075 = fieldWeight in 609, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.30326 = idf(docFreq=219, maxDocs=44218)
                0.0625 = fieldNorm(doc=609)
        0.28 = coord(7/25)
    
  5. Khoo, C.S.G.; Dai, D.; Loh, T.E.: Using statistical and contextual information to identify two- and three-character words in Chinese text (2002) 0.25
    0.24831647 = sum of:
      0.24831647 = product of:
        1.034652 = sum of:
          0.021297293 = weight(abstract_txt:found in 5206) [ClassicSimilarity], result of:
            0.021297293 = score(doc=5206,freq=1.0), product of:
              0.07610856 = queryWeight, product of:
                1.0658774 = boost
                4.4772453 = idf(docFreq=1365, maxDocs=44218)
                0.015948335 = queryNorm
              0.27982783 = fieldWeight in 5206, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4772453 = idf(docFreq=1365, maxDocs=44218)
                0.0625 = fieldNorm(doc=5206)
          0.008928803 = weight(abstract_txt:that in 5206) [ClassicSimilarity], result of:
            0.008928803 = score(doc=5206,freq=2.0), product of:
              0.042633016 = queryWeight, product of:
                1.1281804 = boost
                2.3694751 = idf(docFreq=11241, maxDocs=44218)
                0.015948335 = queryNorm
              0.20943399 = fieldWeight in 5206, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.3694751 = idf(docFreq=11241, maxDocs=44218)
                0.0625 = fieldNorm(doc=5206)
          0.01048378 = weight(abstract_txt:with in 5206) [ClassicSimilarity], result of:
            0.01048378 = score(doc=5206,freq=2.0), product of:
              0.04744923 = queryWeight, product of:
                1.1902004 = boost
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.015948335 = queryNorm
              0.22094731 = fieldWeight in 5206, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4997334 = idf(docFreq=9868, maxDocs=44218)
                0.0625 = fieldNorm(doc=5206)
          0.24111412 = weight(abstract_txt:character in 5206) [ClassicSimilarity], result of:
            0.24111412 = score(doc=5206,freq=6.0), product of:
              0.24173841 = queryWeight, product of:
                2.3265316 = boost
                6.515104 = idf(docFreq=177, maxDocs=44218)
                0.015948335 = queryNorm
              0.9974175 = fieldWeight in 5206, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                6.515104 = idf(docFreq=177, maxDocs=44218)
                0.0625 = fieldNorm(doc=5206)
          0.39256793 = weight(abstract_txt:grams in 5206) [ClassicSimilarity], result of:
            0.39256793 = score(doc=5206,freq=4.0), product of:
              0.3829754 = queryWeight, product of:
                2.9283407 = boost
                8.200379 = idf(docFreq=32, maxDocs=44218)
                0.015948335 = queryNorm
              1.0250474 = fieldWeight in 5206, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                8.200379 = idf(docFreq=32, maxDocs=44218)
                0.0625 = fieldNorm(doc=5206)
          0.36026 = weight(abstract_txt:chinese in 5206) [ClassicSimilarity], result of:
            0.36026 = score(doc=5206,freq=3.0), product of:
              0.52797115 = queryWeight, product of:
                5.2520595 = boost
                6.30326 = idf(docFreq=219, maxDocs=44218)
                0.015948335 = queryNorm
              0.6823479 = fieldWeight in 5206, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.30326 = idf(docFreq=219, maxDocs=44218)
                0.0625 = fieldNorm(doc=5206)
        0.24 = coord(6/25)