Document (#38612)

Author

Ofek, N.
Rokach, L.

Title

¬A classifier to determine which Wikipedia biographies will be accepted

Source

Journal of the Association for Information Science and Technology. 66(2015) no.1, S.213-218

Year

2015

Series

Brief communication

Abstract

Wikipedia, like other encyclopedias, includes biographies of notable people. However, because it is jointly written by many contributors, it is subject to constant manipulation by contributors attempting to add biographies of non-notable people. Over time, Wikipedia has developed inclusion criteria for notable people (e.g., receiving a significant award) based on which newly contributed biographies are evaluated. In this paper we present and analyze a set of simple indicators that can be used to predict which article will eventually be accepted. These indicators do not refer to the content itself, but to meta-content features (such as the number of categories that the biography is associated with) and to author-based features (such as if it is a first-time author). By training a classifier on these features, we successfully reached a high predictive performance (area under the receiver operating characteristic [ROC] curve [AUC] of 0.97) even though we overlooked the actual biography text.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23199/abstract.

Theme

Informationsmittel

Object

Wikipedia

Similar documents (author)

1. Rokach, L.; Mitra, P.: Parsimonious citer-based measures : the artificial intelligence domain as a case study (2013) 4.79

   4.7917247 = sum of:
     4.7917247 = weight(author_txt:rokach in 2213) [ClassicSimilarity], result of:
       4.7917247 = fieldWeight in 2213, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.583449 = idf(docFreq=7, maxDocs=42740)
         0.5 = fieldNorm(doc=2213)
   

2. Blank, I.; Rokach, L.; Shani, G.: Leveraging metadata to recommend keywords for academic papers (2016) 3.59

   3.5937934 = sum of:
     3.5937934 = weight(author_txt:rokach in 5233) [ClassicSimilarity], result of:
       3.5937934 = fieldWeight in 5233, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.583449 = idf(docFreq=7, maxDocs=42740)
         0.375 = fieldNorm(doc=5233)
   

3. Greenstein-Messica, A.; Rokach, L.; Shabtai, A.: Personal-discount sensitivity prediction for mobile coupon conversion optimization (2017) 3.59

   3.5937934 = sum of:
     3.5937934 = weight(author_txt:rokach in 5752) [ClassicSimilarity], result of:
       3.5937934 = fieldWeight in 5752, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.583449 = idf(docFreq=7, maxDocs=42740)
         0.375 = fieldNorm(doc=5752)
   

4. Greenstein-Messica, A.; Rokach, L.; Shabtai, A.: Personal-discount sensitivity prediction for mobile coupon conversion optimization (2017) 3.59

   3.5937934 = sum of:
     3.5937934 = weight(author_txt:rokach in 5762) [ClassicSimilarity], result of:
       3.5937934 = fieldWeight in 5762, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.583449 = idf(docFreq=7, maxDocs=42740)
         0.375 = fieldNorm(doc=5762)
   

5. Rokach, L.; Kalech, M.; Blank, I.; Stern, R.: Who is going to win the next Association for the Advancement of Artificial Intelligence Fellowship Award? : evaluating researchers by mining bibliographic data (2011) 2.99

   2.994828 = sum of:
     2.994828 = weight(author_txt:rokach in 1946) [ClassicSimilarity], result of:
       2.994828 = fieldWeight in 1946, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.583449 = idf(docFreq=7, maxDocs=42740)
         0.3125 = fieldNorm(doc=1946)
   

Similar documents (content)

1. Tyrwhitt-Drake, B.: ¬The DNB on CD-ROM (1996) 0.11

   0.10937393 = sum of:
     0.10937393 = product of:
       0.91144943 = sum of:
         0.031033384 = weight(abstract_txt:content in 6707) [ClassicSimilarity], result of:
           0.031033384 = score(doc=6707,freq=1.0), product of:
             0.06758172 = queryWeight, product of:
               1.1235777 = boost
               4.1983805 = idf(docFreq=1744, maxDocs=42740)
               0.014326639 = queryNorm
             0.45919788 = fieldWeight in 6707, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1983805 = idf(docFreq=1744, maxDocs=42740)
               0.109375 = fieldNorm(doc=6707)
         0.26412353 = weight(abstract_txt:biography in 6707) [ClassicSimilarity], result of:
           0.26412353 = score(doc=6707,freq=1.0), product of:
             0.281718 = queryWeight, product of:
               2.2940125 = boost
               8.571848 = idf(docFreq=21, maxDocs=42740)
               0.014326639 = queryNorm
             0.9375459 = fieldWeight in 6707, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.571848 = idf(docFreq=21, maxDocs=42740)
               0.109375 = fieldNorm(doc=6707)
         0.6162925 = weight(abstract_txt:biographies in 6707) [ClassicSimilarity], result of:
           0.6162925 = score(doc=6707,freq=1.0), product of:
             0.62442136 = queryWeight, product of:
               4.829947 = boost
               9.023833 = idf(docFreq=13, maxDocs=42740)
               0.014326639 = queryNorm
             0.98698175 = fieldWeight in 6707, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.023833 = idf(docFreq=13, maxDocs=42740)
               0.109375 = fieldNorm(doc=6707)
       0.12 = coord(3/25)
   

2. Veelen, I. van: ¬The truth according to Wikipedia (2008) 0.09

   0.09495337 = sum of:
     0.09495337 = product of:
       0.3391192 = sum of:
         0.010378127 = weight(abstract_txt:will in 4140) [ClassicSimilarity], result of:
           0.010378127 = score(doc=4140,freq=1.0), product of:
             0.057280526 = queryWeight, product of:
               1.0344083 = boost
               3.8651886 = idf(docFreq=2434, maxDocs=42740)
               0.014326639 = queryNorm
             0.18118072 = fieldWeight in 4140, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8651886 = idf(docFreq=2434, maxDocs=42740)
               0.046875 = fieldNorm(doc=4140)
         0.012991689 = weight(abstract_txt:time in 4140) [ClassicSimilarity], result of:
           0.012991689 = score(doc=4140,freq=1.0), product of:
             0.066533156 = queryWeight, product of:
               1.1148273 = boost
               4.1656833 = idf(docFreq=1802, maxDocs=42740)
               0.014326639 = queryNorm
             0.1952664 = fieldWeight in 4140, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1656833 = idf(docFreq=1802, maxDocs=42740)
               0.046875 = fieldNorm(doc=4140)
         0.018809069 = weight(abstract_txt:content in 4140) [ClassicSimilarity], result of:
           0.018809069 = score(doc=4140,freq=2.0), product of:
             0.06758172 = queryWeight, product of:
               1.1235777 = boost
               4.1983805 = idf(docFreq=1744, maxDocs=42740)
               0.014326639 = queryNorm
             0.27831593 = fieldWeight in 4140, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1983805 = idf(docFreq=1744, maxDocs=42740)
               0.046875 = fieldNorm(doc=4140)
         0.0068053976 = weight(abstract_txt:which in 4140) [ClassicSimilarity], result of:
           0.0068053976 = score(doc=4140,freq=1.0), product of:
             0.0494911 = queryWeight, product of:
               1.1775997 = boost
               2.9334934 = idf(docFreq=6181, maxDocs=42740)
               0.014326639 = queryNorm
             0.1375075 = fieldWeight in 4140, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.9334934 = idf(docFreq=6181, maxDocs=42740)
               0.046875 = fieldNorm(doc=4140)
         0.031429857 = weight(abstract_txt:author in 4140) [ClassicSimilarity], result of:
           0.031429857 = score(doc=4140,freq=2.0), product of:
             0.09516545 = queryWeight, product of:
               1.3333008 = boost
               4.9820356 = idf(docFreq=796, maxDocs=42740)
               0.014326639 = queryNorm
             0.33026543 = fieldWeight in 4140, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9820356 = idf(docFreq=796, maxDocs=42740)
               0.046875 = fieldNorm(doc=4140)
         0.057222296 = weight(abstract_txt:people in 4140) [ClassicSimilarity], result of:
           0.057222296 = score(doc=4140,freq=3.0), product of:
             0.14189309 = queryWeight, product of:
               1.9939522 = boost
               4.9670916 = idf(docFreq=808, maxDocs=42740)
               0.014326639 = queryNorm
             0.40327755 = fieldWeight in 4140, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.9670916 = idf(docFreq=808, maxDocs=42740)
               0.046875 = fieldNorm(doc=4140)
         0.20148276 = weight(abstract_txt:wikipedia in 4140) [ClassicSimilarity], result of:
           0.20148276 = score(doc=4140,freq=9.0), product of:
             0.22770323 = queryWeight, product of:
               2.5259151 = boost
               6.2922525 = idf(docFreq=214, maxDocs=42740)
               0.014326639 = queryNorm
             0.88484806 = fieldWeight in 4140, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               6.2922525 = idf(docFreq=214, maxDocs=42740)
               0.046875 = fieldNorm(doc=4140)
       0.28 = coord(7/25)
   

3. Bounhas, I.; Elayeb, B.; Evrard, F.; Slimani, Y.: Toward a computer study of the reliability of Arabic stories (2010) 0.07

   0.0717849 = sum of:
     0.0717849 = product of:
       0.5982075 = sum of:
         0.009073864 = weight(abstract_txt:which in 710) [ClassicSimilarity], result of:
           0.009073864 = score(doc=710,freq=1.0), product of:
             0.0494911 = queryWeight, product of:
               1.1775997 = boost
               2.9334934 = idf(docFreq=6181, maxDocs=42740)
               0.014326639 = queryNorm
             0.18334334 = fieldWeight in 710, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.9334934 = idf(docFreq=6181, maxDocs=42740)
               0.0625 = fieldNorm(doc=710)
         0.09109404 = weight(abstract_txt:classifier in 710) [ClassicSimilarity], result of:
           0.09109404 = score(doc=710,freq=1.0), product of:
             0.20120025 = queryWeight, product of:
               1.9386649 = boost
               7.24405 = idf(docFreq=82, maxDocs=42740)
               0.014326639 = queryNorm
             0.45275313 = fieldWeight in 710, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.24405 = idf(docFreq=82, maxDocs=42740)
               0.0625 = fieldNorm(doc=710)
         0.49803954 = weight(abstract_txt:biographies in 710) [ClassicSimilarity], result of:
           0.49803954 = score(doc=710,freq=2.0), product of:
             0.62442136 = queryWeight, product of:
               4.829947 = boost
               9.023833 = idf(docFreq=13, maxDocs=42740)
               0.014326639 = queryNorm
             0.7976017 = fieldWeight in 710, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.023833 = idf(docFreq=13, maxDocs=42740)
               0.0625 = fieldNorm(doc=710)
       0.12 = coord(3/25)
   

4. Fallis, D.: Toward an epistemology of Wikipedia (2008) 0.07

   0.06880075 = sum of:
     0.06880075 = product of:
       0.4300047 = sum of:
         0.012107815 = weight(abstract_txt:will in 4011) [ClassicSimilarity], result of:
           0.012107815 = score(doc=4011,freq=1.0), product of:
             0.057280526 = queryWeight, product of:
               1.0344083 = boost
               3.8651886 = idf(docFreq=2434, maxDocs=42740)
               0.014326639 = queryNorm
             0.2113775 = fieldWeight in 4011, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8651886 = idf(docFreq=2434, maxDocs=42740)
               0.0546875 = fieldNorm(doc=4011)
         0.04920012 = weight(abstract_txt:encyclopedias in 4011) [ClassicSimilarity], result of:
           0.04920012 = score(doc=4011,freq=1.0), product of:
             0.11577033 = queryWeight, product of:
               1.0398535 = boost
               7.77107 = idf(docFreq=48, maxDocs=42740)
               0.014326639 = queryNorm
             0.4249804 = fieldWeight in 4011, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.77107 = idf(docFreq=48, maxDocs=42740)
               0.0546875 = fieldNorm(doc=4011)
         0.086185955 = weight(abstract_txt:people in 4011) [ClassicSimilarity], result of:
           0.086185955 = score(doc=4011,freq=5.0), product of:
             0.14189309 = queryWeight, product of:
               1.9939522 = boost
               4.9670916 = idf(docFreq=808, maxDocs=42740)
               0.014326639 = queryNorm
             0.60740066 = fieldWeight in 4011, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.9670916 = idf(docFreq=808, maxDocs=42740)
               0.0546875 = fieldNorm(doc=4011)
         0.2825108 = weight(abstract_txt:wikipedia in 4011) [ClassicSimilarity], result of:
           0.2825108 = score(doc=4011,freq=13.0), product of:
             0.22770323 = queryWeight, product of:
               2.5259151 = boost
               6.2922525 = idf(docFreq=214, maxDocs=42740)
               0.014326639 = queryNorm
             1.2406974 = fieldWeight in 4011, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               6.2922525 = idf(docFreq=214, maxDocs=42740)
               0.0546875 = fieldNorm(doc=4011)
       0.16 = coord(4/25)
   

5. Kubiszewski, I.; Cleveland, C.J.: ¬The Encyclopedia of Earth (2007) 0.06

   0.05824548 = sum of:
     0.05824548 = product of:
       0.2912274 = sum of:
         0.019338496 = weight(abstract_txt:will in 3171) [ClassicSimilarity], result of:
           0.019338496 = score(doc=3171,freq=5.0), product of:
             0.057280526 = queryWeight, product of:
               1.0344083 = boost
               3.8651886 = idf(docFreq=2434, maxDocs=42740)
               0.014326639 = queryNorm
             0.3376103 = fieldWeight in 3171, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.8651886 = idf(docFreq=2434, maxDocs=42740)
               0.0390625 = fieldNorm(doc=3171)
         0.024783125 = weight(abstract_txt:content in 3171) [ClassicSimilarity], result of:
           0.024783125 = score(doc=3171,freq=5.0), product of:
             0.06758172 = queryWeight, product of:
               1.1235777 = boost
               4.1983805 = idf(docFreq=1744, maxDocs=42740)
               0.014326639 = queryNorm
             0.36671343 = fieldWeight in 3171, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1983805 = idf(docFreq=1744, maxDocs=42740)
               0.0390625 = fieldNorm(doc=3171)
         0.0056711645 = weight(abstract_txt:which in 3171) [ClassicSimilarity], result of:
           0.0056711645 = score(doc=3171,freq=1.0), product of:
             0.0494911 = queryWeight, product of:
               1.1775997 = boost
               2.9334934 = idf(docFreq=6181, maxDocs=42740)
               0.014326639 = queryNorm
             0.11458959 = fieldWeight in 3171, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.9334934 = idf(docFreq=6181, maxDocs=42740)
               0.0390625 = fieldNorm(doc=3171)
         0.021330142 = weight(abstract_txt:features in 3171) [ClassicSimilarity], result of:
           0.021330142 = score(doc=3171,freq=1.0), product of:
             0.11969466 = queryWeight, product of:
               1.8313507 = boost
               4.5620384 = idf(docFreq=1212, maxDocs=42740)
               0.014326639 = queryNorm
             0.17820463 = fieldWeight in 3171, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5620384 = idf(docFreq=1212, maxDocs=42740)
               0.0390625 = fieldNorm(doc=3171)
         0.22010447 = weight(abstract_txt:biographies in 3171) [ClassicSimilarity], result of:
           0.22010447 = score(doc=3171,freq=1.0), product of:
             0.62442136 = queryWeight, product of:
               4.829947 = boost
               9.023833 = idf(docFreq=13, maxDocs=42740)
               0.014326639 = queryNorm
             0.3524935 = fieldWeight in 3171, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.023833 = idf(docFreq=13, maxDocs=42740)
               0.0390625 = fieldNorm(doc=3171)
       0.2 = coord(5/25)