Document (#40358)

Author

Daraio, C.
Bonaccorsi, A.

Title

Beyond university rankings? : generating new indicators on universities by linking data in open platforms

Source

Journal of the Association for Information Science and Technology. 68(2017) no.2, S.508-529

Year

2017

Abstract

The need for new indicators on universities is growing enormously. Governments and decision makers at all levels are faced with the huge opportunities generated by the availability of new knowledge and information and, simultaneously, are pressed by tight budget constraints. University rankings, in particular, are attracting policy and media attention, but at the same time receive harsh methodological criticism. After summarizing the main criticisms of rankings, we describe 2 trends in the user requirements for indicators; namely, granularity and cross-referencing. We then suggest that a change in the paradigm of the design and production of indicators is needed. The traditional approach is one that not only leverages on the existing data but also suggests heavy investment to integrate existing databases and to build up tailored indicators. We show, based on the European universities case, how the intelligent integration of existing data may lead to an open-linked data platform which permits the construction of new indicators. The power of the approach derives from the ability to combine heterogeneous sources of data to generate indicators that address a variety of user requirements without the need to design indicators on a custom basis.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23679/full.

Similar documents (content)

1. Waltman, L.; Calero-Medina, C.; Kosten, J.; Noyons, E.C.M.; Tijssen, R.J.W.; Eck, N.J. van; Leeuwen, T.N. van; Raan, A.F.J. van; Visser, M.S.; Wouters, P.: ¬The Leiden ranking 2011/2012 : data collection, indicators, and interpretation (2012) 0.17

   0.17496447 = sum of:
     0.17496447 = product of:
       0.8748224 = sum of:
         0.030291794 = weight(abstract_txt:university in 514) [ClassicSimilarity], result of:
           0.030291794 = score(doc=514,freq=2.0), product of:
             0.08035473 = queryWeight, product of:
               1.1268519 = boost
               4.264995 = idf(docFreq=1688, maxDocs=44218)
               0.016719606 = queryNorm
             0.37697586 = fieldWeight in 514, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.264995 = idf(docFreq=1688, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.025633527 = weight(abstract_txt:data in 514) [ClassicSimilarity], result of:
           0.025633527 = score(doc=514,freq=1.0), product of:
             0.12292976 = queryWeight, product of:
               2.2037365 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.016719606 = queryNorm
             0.20852174 = fieldWeight in 514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.16604428 = weight(abstract_txt:universities in 514) [ClassicSimilarity], result of:
           0.16604428 = score(doc=514,freq=3.0), product of:
             0.24981052 = queryWeight, product of:
               2.4333923 = boost
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.016719606 = queryNorm
             0.6646809 = fieldWeight in 514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.23407865 = weight(abstract_txt:rankings in 514) [ClassicSimilarity], result of:
           0.23407865 = score(doc=514,freq=3.0), product of:
             0.31407687 = queryWeight, product of:
               2.728505 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.016719606 = queryNorm
             0.74529094 = fieldWeight in 514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.41877416 = weight(abstract_txt:indicators in 514) [ClassicSimilarity], result of:
           0.41877416 = score(doc=514,freq=3.0), product of:
             0.641856 = queryWeight, product of:
               6.3695674 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.016719606 = queryNorm
             0.6524425 = fieldWeight in 514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
       0.2 = coord(5/25)
   

2. Aguillo, I.F.; Granadino, B.; Ortega, J.L.; Prieto, J.A.: Scientific research activity and communication measured with cybermetrics indicators (2006) 0.17

   0.17386523 = sum of:
     0.17386523 = product of:
       0.8693261 = sum of:
         0.03786474 = weight(abstract_txt:university in 5898) [ClassicSimilarity], result of:
           0.03786474 = score(doc=5898,freq=2.0), product of:
             0.08035473 = queryWeight, product of:
               1.1268519 = boost
               4.264995 = idf(docFreq=1688, maxDocs=44218)
               0.016719606 = queryNorm
             0.47121984 = fieldWeight in 5898, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.264995 = idf(docFreq=1688, maxDocs=44218)
               0.078125 = fieldNorm(doc=5898)
         0.0453141 = weight(abstract_txt:data in 5898) [ClassicSimilarity], result of:
           0.0453141 = score(doc=5898,freq=2.0), product of:
             0.12292976 = queryWeight, product of:
               2.2037365 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.016719606 = queryNorm
             0.36861783 = fieldWeight in 5898, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.078125 = fieldNorm(doc=5898)
         0.11983213 = weight(abstract_txt:universities in 5898) [ClassicSimilarity], result of:
           0.11983213 = score(doc=5898,freq=1.0), product of:
             0.24981052 = queryWeight, product of:
               2.4333923 = boost
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.016719606 = queryNorm
             0.4796921 = fieldWeight in 5898, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.078125 = fieldNorm(doc=5898)
         0.2389055 = weight(abstract_txt:rankings in 5898) [ClassicSimilarity], result of:
           0.2389055 = score(doc=5898,freq=2.0), product of:
             0.31407687 = queryWeight, product of:
               2.728505 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.016719606 = queryNorm
             0.76065934 = fieldWeight in 5898, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.078125 = fieldNorm(doc=5898)
         0.42740962 = weight(abstract_txt:indicators in 5898) [ClassicSimilarity], result of:
           0.42740962 = score(doc=5898,freq=2.0), product of:
             0.641856 = queryWeight, product of:
               6.3695674 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.016719606 = queryNorm
             0.6658964 = fieldWeight in 5898, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.078125 = fieldNorm(doc=5898)
       0.2 = coord(5/25)
   

3. Gingras, Y.: Bibliometrics and research evaluation : uses and abuses (2016) 0.14

   0.13544144 = sum of:
     0.13544144 = product of:
       0.84650904 = sum of:
         0.036251284 = weight(abstract_txt:data in 3805) [ClassicSimilarity], result of:
           0.036251284 = score(doc=3805,freq=2.0), product of:
             0.12292976 = queryWeight, product of:
               2.2037365 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.016719606 = queryNorm
             0.29489428 = fieldWeight in 3805, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=3805)
         0.13557458 = weight(abstract_txt:universities in 3805) [ClassicSimilarity], result of:
           0.13557458 = score(doc=3805,freq=2.0), product of:
             0.24981052 = queryWeight, product of:
               2.4333923 = boost
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.016719606 = queryNorm
             0.54270965 = fieldWeight in 3805, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.0625 = fieldNorm(doc=3805)
         0.19112441 = weight(abstract_txt:rankings in 3805) [ClassicSimilarity], result of:
           0.19112441 = score(doc=3805,freq=2.0), product of:
             0.31407687 = queryWeight, product of:
               2.728505 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.016719606 = queryNorm
             0.6085275 = fieldWeight in 3805, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0625 = fieldNorm(doc=3805)
         0.48355877 = weight(abstract_txt:indicators in 3805) [ClassicSimilarity], result of:
           0.48355877 = score(doc=3805,freq=4.0), product of:
             0.641856 = queryWeight, product of:
               6.3695674 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.016719606 = queryNorm
             0.75337577 = fieldWeight in 3805, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.0625 = fieldNorm(doc=3805)
       0.16 = coord(4/25)
   

4. Thelwall, M.: Web indicators for research evaluation : a practical guide (2016) 0.12

   0.115085706 = sum of:
     0.115085706 = product of:
       0.95904756 = sum of:
         0.025633527 = weight(abstract_txt:data in 3384) [ClassicSimilarity], result of:
           0.025633527 = score(doc=3384,freq=1.0), product of:
             0.12292976 = queryWeight, product of:
               2.2037365 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.016719606 = queryNorm
             0.20852174 = fieldWeight in 3384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
         0.095865704 = weight(abstract_txt:universities in 3384) [ClassicSimilarity], result of:
           0.095865704 = score(doc=3384,freq=1.0), product of:
             0.24981052 = queryWeight, product of:
               2.4333923 = boost
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.016719606 = queryNorm
             0.3837537 = fieldWeight in 3384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
         0.8375483 = weight(abstract_txt:indicators in 3384) [ClassicSimilarity], result of:
           0.8375483 = score(doc=3384,freq=12.0), product of:
             0.641856 = queryWeight, product of:
               6.3695674 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.016719606 = queryNorm
             1.304885 = fieldWeight in 3384, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.0625 = fieldNorm(doc=3384)
       0.12 = coord(3/25)
   

5. Liebscher, P.; Abels, E.G.; Denman, D.W.: Factors that influence the use of electronic networks by science and engineering faculty at small institutions : Part II: Preliminary use indicators (1997) 0.11

   0.10920635 = sum of:
     0.10920635 = product of:
       0.6825397 = sum of:
         0.10947421 = weight(abstract_txt:heavy in 391) [ClassicSimilarity], result of:
           0.10947421 = score(doc=391,freq=1.0), product of:
             0.14441372 = queryWeight, product of:
               1.0681946 = boost
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.016719606 = queryNorm
             0.7580596 = fieldWeight in 391, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.09375 = fieldNorm(doc=391)
         0.06659785 = weight(abstract_txt:data in 391) [ClassicSimilarity], result of:
           0.06659785 = score(doc=391,freq=3.0), product of:
             0.12292976 = queryWeight, product of:
               2.2037365 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.016719606 = queryNorm
             0.5417553 = fieldWeight in 391, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.09375 = fieldNorm(doc=391)
         0.14379856 = weight(abstract_txt:universities in 391) [ClassicSimilarity], result of:
           0.14379856 = score(doc=391,freq=1.0), product of:
             0.24981052 = queryWeight, product of:
               2.4333923 = boost
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.016719606 = queryNorm
             0.57563055 = fieldWeight in 391, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.09375 = fieldNorm(doc=391)
         0.36266908 = weight(abstract_txt:indicators in 391) [ClassicSimilarity], result of:
           0.36266908 = score(doc=391,freq=1.0), product of:
             0.641856 = queryWeight, product of:
               6.3695674 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.016719606 = queryNorm
             0.5650318 = fieldWeight in 391, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.09375 = fieldNorm(doc=391)
       0.16 = coord(4/25)