Document (#31299)

Author

Souza, R.R.
Raghavan, K.S.

Title

¬A methodology for noun phrase-based automatic indexing

Source

Knowledge organization. 33(2006) no.1, S.35-44

Year

2006

Abstract

The scholarly community is increasingly employing the Web both for publication of scholarly output and for locating and accessing relevant scholarly literature. Organization of this vast body of digital information assumes significance in this context. The sheer volume of digital information to be handled makes traditional indexing and knowledge representation strategies ineffective and impractical. It is, therefore, worth exploring new approaches. An approach being discussed considers the intrinsic semantics of texts of documents. Based on the hypothesis that noun phrases in a text are semantically rich in terms of their ability to represent the subject content of the document, this approach seeks to identify and extract noun phrases instead of single keywords, and use them as descriptors. This paper presents a methodology that has been developed for extracting noun phrases from Portuguese texts. The results of an experiment carried out to test the adequacy of the methodology are also presented.

Theme

Automatisches Indexieren

Similar documents (author)

1. Raghavan, K.S.: ¬The general theory of classification as the basis for structuring of subject headings (1985(?)) 1.83

   1.825046 = sum of:
     1.825046 = product of:
       3.650092 = sum of:
         3.650092 = weight(author_txt:raghavan in 1830) [ClassicSimilarity], result of:
           3.650092 = score(doc=1830,freq=1.0), product of:
             0.71218014 = queryWeight, product of:
               1.0072271 = boost
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.08622408 = queryNorm
             5.125237 = fieldWeight in 1830, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.625 = fieldNorm(doc=1830)
       0.5 = coord(1/2)
   

2. Raghavan, K.S.: Education for knowledge organization : the Indian scene (2005) 1.83

   1.825046 = sum of:
     1.825046 = product of:
       3.650092 = sum of:
         3.650092 = weight(author_txt:raghavan in 6738) [ClassicSimilarity], result of:
           3.650092 = score(doc=6738,freq=1.0), product of:
             0.71218014 = queryWeight, product of:
               1.0072271 = boost
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.08622408 = queryNorm
             5.125237 = fieldWeight in 6738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.625 = fieldNorm(doc=6738)
       0.5 = coord(1/2)
   

3. Raghavan, K.S.: Education for information management as a transformation force (2013) 1.83

   1.825046 = sum of:
     1.825046 = product of:
       3.650092 = sum of:
         3.650092 = weight(author_txt:raghavan in 937) [ClassicSimilarity], result of:
           3.650092 = score(doc=937,freq=1.0), product of:
             0.71218014 = queryWeight, product of:
               1.0072271 = boost
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.08622408 = queryNorm
             5.125237 = fieldWeight in 937, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.625 = fieldNorm(doc=937)
       0.5 = coord(1/2)
   

4. Raghavan, K.S.: ¬The Colon Classification : a few considerations on its future (2015) 1.83

   1.825046 = sum of:
     1.825046 = product of:
       3.650092 = sum of:
         3.650092 = weight(author_txt:raghavan in 2760) [ClassicSimilarity], result of:
           3.650092 = score(doc=2760,freq=1.0), product of:
             0.71218014 = queryWeight, product of:
               1.0072271 = boost
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.08622408 = queryNorm
             5.125237 = fieldWeight in 2760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.625 = fieldNorm(doc=2760)
       0.5 = coord(1/2)
   

5. Souza, S.d.: Informacion : utopia y realidad de la bibliotelogia (1996) 1.79

   1.786042 = sum of:
     1.786042 = product of:
       3.572084 = sum of:
         3.572084 = weight(author_txt:souza in 824) [ClassicSimilarity], result of:
           3.572084 = score(doc=824,freq=1.0), product of:
             0.70199674 = queryWeight, product of:
               8.14154 = idf(docFreq=34, maxDocs=44218)
               0.08622408 = queryNorm
             5.0884624 = fieldWeight in 824, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.14154 = idf(docFreq=34, maxDocs=44218)
               0.625 = fieldNorm(doc=824)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Styltsvig, H.B.: Ontology-based information retrieval (2006) 0.22

   0.21513252 = sum of:
     0.21513252 = product of:
       0.67228913 = sum of:
         0.036947053 = weight(abstract_txt:hypothesis in 1154) [ClassicSimilarity], result of:
           0.036947053 = score(doc=1154,freq=1.0), product of:
             0.116432264 = queryWeight, product of:
               1.0134778 = boost
               6.769634 = idf(docFreq=137, maxDocs=44218)
               0.016970472 = queryNorm
             0.31732658 = fieldWeight in 1154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.769634 = idf(docFreq=137, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.012513644 = weight(abstract_txt:approach in 1154) [ClassicSimilarity], result of:
           0.012513644 = score(doc=1154,freq=1.0), product of:
             0.07127754 = queryWeight, product of:
               1.1214216 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.016970472 = queryNorm
             0.17556225 = fieldWeight in 1154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.059516568 = weight(abstract_txt:handled in 1154) [ClassicSimilarity], result of:
           0.059516568 = score(doc=1154,freq=1.0), product of:
             0.15999709 = queryWeight, product of:
               1.1880469 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.016970472 = queryNorm
             0.37198532 = fieldWeight in 1154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.027718741 = weight(abstract_txt:indexing in 1154) [ClassicSimilarity], result of:
           0.027718741 = score(doc=1154,freq=2.0), product of:
             0.096132256 = queryWeight, product of:
               1.3023483 = boost
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.016970472 = queryNorm
             0.28833964 = fieldWeight in 1154, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.01338615 = weight(abstract_txt:this in 1154) [ClassicSimilarity], result of:
           0.01338615 = score(doc=1154,freq=4.0), product of:
             0.059173044 = queryWeight, product of:
               1.4450055 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.016970472 = queryNorm
             0.2262204 = fieldWeight in 1154, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.04305666 = weight(abstract_txt:texts in 1154) [ClassicSimilarity], result of:
           0.04305666 = score(doc=1154,freq=1.0), product of:
             0.16245149 = queryWeight, product of:
               1.6929901 = boost
               5.6542544 = idf(docFreq=420, maxDocs=44218)
               0.016970472 = queryNorm
             0.26504317 = fieldWeight in 1154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6542544 = idf(docFreq=420, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.16372696 = weight(abstract_txt:phrases in 1154) [ClassicSimilarity], result of:
           0.16372696 = score(doc=1154,freq=2.0), product of:
             0.35958153 = queryWeight, product of:
               3.08487 = boost
               6.8685737 = idf(docFreq=124, maxDocs=44218)
               0.016970472 = queryNorm
             0.45532638 = fieldWeight in 1154, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8685737 = idf(docFreq=124, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
         0.3154234 = weight(abstract_txt:noun in 1154) [ClassicSimilarity], result of:
           0.3154234 = score(doc=1154,freq=2.0), product of:
             0.6127633 = queryWeight, product of:
               4.6500106 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.016970472 = queryNorm
             0.5147557 = fieldWeight in 1154, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.046875 = fieldNorm(doc=1154)
       0.32 = coord(8/25)
   

2. Justeson, J.S.; Katz, S.M.: Technical terminology : some linguistic properties and an algorithm for identification in text (1995) 0.17

   0.17436138 = sum of:
     0.17436138 = product of:
       1.0897586 = sum of:
         0.100541964 = weight(abstract_txt:phrase in 755) [ClassicSimilarity], result of:
           0.100541964 = score(doc=755,freq=2.0), product of:
             0.1281374 = queryWeight, product of:
               1.0632013 = boost
               7.1017675 = idf(docFreq=98, maxDocs=44218)
               0.016970472 = queryNorm
             0.78464186 = fieldWeight in 755, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.1017675 = idf(docFreq=98, maxDocs=44218)
               0.078125 = fieldNorm(doc=755)
         0.011155124 = weight(abstract_txt:this in 755) [ClassicSimilarity], result of:
           0.011155124 = score(doc=755,freq=1.0), product of:
             0.059173044 = queryWeight, product of:
               1.4450055 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.016970472 = queryNorm
             0.18851699 = fieldWeight in 755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=755)
         0.33420625 = weight(abstract_txt:phrases in 755) [ClassicSimilarity], result of:
           0.33420625 = score(doc=755,freq=3.0), product of:
             0.35958153 = queryWeight, product of:
               3.08487 = boost
               6.8685737 = idf(docFreq=124, maxDocs=44218)
               0.016970472 = queryNorm
             0.9294311 = fieldWeight in 755, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.8685737 = idf(docFreq=124, maxDocs=44218)
               0.078125 = fieldNorm(doc=755)
         0.64385533 = weight(abstract_txt:noun in 755) [ClassicSimilarity], result of:
           0.64385533 = score(doc=755,freq=3.0), product of:
             0.6127633 = queryWeight, product of:
               4.6500106 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.016970472 = queryNorm
             1.0507407 = fieldWeight in 755, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.078125 = fieldNorm(doc=755)
       0.16 = coord(4/25)
   

3. Mesquita, L.A.P.; Souza, R.R.; Baracho Porto, R.M.A.: Noun phrases in automatic indexing: : a structural analysis of the distribution of relevant terms in doctoral theses (2014) 0.17

   0.17223589 = sum of:
     0.17223589 = product of:
       0.8611795 = sum of:
         0.027718741 = weight(abstract_txt:indexing in 1442) [ClassicSimilarity], result of:
           0.027718741 = score(doc=1442,freq=2.0), product of:
             0.096132256 = queryWeight, product of:
               1.3023483 = boost
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.016970472 = queryNorm
             0.28833964 = fieldWeight in 1442, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.046875 = fieldNorm(doc=1442)
         0.014966169 = weight(abstract_txt:this in 1442) [ClassicSimilarity], result of:
           0.014966169 = score(doc=1442,freq=5.0), product of:
             0.059173044 = queryWeight, product of:
               1.4450055 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.016970472 = queryNorm
             0.2529221 = fieldWeight in 1442, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.046875 = fieldNorm(doc=1442)
         0.06089131 = weight(abstract_txt:texts in 1442) [ClassicSimilarity], result of:
           0.06089131 = score(doc=1442,freq=2.0), product of:
             0.16245149 = queryWeight, product of:
               1.6929901 = boost
               5.6542544 = idf(docFreq=420, maxDocs=44218)
               0.016970472 = queryNorm
             0.37482765 = fieldWeight in 1442, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6542544 = idf(docFreq=420, maxDocs=44218)
               0.046875 = fieldNorm(doc=1442)
         0.25887507 = weight(abstract_txt:phrases in 1442) [ClassicSimilarity], result of:
           0.25887507 = score(doc=1442,freq=5.0), product of:
             0.35958153 = queryWeight, product of:
               3.08487 = boost
               6.8685737 = idf(docFreq=124, maxDocs=44218)
               0.016970472 = queryNorm
             0.7199343 = fieldWeight in 1442, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.8685737 = idf(docFreq=124, maxDocs=44218)
               0.046875 = fieldNorm(doc=1442)
         0.4987282 = weight(abstract_txt:noun in 1442) [ClassicSimilarity], result of:
           0.4987282 = score(doc=1442,freq=5.0), product of:
             0.6127633 = queryWeight, product of:
               4.6500106 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.016970472 = queryNorm
             0.81390023 = fieldWeight in 1442, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.046875 = fieldNorm(doc=1442)
       0.2 = coord(5/25)
   

4. Martins, A.L.; Souza, R.R.; Ribeiro de Mello, H.: ¬The use of noun phrases in information retrieval : proposing a mechanism for automatic classification (2014) 0.17

   0.16693473 = sum of:
     0.16693473 = product of:
       0.6955614 = sum of:
         0.043104894 = weight(abstract_txt:hypothesis in 1441) [ClassicSimilarity], result of:
           0.043104894 = score(doc=1441,freq=1.0), product of:
             0.116432264 = queryWeight, product of:
               1.0134778 = boost
               6.769634 = idf(docFreq=137, maxDocs=44218)
               0.016970472 = queryNorm
             0.37021434 = fieldWeight in 1441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.769634 = idf(docFreq=137, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1441)
         0.0145992525 = weight(abstract_txt:approach in 1441) [ClassicSimilarity], result of:
           0.0145992525 = score(doc=1441,freq=1.0), product of:
             0.07127754 = queryWeight, product of:
               1.1214216 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.016970472 = queryNorm
             0.20482263 = fieldWeight in 1441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1441)
         0.007808587 = weight(abstract_txt:this in 1441) [ClassicSimilarity], result of:
           0.007808587 = score(doc=1441,freq=1.0), product of:
             0.059173044 = queryWeight, product of:
               1.4450055 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.016970472 = queryNorm
             0.1319619 = fieldWeight in 1441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1441)
         0.07103986 = weight(abstract_txt:texts in 1441) [ClassicSimilarity], result of:
           0.07103986 = score(doc=1441,freq=2.0), product of:
             0.16245149 = queryWeight, product of:
               1.6929901 = boost
               5.6542544 = idf(docFreq=420, maxDocs=44218)
               0.016970472 = queryNorm
             0.43729892 = fieldWeight in 1441, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6542544 = idf(docFreq=420, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1441)
         0.19101478 = weight(abstract_txt:phrases in 1441) [ClassicSimilarity], result of:
           0.19101478 = score(doc=1441,freq=2.0), product of:
             0.35958153 = queryWeight, product of:
               3.08487 = boost
               6.8685737 = idf(docFreq=124, maxDocs=44218)
               0.016970472 = queryNorm
             0.5312141 = fieldWeight in 1441, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8685737 = idf(docFreq=124, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1441)
         0.36799398 = weight(abstract_txt:noun in 1441) [ClassicSimilarity], result of:
           0.36799398 = score(doc=1441,freq=2.0), product of:
             0.6127633 = queryWeight, product of:
               4.6500106 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.016970472 = queryNorm
             0.6005483 = fieldWeight in 1441, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1441)
       0.24 = coord(6/25)
   

5. Driscoll, J.R.; Rajala, D.A.; Shaffer, W.H.: ¬The operation and performance of an artificially intelligent keywording system (1991) 0.16

   0.16304977 = sum of:
     0.16304977 = product of:
       0.67937404 = sum of:
         0.064543925 = weight(abstract_txt:semantically in 6681) [ClassicSimilarity], result of:
           0.064543925 = score(doc=6681,freq=1.0), product of:
             0.120141 = queryWeight, product of:
               1.0294925 = boost
               6.8766055 = idf(docFreq=123, maxDocs=44218)
               0.016970472 = queryNorm
             0.5372348 = fieldWeight in 6681, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8766055 = idf(docFreq=123, maxDocs=44218)
               0.078125 = fieldNorm(doc=6681)
         0.100541964 = weight(abstract_txt:phrase in 6681) [ClassicSimilarity], result of:
           0.100541964 = score(doc=6681,freq=2.0), product of:
             0.1281374 = queryWeight, product of:
               1.0632013 = boost
               7.1017675 = idf(docFreq=98, maxDocs=44218)
               0.016970472 = queryNorm
             0.78464186 = fieldWeight in 6681, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.1017675 = idf(docFreq=98, maxDocs=44218)
               0.078125 = fieldNorm(doc=6681)
         0.020856073 = weight(abstract_txt:approach in 6681) [ClassicSimilarity], result of:
           0.020856073 = score(doc=6681,freq=1.0), product of:
             0.07127754 = queryWeight, product of:
               1.1214216 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.016970472 = queryNorm
             0.29260373 = fieldWeight in 6681, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.078125 = fieldNorm(doc=6681)
         0.0461979 = weight(abstract_txt:indexing in 6681) [ClassicSimilarity], result of:
           0.0461979 = score(doc=6681,freq=2.0), product of:
             0.096132256 = queryWeight, product of:
               1.3023483 = boost
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.016970472 = queryNorm
             0.48056605 = fieldWeight in 6681, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.078125 = fieldNorm(doc=6681)
         0.015775729 = weight(abstract_txt:this in 6681) [ClassicSimilarity], result of:
           0.015775729 = score(doc=6681,freq=2.0), product of:
             0.059173044 = queryWeight, product of:
               1.4450055 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.016970472 = queryNorm
             0.2666033 = fieldWeight in 6681, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=6681)
         0.43145847 = weight(abstract_txt:phrases in 6681) [ClassicSimilarity], result of:
           0.43145847 = score(doc=6681,freq=5.0), product of:
             0.35958153 = queryWeight, product of:
               3.08487 = boost
               6.8685737 = idf(docFreq=124, maxDocs=44218)
               0.016970472 = queryNorm
             1.1998905 = fieldWeight in 6681, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.8685737 = idf(docFreq=124, maxDocs=44218)
               0.078125 = fieldNorm(doc=6681)
       0.24 = coord(6/25)