Document (#42056)

Author

Ru, C.
Tang, J.
Li, S.
Xie, S.
Wang, T.

Title

Using semantic similarity to reduce wrong labels in distant supervision for relation extraction

Source

Information processing and management. 54(2018) no.4, S.593-608

Year

2018

Abstract

Distant supervision (DS) has the advantage of automatically generating large amounts of labelled training data and has been widely used for relation extraction. However, there are usually many wrong labels in the automatically labelled data in distant supervision (Riedel, Yao, & McCallum, 2010). This paper presents a novel method to reduce the wrong labels. The proposed method uses the semantic Jaccard with word embedding to measure the semantic similarity between the relation phrase in the knowledge base and the dependency phrases between two entities in a sentence to filter the wrong labels. In the process of reducing wrong labels, the semantic Jaccard algorithm selects a core dependency phrase to represent the candidate relation in a sentence, which can capture features for relation classification and avoid the negative impact from irrelevant term sequences that previous neural network models of relation extraction often suffer. In the process of relation classification, the core dependency phrases are also used as the input of a convolutional neural network (CNN) for relation classification. The experimental results show that compared with the methods using original DS data, the methods using filtered DS data performed much better in relation extraction. It indicates that the semantic similarity based method is effective in reducing wrong labels. The relation extraction performance of the CNN model using the core dependency phrases as input is the best of all, which indicates that using the core dependency phrases as input of CNN is enough to capture the features for relation classification and could avoid negative impact from irrelevant terms.

Content

Vgl.: https://doi.org/10.1016/j.ipm.2018.04.002.

Theme

Semantisches Umfeld in Indexierung u. Retrieval
Automatisches Klassifizieren

Similar documents (author)

1. Zhang, X.; Wang, D.; Tang, Y.; Xiao, Q.: How question type influences knowledge withholding in social Q&A community (2023) 3.22

   3.215001 = sum of:
     3.215001 = sum of:
       1.1476206 = weight(author_txt:wang in 1067) [ClassicSimilarity], result of:
         1.1476206 = score(doc=1067,freq=1.0), product of:
           0.559722 = queryWeight, product of:
             6.5610886 = idf(docFreq=169, maxDocs=44218)
             0.08530932 = queryNorm
           2.0503402 = fieldWeight in 1067, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.5610886 = idf(docFreq=169, maxDocs=44218)
             0.3125 = fieldNorm(doc=1067)
       2.0673804 = weight(author_txt:tang in 1067) [ClassicSimilarity], result of:
         2.0673804 = score(doc=1067,freq=1.0), product of:
           0.82868046 = queryWeight, product of:
             1.2167668 = boost
             7.983315 = idf(docFreq=40, maxDocs=44218)
             0.08530932 = queryNorm
           2.494786 = fieldWeight in 1067, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.983315 = idf(docFreq=40, maxDocs=44218)
             0.3125 = fieldNorm(doc=1067)
   

2. Tang, R.; Solomon, P.: Toward an understanding of the dynamics of relevance judgement : an analysis of one person's search behavior (1998) 1.65

   1.6539043 = sum of:
     1.6539043 = product of:
       3.3078086 = sum of:
         3.3078086 = weight(author_txt:tang in 3268) [ClassicSimilarity], result of:
           3.3078086 = score(doc=3268,freq=1.0), product of:
             0.82868046 = queryWeight, product of:
               1.2167668 = boost
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.08530932 = queryNorm
             3.9916575 = fieldWeight in 3268, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.5 = fieldNorm(doc=3268)
       0.5 = coord(1/2)
   

3. Tang, R.; Solomon, P.: Use of relevance criteria across stages of document evaluation : on the complementarity of experimental and naturalistic studies (2001) 1.65

   1.6539043 = sum of:
     1.6539043 = product of:
       3.3078086 = sum of:
         3.3078086 = weight(author_txt:tang in 5213) [ClassicSimilarity], result of:
           3.3078086 = score(doc=5213,freq=1.0), product of:
             0.82868046 = queryWeight, product of:
               1.2167668 = boost
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.08530932 = queryNorm
             3.9916575 = fieldWeight in 5213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.5 = fieldNorm(doc=5213)
       0.5 = coord(1/2)
   

4. Tang, M.-C.: Browsing and searching in a faceted information space : a naturalistic study of PubMed users' interaction with a display tool (2007) 1.65

   1.6539043 = sum of:
     1.6539043 = product of:
       3.3078086 = sum of:
         3.3078086 = weight(author_txt:tang in 617) [ClassicSimilarity], result of:
           3.3078086 = score(doc=617,freq=1.0), product of:
             0.82868046 = queryWeight, product of:
               1.2167668 = boost
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.08530932 = queryNorm
             3.9916575 = fieldWeight in 617, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.5 = fieldNorm(doc=617)
       0.5 = coord(1/2)
   

5. Tang, R.; Safer, M.A.: Author-rated importance of cited references in biology and psychology publications (2008) 1.65

   1.6539043 = sum of:
     1.6539043 = product of:
       3.3078086 = sum of:
         3.3078086 = weight(author_txt:tang in 1738) [ClassicSimilarity], result of:
           3.3078086 = score(doc=1738,freq=1.0), product of:
             0.82868046 = queryWeight, product of:
               1.2167668 = boost
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.08530932 = queryNorm
             3.9916575 = fieldWeight in 1738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.983315 = idf(docFreq=40, maxDocs=44218)
               0.5 = fieldNorm(doc=1738)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Zhang, M.; Zhou, G.D.; Aw, A.: Exploring syntactic structured features over parse trees for relation extraction using kernel methods (2008) 0.21

   0.21226448 = sum of:
     0.21226448 = product of:
       0.7580874 = sum of:
         0.035755087 = weight(abstract_txt:capture in 2055) [ClassicSimilarity], result of:
           0.035755087 = score(doc=2055,freq=1.0), product of:
             0.08995911 = queryWeight, product of:
               6.3593493 = idf(docFreq=207, maxDocs=44218)
               0.014145961 = queryNorm
             0.39745933 = fieldWeight in 2055, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3593493 = idf(docFreq=207, maxDocs=44218)
               0.0625 = fieldNorm(doc=2055)
         0.019015318 = weight(abstract_txt:method in 2055) [ClassicSimilarity], result of:
           0.019015318 = score(doc=2055,freq=1.0), product of:
             0.06759575 = queryWeight, product of:
               1.0616534 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.014145961 = queryNorm
             0.28130937 = fieldWeight in 2055, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.0625 = fieldNorm(doc=2055)
         0.014435834 = weight(abstract_txt:using in 2055) [ClassicSimilarity], result of:
           0.014435834 = score(doc=2055,freq=1.0), product of:
             0.06669519 = queryWeight, product of:
               1.3614281 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.014145961 = queryNorm
             0.21644491 = fieldWeight in 2055, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.0625 = fieldNorm(doc=2055)
         0.031133026 = weight(abstract_txt:semantic in 2055) [ClassicSimilarity], result of:
           0.031133026 = score(doc=2055,freq=1.0), product of:
             0.111330494 = queryWeight, product of:
               1.758954 = boost
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.014145961 = queryNorm
             0.2796451 = fieldWeight in 2055, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.0625 = fieldNorm(doc=2055)
         0.202076 = weight(abstract_txt:extraction in 2055) [ClassicSimilarity], result of:
           0.202076 = score(doc=2055,freq=6.0), product of:
             0.21318631 = queryWeight, product of:
               2.4340365 = boost
               6.1915555 = idf(docFreq=245, maxDocs=44218)
               0.014145961 = queryNorm
             0.9478845 = fieldWeight in 2055, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.1915555 = idf(docFreq=245, maxDocs=44218)
               0.0625 = fieldNorm(doc=2055)
         0.18756829 = weight(abstract_txt:dependency in 2055) [ClassicSimilarity], result of:
           0.18756829 = score(doc=2055,freq=1.0), product of:
             0.36861488 = queryWeight, product of:
               3.2006183 = boost
               8.14154 = idf(docFreq=34, maxDocs=44218)
               0.014145961 = queryNorm
             0.5088462 = fieldWeight in 2055, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.14154 = idf(docFreq=34, maxDocs=44218)
               0.0625 = fieldNorm(doc=2055)
         0.26810387 = weight(abstract_txt:relation in 2055) [ClassicSimilarity], result of:
           0.26810387 = score(doc=2055,freq=5.0), product of:
             0.35575652 = queryWeight, product of:
               4.663749 = boost
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.014145961 = queryNorm
             0.7536162 = fieldWeight in 2055, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.0625 = fieldNorm(doc=2055)
       0.28 = coord(7/25)
   

2. Vlachidis, A.; Tudhope, D.: ¬A knowledge-based approach to information extraction for semantic interoperability in the archaeology domain (2016) 0.17

   0.16652568 = sum of:
     0.16652568 = product of:
       0.59473455 = sum of:
         0.019015318 = weight(abstract_txt:method in 2895) [ClassicSimilarity], result of:
           0.019015318 = score(doc=2895,freq=1.0), product of:
             0.06759575 = queryWeight, product of:
               1.0616534 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.014145961 = queryNorm
             0.28130937 = fieldWeight in 2895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.0625 = fieldNorm(doc=2895)
         0.049796537 = weight(abstract_txt:phrase in 2895) [ClassicSimilarity], result of:
           0.049796537 = score(doc=2895,freq=1.0), product of:
             0.11218962 = queryWeight, product of:
               1.1167444 = boost
               7.1017675 = idf(docFreq=98, maxDocs=44218)
               0.014145961 = queryNorm
             0.44386047 = fieldWeight in 2895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1017675 = idf(docFreq=98, maxDocs=44218)
               0.0625 = fieldNorm(doc=2895)
         0.025003599 = weight(abstract_txt:using in 2895) [ClassicSimilarity], result of:
           0.025003599 = score(doc=2895,freq=3.0), product of:
             0.06669519 = queryWeight, product of:
               1.3614281 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.014145961 = queryNorm
             0.37489358 = fieldWeight in 2895, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.0625 = fieldNorm(doc=2895)
         0.07626003 = weight(abstract_txt:semantic in 2895) [ClassicSimilarity], result of:
           0.07626003 = score(doc=2895,freq=6.0), product of:
             0.111330494 = queryWeight, product of:
               1.758954 = boost
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.014145961 = queryNorm
             0.6849878 = fieldWeight in 2895, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.0625 = fieldNorm(doc=2895)
         0.09010097 = weight(abstract_txt:phrases in 2895) [ClassicSimilarity], result of:
           0.09010097 = score(doc=2895,freq=1.0), product of:
             0.20988572 = queryWeight, product of:
               2.1601498 = boost
               6.8685737 = idf(docFreq=124, maxDocs=44218)
               0.014145961 = queryNorm
             0.42928585 = fieldWeight in 2895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8685737 = idf(docFreq=124, maxDocs=44218)
               0.0625 = fieldNorm(doc=2895)
         0.16499436 = weight(abstract_txt:extraction in 2895) [ClassicSimilarity], result of:
           0.16499436 = score(doc=2895,freq=4.0), product of:
             0.21318631 = queryWeight, product of:
               2.4340365 = boost
               6.1915555 = idf(docFreq=245, maxDocs=44218)
               0.014145961 = queryNorm
             0.77394444 = fieldWeight in 2895, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.1915555 = idf(docFreq=245, maxDocs=44218)
               0.0625 = fieldNorm(doc=2895)
         0.16956377 = weight(abstract_txt:relation in 2895) [ClassicSimilarity], result of:
           0.16956377 = score(doc=2895,freq=2.0), product of:
             0.35575652 = queryWeight, product of:
               4.663749 = boost
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.014145961 = queryNorm
             0.47662872 = fieldWeight in 2895, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.0625 = fieldNorm(doc=2895)
       0.28 = coord(7/25)
   

3. Agarwal, B.; Ramampiaro, H.; Langseth, H.; Ruocco, M.: ¬A deep network model for paraphrase detection in short text messages (2018) 0.14

   0.13610667 = sum of:
     0.13610667 = product of:
       0.48609525 = sum of:
         0.035755087 = weight(abstract_txt:capture in 5043) [ClassicSimilarity], result of:
           0.035755087 = score(doc=5043,freq=1.0), product of:
             0.08995911 = queryWeight, product of:
               6.3593493 = idf(docFreq=207, maxDocs=44218)
               0.014145961 = queryNorm
             0.39745933 = fieldWeight in 5043, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3593493 = idf(docFreq=207, maxDocs=44218)
               0.0625 = fieldNorm(doc=5043)
         0.07722421 = weight(abstract_txt:sentence in 5043) [ClassicSimilarity], result of:
           0.07722421 = score(doc=5043,freq=3.0), product of:
             0.10421938 = queryWeight, product of:
               1.0763454 = boost
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.014145961 = queryNorm
             0.74097747 = fieldWeight in 5043, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.0625 = fieldNorm(doc=5043)
         0.08001033 = weight(abstract_txt:neural in 5043) [ClassicSimilarity], result of:
           0.08001033 = score(doc=5043,freq=3.0), product of:
             0.10671125 = queryWeight, product of:
               1.0891371 = boost
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.014145961 = queryNorm
             0.74978346 = fieldWeight in 5043, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.0625 = fieldNorm(doc=5043)
         0.020415353 = weight(abstract_txt:using in 5043) [ClassicSimilarity], result of:
           0.020415353 = score(doc=5043,freq=2.0), product of:
             0.06669519 = queryWeight, product of:
               1.3614281 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.014145961 = queryNorm
             0.30609933 = fieldWeight in 5043, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.0625 = fieldNorm(doc=5043)
         0.041093208 = weight(abstract_txt:similarity in 5043) [ClassicSimilarity], result of:
           0.041093208 = score(doc=5043,freq=1.0), product of:
             0.112987496 = queryWeight, product of:
               1.3725818 = boost
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.014145961 = queryNorm
             0.36369696 = fieldWeight in 5043, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.0625 = fieldNorm(doc=5043)
         0.044028744 = weight(abstract_txt:semantic in 5043) [ClassicSimilarity], result of:
           0.044028744 = score(doc=5043,freq=2.0), product of:
             0.111330494 = queryWeight, product of:
               1.758954 = boost
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.014145961 = queryNorm
             0.39547786 = fieldWeight in 5043, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.0625 = fieldNorm(doc=5043)
         0.18756829 = weight(abstract_txt:dependency in 5043) [ClassicSimilarity], result of:
           0.18756829 = score(doc=5043,freq=1.0), product of:
             0.36861488 = queryWeight, product of:
               3.2006183 = boost
               8.14154 = idf(docFreq=34, maxDocs=44218)
               0.014145961 = queryNorm
             0.5088462 = fieldWeight in 5043, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.14154 = idf(docFreq=34, maxDocs=44218)
               0.0625 = fieldNorm(doc=5043)
       0.28 = coord(7/25)
   

4. Zhou, G.D.; Zhang, M.: Extracting relation information from text documents by exploring various types of knowledge (2007) 0.13

   0.12602329 = sum of:
     0.12602329 = product of:
       0.63011646 = sum of:
         0.049796537 = weight(abstract_txt:phrase in 927) [ClassicSimilarity], result of:
           0.049796537 = score(doc=927,freq=1.0), product of:
             0.11218962 = queryWeight, product of:
               1.1167444 = boost
               7.1017675 = idf(docFreq=98, maxDocs=44218)
               0.014145961 = queryNorm
             0.44386047 = fieldWeight in 927, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1017675 = idf(docFreq=98, maxDocs=44218)
               0.0625 = fieldNorm(doc=927)
         0.014435834 = weight(abstract_txt:using in 927) [ClassicSimilarity], result of:
           0.014435834 = score(doc=927,freq=1.0), product of:
             0.06669519 = queryWeight, product of:
               1.3614281 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.014145961 = queryNorm
             0.21644491 = fieldWeight in 927, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.0625 = fieldNorm(doc=927)
         0.05392398 = weight(abstract_txt:semantic in 927) [ClassicSimilarity], result of:
           0.05392398 = score(doc=927,freq=3.0), product of:
             0.111330494 = queryWeight, product of:
               1.758954 = boost
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.014145961 = queryNorm
             0.48435947 = fieldWeight in 927, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.0625 = fieldNorm(doc=927)
         0.21826701 = weight(abstract_txt:extraction in 927) [ClassicSimilarity], result of:
           0.21826701 = score(doc=927,freq=7.0), product of:
             0.21318631 = queryWeight, product of:
               2.4340365 = boost
               6.1915555 = idf(docFreq=245, maxDocs=44218)
               0.014145961 = queryNorm
             1.0238322 = fieldWeight in 927, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.1915555 = idf(docFreq=245, maxDocs=44218)
               0.0625 = fieldNorm(doc=927)
         0.2936931 = weight(abstract_txt:relation in 927) [ClassicSimilarity], result of:
           0.2936931 = score(doc=927,freq=6.0), product of:
             0.35575652 = queryWeight, product of:
               4.663749 = boost
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.014145961 = queryNorm
             0.8255452 = fieldWeight in 927, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.0625 = fieldNorm(doc=927)
       0.2 = coord(5/25)
   

5. Collovini de Abreu, S.; Vieira, R.: RelP: Portuguese open relation extraction (2017) 0.12

   0.11772662 = sum of:
     0.11772662 = product of:
       0.58863306 = sum of:
         0.010326277 = weight(abstract_txt:data in 3621) [ClassicSimilarity], result of:
           0.010326277 = score(doc=3621,freq=1.0), product of:
             0.049521346 = queryWeight, product of:
               1.0492734 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.014145961 = queryNorm
             0.20852174 = fieldWeight in 3621, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=3621)
         0.044585418 = weight(abstract_txt:sentence in 3621) [ClassicSimilarity], result of:
           0.044585418 = score(doc=3621,freq=1.0), product of:
             0.10421938 = queryWeight, product of:
               1.0763454 = boost
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.014145961 = queryNorm
             0.42780355 = fieldWeight in 3621, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.0625 = fieldNorm(doc=3621)
         0.031133026 = weight(abstract_txt:semantic in 3621) [ClassicSimilarity], result of:
           0.031133026 = score(doc=3621,freq=1.0), product of:
             0.111330494 = queryWeight, product of:
               1.758954 = boost
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.014145961 = queryNorm
             0.2796451 = fieldWeight in 3621, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.0625 = fieldNorm(doc=3621)
         0.1428893 = weight(abstract_txt:extraction in 3621) [ClassicSimilarity], result of:
           0.1428893 = score(doc=3621,freq=3.0), product of:
             0.21318631 = queryWeight, product of:
               2.4340365 = boost
               6.1915555 = idf(docFreq=245, maxDocs=44218)
               0.014145961 = queryNorm
             0.67025554 = fieldWeight in 3621, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.1915555 = idf(docFreq=245, maxDocs=44218)
               0.0625 = fieldNorm(doc=3621)
         0.35969907 = weight(abstract_txt:relation in 3621) [ClassicSimilarity], result of:
           0.35969907 = score(doc=3621,freq=9.0), product of:
             0.35575652 = queryWeight, product of:
               4.663749 = boost
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.014145961 = queryNorm
             1.0110822 = fieldWeight in 3621, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.3924384 = idf(docFreq=546, maxDocs=44218)
               0.0625 = fieldNorm(doc=3621)
       0.2 = coord(5/25)