Document (#42057)

Author
Ru, C.
Tang, J.
Li, S.
Xie, S.
Wang, T.
Title
Using semantic similarity to reduce wrong labels in distant supervision for relation extraction
Source
Information processing and management. 54(2018) no.4, S.593-608
Year
2018
Abstract
Distant supervision (DS) has the advantage of automatically generating large amounts of labelled training data and has been widely used for relation extraction. However, there are usually many wrong labels in the automatically labelled data in distant supervision (Riedel, Yao, & McCallum, 2010). This paper presents a novel method to reduce the wrong labels. The proposed method uses the semantic Jaccard with word embedding to measure the semantic similarity between the relation phrase in the knowledge base and the dependency phrases between two entities in a sentence to filter the wrong labels. In the process of reducing wrong labels, the semantic Jaccard algorithm selects a core dependency phrase to represent the candidate relation in a sentence, which can capture features for relation classification and avoid the negative impact from irrelevant term sequences that previous neural network models of relation extraction often suffer. In the process of relation classification, the core dependency phrases are also used as the input of a convolutional neural network (CNN) for relation classification. The experimental results show that compared with the methods using original DS data, the methods using filtered DS data performed much better in relation extraction. It indicates that the semantic similarity based method is effective in reducing wrong labels. The relation extraction performance of the CNN model using the core dependency phrases as input is the best of all, which indicates that using the core dependency phrases as input of CNN is enough to capture the features for relation classification and could avoid negative impact from irrelevant terms.
Content
Vgl.: https://doi.org/10.1016/j.ipm.2018.04.002.
Theme
Semantisches Umfeld in Indexierung u. Retrieval
Automatisches Klassifizieren

Similar documents (author)

  1. Tang, R.; Solomon, P.: Toward an understanding of the dynamics of relevance judgement : an analysis of one person's search behavior (1998) 1.67
    1.6736971 = sum of:
      1.6736971 = product of:
        3.3473942 = sum of:
          3.3473942 = weight(author_txt:tang in 5269) [ClassicSimilarity], result of:
            3.3473942 = score(doc=5269,freq=1.0), product of:
              0.8245324 = queryWeight, product of:
                1.2071654 = boost
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.084122434 = queryNorm
              4.0597486 = fieldWeight in 5269, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.5 = fieldNorm(doc=5269)
        0.5 = coord(1/2)
    
  2. Tang, R.; Solomon, P.: Use of relevance criteria across stages of document evaluation : on the complementarity of experimental and naturalistic studies (2001) 1.67
    1.6736971 = sum of:
      1.6736971 = product of:
        3.3473942 = sum of:
          3.3473942 = weight(author_txt:tang in 214) [ClassicSimilarity], result of:
            3.3473942 = score(doc=214,freq=1.0), product of:
              0.8245324 = queryWeight, product of:
                1.2071654 = boost
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.084122434 = queryNorm
              4.0597486 = fieldWeight in 214, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.5 = fieldNorm(doc=214)
        0.5 = coord(1/2)
    
  3. Tang, M.-C.: Browsing and searching in a faceted information space : a naturalistic study of PubMed users' interaction with a display tool (2007) 1.67
    1.6736971 = sum of:
      1.6736971 = product of:
        3.3473942 = sum of:
          3.3473942 = weight(author_txt:tang in 2618) [ClassicSimilarity], result of:
            3.3473942 = score(doc=2618,freq=1.0), product of:
              0.8245324 = queryWeight, product of:
                1.2071654 = boost
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.084122434 = queryNorm
              4.0597486 = fieldWeight in 2618, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.5 = fieldNorm(doc=2618)
        0.5 = coord(1/2)
    
  4. Tang, R.; Safer, M.A.: Author-rated importance of cited references in biology and psychology publications (2008) 1.67
    1.6736971 = sum of:
      1.6736971 = product of:
        3.3473942 = sum of:
          3.3473942 = weight(author_txt:tang in 3739) [ClassicSimilarity], result of:
            3.3473942 = score(doc=3739,freq=1.0), product of:
              0.8245324 = queryWeight, product of:
                1.2071654 = boost
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.084122434 = queryNorm
              4.0597486 = fieldWeight in 3739, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.5 = fieldNorm(doc=3739)
        0.5 = coord(1/2)
    
  5. Tang, L.; Hu, G.: Tracing the footprint of knowledge spillover : evidence from U.S.-China collaboration in nanotechnology (2013) 1.67
    1.6736971 = sum of:
      1.6736971 = product of:
        3.3473942 = sum of:
          3.3473942 = weight(author_txt:tang in 2504) [ClassicSimilarity], result of:
            3.3473942 = score(doc=2504,freq=1.0), product of:
              0.8245324 = queryWeight, product of:
                1.2071654 = boost
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.084122434 = queryNorm
              4.0597486 = fieldWeight in 2504, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.5 = fieldNorm(doc=2504)
        0.5 = coord(1/2)
    

Similar documents (content)

  1. Zhang, M.; Zhou, G.D.; Aw, A.: Exploring syntactic structured features over parse trees for relation extraction using kernel methods (2008) 0.21
    0.21190672 = sum of:
      0.21190672 = product of:
        0.7568097 = sum of:
          0.03560693 = weight(abstract_txt:capture in 4056) [ClassicSimilarity], result of:
            0.03560693 = score(doc=4056,freq=1.0), product of:
              0.08941493 = queryWeight, product of:
                6.37154 = idf(docFreq=200, maxDocs=43254)
                0.014033488 = queryNorm
              0.39822125 = fieldWeight in 4056, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.37154 = idf(docFreq=200, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.018972693 = weight(abstract_txt:method in 4056) [ClassicSimilarity], result of:
            0.018972693 = score(doc=4056,freq=1.0), product of:
              0.06727238 = queryWeight, product of:
                1.0623289 = boost
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.014033488 = queryNorm
              0.28202796 = fieldWeight in 4056, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.014418661 = weight(abstract_txt:using in 4056) [ClassicSimilarity], result of:
            0.014418661 = score(doc=4056,freq=1.0), product of:
              0.066422775 = queryWeight, product of:
                1.362773 = boost
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.014033488 = queryNorm
              0.21707405 = fieldWeight in 4056, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.031046037 = weight(abstract_txt:semantic in 4056) [ClassicSimilarity], result of:
            0.031046037 = score(doc=4056,freq=1.0), product of:
              0.11075699 = queryWeight, product of:
                1.7597483 = boost
                4.484923 = idf(docFreq=1325, maxDocs=43254)
                0.014033488 = queryNorm
              0.28030768 = fieldWeight in 4056, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.484923 = idf(docFreq=1325, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.20197807 = weight(abstract_txt:extraction in 4056) [ClassicSimilarity], result of:
            0.20197807 = score(doc=4056,freq=6.0), product of:
              0.21241546 = queryWeight, product of:
                2.437014 = boost
                6.2110133 = idf(docFreq=235, maxDocs=43254)
                0.014033488 = queryNorm
              0.95086336 = fieldWeight in 4056, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                6.2110133 = idf(docFreq=235, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.18421656 = weight(abstract_txt:dependency in 4056) [ClassicSimilarity], result of:
            0.18421656 = score(doc=4056,freq=1.0), product of:
              0.36301076 = queryWeight, product of:
                3.1858459 = boost
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.014033488 = queryNorm
              0.5074686 = fieldWeight in 4056, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
          0.27057078 = weight(abstract_txt:relation in 4056) [ClassicSimilarity], result of:
            0.27057078 = score(doc=4056,freq=5.0), product of:
              0.35675648 = queryWeight, product of:
                4.6844893 = boost
                5.426802 = idf(docFreq=516, maxDocs=43254)
                0.014033488 = queryNorm
              0.7584187 = fieldWeight in 4056, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.426802 = idf(docFreq=516, maxDocs=43254)
                0.0625 = fieldNorm(doc=4056)
        0.28 = coord(7/25)
    
  2. Vlachidis, A.; Tudhope, D.: ¬A knowledge-based approach to information extraction for semantic interoperability in the archaeology domain (2016) 0.17
    0.1662818 = sum of:
      0.1662818 = product of:
        0.5938636 = sum of:
          0.018972693 = weight(abstract_txt:method in 4360) [ClassicSimilarity], result of:
            0.018972693 = score(doc=4360,freq=1.0), product of:
              0.06727238 = queryWeight, product of:
                1.0623289 = boost
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.014033488 = queryNorm
              0.28202796 = fieldWeight in 4360, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5124474 = idf(docFreq=1289, maxDocs=43254)
                0.0625 = fieldNorm(doc=4360)
          0.048848413 = weight(abstract_txt:phrase in 4360) [ClassicSimilarity], result of:
            0.048848413 = score(doc=4360,freq=1.0), product of:
              0.11039618 = queryWeight, product of:
                1.1111482 = boost
                7.0797253 = idf(docFreq=98, maxDocs=43254)
                0.014033488 = queryNorm
              0.44248283 = fieldWeight in 4360, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.0797253 = idf(docFreq=98, maxDocs=43254)
                0.0625 = fieldNorm(doc=4360)
          0.024973853 = weight(abstract_txt:using in 4360) [ClassicSimilarity], result of:
            0.024973853 = score(doc=4360,freq=3.0), product of:
              0.066422775 = queryWeight, product of:
                1.362773 = boost
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.014033488 = queryNorm
              0.37598327 = fieldWeight in 4360, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.0625 = fieldNorm(doc=4360)
          0.07604695 = weight(abstract_txt:semantic in 4360) [ClassicSimilarity], result of:
            0.07604695 = score(doc=4360,freq=6.0), product of:
              0.11075699 = queryWeight, product of:
                1.7597483 = boost
                4.484923 = idf(docFreq=1325, maxDocs=43254)
                0.014033488 = queryNorm
              0.6866108 = fieldWeight in 4360, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                4.484923 = idf(docFreq=1325, maxDocs=43254)
                0.0625 = fieldNorm(doc=4360)
          0.08898336 = weight(abstract_txt:phrases in 4360) [ClassicSimilarity], result of:
            0.08898336 = score(doc=4360,freq=1.0), product of:
              0.2074609 = queryWeight, product of:
                2.1541607 = boost
                6.8626604 = idf(docFreq=122, maxDocs=43254)
                0.014033488 = queryNorm
              0.42891628 = fieldWeight in 4360, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.8626604 = idf(docFreq=122, maxDocs=43254)
                0.0625 = fieldNorm(doc=4360)
          0.1649144 = weight(abstract_txt:extraction in 4360) [ClassicSimilarity], result of:
            0.1649144 = score(doc=4360,freq=4.0), product of:
              0.21241546 = queryWeight, product of:
                2.437014 = boost
                6.2110133 = idf(docFreq=235, maxDocs=43254)
                0.014033488 = queryNorm
              0.77637666 = fieldWeight in 4360, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.2110133 = idf(docFreq=235, maxDocs=43254)
                0.0625 = fieldNorm(doc=4360)
          0.17112397 = weight(abstract_txt:relation in 4360) [ClassicSimilarity], result of:
            0.17112397 = score(doc=4360,freq=2.0), product of:
              0.35675648 = queryWeight, product of:
                4.6844893 = boost
                5.426802 = idf(docFreq=516, maxDocs=43254)
                0.014033488 = queryNorm
              0.47966605 = fieldWeight in 4360, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.426802 = idf(docFreq=516, maxDocs=43254)
                0.0625 = fieldNorm(doc=4360)
        0.28 = coord(7/25)
    
  3. Agarwal, B.; Ramampiaro, H.; Langseth, H.; Ruocco, M.: ¬A deep network model for paraphrase detection in short text messages (2018) 0.14
    0.13500704 = sum of:
      0.13500704 = product of:
        0.48216802 = sum of:
          0.03560693 = weight(abstract_txt:capture in 44) [ClassicSimilarity], result of:
            0.03560693 = score(doc=44,freq=1.0), product of:
              0.08941493 = queryWeight, product of:
                6.37154 = idf(docFreq=200, maxDocs=43254)
                0.014033488 = queryNorm
              0.39822125 = fieldWeight in 44, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.37154 = idf(docFreq=200, maxDocs=43254)
                0.0625 = fieldNorm(doc=44)
          0.07651977 = weight(abstract_txt:sentence in 44) [ClassicSimilarity], result of:
            0.07651977 = score(doc=44,freq=3.0), product of:
              0.10324343 = queryWeight, product of:
                1.074549 = boost
                6.8465314 = idf(docFreq=124, maxDocs=43254)
                0.014033488 = queryNorm
              0.7411587 = fieldWeight in 44, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.8465314 = idf(docFreq=124, maxDocs=43254)
                0.0625 = fieldNorm(doc=44)
          0.08088646 = weight(abstract_txt:neural in 44) [ClassicSimilarity], result of:
            0.08088646 = score(doc=44,freq=3.0), product of:
              0.1071348 = queryWeight, product of:
                1.0946121 = boost
                6.9743648 = idf(docFreq=109, maxDocs=43254)
                0.014033488 = queryNorm
              0.75499713 = fieldWeight in 44, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.9743648 = idf(docFreq=109, maxDocs=43254)
                0.0625 = fieldNorm(doc=44)
          0.020391066 = weight(abstract_txt:using in 44) [ClassicSimilarity], result of:
            0.020391066 = score(doc=44,freq=2.0), product of:
              0.066422775 = queryWeight, product of:
                1.362773 = boost
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.014033488 = queryNorm
              0.30698907 = fieldWeight in 44, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.0625 = fieldNorm(doc=44)
          0.040641516 = weight(abstract_txt:similarity in 44) [ClassicSimilarity], result of:
            0.040641516 = score(doc=44,freq=1.0), product of:
              0.11178858 = queryWeight, product of:
                1.3694284 = boost
                5.8169117 = idf(docFreq=349, maxDocs=43254)
                0.014033488 = queryNorm
              0.36355698 = fieldWeight in 44, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.8169117 = idf(docFreq=349, maxDocs=43254)
                0.0625 = fieldNorm(doc=44)
          0.043905724 = weight(abstract_txt:semantic in 44) [ClassicSimilarity], result of:
            0.043905724 = score(doc=44,freq=2.0), product of:
              0.11075699 = queryWeight, product of:
                1.7597483 = boost
                4.484923 = idf(docFreq=1325, maxDocs=43254)
                0.014033488 = queryNorm
              0.3964149 = fieldWeight in 44, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.484923 = idf(docFreq=1325, maxDocs=43254)
                0.0625 = fieldNorm(doc=44)
          0.18421656 = weight(abstract_txt:dependency in 44) [ClassicSimilarity], result of:
            0.18421656 = score(doc=44,freq=1.0), product of:
              0.36301076 = queryWeight, product of:
                3.1858459 = boost
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.014033488 = queryNorm
              0.5074686 = fieldWeight in 44, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.119497 = idf(docFreq=34, maxDocs=43254)
                0.0625 = fieldNorm(doc=44)
        0.28 = coord(7/25)
    
  4. Zhou, G.D.; Zhang, M.: Extracting relation information from text documents by exploring various types of knowledge (2007) 0.13
    0.12631941 = sum of:
      0.12631941 = product of:
        0.63159704 = sum of:
          0.048848413 = weight(abstract_txt:phrase in 2928) [ClassicSimilarity], result of:
            0.048848413 = score(doc=2928,freq=1.0), product of:
              0.11039618 = queryWeight, product of:
                1.1111482 = boost
                7.0797253 = idf(docFreq=98, maxDocs=43254)
                0.014033488 = queryNorm
              0.44248283 = fieldWeight in 2928, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.0797253 = idf(docFreq=98, maxDocs=43254)
                0.0625 = fieldNorm(doc=2928)
          0.014418661 = weight(abstract_txt:using in 2928) [ClassicSimilarity], result of:
            0.014418661 = score(doc=2928,freq=1.0), product of:
              0.066422775 = queryWeight, product of:
                1.362773 = boost
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.014033488 = queryNorm
              0.21707405 = fieldWeight in 2928, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4731848 = idf(docFreq=3646, maxDocs=43254)
                0.0625 = fieldNorm(doc=2928)
          0.05377331 = weight(abstract_txt:semantic in 2928) [ClassicSimilarity], result of:
            0.05377331 = score(doc=2928,freq=3.0), product of:
              0.11075699 = queryWeight, product of:
                1.7597483 = boost
                4.484923 = idf(docFreq=1325, maxDocs=43254)
                0.014033488 = queryNorm
              0.48550713 = fieldWeight in 2928, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.484923 = idf(docFreq=1325, maxDocs=43254)
                0.0625 = fieldNorm(doc=2928)
          0.21816126 = weight(abstract_txt:extraction in 2928) [ClassicSimilarity], result of:
            0.21816126 = score(doc=2928,freq=7.0), product of:
              0.21241546 = queryWeight, product of:
                2.437014 = boost
                6.2110133 = idf(docFreq=235, maxDocs=43254)
                0.014033488 = queryNorm
              1.0270498 = fieldWeight in 2928, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                6.2110133 = idf(docFreq=235, maxDocs=43254)
                0.0625 = fieldNorm(doc=2928)
          0.29639542 = weight(abstract_txt:relation in 2928) [ClassicSimilarity], result of:
            0.29639542 = score(doc=2928,freq=6.0), product of:
              0.35675648 = queryWeight, product of:
                4.6844893 = boost
                5.426802 = idf(docFreq=516, maxDocs=43254)
                0.014033488 = queryNorm
              0.830806 = fieldWeight in 2928, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                5.426802 = idf(docFreq=516, maxDocs=43254)
                0.0625 = fieldNorm(doc=2928)
        0.2 = coord(5/25)
    
  5. Collovini de Abreu, S.; Vieira, R.: RelP: Portuguese open relation extraction (2017) 0.12
    0.11829764 = sum of:
      0.11829764 = product of:
        0.5914882 = sum of:
          0.010434564 = weight(abstract_txt:data in 5086) [ClassicSimilarity], result of:
            0.010434564 = score(doc=5086,freq=1.0), product of:
              0.049702693 = queryWeight, product of:
                1.0543867 = boost
                3.3590338 = idf(docFreq=4087, maxDocs=43254)
                0.014033488 = queryNorm
              0.20993961 = fieldWeight in 5086, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3590338 = idf(docFreq=4087, maxDocs=43254)
                0.0625 = fieldNorm(doc=5086)
          0.044178713 = weight(abstract_txt:sentence in 5086) [ClassicSimilarity], result of:
            0.044178713 = score(doc=5086,freq=1.0), product of:
              0.10324343 = queryWeight, product of:
                1.074549 = boost
                6.8465314 = idf(docFreq=124, maxDocs=43254)
                0.014033488 = queryNorm
              0.4279082 = fieldWeight in 5086, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.8465314 = idf(docFreq=124, maxDocs=43254)
                0.0625 = fieldNorm(doc=5086)
          0.031046037 = weight(abstract_txt:semantic in 5086) [ClassicSimilarity], result of:
            0.031046037 = score(doc=5086,freq=1.0), product of:
              0.11075699 = queryWeight, product of:
                1.7597483 = boost
                4.484923 = idf(docFreq=1325, maxDocs=43254)
                0.014033488 = queryNorm
              0.28030768 = fieldWeight in 5086, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.484923 = idf(docFreq=1325, maxDocs=43254)
                0.0625 = fieldNorm(doc=5086)
          0.14282006 = weight(abstract_txt:extraction in 5086) [ClassicSimilarity], result of:
            0.14282006 = score(doc=5086,freq=3.0), product of:
              0.21241546 = queryWeight, product of:
                2.437014 = boost
                6.2110133 = idf(docFreq=235, maxDocs=43254)
                0.014033488 = queryNorm
              0.6723619 = fieldWeight in 5086, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.2110133 = idf(docFreq=235, maxDocs=43254)
                0.0625 = fieldNorm(doc=5086)
          0.3630088 = weight(abstract_txt:relation in 5086) [ClassicSimilarity], result of:
            0.3630088 = score(doc=5086,freq=9.0), product of:
              0.35675648 = queryWeight, product of:
                4.6844893 = boost
                5.426802 = idf(docFreq=516, maxDocs=43254)
                0.014033488 = queryNorm
              1.0175254 = fieldWeight in 5086, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                5.426802 = idf(docFreq=516, maxDocs=43254)
                0.0625 = fieldNorm(doc=5086)
        0.2 = coord(5/25)