Document (#38109)

Author
Liu, R.-L.
Title
¬A passage extractor for classification of disease aspect information
Source
Journal of the American Society for Information Science and Technology. 64(2013) no.11, S.2265-2277
Year
2013
Abstract
Retrieval of disease information is often based on several key aspects such as etiology, diagnosis, treatment, prevention, and symptoms of diseases. Automatic identification of disease aspect information is thus essential. In this article, I model the aspect identification problem as a text classification (TC) problem in which a disease aspect corresponds to a category. The disease aspect classification problem poses two challenges to classifiers: (a) a medical text often contains information about multiple aspects of a disease and hence produces noise for the classifiers and (b) text classifiers often cannot extract the textual parts (i.e., passages) about the categories of interest. I thus develop a technique, PETC (Passage Extractor for Text Classification), that extracts passages (from medical texts) for the underlying text classifiers to classify. Case studies on thousands of Chinese and English medical texts show that PETC enhances a support vector machine (SVM) classifier in classifying disease aspect information. PETC also performs better than three state-of-the-art classifier enhancement techniques, including two passage extraction techniques for text classifiers and a technique that employs term proximity information to enhance text classifiers. The contribution is of significance to evidence-based medicine, health education, and healthcare decision support. PETC can be used in those application domains in which a text to be classified may have several parts about different categories.
Theme
Automatisches Klassifizieren
Field
Medizin

Similar documents (content)

  1. Mengle, S.; Goharian, N.: Passage detection using text classification (2009) 0.35
    0.35451096 = sum of:
      0.35451096 = product of:
        0.98475266 = sum of:
          0.023579597 = weight(abstract_txt:techniques in 4766) [ClassicSimilarity], result of:
            0.023579597 = score(doc=4766,freq=3.0), product of:
              0.05500604 = queryWeight, product of:
                4.525612 = idf(docFreq=1257, maxDocs=42740)
                0.012154387 = queryNorm
              0.42867288 = fieldWeight in 4766, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.525612 = idf(docFreq=1257, maxDocs=42740)
                0.0546875 = fieldNorm(doc=4766)
          0.019784732 = weight(abstract_txt:thus in 4766) [ClassicSimilarity], result of:
            0.019784732 = score(doc=4766,freq=1.0), product of:
              0.07057431 = queryWeight, product of:
                1.1327084 = boost
                5.126199 = idf(docFreq=689, maxDocs=42740)
                0.012154387 = queryNorm
              0.280339 = fieldWeight in 4766, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.126199 = idf(docFreq=689, maxDocs=42740)
                0.0546875 = fieldNorm(doc=4766)
          0.03576676 = weight(abstract_txt:categories in 4766) [ClassicSimilarity], result of:
            0.03576676 = score(doc=4766,freq=3.0), product of:
              0.07261715 = queryWeight, product of:
                1.1489851 = boost
                5.199861 = idf(docFreq=640, maxDocs=42740)
                0.012154387 = queryNorm
              0.49253875 = fieldWeight in 4766, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.199861 = idf(docFreq=640, maxDocs=42740)
                0.0546875 = fieldNorm(doc=4766)
          0.02475584 = weight(abstract_txt:often in 4766) [ClassicSimilarity], result of:
            0.02475584 = score(doc=4766,freq=1.0), product of:
              0.09380847 = queryWeight, product of:
                1.5994161 = boost
                4.8255577 = idf(docFreq=931, maxDocs=42740)
                0.012154387 = queryNorm
              0.2638977 = fieldWeight in 4766, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.8255577 = idf(docFreq=931, maxDocs=42740)
                0.0546875 = fieldNorm(doc=4766)
          0.010952172 = weight(abstract_txt:information in 4766) [ClassicSimilarity], result of:
            0.010952172 = score(doc=4766,freq=3.0), product of:
              0.04758025 = queryWeight, product of:
                1.6109008 = boost
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.012154387 = queryNorm
              0.23018315 = fieldWeight in 4766, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.0546875 = fieldNorm(doc=4766)
          0.01879916 = weight(abstract_txt:classification in 4766) [ClassicSimilarity], result of:
            0.01879916 = score(doc=4766,freq=1.0), product of:
              0.085940026 = queryWeight, product of:
                1.7676959 = boost
                3.9999528 = idf(docFreq=2127, maxDocs=42740)
                0.012154387 = queryNorm
              0.21874742 = fieldWeight in 4766, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.9999528 = idf(docFreq=2127, maxDocs=42740)
                0.0546875 = fieldNorm(doc=4766)
          0.313726 = weight(abstract_txt:passages in 4766) [ClassicSimilarity], result of:
            0.313726 = score(doc=4766,freq=14.0), product of:
              0.18482082 = queryWeight, product of:
                1.8330328 = boost
                8.295595 = idf(docFreq=28, maxDocs=42740)
                0.012154387 = queryNorm
              1.6974604 = fieldWeight in 4766, product of:
                3.7416575 = tf(freq=14.0), with freq of:
                  14.0 = termFreq=14.0
                8.295595 = idf(docFreq=28, maxDocs=42740)
                0.0546875 = fieldNorm(doc=4766)
          0.4593303 = weight(abstract_txt:passage in 4766) [ClassicSimilarity], result of:
            0.4593303 = score(doc=4766,freq=14.0), product of:
              0.2727916 = queryWeight, product of:
                2.7274444 = boost
                8.228904 = idf(docFreq=30, maxDocs=42740)
                0.012154387 = queryNorm
              1.6838139 = fieldWeight in 4766, product of:
                3.7416575 = tf(freq=14.0), with freq of:
                  14.0 = termFreq=14.0
                8.228904 = idf(docFreq=30, maxDocs=42740)
                0.0546875 = fieldNorm(doc=4766)
          0.078058094 = weight(abstract_txt:text in 4766) [ClassicSimilarity], result of:
            0.078058094 = score(doc=4766,freq=4.0), product of:
              0.17621323 = queryWeight, product of:
                3.5796788 = boost
                4.0500593 = idf(docFreq=2023, maxDocs=42740)
                0.012154387 = queryNorm
              0.44297522 = fieldWeight in 4766, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.0500593 = idf(docFreq=2023, maxDocs=42740)
                0.0546875 = fieldNorm(doc=4766)
        0.36 = coord(9/25)
    
  2. Liu, R.-L.: Dynamic category profiling for text filtering and classification (2007) 0.29
    0.29325524 = sum of:
      0.29325524 = product of:
        0.9164226 = sum of:
          0.0417192 = weight(abstract_txt:categories in 2901) [ClassicSimilarity], result of:
            0.0417192 = score(doc=2901,freq=2.0), product of:
              0.07261715 = queryWeight, product of:
                1.1489851 = boost
                5.199861 = idf(docFreq=640, maxDocs=42740)
                0.012154387 = queryNorm
              0.5745089 = fieldWeight in 2901, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.199861 = idf(docFreq=640, maxDocs=42740)
                0.078125 = fieldNorm(doc=2901)
          0.036692966 = weight(abstract_txt:technique in 2901) [ClassicSimilarity], result of:
            0.036692966 = score(doc=2901,freq=1.0), product of:
              0.08398733 = queryWeight, product of:
                1.2356677 = boost
                5.5921526 = idf(docFreq=432, maxDocs=42740)
                0.012154387 = queryNorm
              0.4368869 = fieldWeight in 2901, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5921526 = idf(docFreq=432, maxDocs=42740)
                0.078125 = fieldNorm(doc=2901)
          0.027884096 = weight(abstract_txt:problem in 2901) [ClassicSimilarity], result of:
            0.027884096 = score(doc=2901,freq=1.0), product of:
              0.08006205 = queryWeight, product of:
                1.4775895 = boost
                4.457998 = idf(docFreq=1345, maxDocs=42740)
                0.012154387 = queryNorm
              0.3482811 = fieldWeight in 2901, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.457998 = idf(docFreq=1345, maxDocs=42740)
                0.078125 = fieldNorm(doc=2901)
          0.050014347 = weight(abstract_txt:often in 2901) [ClassicSimilarity], result of:
            0.050014347 = score(doc=2901,freq=2.0), product of:
              0.09380847 = queryWeight, product of:
                1.5994161 = boost
                4.8255577 = idf(docFreq=931, maxDocs=42740)
                0.012154387 = queryNorm
              0.53315383 = fieldWeight in 2901, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.8255577 = idf(docFreq=931, maxDocs=42740)
                0.078125 = fieldNorm(doc=2901)
          0.009033199 = weight(abstract_txt:information in 2901) [ClassicSimilarity], result of:
            0.009033199 = score(doc=2901,freq=1.0), product of:
              0.04758025 = queryWeight, product of:
                1.6109008 = boost
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.012154387 = queryNorm
              0.18985188 = fieldWeight in 2901, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.078125 = fieldNorm(doc=2901)
          0.02685594 = weight(abstract_txt:classification in 2901) [ClassicSimilarity], result of:
            0.02685594 = score(doc=2901,freq=1.0), product of:
              0.085940026 = queryWeight, product of:
                1.7676959 = boost
                3.9999528 = idf(docFreq=2127, maxDocs=42740)
                0.012154387 = queryNorm
              0.3124963 = fieldWeight in 2901, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.9999528 = idf(docFreq=2127, maxDocs=42740)
                0.078125 = fieldNorm(doc=2901)
          0.055755787 = weight(abstract_txt:text in 2901) [ClassicSimilarity], result of:
            0.055755787 = score(doc=2901,freq=1.0), product of:
              0.17621323 = queryWeight, product of:
                3.5796788 = boost
                4.0500593 = idf(docFreq=2023, maxDocs=42740)
                0.012154387 = queryNorm
              0.3164109 = fieldWeight in 2901, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.0500593 = idf(docFreq=2023, maxDocs=42740)
                0.078125 = fieldNorm(doc=2901)
          0.66846704 = weight(abstract_txt:classifiers in 2901) [ClassicSimilarity], result of:
            0.66846704 = score(doc=2901,freq=6.0), product of:
              0.4615321 = queryWeight, product of:
                5.017142 = boost
                7.568546 = idf(docFreq=59, maxDocs=42740)
                0.012154387 = queryNorm
              1.4483653 = fieldWeight in 2901, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                7.568546 = idf(docFreq=59, maxDocs=42740)
                0.078125 = fieldNorm(doc=2901)
        0.32 = coord(8/25)
    
  3. Hofmann-Apitius, M.: Direct use of information extraction from scientific text for modeling and simulation in the life sciences (2009) 0.20
    0.19748534 = sum of:
      0.19748534 = product of:
        0.8228556 = sum of:
          0.080724716 = weight(abstract_txt:etiology in 4815) [ClassicSimilarity], result of:
            0.080724716 = score(doc=4815,freq=1.0), product of:
              0.13084574 = queryWeight, product of:
                1.0905852 = boost
                9.871131 = idf(docFreq=5, maxDocs=42740)
                0.012154387 = queryNorm
              0.6169457 = fieldWeight in 4815, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.871131 = idf(docFreq=5, maxDocs=42740)
                0.0625 = fieldNorm(doc=4815)
          0.0338433 = weight(abstract_txt:identification in 4815) [ClassicSimilarity], result of:
            0.0338433 = score(doc=4815,freq=1.0), product of:
              0.092345074 = queryWeight, product of:
                1.2956917 = boost
                5.8637977 = idf(docFreq=329, maxDocs=42740)
                0.012154387 = queryNorm
              0.36648735 = fieldWeight in 4815, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.8637977 = idf(docFreq=329, maxDocs=42740)
                0.0625 = fieldNorm(doc=4815)
          0.015491077 = weight(abstract_txt:about in 4815) [ClassicSimilarity], result of:
            0.015491077 = score(doc=4815,freq=1.0), product of:
              0.06278416 = queryWeight, product of:
                1.3084751 = boost
                3.947767 = idf(docFreq=2241, maxDocs=42740)
                0.012154387 = queryNorm
              0.24673544 = fieldWeight in 4815, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.947767 = idf(docFreq=2241, maxDocs=42740)
                0.0625 = fieldNorm(doc=4815)
          0.01445312 = weight(abstract_txt:information in 4815) [ClassicSimilarity], result of:
            0.01445312 = score(doc=4815,freq=4.0), product of:
              0.04758025 = queryWeight, product of:
                1.6109008 = boost
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.012154387 = queryNorm
              0.303763 = fieldWeight in 4815, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.0625 = fieldNorm(doc=4815)
          0.11801275 = weight(abstract_txt:text in 4815) [ClassicSimilarity], result of:
            0.11801275 = score(doc=4815,freq=7.0), product of:
              0.17621323 = queryWeight, product of:
                3.5796788 = boost
                4.0500593 = idf(docFreq=2023, maxDocs=42740)
                0.012154387 = queryNorm
              0.6697156 = fieldWeight in 4815, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.0500593 = idf(docFreq=2023, maxDocs=42740)
                0.0625 = fieldNorm(doc=4815)
          0.5603306 = weight(abstract_txt:disease in 4815) [ClassicSimilarity], result of:
            0.5603306 = score(doc=4815,freq=4.0), product of:
              0.57376075 = queryWeight, product of:
                6.042188 = boost
                7.8127427 = idf(docFreq=46, maxDocs=42740)
                0.012154387 = queryNorm
              0.97659284 = fieldWeight in 4815, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                7.8127427 = idf(docFreq=46, maxDocs=42740)
                0.0625 = fieldNorm(doc=4815)
        0.24 = coord(6/25)
    
  4. Sebastiani, F.: Classification of text, automatic (2006) 0.19
    0.1892281 = sum of:
      0.1892281 = product of:
        0.6758146 = sum of:
          0.05006304 = weight(abstract_txt:categories in 4) [ClassicSimilarity], result of:
            0.05006304 = score(doc=4,freq=2.0), product of:
              0.07261715 = queryWeight, product of:
                1.1489851 = boost
                5.199861 = idf(docFreq=640, maxDocs=42740)
                0.012154387 = queryNorm
              0.6894107 = fieldWeight in 4, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.199861 = idf(docFreq=640, maxDocs=42740)
                0.09375 = fieldNorm(doc=4)
          0.06487018 = weight(abstract_txt:texts in 4) [ClassicSimilarity], result of:
            0.06487018 = score(doc=4,freq=2.0), product of:
              0.08630934 = queryWeight, product of:
                1.2526326 = boost
                5.668929 = idf(docFreq=400, maxDocs=42740)
                0.012154387 = queryNorm
              0.7516009 = fieldWeight in 4, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.668929 = idf(docFreq=400, maxDocs=42740)
                0.09375 = fieldNorm(doc=4)
          0.0957131 = weight(abstract_txt:classifier in 4) [ClassicSimilarity], result of:
            0.0957131 = score(doc=4,freq=1.0), product of:
              0.14093493 = queryWeight, product of:
                1.6006786 = boost
                7.24405 = idf(docFreq=82, maxDocs=42740)
                0.012154387 = queryNorm
              0.6791297 = fieldWeight in 4, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.24405 = idf(docFreq=82, maxDocs=42740)
                0.09375 = fieldNorm(doc=4)
          0.0108398395 = weight(abstract_txt:information in 4) [ClassicSimilarity], result of:
            0.0108398395 = score(doc=4,freq=1.0), product of:
              0.04758025 = queryWeight, product of:
                1.6109008 = boost
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.012154387 = queryNorm
              0.22782224 = fieldWeight in 4, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.09375 = fieldNorm(doc=4)
          0.03222713 = weight(abstract_txt:classification in 4) [ClassicSimilarity], result of:
            0.03222713 = score(doc=4,freq=1.0), product of:
              0.085940026 = queryWeight, product of:
                1.7676959 = boost
                3.9999528 = idf(docFreq=2127, maxDocs=42740)
                0.012154387 = queryNorm
              0.3749956 = fieldWeight in 4, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.9999528 = idf(docFreq=2127, maxDocs=42740)
                0.09375 = fieldNorm(doc=4)
          0.0946207 = weight(abstract_txt:text in 4) [ClassicSimilarity], result of:
            0.0946207 = score(doc=4,freq=2.0), product of:
              0.17621323 = queryWeight, product of:
                3.5796788 = boost
                4.0500593 = idf(docFreq=2023, maxDocs=42740)
                0.012154387 = queryNorm
              0.53696704 = fieldWeight in 4, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.0500593 = idf(docFreq=2023, maxDocs=42740)
                0.09375 = fieldNorm(doc=4)
          0.3274806 = weight(abstract_txt:classifiers in 4) [ClassicSimilarity], result of:
            0.3274806 = score(doc=4,freq=1.0), product of:
              0.4615321 = queryWeight, product of:
                5.017142 = boost
                7.568546 = idf(docFreq=59, maxDocs=42740)
                0.012154387 = queryNorm
              0.70955116 = fieldWeight in 4, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.568546 = idf(docFreq=59, maxDocs=42740)
                0.09375 = fieldNorm(doc=4)
        0.28 = coord(7/25)
    
  5. Liu, R.-L.: Context-based term frequency assessment for text classification (2010) 0.18
    0.17994554 = sum of:
      0.17994554 = product of:
        0.74977314 = sum of:
          0.01987843 = weight(abstract_txt:several in 332) [ClassicSimilarity], result of:
            0.01987843 = score(doc=332,freq=1.0), product of:
              0.05581445 = queryWeight, product of:
                1.0073216 = boost
                4.5587463 = idf(docFreq=1216, maxDocs=42740)
                0.012154387 = queryNorm
              0.35615206 = fieldWeight in 332, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5587463 = idf(docFreq=1216, maxDocs=42740)
                0.078125 = fieldNorm(doc=332)
          0.036692966 = weight(abstract_txt:technique in 332) [ClassicSimilarity], result of:
            0.036692966 = score(doc=332,freq=1.0), product of:
              0.08398733 = queryWeight, product of:
                1.2356677 = boost
                5.5921526 = idf(docFreq=432, maxDocs=42740)
                0.012154387 = queryNorm
              0.4368869 = fieldWeight in 332, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5921526 = idf(docFreq=432, maxDocs=42740)
                0.078125 = fieldNorm(doc=332)
          0.009033199 = weight(abstract_txt:information in 332) [ClassicSimilarity], result of:
            0.009033199 = score(doc=332,freq=1.0), product of:
              0.04758025 = queryWeight, product of:
                1.6109008 = boost
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.012154387 = queryNorm
              0.18985188 = fieldWeight in 332, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.430104 = idf(docFreq=10226, maxDocs=42740)
                0.078125 = fieldNorm(doc=332)
          0.02685594 = weight(abstract_txt:classification in 332) [ClassicSimilarity], result of:
            0.02685594 = score(doc=332,freq=1.0), product of:
              0.085940026 = queryWeight, product of:
                1.7676959 = boost
                3.9999528 = idf(docFreq=2127, maxDocs=42740)
                0.012154387 = queryNorm
              0.3124963 = fieldWeight in 332, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.9999528 = idf(docFreq=2127, maxDocs=42740)
                0.078125 = fieldNorm(doc=332)
          0.11151157 = weight(abstract_txt:text in 332) [ClassicSimilarity], result of:
            0.11151157 = score(doc=332,freq=4.0), product of:
              0.17621323 = queryWeight, product of:
                3.5796788 = boost
                4.0500593 = idf(docFreq=2023, maxDocs=42740)
                0.012154387 = queryNorm
              0.6328218 = fieldWeight in 332, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.0500593 = idf(docFreq=2023, maxDocs=42740)
                0.078125 = fieldNorm(doc=332)
          0.54580104 = weight(abstract_txt:classifiers in 332) [ClassicSimilarity], result of:
            0.54580104 = score(doc=332,freq=4.0), product of:
              0.4615321 = queryWeight, product of:
                5.017142 = boost
                7.568546 = idf(docFreq=59, maxDocs=42740)
                0.012154387 = queryNorm
              1.1825852 = fieldWeight in 332, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                7.568546 = idf(docFreq=59, maxDocs=42740)
                0.078125 = fieldNorm(doc=332)
        0.24 = coord(6/25)