Search (3 results, page 1 of 1)

Wacholder, N.; Kelly, D.; Kantor, P.; Rittman, R.; Sun, Y.; Bai, B.; Small, S.; Yamrom, B.; Strzalkowski, T.: ¬A model for quantitative evaluation of an end-to-end question-answering system (2007) 0.02
```
0.018938396 = product of:
  0.037876792 = sum of:
    0.037876792 = product of:
      0.075753585 = sum of:
        0.075753585 = weight(_text_:b in 435) [ClassicSimilarity], result of:
          0.075753585 = score(doc=435,freq=8.0), product of:
            0.16126883 = queryWeight, product of:
              3.542962 = idf(docFreq=3476, maxDocs=44218)
              0.045518078 = queryNorm
            0.46973482 = fieldWeight in 435, product of:
              2.828427 = tf(freq=8.0), with freq of:
                8.0 = termFreq=8.0
              3.542962 = idf(docFreq=3476, maxDocs=44218)
              0.046875 = fieldNorm(doc=435)
      0.5 = coord(1/2)
  0.5 = coord(1/2)
```
Abstract

We describe a procedure for quantitative evaluation of interactive question-answering systems and illustrate it with application to the High-Quality Interactive QuestionAnswering (HITIQA) system. Our objectives were (a) to design a method to realistically and reliably assess interactive question-answering systems by comparing the quality of reports produced using different systems, (b) to conduct a pilot test of this method, and (c) to perform a formative evaluation of the HITIQA system. Far more important than the specific information gathered from this pilot evaluation is the development of (a) a protocol for evaluating an emerging technology, (b) reusable assessment instruments, and (c) the knowledge gained in conducting the evaluation. We conclude that this method, which uses a surprisingly small number of subjects and does not rely on predetermined relevance judgments, measures the impact of system change on work produced by users. Therefore this method can be used to compare the product of interactive systems that use different underlying technologies.

Ng, K.B.; Kantor, P.B.; Strzalkowski, T.; Wacholder, N.; Tang, R.; Bai, B.; Rittman,; Song, P.; Sun, Y.: Automated judgment of document qualities (2006) 0.01

0.009469198 = product of:
  0.018938396 = sum of:
    0.018938396 = product of:
      0.037876792 = sum of:
        0.037876792 = weight(_text_:b in 182) [ClassicSimilarity], result of:
          0.037876792 = score(doc=182,freq=2.0), product of:
            0.16126883 = queryWeight, product of:
              3.542962 = idf(docFreq=3476, maxDocs=44218)
              0.045518078 = queryNorm
            0.23486741 = fieldWeight in 182, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.542962 = idf(docFreq=3476, maxDocs=44218)
              0.046875 = fieldNorm(doc=182)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Leydesdorff, L.; Sun, Y.: National and international dimensions of the Triple Helix in Japan : university-industry-government versus international coauthorship relations (2009) 0.01

0.009250606 = product of:
  0.018501213 = sum of:
    0.018501213 = product of:
      0.037002426 = sum of:
        0.037002426 = weight(_text_:22 in 2761) [ClassicSimilarity], result of:
          0.037002426 = score(doc=2761,freq=2.0), product of:
            0.15939656 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.045518078 = queryNorm
            0.23214069 = fieldWeight in 2761, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.046875 = fieldNorm(doc=2761)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Date: 22. 3.2009 19:07:20

Search (3 results, page 1 of 1)

Authors