Sjöbergh, J.: Older versions of the ROUGEeval summarization evaluation system were easier to fool (2007)
0.01
0.0068851607 = product of:
0.017212901 = sum of:
0.010897844 = weight(_text_:a in 940) [ClassicSimilarity], result of:
0.010897844 = score(doc=940,freq=8.0), product of:
0.053464882 = queryWeight, product of:
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.046368346 = queryNorm
0.20383182 = fieldWeight in 940, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
1.153047 = idf(docFreq=37942, maxDocs=44218)
0.0625 = fieldNorm(doc=940)
0.006315058 = product of:
0.012630116 = sum of:
0.012630116 = weight(_text_:information in 940) [ClassicSimilarity], result of:
0.012630116 = score(doc=940,freq=2.0), product of:
0.08139861 = queryWeight, product of:
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.046368346 = queryNorm
0.1551638 = fieldWeight in 940, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.7554779 = idf(docFreq=20772, maxDocs=44218)
0.0625 = fieldNorm(doc=940)
0.5 = coord(1/2)
0.4 = coord(2/5)
- Abstract
- We show some limitations of the ROUGE evaluation method for automatic summarization. We present a method for automatic summarization based on a Markov model of the source text. By a simple greedy word selection strategy, summaries with high ROUGE-scores are generated. These summaries would however not be considered good by human readers. The method can be adapted to trick different settings of the ROUGEeval package.
- Source
- Information processing and management. 43(2007) no.6, S.1500-1505
- Type
- a
