# Document (#43669)

Author
Aizawa, A.
Kohlhase, M.
Title
Mathematical information retrieval
Source
Evaluating information retrieval and access tasks. Eds.: Sakai, T., Oard, D., Kando, N. [https://doi.org/10.1007/978-981-15-5554-1_12]
Imprint
Singapore : Springer
Year
2021
Pages
S.169-185
Series
¬The Information retrieval series, vol 43
Abstract
We present an overview of the NTCIR Math Tasks organized during NTCIR-10, 11, and 12. These tasks are primarily dedicated to techniques for searching mathematical content with formula expressions. In this chapter, we first summarize the task design and introduce test collections generated in the tasks. We also describe the features and main challenges of mathematical information retrieval systems and discuss future perspectives in the field.
Content
Vgl.: https://doi.org/10.1007/978-981-15-5554-1_12.
Theme
Computerlinguistik
Wissensrepräsentation
Field
Mathematik

## Similar documents (content)

1. Stathopoulos, Y.; Baker, S.; Rei, M.; Teufel, S.: Variable typing : assigning meaning to variables in mathematical text (2018) 0.26
```0.26265174 = sum of:
0.26265174 = product of:
0.9380419 = sum of:
0.011162962 = weight(abstract_txt:information in 4432) [ClassicSimilarity], result of:
0.011162962 = score(doc=4432,freq=2.0), product of:
0.041733928 = queryWeight, product of:
1.0496962 = boost
2.4209464 = idf(docFreq=10677, maxDocs=44218)
0.016422546 = queryNorm
0.2674793 = fieldWeight in 4432, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
2.4209464 = idf(docFreq=10677, maxDocs=44218)
0.078125 = fieldNorm(doc=4432)
0.046599716 = weight(abstract_txt:task in 4432) [ClassicSimilarity], result of:
0.046599716 = score(doc=4432,freq=2.0), product of:
0.08587798 = queryWeight, product of:
1.0647433 = boost
4.9112997 = idf(docFreq=884, maxDocs=44218)
0.016422546 = queryNorm
0.5426271 = fieldWeight in 4432, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.9112997 = idf(docFreq=884, maxDocs=44218)
0.078125 = fieldNorm(doc=4432)
0.09037648 = weight(abstract_txt:introduce in 4432) [ClassicSimilarity], result of:
0.09037648 = score(doc=4432,freq=2.0), product of:
0.13355595 = queryWeight, product of:
1.3278091 = boost
6.124733 = idf(docFreq=262, maxDocs=44218)
0.016422546 = queryNorm
0.6766938 = fieldWeight in 4432, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
6.124733 = idf(docFreq=262, maxDocs=44218)
0.078125 = fieldNorm(doc=4432)
0.023346705 = weight(abstract_txt:retrieval in 4432) [ClassicSimilarity], result of:
0.023346705 = score(doc=4432,freq=1.0), product of:
0.08599305 = queryWeight, product of:
1.5067829 = boost
3.4751394 = idf(docFreq=3720, maxDocs=44218)
0.016422546 = queryNorm
0.27149525 = fieldWeight in 4432, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
3.4751394 = idf(docFreq=3720, maxDocs=44218)
0.078125 = fieldNorm(doc=4432)
0.17399938 = weight(abstract_txt:formula in 4432) [ClassicSimilarity], result of:
0.17399938 = score(doc=4432,freq=2.0), product of:
0.20669253 = queryWeight, product of:
1.651834 = boost
7.61935 = idf(docFreq=58, maxDocs=44218)
0.016422546 = queryNorm
0.84182715 = fieldWeight in 4432, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
7.61935 = idf(docFreq=58, maxDocs=44218)
0.078125 = fieldNorm(doc=4432)
0.114850104 = weight(abstract_txt:tasks in 4432) [ClassicSimilarity], result of:
0.114850104 = score(doc=4432,freq=1.0), product of:
0.28472853 = queryWeight, product of:
3.3579955 = boost
5.1630983 = idf(docFreq=687, maxDocs=44218)
0.016422546 = queryNorm
0.40336704 = fieldWeight in 4432, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
5.1630983 = idf(docFreq=687, maxDocs=44218)
0.078125 = fieldNorm(doc=4432)
0.47770652 = weight(abstract_txt:mathematical in 4432) [ClassicSimilarity], result of:
0.47770652 = score(doc=4432,freq=5.0), product of:
0.43065304 = queryWeight, product of:
4.129794 = boost
6.3497796 = idf(docFreq=209, maxDocs=44218)
0.016422546 = queryNorm
1.1092608 = fieldWeight in 4432, product of:
2.236068 = tf(freq=5.0), with freq of:
5.0 = termFreq=5.0
6.3497796 = idf(docFreq=209, maxDocs=44218)
0.078125 = fieldNorm(doc=4432)
0.28 = coord(7/25)
```
2. Fujita, S.: Technology survey and invalidity search : a comparative study of different tasks for Japanese patent document retrieval (2007) 0.16
```0.1626399 = sum of:
0.1626399 = product of:
0.8131995 = sum of:
0.034517556 = weight(abstract_txt:collections in 918) [ClassicSimilarity], result of:
0.034517556 = score(doc=918,freq=1.0), product of:
0.07844083 = queryWeight, product of:
1.0175953 = boost
4.693822 = idf(docFreq=1099, maxDocs=44218)
0.016422546 = queryNorm
0.4400458 = fieldWeight in 918, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
4.693822 = idf(docFreq=1099, maxDocs=44218)
0.09375 = fieldNorm(doc=918)
0.04290016 = weight(abstract_txt:test in 918) [ClassicSimilarity], result of:
0.04290016 = score(doc=918,freq=1.0), product of:
0.09067511 = queryWeight, product of:
1.0940773 = boost
5.046608 = idf(docFreq=772, maxDocs=44218)
0.016422546 = queryNorm
0.4731195 = fieldWeight in 918, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
5.046608 = idf(docFreq=772, maxDocs=44218)
0.09375 = fieldNorm(doc=918)
0.056032095 = weight(abstract_txt:retrieval in 918) [ClassicSimilarity], result of:
0.056032095 = score(doc=918,freq=4.0), product of:
0.08599305 = queryWeight, product of:
1.5067829 = boost
3.4751394 = idf(docFreq=3720, maxDocs=44218)
0.016422546 = queryNorm
0.6515886 = fieldWeight in 918, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.4751394 = idf(docFreq=3720, maxDocs=44218)
0.09375 = fieldNorm(doc=918)
0.19490708 = weight(abstract_txt:tasks in 918) [ClassicSimilarity], result of:
0.19490708 = score(doc=918,freq=2.0), product of:
0.28472853 = queryWeight, product of:
3.3579955 = boost
5.1630983 = idf(docFreq=687, maxDocs=44218)
0.016422546 = queryNorm
0.6845366 = fieldWeight in 918, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
5.1630983 = idf(docFreq=687, maxDocs=44218)
0.09375 = fieldNorm(doc=918)
0.4848426 = weight(abstract_txt:ntcir in 918) [ClassicSimilarity], result of:
0.4848426 = score(doc=918,freq=1.0), product of:
0.5753419 = queryWeight, product of:
3.8974628 = boost
8.988837 = idf(docFreq=14, maxDocs=44218)
0.016422546 = queryNorm
0.84270346 = fieldWeight in 918, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
8.988837 = idf(docFreq=14, maxDocs=44218)
0.09375 = fieldNorm(doc=918)
0.2 = coord(5/25)
```
3. Kang, I.-S.; Na, S.-H.; Kim, J.; Lee, J.-H.: Cluster-based patent retrieval (2007) 0.15
```0.1494913 = sum of:
0.1494913 = product of:
0.6228804 = sum of:
0.010937424 = weight(abstract_txt:information in 930) [ClassicSimilarity], result of:
0.010937424 = score(doc=930,freq=3.0), product of:
0.041733928 = queryWeight, product of:
1.0496962 = boost
2.4209464 = idf(docFreq=10677, maxDocs=44218)
0.016422546 = queryNorm
0.26207513 = fieldWeight in 930, product of:
1.7320508 = tf(freq=3.0), with freq of:
3.0 = termFreq=3.0
2.4209464 = idf(docFreq=10677, maxDocs=44218)
0.0625 = fieldNorm(doc=930)
0.02636078 = weight(abstract_txt:task in 930) [ClassicSimilarity], result of:
0.02636078 = score(doc=930,freq=1.0), product of:
0.08587798 = queryWeight, product of:
1.0647433 = boost
4.9112997 = idf(docFreq=884, maxDocs=44218)
0.016422546 = queryNorm
0.30695623 = fieldWeight in 930, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
4.9112997 = idf(docFreq=884, maxDocs=44218)
0.0625 = fieldNorm(doc=930)
0.028600108 = weight(abstract_txt:test in 930) [ClassicSimilarity], result of:
0.028600108 = score(doc=930,freq=1.0), product of:
0.09067511 = queryWeight, product of:
1.0940773 = boost
5.046608 = idf(docFreq=772, maxDocs=44218)
0.016422546 = queryNorm
0.315413 = fieldWeight in 930, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
5.046608 = idf(docFreq=772, maxDocs=44218)
0.0625 = fieldNorm(doc=930)
0.04704055 = weight(abstract_txt:organized in 930) [ClassicSimilarity], result of:
0.04704055 = score(doc=930,freq=1.0), product of:
0.12634495 = queryWeight, product of:
1.2914659 = boost
5.957094 = idf(docFreq=310, maxDocs=44218)
0.016422546 = queryNorm
0.3723184 = fieldWeight in 930, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
5.957094 = idf(docFreq=310, maxDocs=44218)
0.0625 = fieldNorm(doc=930)
0.052827563 = weight(abstract_txt:retrieval in 930) [ClassicSimilarity], result of:
0.052827563 = score(doc=930,freq=8.0), product of:
0.08599305 = queryWeight, product of:
1.5067829 = boost
3.4751394 = idf(docFreq=3720, maxDocs=44218)
0.016422546 = queryNorm
0.6143236 = fieldWeight in 930, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
3.4751394 = idf(docFreq=3720, maxDocs=44218)
0.0625 = fieldNorm(doc=930)
0.45711398 = weight(abstract_txt:ntcir in 930) [ClassicSimilarity], result of:
0.45711398 = score(doc=930,freq=2.0), product of:
0.5753419 = queryWeight, product of:
3.8974628 = boost
8.988837 = idf(docFreq=14, maxDocs=44218)
0.016422546 = queryNorm
0.79450846 = fieldWeight in 930, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
8.988837 = idf(docFreq=14, maxDocs=44218)
0.0625 = fieldNorm(doc=930)
0.24 = coord(6/25)
```
4. Fife, E.D.; Husch, L.: ¬The Mathematics Archives : making mathematics easy to find on the Web (1999) 0.14
```0.14405304 = sum of:
0.14405304 = product of:
0.60022104 = sum of:
0.023011705 = weight(abstract_txt:collections in 1239) [ClassicSimilarity], result of:
0.023011705 = score(doc=1239,freq=1.0), product of:
0.07844083 = queryWeight, product of:
1.0175953 = boost
4.693822 = idf(docFreq=1099, maxDocs=44218)
0.016422546 = queryNorm
0.29336387 = fieldWeight in 1239, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
4.693822 = idf(docFreq=1099, maxDocs=44218)
0.0625 = fieldNorm(doc=1239)
0.006314725 = weight(abstract_txt:information in 1239) [ClassicSimilarity], result of:
0.006314725 = score(doc=1239,freq=1.0), product of:
0.041733928 = queryWeight, product of:
1.0496962 = boost
2.4209464 = idf(docFreq=10677, maxDocs=44218)
0.016422546 = queryNorm
0.15130915 = fieldWeight in 1239, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
2.4209464 = idf(docFreq=10677, maxDocs=44218)
0.0625 = fieldNorm(doc=1239)
0.04704055 = weight(abstract_txt:organized in 1239) [ClassicSimilarity], result of:
0.04704055 = score(doc=1239,freq=1.0), product of:
0.12634495 = queryWeight, product of:
1.2914659 = boost
5.957094 = idf(docFreq=310, maxDocs=44218)
0.016422546 = queryNorm
0.3723184 = fieldWeight in 1239, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
5.957094 = idf(docFreq=310, maxDocs=44218)
0.0625 = fieldNorm(doc=1239)
0.05180318 = weight(abstract_txt:primarily in 1239) [ClassicSimilarity], result of:
0.05180318 = score(doc=1239,freq=1.0), product of:
0.13473505 = queryWeight, product of:
1.3336575 = boost
6.1517096 = idf(docFreq=255, maxDocs=44218)
0.016422546 = queryNorm
0.38448185 = fieldWeight in 1239, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
6.1517096 = idf(docFreq=255, maxDocs=44218)
0.0625 = fieldNorm(doc=1239)
0.13023192 = weight(abstract_txt:math in 1239) [ClassicSimilarity], result of:
0.13023192 = score(doc=1239,freq=1.0), product of:
0.24910814 = queryWeight, product of:
1.8134181 = boost
8.364683 = idf(docFreq=27, maxDocs=44218)
0.016422546 = queryNorm
0.5227927 = fieldWeight in 1239, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
8.364683 = idf(docFreq=27, maxDocs=44218)
0.0625 = fieldNorm(doc=1239)
0.341819 = weight(abstract_txt:mathematical in 1239) [ClassicSimilarity], result of:
0.341819 = score(doc=1239,freq=4.0), product of:
0.43065304 = queryWeight, product of:
4.129794 = boost
6.3497796 = idf(docFreq=209, maxDocs=44218)
0.016422546 = queryNorm
0.79372245 = fieldWeight in 1239, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
6.3497796 = idf(docFreq=209, maxDocs=44218)
0.0625 = fieldNorm(doc=1239)
0.24 = coord(6/25)
```
5. Fujita, S.: NTCIR-2 as a Rosetta stone in laboratory experiments of IR systems (2005) 0.14
```0.14223795 = sum of:
0.14223795 = product of:
0.71118975 = sum of:
0.04067933 = weight(abstract_txt:collections in 1017) [ClassicSimilarity], result of:
0.04067933 = score(doc=1017,freq=2.0), product of:
0.07844083 = queryWeight, product of:
1.0175953 = boost
4.693822 = idf(docFreq=1099, maxDocs=44218)
0.016422546 = queryNorm
0.5185989 = fieldWeight in 1017, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.693822 = idf(docFreq=1099, maxDocs=44218)
0.078125 = fieldNorm(doc=1017)
0.011162962 = weight(abstract_txt:information in 1017) [ClassicSimilarity], result of:
0.011162962 = score(doc=1017,freq=2.0), product of:
0.041733928 = queryWeight, product of:
1.0496962 = boost
2.4209464 = idf(docFreq=10677, maxDocs=44218)
0.016422546 = queryNorm
0.2674793 = fieldWeight in 1017, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
2.4209464 = idf(docFreq=10677, maxDocs=44218)
0.078125 = fieldNorm(doc=1017)
0.035750136 = weight(abstract_txt:test in 1017) [ClassicSimilarity], result of:
0.035750136 = score(doc=1017,freq=1.0), product of:
0.09067511 = queryWeight, product of:
1.0940773 = boost
5.046608 = idf(docFreq=772, maxDocs=44218)
0.016422546 = queryNorm
0.39426625 = fieldWeight in 1017, product of:
1.0 = tf(freq=1.0), with freq of:
1.0 = termFreq=1.0
5.046608 = idf(docFreq=772, maxDocs=44218)
0.078125 = fieldNorm(doc=1017)
0.052204825 = weight(abstract_txt:retrieval in 1017) [ClassicSimilarity], result of:
0.052204825 = score(doc=1017,freq=5.0), product of:
0.08599305 = queryWeight, product of:
1.5067829 = boost
3.4751394 = idf(docFreq=3720, maxDocs=44218)
0.016422546 = queryNorm
0.6070819 = fieldWeight in 1017, product of:
2.236068 = tf(freq=5.0), with freq of:
5.0 = termFreq=5.0
3.4751394 = idf(docFreq=3720, maxDocs=44218)
0.078125 = fieldNorm(doc=1017)
0.5713925 = weight(abstract_txt:ntcir in 1017) [ClassicSimilarity], result of:
0.5713925 = score(doc=1017,freq=2.0), product of:
0.5753419 = queryWeight, product of:
3.8974628 = boost
8.988837 = idf(docFreq=14, maxDocs=44218)
0.016422546 = queryNorm
0.9931356 = fieldWeight in 1017, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
8.988837 = idf(docFreq=14, maxDocs=44218)
0.078125 = fieldNorm(doc=1017)
0.2 = coord(5/25)
```