Document (#43873)

Author

Radford, A.
Wu, J.
Child, R.
Luan, D.
Amode, D.
Sutskever, I.

Title

Language models are unsupervised multitask learners

Source

https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf

Abstract

Natural language processing tasks, such as question answering, machine translation, reading comprehension, and summarization, are typically approached with supervised learning on task-specific datasets. We demonstrate that language models begin to learn these tasks without any explicit supervision when trained on a new dataset of millions of webpages called WebText. When conditioned on a document plus questions, the answers generated by the language model reach 55 F1 on the CoQA dataset - matching or exceeding the performance of 3 out of 4 baseline systems without using the 127,000+ training examples. The capacity of the language model is essential to the success of zero-shot task transfer and increasing it improves performance in a log-linear fashion across tasks. Our largest model, GPT-2, is a 1.5B parameter Transformer that achieves state of the art results on 7 out of 8 tested language modeling datasets in a zero-shot setting but still underfits WebText. Samples from the model reflect these improvements and contain coherent paragraphs of text. These findings suggest a promising path towards building language processing systems which learn to perform tasks from their naturally occurring demonstrations.

Theme

Computerlinguistik

Object

GPT-2

Similar documents (author)

1. Radford, G.P.; Radford, M.L.: Structuralism, post-structuralism, and the library : de Saussure and Foucault (2005) 6.36

   6.3560677 = sum of:
     6.3560677 = weight(author_txt:radford in 4411) [ClassicSimilarity], result of:
       6.3560677 = fieldWeight in 4411, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         8.988837 = idf(docFreq=14, maxDocs=44218)
         0.5 = fieldNorm(doc=4411)
   

2. Radford, W.: Cataloges, codes and bibliographical control (1949) 5.62

   5.6180234 = sum of:
     5.6180234 = weight(author_txt:radford in 1837) [ClassicSimilarity], result of:
       5.6180234 = fieldWeight in 1837, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.988837 = idf(docFreq=14, maxDocs=44218)
         0.625 = fieldNorm(doc=1837)
   

3. Radford, M.L.: Communication theory applied to the reference encounter : an analysis of critical incidents (1996) 5.62

   5.6180234 = sum of:
     5.6180234 = weight(author_txt:radford in 6421) [ClassicSimilarity], result of:
       5.6180234 = fieldWeight in 6421, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.988837 = idf(docFreq=14, maxDocs=44218)
         0.625 = fieldNorm(doc=6421)
   

4. Radford, G.P.: Flaubert, Foucault, and the Bibliothèque Fantastique : toward a postmodern epistemology for library science (1998) 5.62

   5.6180234 = sum of:
     5.6180234 = weight(author_txt:radford in 2974) [ClassicSimilarity], result of:
       5.6180234 = fieldWeight in 2974, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.988837 = idf(docFreq=14, maxDocs=44218)
         0.625 = fieldNorm(doc=2974)
   

5. Radford, M.L.: Approach or avoidance? : The role of nonverbal communication in the academic library user's decision to initiate a reference encounter (1998) 5.62

   5.6180234 = sum of:
     5.6180234 = weight(author_txt:radford in 3050) [ClassicSimilarity], result of:
       5.6180234 = fieldWeight in 3050, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.988837 = idf(docFreq=14, maxDocs=44218)
         0.625 = fieldNorm(doc=3050)
   

Similar documents (content)

1. Brown, T.B.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; Agarwal, S.; Herbert-Voss, A.; Krueger, G.; Henighan, T.; Child, R.; Ramesh, A.; Ziegler, D.M.; Wu, J.; Winter, C.; Hesse, C.; Chen, M.; Sigler, E.; Litwin, M.; Gray, S.; Chess, B.; Clark, J.; Berner, C.; McCandlish, S.; Radford, A.; Sutskever, I.; Amodei, D.: Language models are few-shot learners (2020) 0.46

   0.45848653 = sum of:
     0.45848653 = product of:
       1.1462163 = sum of:
         0.097832 = weight(abstract_txt:demonstrations in 872) [ClassicSimilarity], result of:
           0.097832 = score(doc=872,freq=1.0), product of:
             0.19901663 = queryWeight, product of:
               1.1770972 = boost
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.018809339 = queryNorm
             0.49157703 = fieldWeight in 872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.0546875 = fieldNorm(doc=872)
         0.04632573 = weight(abstract_txt:performance in 872) [ClassicSimilarity], result of:
           0.04632573 = score(doc=872,freq=3.0), product of:
             0.10562171 = queryWeight, product of:
               1.2127163 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.018809339 = queryNorm
             0.43860045 = fieldWeight in 872, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0546875 = fieldNorm(doc=872)
         0.026939925 = weight(abstract_txt:models in 872) [ClassicSimilarity], result of:
           0.026939925 = score(doc=872,freq=1.0), product of:
             0.10613118 = queryWeight, product of:
               1.2156377 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.018809339 = queryNorm
             0.2538361 = fieldWeight in 872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0546875 = fieldNorm(doc=872)
         0.07136327 = weight(abstract_txt:task in 872) [ClassicSimilarity], result of:
           0.07136327 = score(doc=872,freq=5.0), product of:
             0.11882429 = queryWeight, product of:
               1.2862792 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.018809339 = queryNorm
             0.6005781 = fieldWeight in 872, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0546875 = fieldNorm(doc=872)
         0.03845302 = weight(abstract_txt:without in 872) [ClassicSimilarity], result of:
           0.03845302 = score(doc=872,freq=1.0), product of:
             0.13454443 = queryWeight, product of:
               1.3687228 = boost
               5.2260876 = idf(docFreq=645, maxDocs=44218)
               0.018809339 = queryNorm
             0.28580165 = fieldWeight in 872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2260876 = idf(docFreq=645, maxDocs=44218)
               0.0546875 = fieldNorm(doc=872)
         0.15342246 = weight(abstract_txt:datasets in 872) [ClassicSimilarity], result of:
           0.15342246 = score(doc=872,freq=4.0), product of:
             0.21321514 = queryWeight, product of:
               1.7230253 = boost
               6.578893 = idf(docFreq=166, maxDocs=44218)
               0.018809339 = queryNorm
             0.71956646 = fieldWeight in 872, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.578893 = idf(docFreq=166, maxDocs=44218)
               0.0546875 = fieldNorm(doc=872)
         0.059112515 = weight(abstract_txt:model in 872) [ClassicSimilarity], result of:
           0.059112515 = score(doc=872,freq=3.0), product of:
             0.15655535 = queryWeight, product of:
               2.0880053 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.018809339 = queryNorm
             0.3775822 = fieldWeight in 872, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.0546875 = fieldNorm(doc=872)
         0.34900758 = weight(abstract_txt:shot in 872) [ClassicSimilarity], result of:
           0.34900758 = score(doc=872,freq=4.0), product of:
             0.3687924 = queryWeight, product of:
               2.2660716 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.018809339 = queryNorm
             0.94635236 = fieldWeight in 872, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.0546875 = fieldNorm(doc=872)
         0.16582371 = weight(abstract_txt:tasks in 872) [ClassicSimilarity], result of:
           0.16582371 = score(doc=872,freq=5.0), product of:
             0.26264137 = queryWeight, product of:
               2.7044516 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.018809339 = queryNorm
             0.63136935 = fieldWeight in 872, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.0546875 = fieldNorm(doc=872)
         0.13793604 = weight(abstract_txt:language in 872) [ClassicSimilarity], result of:
           0.13793604 = score(doc=872,freq=4.0), product of:
             0.30155504 = queryWeight, product of:
               3.8335397 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.018809339 = queryNorm
             0.45741582 = fieldWeight in 872, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0546875 = fieldNorm(doc=872)
       0.4 = coord(10/25)
   

2. Shree, P.: ¬The journey of Open AI GPT models (2020) 0.36

   0.3607726 = sum of:
     0.3607726 = product of:
       1.0021461 = sum of:
         0.09695069 = weight(abstract_txt:learners in 869) [ClassicSimilarity], result of:
           0.09695069 = score(doc=869,freq=2.0), product of:
             0.14363647 = queryWeight, product of:
               7.636444 = idf(docFreq=57, maxDocs=44218)
               0.018809339 = queryNorm
             0.67497265 = fieldWeight in 869, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.636444 = idf(docFreq=57, maxDocs=44218)
               0.0625 = fieldNorm(doc=869)
         0.09236545 = weight(abstract_txt:models in 869) [ClassicSimilarity], result of:
           0.09236545 = score(doc=869,freq=9.0), product of:
             0.10613118 = queryWeight, product of:
               1.2156377 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.018809339 = queryNorm
             0.87029517 = fieldWeight in 869, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=869)
         0.02592102 = weight(abstract_txt:these in 869) [ClassicSimilarity], result of:
           0.02592102 = score(doc=869,freq=3.0), product of:
             0.07510615 = queryWeight, product of:
               1.2524662 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.018809339 = queryNorm
             0.34512514 = fieldWeight in 869, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.0625 = fieldNorm(doc=869)
         0.19366744 = weight(abstract_txt:transformer in 869) [ClassicSimilarity], result of:
           0.19366744 = score(doc=869,freq=2.0), product of:
             0.22782525 = queryWeight, product of:
               1.2594142 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.018809339 = queryNorm
             0.8500701 = fieldWeight in 869, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.0625 = fieldNorm(doc=869)
         0.036933582 = weight(abstract_txt:processing in 869) [ClassicSimilarity], result of:
           0.036933582 = score(doc=869,freq=1.0), product of:
             0.11982067 = queryWeight, product of:
               1.2916609 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.018809339 = queryNorm
             0.3082405 = fieldWeight in 869, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=869)
         0.04394631 = weight(abstract_txt:without in 869) [ClassicSimilarity], result of:
           0.04394631 = score(doc=869,freq=1.0), product of:
             0.13454443 = queryWeight, product of:
               1.3687228 = boost
               5.2260876 = idf(docFreq=645, maxDocs=44218)
               0.018809339 = queryNorm
             0.32663047 = fieldWeight in 869, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2260876 = idf(docFreq=645, maxDocs=44218)
               0.0625 = fieldNorm(doc=869)
         0.19943291 = weight(abstract_txt:shot in 869) [ClassicSimilarity], result of:
           0.19943291 = score(doc=869,freq=1.0), product of:
             0.3687924 = queryWeight, product of:
               2.2660716 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.018809339 = queryNorm
             0.5407728 = fieldWeight in 869, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.0625 = fieldNorm(doc=869)
         0.119858414 = weight(abstract_txt:tasks in 869) [ClassicSimilarity], result of:
           0.119858414 = score(doc=869,freq=2.0), product of:
             0.26264137 = queryWeight, product of:
               2.7044516 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.018809339 = queryNorm
             0.45635772 = fieldWeight in 869, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.0625 = fieldNorm(doc=869)
         0.19307025 = weight(abstract_txt:language in 869) [ClassicSimilarity], result of:
           0.19307025 = score(doc=869,freq=6.0), product of:
             0.30155504 = queryWeight, product of:
               3.8335397 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.018809339 = queryNorm
             0.6402488 = fieldWeight in 869, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=869)
       0.36 = coord(9/25)
   

3. Yu, M.; Sun, A.: Dataset versus reality : understanding model performance from the perspective of information need (2023) 0.22

   0.22094314 = sum of:
     0.22094314 = product of:
       0.69044733 = sum of:
         0.019231834 = weight(abstract_txt:when in 1073) [ClassicSimilarity], result of:
           0.019231834 = score(doc=1073,freq=1.0), product of:
             0.084773324 = queryWeight, product of:
               1.0864563 = boost
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.018809339 = queryNorm
             0.22686186 = fieldWeight in 1073, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1073)
         0.03809881 = weight(abstract_txt:models in 1073) [ClassicSimilarity], result of:
           0.03809881 = score(doc=1073,freq=2.0), product of:
             0.10613118 = queryWeight, product of:
               1.2156377 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.018809339 = queryNorm
             0.35897845 = fieldWeight in 1073, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1073)
         0.01851887 = weight(abstract_txt:these in 1073) [ClassicSimilarity], result of:
           0.01851887 = score(doc=1073,freq=2.0), product of:
             0.07510615 = queryWeight, product of:
               1.2524662 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.018809339 = queryNorm
             0.24656929 = fieldWeight in 1073, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1073)
         0.07817455 = weight(abstract_txt:task in 1073) [ClassicSimilarity], result of:
           0.07817455 = score(doc=1073,freq=6.0), product of:
             0.11882429 = queryWeight, product of:
               1.2862792 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.018809339 = queryNorm
             0.6579004 = fieldWeight in 1073, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1073)
         0.18790337 = weight(abstract_txt:datasets in 1073) [ClassicSimilarity], result of:
           0.18790337 = score(doc=1073,freq=6.0), product of:
             0.21321514 = queryWeight, product of:
               1.7230253 = boost
               6.578893 = idf(docFreq=166, maxDocs=44218)
               0.018809339 = queryNorm
             0.8812853 = fieldWeight in 1073, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.578893 = idf(docFreq=166, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1073)
         0.18453132 = weight(abstract_txt:dataset in 1073) [ClassicSimilarity], result of:
           0.18453132 = score(doc=1073,freq=5.0), product of:
             0.22385603 = queryWeight, product of:
               1.7654972 = boost
               6.7410603 = idf(docFreq=141, maxDocs=44218)
               0.018809339 = queryNorm
             0.82433033 = fieldWeight in 1073, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.7410603 = idf(docFreq=141, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1073)
         0.059112515 = weight(abstract_txt:model in 1073) [ClassicSimilarity], result of:
           0.059112515 = score(doc=1073,freq=3.0), product of:
             0.15655535 = queryWeight, product of:
               2.0880053 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.018809339 = queryNorm
             0.3775822 = fieldWeight in 1073, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1073)
         0.104876116 = weight(abstract_txt:tasks in 1073) [ClassicSimilarity], result of:
           0.104876116 = score(doc=1073,freq=2.0), product of:
             0.26264137 = queryWeight, product of:
               2.7044516 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.018809339 = queryNorm
             0.399313 = fieldWeight in 1073, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1073)
       0.32 = coord(8/25)
   

4. Jiang, Y.; Meng, R.; Huang, Y.; Lu, W.; Liu, J.: Generating keyphrases for readers : a controllable keyphrase generation framework (2023) 0.19

   0.19253169 = sum of:
     0.19253169 = product of:
       0.60166156 = sum of:
         0.043541495 = weight(abstract_txt:models in 1012) [ClassicSimilarity], result of:
           0.043541495 = score(doc=1012,freq=2.0), product of:
             0.10613118 = queryWeight, product of:
               1.2156377 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.018809339 = queryNorm
             0.4102611 = fieldWeight in 1012, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
         0.014965508 = weight(abstract_txt:these in 1012) [ClassicSimilarity], result of:
           0.014965508 = score(doc=1012,freq=1.0), product of:
             0.07510615 = queryWeight, product of:
               1.2524662 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.018809339 = queryNorm
             0.19925809 = fieldWeight in 1012, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
         0.13694356 = weight(abstract_txt:transformer in 1012) [ClassicSimilarity], result of:
           0.13694356 = score(doc=1012,freq=1.0), product of:
             0.22782525 = queryWeight, product of:
               1.2594142 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.018809339 = queryNorm
             0.6010904 = fieldWeight in 1012, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
         0.036933582 = weight(abstract_txt:processing in 1012) [ClassicSimilarity], result of:
           0.036933582 = score(doc=1012,freq=1.0), product of:
             0.11982067 = queryWeight, product of:
               1.2916609 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.018809339 = queryNorm
             0.3082405 = fieldWeight in 1012, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
         0.0762842 = weight(abstract_txt:learn in 1012) [ClassicSimilarity], result of:
           0.0762842 = score(doc=1012,freq=1.0), product of:
             0.19433029 = queryWeight, product of:
               1.6449507 = boost
               6.280787 = idf(docFreq=224, maxDocs=44218)
               0.018809339 = queryNorm
             0.3925492 = fieldWeight in 1012, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.280787 = idf(docFreq=224, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
         0.09431419 = weight(abstract_txt:dataset in 1012) [ClassicSimilarity], result of:
           0.09431419 = score(doc=1012,freq=1.0), product of:
             0.22385603 = queryWeight, product of:
               1.7654972 = boost
               6.7410603 = idf(docFreq=141, maxDocs=44218)
               0.018809339 = queryNorm
             0.42131627 = fieldWeight in 1012, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7410603 = idf(docFreq=141, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
         0.119858414 = weight(abstract_txt:tasks in 1012) [ClassicSimilarity], result of:
           0.119858414 = score(doc=1012,freq=2.0), product of:
             0.26264137 = queryWeight, product of:
               2.7044516 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.018809339 = queryNorm
             0.45635772 = fieldWeight in 1012, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
         0.07882059 = weight(abstract_txt:language in 1012) [ClassicSimilarity], result of:
           0.07882059 = score(doc=1012,freq=1.0), product of:
             0.30155504 = queryWeight, product of:
               3.8335397 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.018809339 = queryNorm
             0.26138046 = fieldWeight in 1012, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
       0.32 = coord(8/25)
   

5. Suissa, O.; Elmalech, A.; Zhitomirsky-Geffet, M.: Text analysis using deep neural networks in digital humanities and information science (2022) 0.18

   0.17569754 = sum of:
     0.17569754 = product of:
       0.48804867 = sum of:
         0.021979239 = weight(abstract_txt:when in 491) [ClassicSimilarity], result of:
           0.021979239 = score(doc=491,freq=1.0), product of:
             0.084773324 = queryWeight, product of:
               1.0864563 = boost
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.018809339 = queryNorm
             0.2592707 = fieldWeight in 491, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.0625 = fieldNorm(doc=491)
         0.030567056 = weight(abstract_txt:performance in 491) [ClassicSimilarity], result of:
           0.030567056 = score(doc=491,freq=1.0), product of:
             0.10562171 = queryWeight, product of:
               1.2127163 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.018809339 = queryNorm
             0.28940126 = fieldWeight in 491, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=491)
         0.030788485 = weight(abstract_txt:models in 491) [ClassicSimilarity], result of:
           0.030788485 = score(doc=491,freq=1.0), product of:
             0.10613118 = queryWeight, product of:
               1.2156377 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.018809339 = queryNorm
             0.2900984 = fieldWeight in 491, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=491)
         0.021164423 = weight(abstract_txt:these in 491) [ClassicSimilarity], result of:
           0.021164423 = score(doc=491,freq=2.0), product of:
             0.07510615 = queryWeight, product of:
               1.2524662 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.018809339 = queryNorm
             0.28179348 = fieldWeight in 491, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.0625 = fieldNorm(doc=491)
         0.036933582 = weight(abstract_txt:processing in 491) [ClassicSimilarity], result of:
           0.036933582 = score(doc=491,freq=1.0), product of:
             0.11982067 = queryWeight, product of:
               1.2916609 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.018809339 = queryNorm
             0.3082405 = fieldWeight in 491, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=491)
         0.0762842 = weight(abstract_txt:learn in 491) [ClassicSimilarity], result of:
           0.0762842 = score(doc=491,freq=1.0), product of:
             0.19433029 = queryWeight, product of:
               1.6449507 = boost
               6.280787 = idf(docFreq=224, maxDocs=44218)
               0.018809339 = queryNorm
             0.3925492 = fieldWeight in 491, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.280787 = idf(docFreq=224, maxDocs=44218)
               0.0625 = fieldNorm(doc=491)
         0.039004143 = weight(abstract_txt:model in 491) [ClassicSimilarity], result of:
           0.039004143 = score(doc=491,freq=1.0), product of:
             0.15655535 = queryWeight, product of:
               2.0880053 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.018809339 = queryNorm
             0.24913962 = fieldWeight in 491, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.0625 = fieldNorm(doc=491)
         0.119858414 = weight(abstract_txt:tasks in 491) [ClassicSimilarity], result of:
           0.119858414 = score(doc=491,freq=2.0), product of:
             0.26264137 = queryWeight, product of:
               2.7044516 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.018809339 = queryNorm
             0.45635772 = fieldWeight in 491, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.0625 = fieldNorm(doc=491)
         0.11146916 = weight(abstract_txt:language in 491) [ClassicSimilarity], result of:
           0.11146916 = score(doc=491,freq=2.0), product of:
             0.30155504 = queryWeight, product of:
               3.8335397 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.018809339 = queryNorm
             0.3696478 = fieldWeight in 491, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=491)
       0.36 = coord(9/25)