Document (#43871)

Author

Shree, P.

Title

¬The journey of Open AI GPT models

Issue

[10.11.2020].

Source

https://medium.com/walmartglobaltech/the-journey-of-open-ai-gpt-models-32d95b7b7fb2

Year

2020

Abstract

Generative Pre-trained Transformer (GPT) models by OpenAI have taken natural language processing (NLP) community by storm by introducing very powerful language models. These models can perform various NLP tasks like question answering, textual entailment, text summarisation etc. without any supervised training. These language models need very few to no examples to understand the tasks and perform equivalent or even better than the state-of-the-art models trained in supervised fashion. In this article we will cover the journey of these models and understand how they have evolved over a period of 2 years. 1. Discussion of GPT-1 paper (Improving Language Understanding by Generative Pre-training). 2. Discussion of GPT-2 paper (Language Models are unsupervised multitask learners) and its subsequent improvements over GPT-1. 3. Discussion of GPT-3 paper (Language models are few shot learners) and the improvements which have made it one of the most powerful models NLP has seen till date. This article assumes familiarity with the basics of NLP terminologies and transformer architecture.

Theme

Computerlinguistik

Object

GPT-x

Similar documents (content)

1. Radford, A.; Wu, J.; Child, R.; Luan, D.; Amode, D.; Sutskever, I.: Language models are unsupervised multitask learners 0.46

   0.45899525 = sum of:
     0.45899525 = product of:
       1.043171 = sum of:
         0.11608877 = weight(abstract_txt:shot in 871) [ClassicSimilarity], result of:
           0.11608877 = score(doc=871,freq=2.0), product of:
             0.15179603 = queryWeight, product of:
               1.0192479 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.017212572 = queryNorm
             0.7647682 = fieldWeight in 871, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.0625 = fieldNorm(doc=871)
         0.021338334 = weight(abstract_txt:these in 871) [ClassicSimilarity], result of:
           0.021338334 = score(doc=871,freq=3.0), product of:
             0.061827816 = queryWeight, product of:
               1.1266842 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.017212572 = queryNorm
             0.34512514 = fieldWeight in 871, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.0625 = fieldNorm(doc=871)
         0.033860844 = weight(abstract_txt:training in 871) [ClassicSimilarity], result of:
           0.033860844 = score(doc=871,freq=1.0), product of:
             0.10597874 = queryWeight, product of:
               1.204409 = boost
               5.112096 = idf(docFreq=723, maxDocs=44218)
               0.017212572 = queryNorm
             0.319506 = fieldWeight in 871, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.112096 = idf(docFreq=723, maxDocs=44218)
               0.0625 = fieldNorm(doc=871)
         0.06976891 = weight(abstract_txt:tasks in 871) [ClassicSimilarity], result of:
           0.06976891 = score(doc=871,freq=4.0), product of:
             0.108103946 = queryWeight, product of:
               1.2164252 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.017212572 = queryNorm
             0.6453873 = fieldWeight in 871, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.0625 = fieldNorm(doc=871)
         0.058559917 = weight(abstract_txt:perform in 871) [ClassicSimilarity], result of:
           0.058559917 = score(doc=871,freq=1.0), product of:
             0.1526935 = queryWeight, product of:
               1.4456891 = boost
               6.1362057 = idf(docFreq=259, maxDocs=44218)
               0.017212572 = queryNorm
             0.38351285 = fieldWeight in 871, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1362057 = idf(docFreq=259, maxDocs=44218)
               0.0625 = fieldNorm(doc=871)
         0.060517307 = weight(abstract_txt:improvements in 871) [ClassicSimilarity], result of:
           0.060517307 = score(doc=871,freq=1.0), product of:
             0.15607738 = queryWeight, product of:
               1.4616205 = boost
               6.203826 = idf(docFreq=242, maxDocs=44218)
               0.017212572 = queryNorm
             0.38773912 = fieldWeight in 871, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.203826 = idf(docFreq=242, maxDocs=44218)
               0.0625 = fieldNorm(doc=871)
         0.08927155 = weight(abstract_txt:trained in 871) [ClassicSimilarity], result of:
           0.08927155 = score(doc=871,freq=1.0), product of:
             0.20225331 = queryWeight, product of:
               1.6638434 = boost
               7.062158 = idf(docFreq=102, maxDocs=44218)
               0.017212572 = queryNorm
             0.44138488 = fieldWeight in 871, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.062158 = idf(docFreq=102, maxDocs=44218)
               0.0625 = fieldNorm(doc=871)
         0.10534232 = weight(abstract_txt:supervised in 871) [ClassicSimilarity], result of:
           0.10534232 = score(doc=871,freq=1.0), product of:
             0.22585107 = queryWeight, product of:
               1.7582301 = boost
               7.462781 = idf(docFreq=68, maxDocs=44218)
               0.017212572 = queryNorm
             0.4664238 = fieldWeight in 871, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.462781 = idf(docFreq=68, maxDocs=44218)
               0.0625 = fieldNorm(doc=871)
         0.22546548 = weight(abstract_txt:transformer in 871) [ClassicSimilarity], result of:
           0.22546548 = score(doc=871,freq=1.0), product of:
             0.37509415 = queryWeight, product of:
               2.265869 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.017212572 = queryNorm
             0.6010904 = fieldWeight in 871, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.0625 = fieldNorm(doc=871)
         0.13623133 = weight(abstract_txt:language in 871) [ClassicSimilarity], result of:
           0.13623133 = score(doc=871,freq=6.0), product of:
             0.21277875 = queryWeight, product of:
               2.9558976 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017212572 = queryNorm
             0.6402488 = fieldWeight in 871, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=871)
         0.12672628 = weight(abstract_txt:models in 871) [ClassicSimilarity], result of:
           0.12672628 = score(doc=871,freq=1.0), product of:
             0.43683898 = queryWeight, product of:
               5.467771 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.017212572 = queryNorm
             0.2900984 = fieldWeight in 871, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=871)
       0.44 = coord(11/25)
   

2. Radford, A.; Narasimhan, K.; Salimans, T.; Sutskever, I.: Improving language understanding by Generative Pre-Training 0.38

   0.3770803 = sum of:
     0.3770803 = product of:
       0.94270074 = sum of:
         0.017422674 = weight(abstract_txt:these in 870) [ClassicSimilarity], result of:
           0.017422674 = score(doc=870,freq=2.0), product of:
             0.061827816 = queryWeight, product of:
               1.1266842 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.017212572 = queryNorm
             0.28179348 = fieldWeight in 870, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.0625 = fieldNorm(doc=870)
         0.15942816 = weight(abstract_txt:entailment in 870) [ClassicSimilarity], result of:
           0.15942816 = score(doc=870,freq=2.0), product of:
             0.18754707 = queryWeight, product of:
               1.1329345 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.017212572 = queryNorm
             0.8500701 = fieldWeight in 870, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.0625 = fieldNorm(doc=870)
         0.033860844 = weight(abstract_txt:training in 870) [ClassicSimilarity], result of:
           0.033860844 = score(doc=870,freq=1.0), product of:
             0.10597874 = queryWeight, product of:
               1.204409 = boost
               5.112096 = idf(docFreq=723, maxDocs=44218)
               0.017212572 = queryNorm
             0.319506 = fieldWeight in 870, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.112096 = idf(docFreq=723, maxDocs=44218)
               0.0625 = fieldNorm(doc=870)
         0.06976891 = weight(abstract_txt:tasks in 870) [ClassicSimilarity], result of:
           0.06976891 = score(doc=870,freq=4.0), product of:
             0.108103946 = queryWeight, product of:
               1.2164252 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.017212572 = queryNorm
             0.6453873 = fieldWeight in 870, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.0625 = fieldNorm(doc=870)
         0.058559917 = weight(abstract_txt:perform in 870) [ClassicSimilarity], result of:
           0.058559917 = score(doc=870,freq=1.0), product of:
             0.1526935 = queryWeight, product of:
               1.4456891 = boost
               6.1362057 = idf(docFreq=259, maxDocs=44218)
               0.017212572 = queryNorm
             0.38351285 = fieldWeight in 870, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1362057 = idf(docFreq=259, maxDocs=44218)
               0.0625 = fieldNorm(doc=870)
         0.060517307 = weight(abstract_txt:improvements in 870) [ClassicSimilarity], result of:
           0.060517307 = score(doc=870,freq=1.0), product of:
             0.15607738 = queryWeight, product of:
               1.4616205 = boost
               6.203826 = idf(docFreq=242, maxDocs=44218)
               0.017212572 = queryNorm
             0.38773912 = fieldWeight in 870, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.203826 = idf(docFreq=242, maxDocs=44218)
               0.0625 = fieldNorm(doc=870)
         0.12624905 = weight(abstract_txt:trained in 870) [ClassicSimilarity], result of:
           0.12624905 = score(doc=870,freq=2.0), product of:
             0.20225331 = queryWeight, product of:
               1.6638434 = boost
               7.062158 = idf(docFreq=102, maxDocs=44218)
               0.017212572 = queryNorm
             0.6242125 = fieldWeight in 870, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.062158 = idf(docFreq=102, maxDocs=44218)
               0.0625 = fieldNorm(doc=870)
         0.1413457 = weight(abstract_txt:generative in 870) [ClassicSimilarity], result of:
           0.1413457 = score(doc=870,freq=1.0), product of:
             0.2747527 = queryWeight, product of:
               1.9392581 = boost
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.017212572 = queryNorm
             0.514447 = fieldWeight in 870, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.0625 = fieldNorm(doc=870)
         0.0963301 = weight(abstract_txt:language in 870) [ClassicSimilarity], result of:
           0.0963301 = score(doc=870,freq=3.0), product of:
             0.21277875 = queryWeight, product of:
               2.9558976 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017212572 = queryNorm
             0.45272425 = fieldWeight in 870, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=870)
         0.17921804 = weight(abstract_txt:models in 870) [ClassicSimilarity], result of:
           0.17921804 = score(doc=870,freq=2.0), product of:
             0.43683898 = queryWeight, product of:
               5.467771 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.017212572 = queryNorm
             0.4102611 = fieldWeight in 870, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=870)
       0.4 = coord(10/25)
   

3. Lund, B.D.: ¬A brief review of ChatGPT : its value and the underlying GPT technology (2023) 0.31

   0.31399524 = sum of:
     0.31399524 = product of:
       0.98123515 = sum of:
         0.11772082 = weight(abstract_txt:openai in 873) [ClassicSimilarity], result of:
           0.11772082 = score(doc=873,freq=1.0), product of:
             0.16635624 = queryWeight, product of:
               1.0670117 = boost
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.017212572 = queryNorm
             0.707643 = fieldWeight in 873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.078125 = fieldNorm(doc=873)
         0.04360557 = weight(abstract_txt:tasks in 873) [ClassicSimilarity], result of:
           0.04360557 = score(doc=873,freq=1.0), product of:
             0.108103946 = queryWeight, product of:
               1.2164252 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.017212572 = queryNorm
             0.40336704 = fieldWeight in 873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.078125 = fieldNorm(doc=873)
         0.01981093 = weight(abstract_txt:paper in 873) [ClassicSimilarity], result of:
           0.01981093 = score(doc=873,freq=1.0), product of:
             0.07313309 = queryWeight, product of:
               1.2253699 = boost
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.017212572 = queryNorm
             0.27088875 = fieldWeight in 873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.078125 = fieldNorm(doc=873)
         0.11158945 = weight(abstract_txt:trained in 873) [ClassicSimilarity], result of:
           0.11158945 = score(doc=873,freq=1.0), product of:
             0.20225331 = queryWeight, product of:
               1.6638434 = boost
               7.062158 = idf(docFreq=102, maxDocs=44218)
               0.017212572 = queryNorm
             0.5517311 = fieldWeight in 873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.062158 = idf(docFreq=102, maxDocs=44218)
               0.078125 = fieldNorm(doc=873)
         0.1316779 = weight(abstract_txt:supervised in 873) [ClassicSimilarity], result of:
           0.1316779 = score(doc=873,freq=1.0), product of:
             0.22585107 = queryWeight, product of:
               1.7582301 = boost
               7.462781 = idf(docFreq=68, maxDocs=44218)
               0.017212572 = queryNorm
             0.58302975 = fieldWeight in 873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.462781 = idf(docFreq=68, maxDocs=44218)
               0.078125 = fieldNorm(doc=873)
         0.17668213 = weight(abstract_txt:generative in 873) [ClassicSimilarity], result of:
           0.17668213 = score(doc=873,freq=1.0), product of:
             0.2747527 = queryWeight, product of:
               1.9392581 = boost
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.017212572 = queryNorm
             0.6430587 = fieldWeight in 873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.078125 = fieldNorm(doc=873)
         0.28183186 = weight(abstract_txt:transformer in 873) [ClassicSimilarity], result of:
           0.28183186 = score(doc=873,freq=1.0), product of:
             0.37509415 = queryWeight, product of:
               2.265869 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.017212572 = queryNorm
             0.751363 = fieldWeight in 873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.078125 = fieldNorm(doc=873)
         0.09831649 = weight(abstract_txt:language in 873) [ClassicSimilarity], result of:
           0.09831649 = score(doc=873,freq=2.0), product of:
             0.21277875 = queryWeight, product of:
               2.9558976 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017212572 = queryNorm
             0.46205974 = fieldWeight in 873, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.078125 = fieldNorm(doc=873)
       0.32 = coord(8/25)
   

4. Donahue, J.; Hendricks, L.A.; Guadarrama, S.; Rohrbach, M.; Venugopalan, S.; Saenko, K.; Darrell, T.: Long-term recurrent convolutional networks for visual recognition and description (2014) 0.23

   0.22811049 = sum of:
     0.22811049 = product of:
       0.7128453 = sum of:
         0.019380981 = weight(abstract_txt:over in 1873) [ClassicSimilarity], result of:
           0.019380981 = score(doc=1873,freq=1.0), product of:
             0.0730585 = queryWeight, product of:
               4.244485 = idf(docFreq=1723, maxDocs=44218)
               0.017212572 = queryNorm
             0.2652803 = fieldWeight in 1873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.244485 = idf(docFreq=1723, maxDocs=44218)
               0.0625 = fieldNorm(doc=1873)
         0.012319692 = weight(abstract_txt:these in 1873) [ClassicSimilarity], result of:
           0.012319692 = score(doc=1873,freq=1.0), product of:
             0.061827816 = queryWeight, product of:
               1.1266842 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.017212572 = queryNorm
             0.19925809 = fieldWeight in 1873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.0625 = fieldNorm(doc=1873)
         0.021670796 = weight(abstract_txt:have in 1873) [ClassicSimilarity], result of:
           0.021670796 = score(doc=1873,freq=3.0), product of:
             0.06246837 = queryWeight, product of:
               1.1325055 = boost
               3.2046018 = idf(docFreq=4876, maxDocs=44218)
               0.017212572 = queryNorm
             0.3469083 = fieldWeight in 1873, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.2046018 = idf(docFreq=4876, maxDocs=44218)
               0.0625 = fieldNorm(doc=1873)
         0.033860844 = weight(abstract_txt:training in 1873) [ClassicSimilarity], result of:
           0.033860844 = score(doc=1873,freq=1.0), product of:
             0.10597874 = queryWeight, product of:
               1.204409 = boost
               5.112096 = idf(docFreq=723, maxDocs=44218)
               0.017212572 = queryNorm
             0.319506 = fieldWeight in 1873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.112096 = idf(docFreq=723, maxDocs=44218)
               0.0625 = fieldNorm(doc=1873)
         0.060421646 = weight(abstract_txt:tasks in 1873) [ClassicSimilarity], result of:
           0.060421646 = score(doc=1873,freq=3.0), product of:
             0.108103946 = queryWeight, product of:
               1.2164252 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.017212572 = queryNorm
             0.55892175 = fieldWeight in 1873, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.0625 = fieldNorm(doc=1873)
         0.08927155 = weight(abstract_txt:trained in 1873) [ClassicSimilarity], result of:
           0.08927155 = score(doc=1873,freq=1.0), product of:
             0.20225331 = queryWeight, product of:
               1.6638434 = boost
               7.062158 = idf(docFreq=102, maxDocs=44218)
               0.017212572 = queryNorm
             0.44138488 = fieldWeight in 1873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.062158 = idf(docFreq=102, maxDocs=44218)
               0.0625 = fieldNorm(doc=1873)
         0.055616207 = weight(abstract_txt:language in 1873) [ClassicSimilarity], result of:
           0.055616207 = score(doc=1873,freq=1.0), product of:
             0.21277875 = queryWeight, product of:
               2.9558976 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017212572 = queryNorm
             0.26138046 = fieldWeight in 1873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=1873)
         0.42030358 = weight(abstract_txt:models in 1873) [ClassicSimilarity], result of:
           0.42030358 = score(doc=1873,freq=11.0), product of:
             0.43683898 = queryWeight, product of:
               5.467771 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.017212572 = queryNorm
             0.9621476 = fieldWeight in 1873, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=1873)
       0.32 = coord(8/25)
   

5. Aydin, Ö.; Karaarslan, E.: OpenAI ChatGPT generated literature review: : digital twin in healthcare (2022) 0.21

   0.21323276 = sum of:
     0.21323276 = product of:
       0.76154554 = sum of:
         0.22335956 = weight(abstract_txt:openai in 851) [ClassicSimilarity], result of:
           0.22335956 = score(doc=851,freq=10.0), product of:
             0.16635624 = queryWeight, product of:
               1.0670117 = boost
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.017212572 = queryNorm
             1.3426582 = fieldWeight in 851, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.046875 = fieldNorm(doc=851)
         0.026163341 = weight(abstract_txt:tasks in 851) [ClassicSimilarity], result of:
           0.026163341 = score(doc=851,freq=1.0), product of:
             0.108103946 = queryWeight, product of:
               1.2164252 = boost
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.017212572 = queryNorm
             0.24202023 = fieldWeight in 851, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1630983 = idf(docFreq=687, maxDocs=44218)
               0.046875 = fieldNorm(doc=851)
         0.027675906 = weight(abstract_txt:understand in 851) [ClassicSimilarity], result of:
           0.027675906 = score(doc=851,freq=1.0), product of:
             0.11223129 = queryWeight, product of:
               1.2394289 = boost
               5.260737 = idf(docFreq=623, maxDocs=44218)
               0.017212572 = queryNorm
             0.24659705 = fieldWeight in 851, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.260737 = idf(docFreq=623, maxDocs=44218)
               0.046875 = fieldNorm(doc=851)
         0.11596715 = weight(abstract_txt:trained in 851) [ClassicSimilarity], result of:
           0.11596715 = score(doc=851,freq=3.0), product of:
             0.20225331 = queryWeight, product of:
               1.6638434 = boost
               7.062158 = idf(docFreq=102, maxDocs=44218)
               0.017212572 = queryNorm
             0.57337576 = fieldWeight in 851, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.062158 = idf(docFreq=102, maxDocs=44218)
               0.046875 = fieldNorm(doc=851)
         0.106009275 = weight(abstract_txt:generative in 851) [ClassicSimilarity], result of:
           0.106009275 = score(doc=851,freq=1.0), product of:
             0.2747527 = queryWeight, product of:
               1.9392581 = boost
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.017212572 = queryNorm
             0.38583523 = fieldWeight in 851, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.046875 = fieldNorm(doc=851)
         0.1690991 = weight(abstract_txt:transformer in 851) [ClassicSimilarity], result of:
           0.1690991 = score(doc=851,freq=1.0), product of:
             0.37509415 = queryWeight, product of:
               2.265869 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.017212572 = queryNorm
             0.45081776 = fieldWeight in 851, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.046875 = fieldNorm(doc=851)
         0.09327121 = weight(abstract_txt:language in 851) [ClassicSimilarity], result of:
           0.09327121 = score(doc=851,freq=5.0), product of:
             0.21277875 = queryWeight, product of:
               2.9558976 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017212572 = queryNorm
             0.43834835 = fieldWeight in 851, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.046875 = fieldNorm(doc=851)
       0.28 = coord(7/25)