Document (#43925)

Author

Jha, A.

Title

Why GPT-4 isn't all it's cracked up to be

Issue

[22.03.2023].

Source

¬The Economist. 2023, 22.03.2023

Year

2023

Abstract

"I still don't know what to think about GPT-4, the new large language model (LLM) from OpenAI. On the one hand it is a remarkable product that easily passes the Turing test. If you ask it questions, via the ChatGPT interface, GPT-4 can easily produce fluid sentences largely indistinguishable from those a person might write. But on the other hand, amid the exceptional levels of hype and anticipation, it's hard to know where GPT-4 and other LLMs truly fit in the larger project of making machines intelligent.
They might appear intelligent, but LLMs are nothing of the sort. They don't understand the meanings of the words they are using, nor the concepts expressed within the sentences they create. When asked how to bring a cow back to life, earlier versions of ChatGPT, for example, which ran on a souped-up version of GPT-3, would confidently provide a list of instructions. So-called hallucinations like this happen because language models have no concept of what a "cow" is or that "death" is a non-reversible state of being. LLMs do not have minds that can think about objects in the world and how they relate to each other. All they "know" is how likely it is that some sets of words will follow other sets of words, having calculated those probabilities from their training data. To make sense of all this, I spoke with Gary Marcus, an emeritus professor of psychology and neural science at New York University, for "Babbage", our science and technology podcast. Last year, as the world was transfixed by the sudden appearance of ChatGPT, he made some fascinating predictions about GPT-4.
He doesn't dismiss the potential of LLMs to become useful assistants in all sorts of ways-Google and Microsoft have already announced that they will be integrating LLMs into their search and office productivity software. But he talked me through some of his criticisms of the technology's apparent capabilities. At the heart of Dr Marcus's thoughtful critique is an attempt to put LLMs into proper context. Deep learning, the underlying technology that makes LLMs work, is only one piece of the puzzle in the quest for machine intelligence. To reach the level of artificial general intelligence (AGI) that many tech companies strive for-i.e. machines that can plan, reason and solve problems in the way human brains can-they will need to deploy a suite of other AI techniques. These include, for example, the kind of "symbolic AI" that was popular before artificial neural networks and deep learning became all the rage.
People use symbols to think about the world: if I say the words "cat", "house" or "aeroplane", you know instantly what I mean. Symbols can also be used to describe the way things are behaving (running, falling, flying) or they can represent how things should behave in relation to each other (a "+" means add the numbers before and after). Symbolic AI is a way to embed this human knowledge and reasoning into computer systems. Though the idea has been around for decades, it fell by the wayside a few years ago as deep learning-buoyed by the sudden easy availability of lots of training data and cheap computing power-became more fashionable. In the near future at least, there's no doubt people will find LLMs useful. But whether they represent a critical step on the path towards AGI, or rather just an intriguing detour, remains to be seen."

Theme

Computerlinguistik

Object

ChatGPT
GPT-4

Similar documents (content)

1. Frederick, D.E.: ChatGPT: a viral data-driven disruption in the information environment (2023) 0.32

   0.3188089 = sum of:
     0.3188089 = product of:
       0.7970223 = sum of:
         0.051133547 = weight(abstract_txt:artificial in 983) [ClassicSimilarity], result of:
           0.051133547 = score(doc=983,freq=1.0), product of:
             0.13487975 = queryWeight, product of:
               6.0656753 = idf(docFreq=278, maxDocs=44218)
               0.02223656 = queryNorm
             0.3791047 = fieldWeight in 983, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0656753 = idf(docFreq=278, maxDocs=44218)
               0.0625 = fieldNorm(doc=983)
         0.039043214 = weight(abstract_txt:what in 983) [ClassicSimilarity], result of:
           0.039043214 = score(doc=983,freq=2.0), product of:
             0.102374926 = queryWeight, product of:
               1.0670114 = boost
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.02223656 = queryNorm
             0.38137478 = fieldWeight in 983, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.0625 = fieldNorm(doc=983)
         0.052118868 = weight(abstract_txt:learning in 983) [ClassicSimilarity], result of:
           0.052118868 = score(doc=983,freq=2.0), product of:
             0.124115646 = queryWeight, product of:
               1.1748583 = boost
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.02223656 = queryNorm
             0.41992182 = fieldWeight in 983, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.0625 = fieldNorm(doc=983)
         0.026381636 = weight(abstract_txt:will in 983) [ClassicSimilarity], result of:
           0.026381636 = score(doc=983,freq=1.0), product of:
             0.10931689 = queryWeight, product of:
               1.2731667 = boost
               3.8613079 = idf(docFreq=2528, maxDocs=44218)
               0.02223656 = queryNorm
             0.24133174 = fieldWeight in 983, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8613079 = idf(docFreq=2528, maxDocs=44218)
               0.0625 = fieldNorm(doc=983)
         0.0552564 = weight(abstract_txt:about in 983) [ClassicSimilarity], result of:
           0.0552564 = score(doc=983,freq=4.0), product of:
             0.1127339 = queryWeight, product of:
               1.2929118 = boost
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.02223656 = queryNorm
             0.49014893 = fieldWeight in 983, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.0625 = fieldNorm(doc=983)
         0.0997863 = weight(abstract_txt:think in 983) [ClassicSimilarity], result of:
           0.0997863 = score(doc=983,freq=1.0), product of:
             0.24111292 = queryWeight, product of:
               1.6375045 = boost
               6.6217136 = idf(docFreq=159, maxDocs=44218)
               0.02223656 = queryNorm
             0.4138571 = fieldWeight in 983, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6217136 = idf(docFreq=159, maxDocs=44218)
               0.0625 = fieldNorm(doc=983)
         0.029991707 = weight(abstract_txt:other in 983) [ClassicSimilarity], result of:
           0.029991707 = score(doc=983,freq=1.0), product of:
             0.13630675 = queryWeight, product of:
               1.741189 = boost
               3.5204957 = idf(docFreq=3555, maxDocs=44218)
               0.02223656 = queryNorm
             0.22003098 = fieldWeight in 983, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5204957 = idf(docFreq=3555, maxDocs=44218)
               0.0625 = fieldNorm(doc=983)
         0.019397797 = weight(abstract_txt:that in 983) [ClassicSimilarity], result of:
           0.019397797 = score(doc=983,freq=2.0), product of:
             0.092620105 = queryWeight, product of:
               1.757865 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.02223656 = queryNorm
             0.20943399 = fieldWeight in 983, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=983)
         0.36340085 = weight(abstract_txt:chatgpt in 983) [ClassicSimilarity], result of:
           0.36340085 = score(doc=983,freq=4.0), product of:
             0.3595372 = queryWeight, product of:
               1.999605 = boost
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.02223656 = queryNorm
             1.0107461 = fieldWeight in 983, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.0625 = fieldNorm(doc=983)
         0.06051193 = weight(abstract_txt:they in 983) [ClassicSimilarity], result of:
           0.06051193 = score(doc=983,freq=1.0), product of:
             0.25804383 = queryWeight, product of:
               3.0928464 = boost
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.02223656 = queryNorm
             0.23450254 = fieldWeight in 983, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.0625 = fieldNorm(doc=983)
       0.4 = coord(10/25)
   

2. Battelle, J.: ¬The search : how Google and its rivals rewrote the rules of business and transformed our culture (2005) 0.26

   0.25693145 = sum of:
     0.25693145 = product of:
       0.58393514 = sum of:
         0.02928241 = weight(abstract_txt:what in 5941) [ClassicSimilarity], result of:
           0.02928241 = score(doc=5941,freq=2.0), product of:
             0.102374926 = queryWeight, product of:
               1.0670114 = boost
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.02223656 = queryNorm
             0.28603107 = fieldWeight in 5941, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.046875 = fieldNorm(doc=5941)
         0.038852718 = weight(abstract_txt:world in 5941) [ClassicSimilarity], result of:
           0.038852718 = score(doc=5941,freq=3.0), product of:
             0.10798736 = queryWeight, product of:
               1.0958692 = boost
               4.4314575 = idf(docFreq=1429, maxDocs=44218)
               0.02223656 = queryNorm
             0.3597895 = fieldWeight in 5941, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4314575 = idf(docFreq=1429, maxDocs=44218)
               0.046875 = fieldNorm(doc=5941)
         0.039572455 = weight(abstract_txt:will in 5941) [ClassicSimilarity], result of:
           0.039572455 = score(doc=5941,freq=4.0), product of:
             0.10931689 = queryWeight, product of:
               1.2731667 = boost
               3.8613079 = idf(docFreq=2528, maxDocs=44218)
               0.02223656 = queryNorm
             0.3619976 = fieldWeight in 5941, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.8613079 = idf(docFreq=2528, maxDocs=44218)
               0.046875 = fieldNorm(doc=5941)
         0.035890087 = weight(abstract_txt:about in 5941) [ClassicSimilarity], result of:
           0.035890087 = score(doc=5941,freq=3.0), product of:
             0.1127339 = queryWeight, product of:
               1.2929118 = boost
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.02223656 = queryNorm
             0.31836107 = fieldWeight in 5941, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.046875 = fieldNorm(doc=5941)
         0.08513409 = weight(abstract_txt:don't in 5941) [ClassicSimilarity], result of:
           0.08513409 = score(doc=5941,freq=1.0), product of:
             0.22952902 = queryWeight, product of:
               1.304504 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.02223656 = queryNorm
             0.37090772 = fieldWeight in 5941, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.046875 = fieldNorm(doc=5941)
         0.085878275 = weight(abstract_txt:it's in 5941) [ClassicSimilarity], result of:
           0.085878275 = score(doc=5941,freq=1.0), product of:
             0.23086469 = queryWeight, product of:
               1.308294 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.02223656 = queryNorm
             0.37198532 = fieldWeight in 5941, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.046875 = fieldNorm(doc=5941)
         0.07483972 = weight(abstract_txt:think in 5941) [ClassicSimilarity], result of:
           0.07483972 = score(doc=5941,freq=1.0), product of:
             0.24111292 = queryWeight, product of:
               1.6375045 = boost
               6.6217136 = idf(docFreq=159, maxDocs=44218)
               0.02223656 = queryNorm
             0.31039283 = fieldWeight in 5941, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6217136 = idf(docFreq=159, maxDocs=44218)
               0.046875 = fieldNorm(doc=5941)
         0.044987563 = weight(abstract_txt:other in 5941) [ClassicSimilarity], result of:
           0.044987563 = score(doc=5941,freq=4.0), product of:
             0.13630675 = queryWeight, product of:
               1.741189 = boost
               3.5204957 = idf(docFreq=3555, maxDocs=44218)
               0.02223656 = queryNorm
             0.33004647 = fieldWeight in 5941, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.5204957 = idf(docFreq=3555, maxDocs=44218)
               0.046875 = fieldNorm(doc=5941)
         0.017818013 = weight(abstract_txt:that in 5941) [ClassicSimilarity], result of:
           0.017818013 = score(doc=5941,freq=3.0), product of:
             0.092620105 = queryWeight, product of:
               1.757865 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.02223656 = queryNorm
             0.19237739 = fieldWeight in 5941, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.046875 = fieldNorm(doc=5941)
         0.05271729 = weight(abstract_txt:words in 5941) [ClassicSimilarity], result of:
           0.05271729 = score(doc=5941,freq=1.0), product of:
             0.21009417 = queryWeight, product of:
               1.765016 = boost
               5.353007 = idf(docFreq=568, maxDocs=44218)
               0.02223656 = queryNorm
             0.2509222 = fieldWeight in 5941, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.353007 = idf(docFreq=568, maxDocs=44218)
               0.046875 = fieldNorm(doc=5941)
         0.07896256 = weight(abstract_txt:know in 5941) [ClassicSimilarity], result of:
           0.07896256 = score(doc=5941,freq=1.0), product of:
             0.27503803 = queryWeight, product of:
               2.0194728 = boost
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.02223656 = queryNorm
             0.28709686 = fieldWeight in 5941, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.046875 = fieldNorm(doc=5941)
       0.44 = coord(11/25)
   

3. Rosenfeld, L.; Morville, P.: Information architecture for the World Wide Web : designing large-scale Web sites (1998) 0.19

   0.18944202 = sum of:
     0.18944202 = product of:
       0.52622783 = sum of:
         0.02928241 = weight(abstract_txt:what in 493) [ClassicSimilarity], result of:
           0.02928241 = score(doc=493,freq=2.0), product of:
             0.102374926 = queryWeight, product of:
               1.0670114 = boost
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.02223656 = queryNorm
             0.28603107 = fieldWeight in 493, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.046875 = fieldNorm(doc=493)
         0.031723112 = weight(abstract_txt:world in 493) [ClassicSimilarity], result of:
           0.031723112 = score(doc=493,freq=2.0), product of:
             0.10798736 = queryWeight, product of:
               1.0958692 = boost
               4.4314575 = idf(docFreq=1429, maxDocs=44218)
               0.02223656 = queryNorm
             0.29376692 = fieldWeight in 493, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4314575 = idf(docFreq=1429, maxDocs=44218)
               0.046875 = fieldNorm(doc=493)
         0.019786227 = weight(abstract_txt:will in 493) [ClassicSimilarity], result of:
           0.019786227 = score(doc=493,freq=1.0), product of:
             0.10931689 = queryWeight, product of:
               1.2731667 = boost
               3.8613079 = idf(docFreq=2528, maxDocs=44218)
               0.02223656 = queryNorm
             0.1809988 = fieldWeight in 493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8613079 = idf(docFreq=2528, maxDocs=44218)
               0.046875 = fieldNorm(doc=493)
         0.02930413 = weight(abstract_txt:about in 493) [ClassicSimilarity], result of:
           0.02930413 = score(doc=493,freq=2.0), product of:
             0.1127339 = queryWeight, product of:
               1.2929118 = boost
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.02223656 = queryNorm
             0.2599407 = fieldWeight in 493, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.046875 = fieldNorm(doc=493)
         0.08513409 = weight(abstract_txt:don't in 493) [ClassicSimilarity], result of:
           0.08513409 = score(doc=493,freq=1.0), product of:
             0.22952902 = queryWeight, product of:
               1.304504 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.02223656 = queryNorm
             0.37090772 = fieldWeight in 493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.046875 = fieldNorm(doc=493)
         0.14874554 = weight(abstract_txt:it's in 493) [ClassicSimilarity], result of:
           0.14874554 = score(doc=493,freq=3.0), product of:
             0.23086469 = queryWeight, product of:
               1.308294 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.02223656 = queryNorm
             0.6442975 = fieldWeight in 493, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.046875 = fieldNorm(doc=493)
         0.02519848 = weight(abstract_txt:that in 493) [ClassicSimilarity], result of:
           0.02519848 = score(doc=493,freq=6.0), product of:
             0.092620105 = queryWeight, product of:
               1.757865 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.02223656 = queryNorm
             0.27206275 = fieldWeight in 493, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.046875 = fieldNorm(doc=493)
         0.11166991 = weight(abstract_txt:know in 493) [ClassicSimilarity], result of:
           0.11166991 = score(doc=493,freq=2.0), product of:
             0.27503803 = queryWeight, product of:
               2.0194728 = boost
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.02223656 = queryNorm
             0.40601626 = fieldWeight in 493, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.046875 = fieldNorm(doc=493)
         0.04538395 = weight(abstract_txt:they in 493) [ClassicSimilarity], result of:
           0.04538395 = score(doc=493,freq=1.0), product of:
             0.25804383 = queryWeight, product of:
               3.0928464 = boost
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.02223656 = queryNorm
             0.1758769 = fieldWeight in 493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.046875 = fieldNorm(doc=493)
       0.36 = coord(9/25)
   

4. Björklund, L.; Hjerppe, R.; Björklind, A.: Highways and backroads of Internet : strategies and tactics (1995) 0.17

   0.17437585 = sum of:
     0.17437585 = product of:
       0.54492456 = sum of:
         0.027607722 = weight(abstract_txt:what in 1672) [ClassicSimilarity], result of:
           0.027607722 = score(doc=1672,freq=1.0), product of:
             0.102374926 = queryWeight, product of:
               1.0670114 = boost
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.02223656 = queryNorm
             0.2696727 = fieldWeight in 1672, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.0625 = fieldNorm(doc=1672)
         0.026381636 = weight(abstract_txt:will in 1672) [ClassicSimilarity], result of:
           0.026381636 = score(doc=1672,freq=1.0), product of:
             0.10931689 = queryWeight, product of:
               1.2731667 = boost
               3.8613079 = idf(docFreq=2528, maxDocs=44218)
               0.02223656 = queryNorm
             0.24133174 = fieldWeight in 1672, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8613079 = idf(docFreq=2528, maxDocs=44218)
               0.0625 = fieldNorm(doc=1672)
         0.047853447 = weight(abstract_txt:about in 1672) [ClassicSimilarity], result of:
           0.047853447 = score(doc=1672,freq=3.0), product of:
             0.1127339 = queryWeight, product of:
               1.2929118 = boost
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.02223656 = queryNorm
             0.42448142 = fieldWeight in 1672, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.0625 = fieldNorm(doc=1672)
         0.11351211 = weight(abstract_txt:don't in 1672) [ClassicSimilarity], result of:
           0.11351211 = score(doc=1672,freq=1.0), product of:
             0.22952902 = queryWeight, product of:
               1.304504 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.02223656 = queryNorm
             0.4945436 = fieldWeight in 1672, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.0625 = fieldNorm(doc=1672)
         0.11450437 = weight(abstract_txt:it's in 1672) [ClassicSimilarity], result of:
           0.11450437 = score(doc=1672,freq=1.0), product of:
             0.23086469 = queryWeight, product of:
               1.308294 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.02223656 = queryNorm
             0.49598044 = fieldWeight in 1672, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.0625 = fieldNorm(doc=1672)
         0.042414676 = weight(abstract_txt:other in 1672) [ClassicSimilarity], result of:
           0.042414676 = score(doc=1672,freq=2.0), product of:
             0.13630675 = queryWeight, product of:
               1.741189 = boost
               3.5204957 = idf(docFreq=3555, maxDocs=44218)
               0.02223656 = queryNorm
             0.3111708 = fieldWeight in 1672, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5204957 = idf(docFreq=3555, maxDocs=44218)
               0.0625 = fieldNorm(doc=1672)
         0.023757353 = weight(abstract_txt:that in 1672) [ClassicSimilarity], result of:
           0.023757353 = score(doc=1672,freq=3.0), product of:
             0.092620105 = queryWeight, product of:
               1.757865 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.02223656 = queryNorm
             0.2565032 = fieldWeight in 1672, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=1672)
         0.14889322 = weight(abstract_txt:know in 1672) [ClassicSimilarity], result of:
           0.14889322 = score(doc=1672,freq=2.0), product of:
             0.27503803 = queryWeight, product of:
               2.0194728 = boost
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.02223656 = queryNorm
             0.541355 = fieldWeight in 1672, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.0625 = fieldNorm(doc=1672)
       0.32 = coord(8/25)
   

5. Dahlberg, I.: ¬The future of classification in libraries and networks : a theoretical point of view (1995) 0.17

   0.16726704 = sum of:
     0.16726704 = product of:
       0.5973823 = sum of:
         0.039043214 = weight(abstract_txt:what in 5563) [ClassicSimilarity], result of:
           0.039043214 = score(doc=5563,freq=2.0), product of:
             0.102374926 = queryWeight, product of:
               1.0670114 = boost
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.02223656 = queryNorm
             0.38137478 = fieldWeight in 5563, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.0625 = fieldNorm(doc=5563)
         0.042297482 = weight(abstract_txt:world in 5563) [ClassicSimilarity], result of:
           0.042297482 = score(doc=5563,freq=2.0), product of:
             0.10798736 = queryWeight, product of:
               1.0958692 = boost
               4.4314575 = idf(docFreq=1429, maxDocs=44218)
               0.02223656 = queryNorm
             0.3916892 = fieldWeight in 5563, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4314575 = idf(docFreq=1429, maxDocs=44218)
               0.0625 = fieldNorm(doc=5563)
         0.11351211 = weight(abstract_txt:don't in 5563) [ClassicSimilarity], result of:
           0.11351211 = score(doc=5563,freq=1.0), product of:
             0.22952902 = queryWeight, product of:
               1.304504 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.02223656 = queryNorm
             0.4945436 = fieldWeight in 5563, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.0625 = fieldNorm(doc=5563)
         0.18423668 = weight(abstract_txt:sudden in 5563) [ClassicSimilarity], result of:
           0.18423668 = score(doc=5563,freq=1.0), product of:
             0.3170007 = queryWeight, product of:
               1.5330515 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.02223656 = queryNorm
             0.581187 = fieldWeight in 5563, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.0625 = fieldNorm(doc=5563)
         0.02743263 = weight(abstract_txt:that in 5563) [ClassicSimilarity], result of:
           0.02743263 = score(doc=5563,freq=4.0), product of:
             0.092620105 = queryWeight, product of:
               1.757865 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.02223656 = queryNorm
             0.2961844 = fieldWeight in 5563, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=5563)
         0.10528341 = weight(abstract_txt:know in 5563) [ClassicSimilarity], result of:
           0.10528341 = score(doc=5563,freq=1.0), product of:
             0.27503803 = queryWeight, product of:
               2.0194728 = boost
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.02223656 = queryNorm
             0.3827958 = fieldWeight in 5563, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.0625 = fieldNorm(doc=5563)
         0.085576795 = weight(abstract_txt:they in 5563) [ClassicSimilarity], result of:
           0.085576795 = score(doc=5563,freq=2.0), product of:
             0.25804383 = queryWeight, product of:
               3.0928464 = boost
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.02223656 = queryNorm
             0.33163667 = fieldWeight in 5563, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.0625 = fieldNorm(doc=5563)
       0.28 = coord(7/25)