Search (2 results, page 1 of 1)

  • × author_ss:"Wu, J."
  • × year_i:[2020 TO 2030}
  1. He, C.; Wu, J.; Zhang, Q.: Research leadership flow determinants and the role of proximity in research collaborations (2020) 0.00
    0.0016833913 = product of:
      0.016833913 = sum of:
        0.016833913 = weight(_text_:web in 30) [ClassicSimilarity], result of:
          0.016833913 = score(doc=30,freq=2.0), product of:
            0.0933738 = queryWeight, product of:
              3.2635105 = idf(docFreq=4597, maxDocs=44218)
              0.028611459 = queryNorm
            0.18028519 = fieldWeight in 30, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.2635105 = idf(docFreq=4597, maxDocs=44218)
              0.0390625 = fieldNorm(doc=30)
      0.1 = coord(1/10)
    
    Abstract
    Characterizing the leadership in research is important to revealing the interaction pattern and organizational structure through research collaboration. This research defines the leadership role based on the corresponding author's affiliation, and presents the first quantitative research on the factors and evolution of 5 proximity dimensions (geographical, cognitive, institutional, social, and economic) of research leadership. The data to capture research leadership consist of a set of multi-institution articles in the fields of "Life Sciences & Biomedicine," "Technology," "Physical Sciences," "Social Sciences," and "Humanities & Arts" during 2013-2017 from the Web of Science Core Citation Database. A Tobit regression-based gravity model indicates that the mass of research leadership of both the leading and participating institutions and the geographical, cognitive, institutional, social, and economic proximities are important factors for the flow of research leadership among Chinese institutions. In general, the effect of these proximities for research leadership flow has been declining recently. The outcome of this research sheds light on the leadership evolution and flow among Chinese institutions, and thus can provide evidence and support for grant allocation policies to facilitate scientific research and collaborations.
  2. Brown, T.B.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; Agarwal, S.; Herbert-Voss, A.; Krueger, G.; Henighan, T.; Child, R.; Ramesh, A.; Ziegler, D.M.; Wu, J.; Winter, C.; Hesse, C.; Chen, M.; Sigler, E.; Litwin, M.; Gray, S.; Chess, B.; Clark, J.; Berner, C.; McCandlish, S.; Radford, A.; Sutskever, I.; Amodei, D.: Language models are few-shot learners (2020) 0.00
    0.0013467129 = product of:
      0.013467129 = sum of:
        0.013467129 = weight(_text_:web in 872) [ClassicSimilarity], result of:
          0.013467129 = score(doc=872,freq=2.0), product of:
            0.0933738 = queryWeight, product of:
              3.2635105 = idf(docFreq=4597, maxDocs=44218)
              0.028611459 = queryNorm
            0.14422815 = fieldWeight in 872, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.2635105 = idf(docFreq=4597, maxDocs=44218)
              0.03125 = fieldNorm(doc=872)
      0.1 = coord(1/10)
    
    Abstract
    Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task. While typically task-agnostic in architecture, this method still requires task-specific fine-tuning datasets of thousands or tens of thousands of examples. By contrast, humans can generally perform a new language task from only a few examples or from simple instructions - something which current NLP systems still largely struggle to do. Here we show that scaling up language models greatly improves task-agnostic, few-shot performance, sometimes even reaching competitiveness with prior state-of-the-art fine-tuning approaches. Specifically, we train GPT-3, an autoregressive language model with 175 billion parameters, 10x more than any previous non-sparse language model, and test its performance in the few-shot setting. For all tasks, GPT-3 is applied without any gradient updates or fine-tuning, with tasks and few-shot demonstrations specified purely via text interaction with the model. GPT-3 achieves strong performance on many NLP datasets, including translation, question-answering, and cloze tasks, as well as several tasks that require on-the-fly reasoning or domain adaptation, such as unscrambling words, using a novel word in a sentence, or performing 3-digit arithmetic. At the same time, we also identify some datasets where GPT-3's few-shot learning still struggles, as well as some datasets where GPT-3 faces methodological issues related to training on large web corpora. Finally, we find that GPT-3 can generate samples of news articles which human evaluators have difficulty distinguishing from articles written by humans. We discuss broader societal impacts of this finding and of GPT-3 in general.