Search (19 results, page 1 of 1)

  • × author_ss:"Lancaster, F.W."
  1. Lancaster, F.W.: Electronic publishing (1989) 0.01
    0.012396089 = product of:
      0.037188265 = sum of:
        0.037188265 = weight(_text_:to in 2881) [ClassicSimilarity], result of:
          0.037188265 = score(doc=2881,freq=10.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.44915485 = fieldWeight in 2881, product of:
              3.1622777 = tf(freq=10.0), with freq of:
                10.0 = termFreq=10.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.078125 = fieldNorm(doc=2881)
      0.33333334 = coord(1/3)
    
    Abstract
    Contribution to an issue on the impact of technological change on libraries and ways in which librarians are applying technology to their collections, services to users and the management of their libraries. Traces the evolution of electronic publishing from the early 60s to the present. Pays particular attention to computer conferencing, and hypermedia.
  2. Lancaster, F.W.; Connell, T.H.; Bishop, N.; McCowan, S.: Identifying barriers to effective subject access in library catalogs (1991) 0.01
    0.009505464 = product of:
      0.028516391 = sum of:
        0.028516391 = weight(_text_:to in 2259) [ClassicSimilarity], result of:
          0.028516391 = score(doc=2259,freq=12.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.34441712 = fieldWeight in 2259, product of:
              3.4641016 = tf(freq=12.0), with freq of:
                12.0 = termFreq=12.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.0546875 = fieldNorm(doc=2259)
      0.33333334 = coord(1/3)
    
    Abstract
    51 subject searches were performed in an online catalog containing about 4,5 million records. Their success was judges in terms of lists of items, known to be relevant to the various topics, compiled by subject specialists (faculty members or authors of articles in specialized encyclopedias). Many of the items known to be relevant were not retrieved, even in very broad searches that sometimes retrieved several hundred records, and very little could be done to make them retrievable within the constraints of present cataloging practice. Librarians should recognize that library catalogs, as now implemented, offer only the most primitive of subject access and should seek to develop different types of subject access tools. - Vgl auch Letter (B.H. Weinberg) in: LTRS 36(1992) S.123-124.
  3. Lancaster, F.W.: ¬The evolution of electronic publishing (1995) 0.01
    0.00940797 = product of:
      0.02822391 = sum of:
        0.02822391 = weight(_text_:to in 2446) [ClassicSimilarity], result of:
          0.02822391 = score(doc=2446,freq=4.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.34088457 = fieldWeight in 2446, product of:
              2.0 = tf(freq=4.0), with freq of:
                4.0 = termFreq=4.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.09375 = fieldNorm(doc=2446)
      0.33333334 = coord(1/3)
    
    Abstract
    Summarizes the development of electronic publishing since the early 60s, when computers were used merely to produce conventional printed products, to the present move toward networked scholarly publishing
  4. Lancaster, F.W.; Warner, A.: Intelligent technologies in library and information service applications (2001) 0.01
    0.008588262 = product of:
      0.025764786 = sum of:
        0.025764786 = weight(_text_:to in 308) [ClassicSimilarity], result of:
          0.025764786 = score(doc=308,freq=30.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.3111836 = fieldWeight in 308, product of:
              5.477226 = tf(freq=30.0), with freq of:
                30.0 = termFreq=30.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.03125 = fieldNorm(doc=308)
      0.33333334 = coord(1/3)
    
    Footnote
    Rez. in: JASIST 53(2002) no.4, S.321-322 (I. Fourie): "A substantial literature exists on artificial intelligence (AI) and expert systems in general, as well as in Library and Information Science (LIS). Many reports are over-confident and grossly exaggerate the power and potential of artificial intelligence (AI). This is especially true of the first phase of At, and to some extent also of the third phase that is stimulated by developments surrounding the Internet. The middle phase was mostly marked by disillusionment about the potential of Al and expert systems. The confusion around the promises made by AI and the lack of operational success, leaves managers of library and information services with the dilemma of distinguishing between worthwhile research reporting on operational projects and projects that exists only on paper or in the researchers' heads. It is very difficult to sieve between the two when working through the subject literature, and to distinguish between working technology/applications and wishful thinking. This might be one reason why working systems are sometimes ignored. According to Lancaster and Warner, library managers must also look much wider than the LIS literature to note new trends; this can, however, become a daunting task. Against this background the authors report on a study conducted with the support of the Special Libraries Association's Steven I. Goldspiel Memorial Research Grant. The objective of the study was to gain sufficient familiarity with the developments in Al and related technologies to make recommendations to the information service community on what can be applied, and what to expect in the near future. The intention therefore was to focus on systems that are actually operational, and systems that hold potential for the future. Since digital libraries seems an inevitable part of our future, applications concerning them features strongly in the final recommendations. The scope of AI in Library and Information Science depends on the interpretation of the concepts artificial intelligence and expert systems. "If a system has to `behave intelligently' (e.g. make inferences or learn from its mistakes) to qualify as having AI, few such systems exist in any application. On the other hand, if one accepts that a system exhibits AI if its does things that humans need intelligence to do, many more systems would qualify" (p. 107). One example is the field of subject indexing. The same would apply if a more relaxed definition of expert systems is applied as a system that "can help the non-expert perform some task at a level closer to that of an expert, whether or not all the essential components are in place" (p. 107). Most of the AI literature relevant to libraries falls in the field of expert systems. Lancaster and Warner identify (p. 6) expert systems as " a branch of artificial intelligence, even though very few expert systems exhibit true intelligence.""
  5. Lancaster, F.W.: Vocabulary control for information retrieval (1986) 0.01
    0.0082269255 = product of:
      0.024680775 = sum of:
        0.024680775 = product of:
          0.04936155 = sum of:
            0.04936155 = weight(_text_:22 in 217) [ClassicSimilarity], result of:
              0.04936155 = score(doc=217,freq=2.0), product of:
                0.15947726 = queryWeight, product of:
                  3.5018296 = idf(docFreq=3622, maxDocs=44218)
                  0.045541126 = queryNorm
                0.30952093 = fieldWeight in 217, product of:
                  1.4142135 = tf(freq=2.0), with freq of:
                    2.0 = termFreq=2.0
                  3.5018296 = idf(docFreq=3622, maxDocs=44218)
                  0.0625 = fieldNorm(doc=217)
          0.5 = coord(1/2)
      0.33333334 = coord(1/3)
    
    Date
    22. 4.2007 10:07:51
  6. Lancaster, F.W.: Trends in subject indexing from 1957 to 2000 (1980) 0.01
    0.0077611795 = product of:
      0.023283537 = sum of:
        0.023283537 = weight(_text_:to in 208) [ClassicSimilarity], result of:
          0.023283537 = score(doc=208,freq=8.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.28121543 = fieldWeight in 208, product of:
              2.828427 = tf(freq=8.0), with freq of:
                8.0 = termFreq=8.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.0546875 = fieldNorm(doc=208)
      0.33333334 = coord(1/3)
    
    Abstract
    Computer have been used in 2 areas of printed index production: to sort entries and fromat printed indexes, and to derive a series of index entries from a minimum intellectual input. Computer indexing enables more indexing terms to be used as well as weighted terms, links and roles. Interest in automatic indexing peaked in the mid-1960s and has since declined. Interest in machine-aided indexing concentrates on using the computer for on-line display or for indexing by extraction. Computers have also made possible the implementation of retrieval systems without indexing-free text systems. Considers future prospects and needs
  7. Lancaster, F.W.: Evaluation in the context of the digital library (1996) 0.01
    0.0076815756 = product of:
      0.023044726 = sum of:
        0.023044726 = weight(_text_:to in 7886) [ClassicSimilarity], result of:
          0.023044726 = score(doc=7886,freq=6.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.2783311 = fieldWeight in 7886, product of:
              2.4494898 = tf(freq=6.0), with freq of:
                6.0 = termFreq=6.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.0625 = fieldNorm(doc=7886)
      0.33333334 = coord(1/3)
    
    Abstract
    Digital libraries are sufficiently differnt from more traditional print on paper libraries to present a new set of parameters relating to the evaluation of its use. Discusses evaluation criteria, problems and methods relevant to the digital library environment
  8. Lancaster, F.W.: Evaluating the performance of a large computerized information system (1985) 0.01
    0.007354548 = product of:
      0.022063645 = sum of:
        0.022063645 = weight(_text_:to in 3649) [ClassicSimilarity], result of:
          0.022063645 = score(doc=3649,freq=22.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.26648173 = fieldWeight in 3649, product of:
              4.690416 = tf(freq=22.0), with freq of:
                22.0 = termFreq=22.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.03125 = fieldNorm(doc=3649)
      0.33333334 = coord(1/3)
    
    Abstract
    F. W. Lancaster is known for his writing an the state of the art in librarylinformation science. His skill in identifying significant contributions and synthesizing literature in fields as diverse as online systems, vocabulary control, measurement and evaluation, and the paperless society have earned him esteem as a chronicler of information science. Equally deserving of repute is his own contribution to research in the discipline-his evaluation of the MEDLARS operating system. The MEDLARS study is notable for several reasons. It was the first large-scale application of retrieval experiment methodology to the evaluation of an actual operating system. As such, problems had to be faced that do not arise in laboratory-like conditions. One example is the problem of recall: how to determine, for a very large and dynamic database, the number of documents relevant to a given search request. By solving this problem and others attendant upon transferring an experimental methodology to the real world, Lancaster created a constructive procedure that could be used to improve the design and functioning of retrieval systems. The MEDLARS study is notable also for its contribution to our understanding of what constitutes a good index language and good indexing. The ideal retrieval system would be one that retrieves all and only relevant documents. The failures that occur in real operating systems, when a relevant document is not retrieved (a recall failure) or an irrelevant document is retrieved (a precision failure), can be analysed to assess the impact of various factors an the performance of the system. This is exactly what Lancaster did. He found both the MEDLARS indexing and the McSH index language to be significant factors affecting retrieval performance. The indexing, primarily because it was insufficiently exhaustive, explained a large number of recall failures. The index language, largely because of its insufficient specificity, accounted for a large number of precision failures. The purpose of identifying factors responsible for a system's failures is ultimately to improve the system. Unlike many user studies, the MEDLARS evaluation yielded recommendations that were eventually implemented.* Indexing exhaustivity was increased and the McSH index language was enriched with more specific terms and a larger entry vocabulary.
  9. Lancaster, F.W.: Networked electronic publishing of the results of scholarly research (1995) 0.01
    0.006721379 = product of:
      0.020164136 = sum of:
        0.020164136 = weight(_text_:to in 1675) [ClassicSimilarity], result of:
          0.020164136 = score(doc=1675,freq=6.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.24353972 = fieldWeight in 1675, product of:
              2.4494898 = tf(freq=6.0), with freq of:
                6.0 = termFreq=6.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.0546875 = fieldNorm(doc=1675)
      0.33333334 = coord(1/3)
    
    Abstract
    A review of developments in electronic publishing over the last 25 years is followed by a report on a survey conducted, with directors of university libraries and other academic administrators, to determine attitudes toward a networked electronic approach to the publishing of research articles. A major conclusion is that academic administrators do not now consider the academic community well equipped to undertake an enterprise of this kind and would not give it high priority in the allocation of university resources
  10. Elzy, C.; Nourie, A.; Lancaster, F.W.; Joseph, K.M.: Evaluating reference service in a large academic library (1991) 0.01
    0.006721379 = product of:
      0.020164136 = sum of:
        0.020164136 = weight(_text_:to in 4015) [ClassicSimilarity], result of:
          0.020164136 = score(doc=4015,freq=6.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.24353972 = fieldWeight in 4015, product of:
              2.4494898 = tf(freq=6.0), with freq of:
                6.0 = termFreq=6.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.0546875 = fieldNorm(doc=4015)
      0.33333334 = coord(1/3)
    
    Abstract
    Reports an unobtrusive study of the ability of professional librarians to deal with factual questions conducted at the Milner Library, Illinois State University. Standards were recruited to pose questions for which answers were known, to 19 librarians in 5 departments. In all, 190 test incidents (10 questions for each of the 19 librarians) were used. Librarians were evaluated on the accuracy of the responses given and on their responsiveness and helpfulness, as judged by the student proxies. Describes the methods used in the study, including the accuracy and attitude scales developed, presents the major results, and makes suggestions on the follow-up action that seems appropriate after a study of this kind has been performed
  11. Lancaster, F.W.: Artificial intelligence, expert systems and the digital library (1996) 0.01
    0.00627198 = product of:
      0.018815938 = sum of:
        0.018815938 = weight(_text_:to in 839) [ClassicSimilarity], result of:
          0.018815938 = score(doc=839,freq=4.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.22725637 = fieldWeight in 839, product of:
              2.0 = tf(freq=4.0), with freq of:
                4.0 = termFreq=4.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.0625 = fieldNorm(doc=839)
      0.33333334 = coord(1/3)
    
    Abstract
    Based partly on chapters in a forthcoming book 'Technology and Management in Library and Information Sciences' by F.W. Lancaster and B. Sandore. Some inportant functions of a research library operating largely in a networked digital environment are illustrated. The ability of artificial intelligence and expert system technologies to contribute to these functions is discussed, in the light of a report from the American Association for Artificial Intelligence, as well as experiences with these technologies in the library world and elsewhere
  12. Lancaster, F.W.: Libraries in the year 2001 (1993) 0.01
    0.005487982 = product of:
      0.016463947 = sum of:
        0.016463947 = weight(_text_:to in 7599) [ClassicSimilarity], result of:
          0.016463947 = score(doc=7599,freq=4.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.19884932 = fieldWeight in 7599, product of:
              2.0 = tf(freq=4.0), with freq of:
                4.0 = termFreq=4.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.0546875 = fieldNorm(doc=7599)
      0.33333334 = coord(1/3)
    
    Abstract
    Reviews the trend away from a paper based society and towards an electronic society: with the advent of computers, electronic mail, computer conferencing, electronic invisible colleges, and the application of computers to libraries and information networks, and to publishing, with the production of electronic media. Forecasts the advent of the electronic library and the electronic librarian, the decline in the use of present day libraries, technical and library services, and the enhanced and extended role of librarians in the new situation. Predicts the eventual demise of the traditional library with the exception of non research libraries but the enhanced value of the librarians as an information specialist
  13. Krooks, D.A.; Lancaster, F.W.: ¬The evolution of guidelines for thesaurus construction (1993) 0.00
    0.0044349595 = product of:
      0.013304878 = sum of:
        0.013304878 = weight(_text_:to in 7128) [ClassicSimilarity], result of:
          0.013304878 = score(doc=7128,freq=2.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.16069452 = fieldWeight in 7128, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.0625 = fieldNorm(doc=7128)
      0.33333334 = coord(1/3)
    
    Abstract
    This piece of research traces the evolution of guidelines and principles for the construction of information retrieval thesauri from 1959 to 1993. We conclude that the majority of the basic problems of thesaurus construction has already been identified and solved by 1967 and that Eugene Wall, more than any other individual, has profoundly influenced the entire development in this area
  14. Lancaster, F.W.: Precision and recall (2009) 0.00
    0.0044349595 = product of:
      0.013304878 = sum of:
        0.013304878 = weight(_text_:to in 3866) [ClassicSimilarity], result of:
          0.013304878 = score(doc=3866,freq=2.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.16069452 = fieldWeight in 3866, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.0625 = fieldNorm(doc=3866)
      0.33333334 = coord(1/3)
    
    Abstract
    F.W. Lancaster's work has been immensely influential in library and information science. He has written on indexing and information system evaluation, and has been looked to as a pioneer in many areas. Here he describes precision and recall, the two most fundamental and widespread measures of information retrieval effectiveness.
  15. Lancaster, F.W.: From custodian to knowledge engineer : the evolution of librarianship as a profession (1995) 0.00
    0.0038805897 = product of:
      0.011641769 = sum of:
        0.011641769 = weight(_text_:to in 3058) [ClassicSimilarity], result of:
          0.011641769 = score(doc=3058,freq=2.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.14060771 = fieldWeight in 3058, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.0546875 = fieldNorm(doc=3058)
      0.33333334 = coord(1/3)
    
  16. Qin, J.; Lancaster, F.W.; Allen, B.: Types and levels of collaboration in interdisciplinary research in the sciences (1997) 0.00
    0.0038805897 = product of:
      0.011641769 = sum of:
        0.011641769 = weight(_text_:to in 1593) [ClassicSimilarity], result of:
          0.011641769 = score(doc=1593,freq=2.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.14060771 = fieldWeight in 1593, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.0546875 = fieldNorm(doc=1593)
      0.33333334 = coord(1/3)
    
    Abstract
    Reports on a study which collected a sample of 846 scientific research papers published in 1992 and tests 3 hypotheses on the relationship between research collaboration and interdisciplinarity. Results showed significant differences in degrees of interdisciplinarity among different levels of collaboration and among different disciplines. Collaboration contributed significantly to the degree of interdisciplinarity in some disciplines and not in others. Uses a survey that asked authors about their form of collaboration, channels of communication and use of information. The survey provides some qualitative explanation for the bibliometrics findings. Discusses the perspective of scientist-scientist interaction, scientist-information interaction and information-information interaction
  17. Lancaster, F.W.: Searching databases on CD-ROM : comparison of the results of end-user searching with results from two modes of searching by skilled intermediaries (1994) 0.00
    0.0033262195 = product of:
      0.0099786585 = sum of:
        0.0099786585 = weight(_text_:to in 8372) [ClassicSimilarity], result of:
          0.0099786585 = score(doc=8372,freq=2.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.12052089 = fieldWeight in 8372, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.046875 = fieldNorm(doc=8372)
      0.33333334 = coord(1/3)
    
    Abstract
    The results of 35 searches performed by users (end users) of an academic library (Illinois Stae University, Milner Library) in the ERIC databases on CD-ROM were compared with the results for the same topics achieved by an experienced education librarian and by a team of librarians. Recall ratios, precision ratios, and novelty ratios were calculated. Results show that the users, all faculty members or graduate students, found only about a third of the really important items. Suggests that library users are frequently misled into thinking that CD-ROM databases are easy to use and that the 'technology' guarantees satisfactory results.
  18. Xu, H.; Lancaster, F.W.: Redundancy and uniqueness of subject access points in online catalogs (1998) 0.00
    0.0033262195 = product of:
      0.0099786585 = sum of:
        0.0099786585 = weight(_text_:to in 1788) [ClassicSimilarity], result of:
          0.0099786585 = score(doc=1788,freq=2.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.12052089 = fieldWeight in 1788, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.046875 = fieldNorm(doc=1788)
      0.33333334 = coord(1/3)
    
    Abstract
    Reports results of an analysis of 205 randomly selected records from the OCLC OLUC, to test the assumption that online catalogues have greatly improved subject searching capabilities, over card catalogues, by making other fields in the records searchable as subject access points (SAPs). Results showed considerable overlap (duplication) among the SAPs provided by the title, subject heading and classification number fields. On average, little more than 4 unique, unduplicated access points were found per record. Where title and classification number fields do add some access points not provided by subject headings, the increase is less than many librarians might be expected. Suggests that OPACs might outperform catalogues more in precision than in recall by allowing greater discrimination in searching; terms from different fields may be combined; titles offer greater specifity; searches can be limited by date, language or other criteria
  19. Su, S.-F.; Lancaster, F.W.: Evaluation of expert systems in reference service applications (1995) 0.00
    0.0027718497 = product of:
      0.008315549 = sum of:
        0.008315549 = weight(_text_:to in 4014) [ClassicSimilarity], result of:
          0.008315549 = score(doc=4014,freq=2.0), product of:
            0.08279609 = queryWeight, product of:
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.045541126 = queryNorm
            0.10043408 = fieldWeight in 4014, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              1.818051 = idf(docFreq=19512, maxDocs=44218)
              0.0390625 = fieldNorm(doc=4014)
      0.33333334 = coord(1/3)
    
    Abstract
    Reports results of an evaluation of 2 expert systems designed for use in library reference services: ReferenceExpert (RE), developed by Houston University; and SourceFinder (SF), developed by Illinois University at Urbana-Champaign. The test group consisted of 60 graduate students at the initial stage of an intermediate level reference course. The evaluation involved test questions already used in an earlier study (College and research libraries 52(1991) no.5, S.454-465). Results indicated that: there was no significant difference between RE and SF students in the confidence they expressed regarding understanding of their test questions; no significant correlation was found between confidence in understanding the question and success in selecting appropriate sources; only 1/5 of the students agreed that the system they used could be considered 'intelligent'; the majority did not consider the system they used to be 'competent'; almost half agreed that the subject categories provided by the menus were too broad; a little more than half wer not satisfied with the information sources selected by their system; significantly more RE users than SF users agreed that they found the menu interface useful; and a keyword search capability was the feature most often mentioned as a needed system enhancement. Overall results indicated that current expert systems for the selection of reference sources cannot perform as well as experienced subject oriented reference librarians