Search (31 results, page 1 of 2)

0.047432087 = product of:
  0.094864175 = sum of:
    0.094864175 = sum of:
      0.05771552 = weight(_text_:work in 5011) [ClassicSimilarity], result of:
        0.05771552 = score(doc=5011,freq=4.0), product of:
          0.20127523 = queryWeight, product of:
            3.6703904 = idf(docFreq=3060, maxDocs=44218)
            0.054837555 = queryNorm
          0.28674924 = fieldWeight in 5011, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.6703904 = idf(docFreq=3060, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5011)
      0.03714866 = weight(_text_:22 in 5011) [ClassicSimilarity], result of:
        0.03714866 = score(doc=5011,freq=2.0), product of:
          0.19203177 = queryWeight, product of:
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.054837555 = queryNorm
          0.19345059 = fieldWeight in 5011, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.0390625 = fieldNorm(doc=5011)
  0.5 = coord(1/2)

Abstract

The present challenge faced by scientists working with Big Data comes in the overwhelming volume and level of detail provided by current data sets. Exceeding traditional empirical approaches, Big Data opens a new perspective on scientific work in which data comes to play a role in the development of the scientific problematic to be developed. Addressing this reconfiguration of our relationship with data through readings of Wittgenstein, Macherey, and Popper, we propose a picture of science that encourages scientists to engage with the data in a direct way, using the data itself as an instrument for scientific investigation. Using GIS as a theme, we develop the concept of cyber-human systems of thought and understanding to bridge the divide between representative (theoretical) thinking and (non-theoretical) data-driven science. At the foundation of these systems, we invoke the concept of the "semantic pixel" to establish a logical and virtual space linking data and the work of scientists. It is with this discussion of the relationship between analysts in their pursuit of knowledge and the rise of Big Data that this present discussion of the philosophical foundations of Big Data addresses the central questions raised by social informatics research.

Date

7. 3.2019 16:32:22

0.033240896 = product of:
  0.06648179 = sum of:
    0.06648179 = sum of:
      0.051622327 = weight(_text_:work in 1789) [ClassicSimilarity], result of:
        0.051622327 = score(doc=1789,freq=20.0), product of:
          0.20127523 = queryWeight, product of:
            3.6703904 = idf(docFreq=3060, maxDocs=44218)
            0.054837555 = queryNorm
          0.2564763 = fieldWeight in 1789, product of:
            4.472136 = tf(freq=20.0), with freq of:
              20.0 = termFreq=20.0
            3.6703904 = idf(docFreq=3060, maxDocs=44218)
            0.015625 = fieldNorm(doc=1789)
      0.014859463 = weight(_text_:22 in 1789) [ClassicSimilarity], result of:
        0.014859463 = score(doc=1789,freq=2.0), product of:
          0.19203177 = queryWeight, product of:
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.054837555 = queryNorm
          0.07738023 = fieldWeight in 1789, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5018296 = idf(docFreq=3622, maxDocs=44218)
            0.015625 = fieldNorm(doc=1789)
  0.5 = coord(1/2)

Date

23. 3.2008 19:10:22

Footnote

Rez. in: JASIST 54(2003) no.9, S.905-906 (C.A. Badurek): "Visual approaches for knowledge discovery in very large databases are a prime research need for information scientists focused an extracting meaningful information from the ever growing stores of data from a variety of domains, including business, the geosciences, and satellite and medical imagery. This work presents a summary of research efforts in the fields of data mining, knowledge discovery, and data visualization with the goal of aiding the integration of research approaches and techniques from these major fields. The editors, leading computer scientists from academia and industry, present a collection of 32 papers from contributors who are incorporating visualization and data mining techniques through academic research as well application development in industry and government agencies. Information Visualization focuses upon techniques to enhance the natural abilities of humans to visually understand data, in particular, large-scale data sets. It is primarily concerned with developing interactive graphical representations to enable users to more intuitively make sense of multidimensional data as part of the data exploration process. It includes research from computer science, psychology, human-computer interaction, statistics, and information science. Knowledge Discovery in Databases (KDD) most often refers to the process of mining databases for previously unknown patterns and trends in data. Data mining refers to the particular computational methods or algorithms used in this process. The data mining research field is most related to computational advances in database theory, artificial intelligence and machine learning. This work compiles research summaries from these main research areas in order to provide "a reference work containing the collection of thoughts and ideas of noted researchers from the fields of data mining and data visualization" (p. 8). It addresses these areas in three main sections: the first an data visualization, the second an KDD and model visualization, and the last an using visualization in the knowledge discovery process. The seven chapters of Part One focus upon methodologies and successful techniques from the field of Data Visualization. Hoffman and Grinstein (Chapter 2) give a particularly good overview of the field of data visualization and its potential application to data mining. An introduction to the terminology of data visualization, relation to perceptual and cognitive science, and discussion of the major visualization display techniques are presented. Discussion and illustration explain the usefulness and proper context of such data visualization techniques as scatter plots, 2D and 3D isosurfaces, glyphs, parallel coordinates, and radial coordinate visualizations. Remaining chapters present the need for standardization of visualization methods, discussion of user requirements in the development of tools, and examples of using information visualization in addressing research problems.
In 13 chapters, Part Two provides an introduction to KDD, an overview of data mining techniques, and examples of the usefulness of data model visualizations. The importance of visualization throughout the KDD process is stressed in many of the chapters. In particular, the need for measures of visualization effectiveness, benchmarking for identifying best practices, and the use of standardized sample data sets is convincingly presented. Many of the important data mining approaches are discussed in this complementary context. Cluster and outlier detection, classification techniques, and rule discovery algorithms are presented as the basic techniques common to the KDD process. The potential effectiveness of using visualization in the data modeling process are illustrated in chapters focused an using visualization for helping users understand the KDD process, ask questions and form hypotheses about their data, and evaluate the accuracy and veracity of their results. The 11 chapters of Part Three provide an overview of the KDD process and successful approaches to integrating KDD, data mining, and visualization in complementary domains. Rhodes (Chapter 21) begins this section with an excellent overview of the relation between the KDD process and data mining techniques. He states that the "primary goals of data mining are to describe the existing data and to predict the behavior or characteristics of future data of the same type" (p. 281). These goals are met by data mining tasks such as classification, regression, clustering, summarization, dependency modeling, and change or deviation detection. Subsequent chapters demonstrate how visualization can aid users in the interactive process of knowledge discovery by graphically representing the results from these iterative tasks. Finally, examples of the usefulness of integrating visualization and data mining tools in the domain of business, imagery and text mining, and massive data sets are provided. This text concludes with a thorough and useful 17-page index and lengthy yet integrating 17-page summary of the academic and industrial backgrounds of the contributing authors. A 16-page set of color inserts provide a better representation of the visualizations discussed, and a URL provided suggests that readers may view all the book's figures in color on-line, although as of this submission date it only provides access to a summary of the book and its contents. The overall contribution of this work is its focus an bridging two distinct areas of research, making it a valuable addition to the Morgan Kaufmann Series in Database Management Systems. The editors of this text have met their main goal of providing the first textbook integrating knowledge discovery, data mining, and visualization. Although it contributes greatly to our under- standing of the development and current state of the field, a major weakness of this text is that there is no concluding chapter to discuss the contributions of the sum of these contributed papers or give direction to possible future areas of research. "Integration of expertise between two different disciplines is a difficult process of communication and reeducation. Integrating data mining and visualization is particularly complex because each of these fields in itself must draw an a wide range of research experience" (p. 300). Although this work contributes to the crossdisciplinary communication needed to advance visualization in KDD, a more formal call for an interdisciplinary research agenda in a concluding chapter would have provided a more satisfying conclusion to a very good introductory text.
With contributors almost exclusively from the computer science field, the intended audience of this work is heavily slanted towards a computer science perspective. However, it is highly readable and provides introductory material that would be useful to information scientists from a variety of domains. Yet, much interesting work in information visualization from other fields could have been included giving the work more of an interdisciplinary perspective to complement their goals of integrating work in this area. Unfortunately, many of the application chapters are these, shallow, and lack complementary illustrations of visualization techniques or user interfaces used. However, they do provide insight into the many applications being developed in this rapidly expanding field. The authors have successfully put together a highly useful reference text for the data mining and information visualization communities. Those interested in a good introduction and overview of complementary research areas in these fields will be satisfied with this collection of papers. The focus upon integrating data visualization with data mining complements texts in each of these fields, such as Advances in Knowledge Discovery and Data Mining (Fayyad et al., MIT Press) and Readings in Information Visualization: Using Vision to Think (Card et. al., Morgan Kauffman). This unique work is a good starting point for future interaction between researchers in the fields of data visualization and data mining and makes a good accompaniment for a course focused an integrating these areas or to the main reference texts in these fields."

0.02600406 = product of:
  0.05200812 = sum of:
    0.05200812 = product of:
      0.10401624 = sum of:
        0.10401624 = weight(_text_:22 in 4577) [ClassicSimilarity], result of:
          0.10401624 = score(doc=4577,freq=2.0), product of:
            0.19203177 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.054837555 = queryNorm
            0.5416616 = fieldWeight in 4577, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.109375 = fieldNorm(doc=4577)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Date

2. 4.2000 18:01:22

0.022289194 = product of:
  0.04457839 = sum of:
    0.04457839 = product of:
      0.08915678 = sum of:
        0.08915678 = weight(_text_:22 in 6783) [ClassicSimilarity], result of:
          0.08915678 = score(doc=6783,freq=2.0), product of:
            0.19203177 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.054837555 = queryNorm
            0.46428138 = fieldWeight in 6783, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.09375 = fieldNorm(doc=6783)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Footnote

A special issue of selected papers from the Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD'97), held Singapore, 22-23 Feb 1997

0.021206036 = product of:
  0.042412072 = sum of:
    0.042412072 = product of:
      0.084824145 = sum of:
        0.084824145 = weight(_text_:work in 3111) [ClassicSimilarity], result of:
          0.084824145 = score(doc=3111,freq=6.0), product of:
            0.20127523 = queryWeight, product of:
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.054837555 = queryNorm
            0.4214336 = fieldWeight in 3111, product of:
              2.4494898 = tf(freq=6.0), with freq of:
                6.0 = termFreq=6.0
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.046875 = fieldNorm(doc=3111)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

Modern organizations often employ data scientists to improve business processes using diverse sets of data. Researchers and practitioners have both touted the benefits and warned of the drawbacks associated with data science and big data approaches, but few studies investigate how data science is carried out "on the ground." In this paper, we first review the hype and criticisms surrounding data science and big data approaches. We then present the findings of semistructured interviews with 18 data analysts from various industries and organizational roles. Using qualitative coding techniques, we evaluated these interviews in light of the hype and criticisms surrounding data science in the popular discourse. We found that although the data analysts we interviewed were sensitive to both the allure and the potential pitfalls of data science, their motivations and evaluations of their work were more nuanced. We conclude by reflecting on the relationship between data analysts' work and the discourses around data science and big data, suggesting how future research can better account for the everyday practices of this profession.

0.017314656 = product of:
  0.03462931 = sum of:
    0.03462931 = product of:
      0.06925862 = sum of:
        0.06925862 = weight(_text_:work in 4716) [ClassicSimilarity], result of:
          0.06925862 = score(doc=4716,freq=4.0), product of:
            0.20127523 = queryWeight, product of:
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.054837555 = queryNorm
            0.3440991 = fieldWeight in 4716, product of:
              2.0 = tf(freq=4.0), with freq of:
                4.0 = termFreq=4.0
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.046875 = fieldNorm(doc=4716)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

In this paper we give a synoptic view of the growth of the text processing technology of informatione xtraction (IE) whose function is to extract information about a pre-specified set of entities, relations or events from natural language texts and to record this information in structured representations called templates. Here we describe the nature of the IE task, review the history of the area from its origins in AI work in the 1960s and 70s till the present, discuss the techniques being used to carry out the task, describe application areas where IE systems are or are about to be at work, and conclude with a discussion of the challenges facing the area. What emerges is a picture of an exciting new text processing technology with a host of new applications, both on its own and in conjunction with other technologies, such as information retrieval, machine translation and data mining

0.017314656 = product of:
  0.03462931 = sum of:
    0.03462931 = product of:
      0.06925862 = sum of:
        0.06925862 = weight(_text_:work in 473) [ClassicSimilarity], result of:
          0.06925862 = score(doc=473,freq=4.0), product of:
            0.20127523 = queryWeight, product of:
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.054837555 = queryNorm
            0.3440991 = fieldWeight in 473, product of:
              2.0 = tf(freq=4.0), with freq of:
                4.0 = termFreq=4.0
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.046875 = fieldNorm(doc=473)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

The emergence of large multi-institutional digital libraries has opened the door to aggregate-level examinations of the published word. Such large-scale analysis offers a new way to pursue traditional problems in the humanities and social sciences, using digital methods to ask routine questions of large corpora. However, inquiry into multiple centuries of books is constrained by the burdens of scale, where statistical inference is technically complex and limited by hurdles to access and flexibility. This work examines the role that exploratory data analysis and visualization tools may play in understanding large bibliographic datasets. We present one such tool, HathiTrust+Bookworm, which allows multifaceted exploration of the multimillion work HathiTrust Digital Library, and center it in the broader space of scholarly tools for exploratory data analysis.

0.014859463 = product of:
  0.029718926 = sum of:
    0.029718926 = product of:
      0.059437852 = sum of:
        0.059437852 = weight(_text_:22 in 1737) [ClassicSimilarity], result of:
          0.059437852 = score(doc=1737,freq=2.0), product of:
            0.19203177 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.054837555 = queryNorm
            0.30952093 = fieldWeight in 1737, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.0625 = fieldNorm(doc=1737)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Date

22.11.1998 18:57:22

0.014859463 = product of:
  0.029718926 = sum of:
    0.029718926 = product of:
      0.059437852 = sum of:
        0.059437852 = weight(_text_:22 in 4261) [ClassicSimilarity], result of:
          0.059437852 = score(doc=4261,freq=2.0), product of:
            0.19203177 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.054837555 = queryNorm
            0.30952093 = fieldWeight in 4261, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.0625 = fieldNorm(doc=4261)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Date

17. 7.2002 19:22:06

0.014859463 = product of:
  0.029718926 = sum of:
    0.029718926 = product of:
      0.059437852 = sum of:
        0.059437852 = weight(_text_:22 in 1270) [ClassicSimilarity], result of:
          0.059437852 = score(doc=1270,freq=2.0), product of:
            0.19203177 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.054837555 = queryNorm
            0.30952093 = fieldWeight in 1270, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.0625 = fieldNorm(doc=1270)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Source

Information systems. 22(1997) nos.5/6, S.333-347

0.014283863 = product of:
  0.028567726 = sum of:
    0.028567726 = product of:
      0.05713545 = sum of:
        0.05713545 = weight(_text_:work in 2300) [ClassicSimilarity], result of:
          0.05713545 = score(doc=2300,freq=2.0), product of:
            0.20127523 = queryWeight, product of:
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.054837555 = queryNorm
            0.28386727 = fieldWeight in 2300, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.0546875 = fieldNorm(doc=2300)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

State of the art review of the recently developed concepts of data mining (defined as the automated process of evaluating data and finding relationships) and knowledge discovery (defined as the automated process of extracting information, especially unpredicted relationships or previously unknown patterns among the data) with particular reference to numerical data. Includes: the knowledge acquisition process; data mining; evaluation methods; and knowledge discovery. Concludes that existing work in the field are confusing because the terminology is inconsistent and poorly defined. Although methods are available for analyzing and cleaning databases, better coordinated efforts should be directed toward providing users with improved means of structuring search mechanisms to explore the data for relationships

0.014283863 = product of:
  0.028567726 = sum of:
    0.028567726 = product of:
      0.05713545 = sum of:
        0.05713545 = weight(_text_:work in 2899) [ClassicSimilarity], result of:
          0.05713545 = score(doc=2899,freq=2.0), product of:
            0.20127523 = queryWeight, product of:
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.054837555 = queryNorm
            0.28386727 = fieldWeight in 2899, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.0546875 = fieldNorm(doc=2899)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

Defines knowledge discovery and database mining. The challenge for knowledge discovery in databases (KDD) is to automatically process large quantities of raw data, identifying the most significant and meaningful patterns, and present these as as knowledge appropriate for achieving a user's goals. Data mining is the process of deriving useful knowledge from real world databases through the application of pattern extraction techniques. Explains the goals of, and motivation for, research work on data mining. Discusses the nature of database contents, along with problems within the field of data mining

0.01300203 = product of:
  0.02600406 = sum of:
    0.02600406 = product of:
      0.05200812 = sum of:
        0.05200812 = weight(_text_:22 in 2908) [ClassicSimilarity], result of:
          0.05200812 = score(doc=2908,freq=2.0), product of:
            0.19203177 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.054837555 = queryNorm
            0.2708308 = fieldWeight in 2908, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.0546875 = fieldNorm(doc=2908)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Source

Information systems. 22(1997) nos.5/6, S.349-385

0.012243311 = product of:
  0.024486622 = sum of:
    0.024486622 = product of:
      0.048973244 = sum of:
        0.048973244 = weight(_text_:work in 2563) [ClassicSimilarity], result of:
          0.048973244 = score(doc=2563,freq=2.0), product of:
            0.20127523 = queryWeight, product of:
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.054837555 = queryNorm
            0.2433148 = fieldWeight in 2563, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.046875 = fieldNorm(doc=2563)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

Topic discovery is an important means for marketing, e-Business and social science studies. As well, it can be applied to various purposes, such as identifying a group with certain properties and observing the emergence and diminishment of a certain cyber community. Previous topic discovery work (J.M. Kleinberg, Proceedings of the 9th Annual ACM-SIAM Symposium on Discrete Algorithms, San Francisco, California, p. 668) requires manual judgment of usefulness of outcomes and is thus incapable of handling the explosive growth of the Internet. In this paper, we propose the Automatic Topic Discovery (ATD) method, which combines a method of base set construction, a clustering algorithm and an iterative principal eigenvector computation method to discover the topics relevant to a given query without using manual examination. Given a query, ATD returns with topics associated with the query and top representative pages for each topic. Our experiments show that the ATD method performs better than the traditional eigenvector method in terms of computation time and topic discovery quality.

0.012243311 = product of:
  0.024486622 = sum of:
    0.024486622 = product of:
      0.048973244 = sum of:
        0.048973244 = weight(_text_:work in 4296) [ClassicSimilarity], result of:
          0.048973244 = score(doc=4296,freq=2.0), product of:
            0.20127523 = queryWeight, product of:
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.054837555 = queryNorm
            0.2433148 = fieldWeight in 4296, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.046875 = fieldNorm(doc=4296)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

Data mining (DM) is a multistaged process of extracting previously unanticipated knowledge from large databases, and applying the results to decision making. Data mining tools detect patterns from the data and infer associations and rules from them. The extracted information may then be applied to prediction or classification models by identifying relations within the data records or between databases. Those patterns and rules can then guide decision making and forecast the effects of those decisions. However, this definition may be applied equally to "knowledge discovery in databases" (KDD). Indeed, in the recent literature of DM and KDD, a source of confusion has emerged, making it difficult to determine the exact parameters of both. KDD is sometimes viewed as the broader discipline, of which data mining is merely a component-specifically pattern extraction, evaluation, and cleansing methods (Raghavan, Deogun, & Sever, 1998, p. 397). Thurasingham (1999, p. 2) remarked that "knowledge discovery," "pattern discovery," "data dredging," "information extraction," and "knowledge mining" are all employed as synonyms for DM. Trybula, in his ARIST chapter an text mining, observed that the "existing work [in KDD] is confusing because the terminology is inconsistent and poorly defined.

0.011144597 = product of:
  0.022289194 = sum of:
    0.022289194 = product of:
      0.04457839 = sum of:
        0.04457839 = weight(_text_:22 in 1383) [ClassicSimilarity], result of:
          0.04457839 = score(doc=1383,freq=2.0), product of:
            0.19203177 = queryWeight, product of:
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.054837555 = queryNorm
            0.23214069 = fieldWeight in 1383, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.5018296 = idf(docFreq=3622, maxDocs=44218)
              0.046875 = fieldNorm(doc=1383)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Date

22. 3.2008 14:46:06

0.010202759 = product of:
  0.020405518 = sum of:
    0.020405518 = product of:
      0.040811036 = sum of:
        0.040811036 = weight(_text_:work in 597) [ClassicSimilarity], result of:
          0.040811036 = score(doc=597,freq=2.0), product of:
            0.20127523 = queryWeight, product of:
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.054837555 = queryNorm
            0.20276234 = fieldWeight in 597, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.0390625 = fieldNorm(doc=597)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

With the overwhelming volume of information, the task of finding relevant information on a given topic on the Web is becoming increasingly difficult. Web search engines hence become one of the most popular solutions available on the Web. However, it has never been easy for novice users to organize and represent their information needs using simple queries. Users have to keep modifying their input queries until they get expected results. Therefore, it is often desirable for search engines to give suggestions on related queries to users. Besides, by identifying those related queries, search engines can potentially perform optimizations on their systems, such as query expansion and file indexing. In this work we propose a method that suggests a list of related queries given an initial input query. The related queries are based in the query log of previously submitted queries by human users, which can be identified using an enhanced model of association rules. Users can utilize the suggested related queries to tune or redirect the search process. Our method not only discovers the related queries, but also ranks them according to the degree of their relatedness. Unlike many other rival techniques, it also performs reasonably well on less frequent input queries.

0.010202759 = product of:
  0.020405518 = sum of:
    0.020405518 = product of:
      0.040811036 = sum of:
        0.040811036 = weight(_text_:work in 1286) [ClassicSimilarity], result of:
          0.040811036 = score(doc=1286,freq=2.0), product of:
            0.20127523 = queryWeight, product of:
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.054837555 = queryNorm
            0.20276234 = fieldWeight in 1286, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.0390625 = fieldNorm(doc=1286)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

With the rapid growth of Web 2.0, community question answering (CQA) has become a prevalent information seeking channel, in which users form interactive communities by posting questions and providing answers. Communities may evolve over time, because of changes in users' interests, activities, and new users joining the network. To better understand user interactions in CQA communities, it is necessary to analyze the community structures and track community evolution over time. Existing work in CQA focuses on question searching or content quality detection, and the important problems of community extraction and evolutionary pattern detection have not been studied. In this article, we propose a probabilistic community model (PCM) to extract overlapping community structures and capture their evolution patterns in CQA. The empirical results show that our algorithm appears to improve the community extraction quality. We show empirically, using the iPhone data set, that interesting community evolution patterns can be discovered, with each evolution pattern reflecting the variation of users' interests over time. Our analysis suggests that individual users could benefit to gain comprehensive information from tracking the transition of products. We also show that the communities provide a decision-making basis for business.

0.010202759 = product of:
  0.020405518 = sum of:
    0.020405518 = product of:
      0.040811036 = sum of:
        0.040811036 = weight(_text_:work in 3682) [ClassicSimilarity], result of:
          0.040811036 = score(doc=3682,freq=2.0), product of:
            0.20127523 = queryWeight, product of:
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.054837555 = queryNorm
            0.20276234 = fieldWeight in 3682, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.0390625 = fieldNorm(doc=3682)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

Analyzing large quantities of real-world textual data has the potential to provide new insights for researchers. However, such data present challenges for both human and computational methods, requiring a diverse range of specialist skills, often shared across a number of individuals. In this paper we use the analysis of a real-world data set as our case study, and use this exploration as a demonstration of our "insight workflow," which we present for use and adaptation by other researchers. The data we use are impact case study documents collected as part of the UK Research Excellence Framework (REF), consisting of 6,679 documents and 6.25 million words; the analysis was commissioned by the Higher Education Funding Council for England (published as report HEFCE 2015). In our exploration and analysis we used a variety of techniques, ranging from keyword in context and frequency information to more sophisticated methods (topic modeling), with these automated techniques providing an empirical point of entry for in-depth and intensive human analysis. We present the 60 topics to demonstrate the output of our methods, and illustrate how the variety of analysis techniques can be combined to provide insights. We note potential limitations and propose future work.

0.010202759 = product of:
  0.020405518 = sum of:
    0.020405518 = product of:
      0.040811036 = sum of:
        0.040811036 = weight(_text_:work in 4019) [ClassicSimilarity], result of:
          0.040811036 = score(doc=4019,freq=2.0), product of:
            0.20127523 = queryWeight, product of:
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.054837555 = queryNorm
            0.20276234 = fieldWeight in 4019, product of:
              1.4142135 = tf(freq=2.0), with freq of:
                2.0 = termFreq=2.0
              3.6703904 = idf(docFreq=3060, maxDocs=44218)
              0.0390625 = fieldNorm(doc=4019)
      0.5 = coord(1/2)
  0.5 = coord(1/2)

Abstract

What is text mining, and how can it be used? What relevance do these methods have to everyday work in information science and the digital humanities? How does one develop competences in text mining? Working with Text provides a series of cross-disciplinary perspectives on text mining and its applications. As text mining raises legal and ethical issues, the legal background of text mining and the responsibilities of the engineer are discussed in this book. Chapters provide an introduction to the use of the popular GATE text mining package with data drawn from social media, the use of text mining to support semantic search, the development of an authority system to support content tagging, and recent techniques in automatic language evaluation. Focused studies describe text mining on historical texts, automated indexing using constrained vocabularies, and the use of natural language processing to explore the climate science literature. Interviews are included that offer a glimpse into the real-life experience of working within commercial and academic text mining.