-
Haravu, L.J.; Neelameghan, A.: Text mining and data mining in knowledge organization and discovery : the making of knowledge-based products (2003)
0.04
0.036399566 = product of:
0.10919869 = sum of:
0.041947264 = weight(_text_:applications in 5653) [ClassicSimilarity], result of:
0.041947264 = score(doc=5653,freq=2.0), product of:
0.17247584 = queryWeight, product of:
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.03917671 = queryNorm
0.2432066 = fieldWeight in 5653, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.0390625 = fieldNorm(doc=5653)
0.019081537 = weight(_text_:of in 5653) [ClassicSimilarity], result of:
0.019081537 = score(doc=5653,freq=26.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.31146988 = fieldWeight in 5653, product of:
5.0990195 = tf(freq=26.0), with freq of:
26.0 = termFreq=26.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.0390625 = fieldNorm(doc=5653)
0.048169892 = weight(_text_:software in 5653) [ClassicSimilarity], result of:
0.048169892 = score(doc=5653,freq=4.0), product of:
0.15541996 = queryWeight, product of:
3.9671519 = idf(docFreq=2274, maxDocs=44218)
0.03917671 = queryNorm
0.30993375 = fieldWeight in 5653, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.9671519 = idf(docFreq=2274, maxDocs=44218)
0.0390625 = fieldNorm(doc=5653)
0.33333334 = coord(3/9)
- Abstract
- Discusses the importance of knowledge organization in the context of the information overload caused by the vast quantities of data and information accessible on internal and external networks of an organization. Defines the characteristics of a knowledge-based product. Elaborates on the techniques and applications of text mining in developing knowledge products. Presents two approaches, as case studies, to the making of knowledge products: (1) steps and processes in the planning, designing and development of a composite multilingual multimedia CD product, with the potential international, inter-cultural end users in view, and (2) application of natural language processing software in text mining. Using a text mining software, it is possible to link concept terms from a processed text to a related thesaurus, glossary, schedules of a classification scheme, and facet structured subject representations. Concludes that the products of text mining and data mining could be made more useful if the features of a faceted scheme for subject classification are incorporated into text mining techniques and products.
-
Gaizauskas, R.; Wilks, Y.: Information extraction : beyond document retrieval (1998)
0.03
0.031649083 = product of:
0.09494725 = sum of:
0.050336715 = weight(_text_:applications in 4716) [ClassicSimilarity], result of:
0.050336715 = score(doc=4716,freq=2.0), product of:
0.17247584 = queryWeight, product of:
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.03917671 = queryNorm
0.2918479 = fieldWeight in 4716, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.046875 = fieldNorm(doc=4716)
0.020082738 = weight(_text_:of in 4716) [ClassicSimilarity], result of:
0.020082738 = score(doc=4716,freq=20.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.32781258 = fieldWeight in 4716, product of:
4.472136 = tf(freq=20.0), with freq of:
20.0 = termFreq=20.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.046875 = fieldNorm(doc=4716)
0.0245278 = weight(_text_:systems in 4716) [ClassicSimilarity], result of:
0.0245278 = score(doc=4716,freq=2.0), product of:
0.12039685 = queryWeight, product of:
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.03917671 = queryNorm
0.2037246 = fieldWeight in 4716, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.046875 = fieldNorm(doc=4716)
0.33333334 = coord(3/9)
- Abstract
- In this paper we give a synoptic view of the growth of the text processing technology of informatione xtraction (IE) whose function is to extract information about a pre-specified set of entities, relations or events from natural language texts and to record this information in structured representations called templates. Here we describe the nature of the IE task, review the history of the area from its origins in AI work in the 1960s and 70s till the present, discuss the techniques being used to carry out the task, describe application areas where IE systems are or are about to be at work, and conclude with a discussion of the challenges facing the area. What emerges is a picture of an exciting new text processing technology with a host of new applications, both on its own and in conjunction with other technologies, such as information retrieval, machine translation and data mining
- Source
- Journal of documentation. 54(1998) no.1, S.70-105
-
Fayyad, U.; Piatetsky-Shapiro, G.; Smyth, P.: From data mining to knowledge discovery in databases (1996)
0.03
0.029691901 = product of:
0.13361356 = sum of:
0.118644774 = weight(_text_:applications in 7458) [ClassicSimilarity], result of:
0.118644774 = score(doc=7458,freq=4.0), product of:
0.17247584 = queryWeight, product of:
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.03917671 = queryNorm
0.68789214 = fieldWeight in 7458, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.078125 = fieldNorm(doc=7458)
0.014968789 = weight(_text_:of in 7458) [ClassicSimilarity], result of:
0.014968789 = score(doc=7458,freq=4.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.24433708 = fieldWeight in 7458, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.078125 = fieldNorm(doc=7458)
0.22222222 = coord(2/9)
- Abstract
- Gives an overview of data mining and knowledge discovery in databases. Clarifies how they are related both to each other and to related fields. Mentions real world applications data mining techniques, challenges involved in real world applications of knowledge discovery, and current and future research directions
-
Fonseca, F.; Marcinkowski, M.; Davis, C.: Cyber-human systems of thought and understanding (2019)
0.02
0.023708593 = product of:
0.071125776 = sum of:
0.022453185 = weight(_text_:of in 5011) [ClassicSimilarity], result of:
0.022453185 = score(doc=5011,freq=36.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.36650562 = fieldWeight in 5011, product of:
6.0 = tf(freq=36.0), with freq of:
36.0 = termFreq=36.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.0390625 = fieldNorm(doc=5011)
0.03540283 = weight(_text_:systems in 5011) [ClassicSimilarity], result of:
0.03540283 = score(doc=5011,freq=6.0), product of:
0.12039685 = queryWeight, product of:
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.03917671 = queryNorm
0.29405114 = fieldWeight in 5011, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.0390625 = fieldNorm(doc=5011)
0.013269759 = product of:
0.026539518 = sum of:
0.026539518 = weight(_text_:22 in 5011) [ClassicSimilarity], result of:
0.026539518 = score(doc=5011,freq=2.0), product of:
0.13719016 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.03917671 = queryNorm
0.19345059 = fieldWeight in 5011, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=5011)
0.5 = coord(1/2)
0.33333334 = coord(3/9)
- Abstract
- The present challenge faced by scientists working with Big Data comes in the overwhelming volume and level of detail provided by current data sets. Exceeding traditional empirical approaches, Big Data opens a new perspective on scientific work in which data comes to play a role in the development of the scientific problematic to be developed. Addressing this reconfiguration of our relationship with data through readings of Wittgenstein, Macherey, and Popper, we propose a picture of science that encourages scientists to engage with the data in a direct way, using the data itself as an instrument for scientific investigation. Using GIS as a theme, we develop the concept of cyber-human systems of thought and understanding to bridge the divide between representative (theoretical) thinking and (non-theoretical) data-driven science. At the foundation of these systems, we invoke the concept of the "semantic pixel" to establish a logical and virtual space linking data and the work of scientists. It is with this discussion of the relationship between analysts in their pursuit of knowledge and the rise of Big Data that this present discussion of the philosophical foundations of Big Data addresses the central questions raised by social informatics research.
- Date
- 7. 3.2019 16:32:22
- Footnote
- Beitrag eines Special issue on social informatics of knowledge
- Source
- Journal of the Association for Information Science and Technology. 70(2019) no.4, S.402-411
-
Hallonsten, O.; Holmberg, D.: Analyzing structural stratification in the Swedish higher education system : data contextualization with policy-history analysis (2013)
0.02
0.023628347 = product of:
0.07088504 = sum of:
0.016735615 = weight(_text_:of in 668) [ClassicSimilarity], result of:
0.016735615 = score(doc=668,freq=20.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.27317715 = fieldWeight in 668, product of:
4.472136 = tf(freq=20.0), with freq of:
20.0 = termFreq=20.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.0390625 = fieldNorm(doc=668)
0.040879667 = weight(_text_:systems in 668) [ClassicSimilarity], result of:
0.040879667 = score(doc=668,freq=8.0), product of:
0.12039685 = queryWeight, product of:
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.03917671 = queryNorm
0.339541 = fieldWeight in 668, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.0390625 = fieldNorm(doc=668)
0.013269759 = product of:
0.026539518 = sum of:
0.026539518 = weight(_text_:22 in 668) [ClassicSimilarity], result of:
0.026539518 = score(doc=668,freq=2.0), product of:
0.13719016 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.03917671 = queryNorm
0.19345059 = fieldWeight in 668, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0390625 = fieldNorm(doc=668)
0.5 = coord(1/2)
0.33333334 = coord(3/9)
- Abstract
- 20th century massification of higher education and research in academia is said to have produced structurally stratified higher education systems in many countries. Most manifestly, the research mission of universities appears to be divisive. Authors have claimed that the Swedish system, while formally unified, has developed into a binary state, and statistics seem to support this conclusion. This article makes use of a comprehensive statistical data source on Swedish higher education institutions to illustrate stratification, and uses literature on Swedish research policy history to contextualize the statistics. Highlighting the opportunities as well as constraints of the data, the article argues that there is great merit in combining statistics with a qualitative analysis when studying the structural characteristics of national higher education systems. Not least the article shows that it is an over-simplification to describe the Swedish system as binary; the stratification is more complex. On basis of the analysis, the article also argues that while global trends certainly influence national developments, higher education systems have country-specific features that may enrich the understanding of how systems evolve and therefore should be analyzed as part of a broader study of the increasingly globalized academic system.
- Date
- 22. 3.2013 19:43:01
- Source
- Journal of the American Society for Information Science and Technology. 64(2013) no.3, S.574-586
-
Hofstede, A.H.M. ter; Proper, H.A.; Van der Weide, T.P.: Exploiting fact verbalisation in conceptual information modelling (1997)
0.02
0.02226542 = product of:
0.06679626 = sum of:
0.01960283 = weight(_text_:of in 2908) [ClassicSimilarity], result of:
0.01960283 = score(doc=2908,freq=14.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.31997898 = fieldWeight in 2908, product of:
3.7416575 = tf(freq=14.0), with freq of:
14.0 = termFreq=14.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.0546875 = fieldNorm(doc=2908)
0.028615767 = weight(_text_:systems in 2908) [ClassicSimilarity], result of:
0.028615767 = score(doc=2908,freq=2.0), product of:
0.12039685 = queryWeight, product of:
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.03917671 = queryNorm
0.23767869 = fieldWeight in 2908, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.0546875 = fieldNorm(doc=2908)
0.018577661 = product of:
0.037155323 = sum of:
0.037155323 = weight(_text_:22 in 2908) [ClassicSimilarity], result of:
0.037155323 = score(doc=2908,freq=2.0), product of:
0.13719016 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.03917671 = queryNorm
0.2708308 = fieldWeight in 2908, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0546875 = fieldNorm(doc=2908)
0.5 = coord(1/2)
0.33333334 = coord(3/9)
- Abstract
- Focuses on the information modelling side of conceptual modelling. Deals with the exploitation of fact verbalisations after finishing the actual information system. Verbalisations are used as input for the design of the so-called information model. Exploits these verbalisation in 4 directions: considers their use for a conceptual query language, the verbalisation of instances, the description of the contents of a database and for the verbalisation of queries in a computer supported query environment. Provides an example session with an envisioned tool for end user query formulations that exploits the verbalisation
- Source
- Information systems. 22(1997) nos.5/6, S.349-385
-
Amir, A.; Feldman, R.; Kashi, R.: ¬A new and versatile method for association generation (1997)
0.02
0.020800991 = product of:
0.06240297 = sum of:
0.008467626 = weight(_text_:of in 1270) [ClassicSimilarity], result of:
0.008467626 = score(doc=1270,freq=2.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.13821793 = fieldWeight in 1270, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.0625 = fieldNorm(doc=1270)
0.03270373 = weight(_text_:systems in 1270) [ClassicSimilarity], result of:
0.03270373 = score(doc=1270,freq=2.0), product of:
0.12039685 = queryWeight, product of:
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.03917671 = queryNorm
0.2716328 = fieldWeight in 1270, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.0625 = fieldNorm(doc=1270)
0.021231614 = product of:
0.042463228 = sum of:
0.042463228 = weight(_text_:22 in 1270) [ClassicSimilarity], result of:
0.042463228 = score(doc=1270,freq=2.0), product of:
0.13719016 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.03917671 = queryNorm
0.30952093 = fieldWeight in 1270, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0625 = fieldNorm(doc=1270)
0.5 = coord(1/2)
0.33333334 = coord(3/9)
- Abstract
- Current algorithms for finding associations among the attributes describing data in a database have a number of shortcomings. Presents a novel method for association generation, that answers all desiderata. The method is different from all existing algorithms and especially suitable to textual databases with binary attributes. Uses subword trees for quick indexing into the required database statistics. Tests the algorithm on the Reuters-22173 database with satisfactory results
- Source
- Information systems. 22(1997) nos.5/6, S.333-347
-
Chen, H.; Chau, M.: Web mining : machine learning for Web applications (2003)
0.02
0.01981098 = product of:
0.08914941 = sum of:
0.07118686 = weight(_text_:applications in 4242) [ClassicSimilarity], result of:
0.07118686 = score(doc=4242,freq=4.0), product of:
0.17247584 = queryWeight, product of:
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.03917671 = queryNorm
0.41273528 = fieldWeight in 4242, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.046875 = fieldNorm(doc=4242)
0.017962547 = weight(_text_:of in 4242) [ClassicSimilarity], result of:
0.017962547 = score(doc=4242,freq=16.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.2932045 = fieldWeight in 4242, product of:
4.0 = tf(freq=16.0), with freq of:
16.0 = termFreq=16.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.046875 = fieldNorm(doc=4242)
0.22222222 = coord(2/9)
- Abstract
- With more than two billion pages created by millions of Web page authors and organizations, the World Wide Web is a tremendously rich knowledge base. The knowledge comes not only from the content of the pages themselves, but also from the unique characteristics of the Web, such as its hyperlink structure and its diversity of content and languages. Analysis of these characteristics often reveals interesting patterns and new knowledge. Such knowledge can be used to improve users' efficiency and effectiveness in searching for information an the Web, and also for applications unrelated to the Web, such as support for decision making or business management. The Web's size and its unstructured and dynamic content, as well as its multilingual nature, make the extraction of useful knowledge a challenging research problem. Furthermore, the Web generates a large amount of data in other formats that contain valuable information. For example, Web server logs' information about user access patterns can be used for information personalization or improving Web page design.
- Source
- Annual review of information science and technology. 38(2004), S.289-330
-
Kulathuramaiyer, N.; Maurer, H.: Implications of emerging data mining (2009)
0.02
0.015177614 = product of:
0.06829926 = sum of:
0.050336715 = weight(_text_:applications in 3144) [ClassicSimilarity], result of:
0.050336715 = score(doc=3144,freq=2.0), product of:
0.17247584 = queryWeight, product of:
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.03917671 = queryNorm
0.2918479 = fieldWeight in 3144, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.046875 = fieldNorm(doc=3144)
0.017962547 = weight(_text_:of in 3144) [ClassicSimilarity], result of:
0.017962547 = score(doc=3144,freq=16.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.2932045 = fieldWeight in 3144, product of:
4.0 = tf(freq=16.0), with freq of:
16.0 = termFreq=16.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.046875 = fieldNorm(doc=3144)
0.22222222 = coord(2/9)
- Abstract
- Data Mining describes a technology that discovers non-trivial hidden patterns in a large collection of data. Although this technology has a tremendous impact on our lives, the invaluable contributions of this invisible technology often go unnoticed. This paper discusses advances in data mining while focusing on the emerging data mining capability. Such data mining applications perform multidimensional mining on a wide variety of heterogeneous data sources, providing solutions to many unresolved problems. This paper also highlights the advantages and disadvantages arising from the ever-expanding scope of data mining. Data Mining augments human intelligence by equipping us with a wealth of knowledge and by empowering us to perform our daily tasks better. As the mining scope and capacity increases, users and organizations become more willing to compromise privacy. The huge data stores of the 'master miners' allow them to gain deep insights into individual lifestyles and their social and behavioural patterns. Data integration and analysis capability of combining business and financial trends together with the ability to deterministically track market changes will drastically affect our lives.
-
Fenstermacher, K.D.; Ginsburg, M.: Client-side monitoring for Web mining (2003)
0.01
0.014008479 = product of:
0.063038155 = sum of:
0.050336715 = weight(_text_:applications in 1611) [ClassicSimilarity], result of:
0.050336715 = score(doc=1611,freq=2.0), product of:
0.17247584 = queryWeight, product of:
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.03917671 = queryNorm
0.2918479 = fieldWeight in 1611, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.046875 = fieldNorm(doc=1611)
0.012701439 = weight(_text_:of in 1611) [ClassicSimilarity], result of:
0.012701439 = score(doc=1611,freq=8.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.20732689 = fieldWeight in 1611, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.046875 = fieldNorm(doc=1611)
0.22222222 = coord(2/9)
- Abstract
- "Garbage in, garbage out" is a well-known phrase in computer analysis, and one that comes to mind when mining Web data to draw conclusions about Web users. The challenge is that data analysts wish to infer patterns of client-side behavior from server-side data. However, because only a fraction of the user's actions ever reaches the Web server, analysts must rely an incomplete data. In this paper, we propose a client-side monitoring system that is unobtrusive and supports flexible data collection. Moreover, the proposed framework encompasses client-side applications beyond the Web browser. Expanding monitoring beyond the browser to incorporate standard office productivity tools enables analysts to derive a much richer and more accurate picture of user behavior an the Web.
- Source
- Journal of the American Society for Information Science and technology. 54(2003) no.7, S.625-637
-
Lischka, K.: Spurensuche im Datenwust : Data-Mining-Software fahndet nach kriminellen Mitarbeitern, guten Kunden - und bald vielleicht auch nach Terroristen (2002)
0.01
0.013784983 = product of:
0.062032424 = sum of:
0.05407057 = weight(_text_:software in 1178) [ClassicSimilarity], result of:
0.05407057 = score(doc=1178,freq=14.0), product of:
0.15541996 = queryWeight, product of:
3.9671519 = idf(docFreq=2274, maxDocs=44218)
0.03917671 = queryNorm
0.34789976 = fieldWeight in 1178, product of:
3.7416575 = tf(freq=14.0), with freq of:
14.0 = termFreq=14.0
3.9671519 = idf(docFreq=2274, maxDocs=44218)
0.0234375 = fieldNorm(doc=1178)
0.007961854 = product of:
0.015923709 = sum of:
0.015923709 = weight(_text_:22 in 1178) [ClassicSimilarity], result of:
0.015923709 = score(doc=1178,freq=2.0), product of:
0.13719016 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.03917671 = queryNorm
0.116070345 = fieldWeight in 1178, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.0234375 = fieldNorm(doc=1178)
0.5 = coord(1/2)
0.22222222 = coord(2/9)
- Abstract
- US-Behörden wollen mit spezieller Software die Datenspuren von Terroristen finden. Wie das funktionieren könnte, zeigen Programmen, die heute schon für Unternehmen Kunden und Mitarbeiter analysieren.
- Content
- "Ob man als Terrorist einen Anschlag gegen die Vereinigten Staaten plant, als Kassierer Scheine aus der Kasse unterschlägt oder für bestimmte Produkte besonders gerne Geld ausgibt - einen Unterschied macht Data-Mining-Software da nicht. Solche Programme analysieren riesige Daten- mengen und fällen statistische Urteile. Mit diesen Methoden wollen nun die For- scher des "Information Awaren in den Vereinigten Staaten Spuren von Terroristen in den Datenbanken von Behörden und privaten Unternehmen wie Kreditkartenfirmen finden. 200 Millionen Dollar umfasst der Jahresetat für die verschiedenen Forschungsprojekte. Dass solche Software in der Praxis funktioniert, zeigen die steigenden Umsätze der Anbieter so genannter Customer-Relationship-Management-Software. Im vergangenen Jahr ist das Potenzial für analytische CRM-Anwendungen laut dem Marktforschungsinstitut IDC weltweit um 22 Prozent gewachsen, bis zum Jahr 2006 soll es in Deutschland mit einem jährlichen Plus von 14,1 Prozent so weitergehen. Und das trotz schwacher Konjunktur - oder gerade deswegen. Denn ähnlich wie Data-Mining der USRegierung helfen soll, Terroristen zu finden, entscheiden CRM-Programme heute, welche Kunden für eine Firma profitabel sind. Und welche es künftig sein werden, wie Manuela Schnaubelt, Sprecherin des CRM-Anbieters SAP, beschreibt: "Die Kundenbewertung ist ein zentraler Bestandteil des analytischen CRM. Sie ermöglicht es Unternehmen, sich auf die für sie wichtigen und richtigen Kunden zu fokussieren. Darüber hinaus können Firmen mit speziellen Scoring- Verfahren ermitteln, welche Kunden langfristig in welchem Maße zum Unternehmenserfolg beitragen." Die Folgen der Bewertungen sind für die Betroffenen nicht immer positiv: Attraktive Kunden profitieren von individuellen Sonderangeboten und besonderer Zuwendung. Andere hängen vielleicht so lauge in der Warteschleife des Telefonservice, bis die profitableren Kunden abgearbeitet sind. So könnte eine praktische Umsetzung dessen aussehen, was SAP-Spreche-rin Schnaubelt abstrakt beschreibt: "In vielen Unternehmen wird Kundenbewertung mit der klassischen ABC-Analyse durchgeführt, bei der Kunden anhand von Daten wie dem Umsatz kategorisiert werden. A-Kunden als besonders wichtige Kunden werden anders betreut als C-Kunden." Noch näher am geplanten Einsatz von Data-Mining zur Terroristenjagd ist eine Anwendung, die heute viele Firmen erfolgreich nutzen: Sie spüren betrügende Mitarbeiter auf. Werner Sülzer vom großen CRM-Anbieter NCR Teradata beschreibt die Möglichkeiten so: "Heute hinterlässt praktisch jeder Täter - ob Mitarbeiter, Kunde oder Lieferant - Datenspuren bei seinen wirtschaftskriminellen Handlungen. Es muss vorrangig darum gehen, einzelne Spuren zu Handlungsmustern und Täterprofilen zu verdichten. Das gelingt mittels zentraler Datenlager und hoch entwickelter Such- und Analyseinstrumente." Von konkreten Erfolgen sprich: Entlas-sungen krimineller Mitarbeiter-nach Einsatz solcher Programme erzählen Unternehmen nicht gerne. Matthias Wilke von der "Beratungsstelle für Technologiefolgen und Qualifizierung" (BTQ) der Gewerkschaft Verdi weiß von einem Fall 'aus der Schweiz. Dort setzt die Handelskette "Pick Pay" das Programm "Lord Lose Prevention" ein. Zwei Monate nach Einfüh-rung seien Unterschlagungen im Wert von etwa 200 000 Franken ermittelt worden. Das kostete mehr als 50 verdächtige Kassiererinnen und Kassierer den Job.
Jede Kasse schickt die Daten zu Stornos, Rückgaben, Korrekturen und dergleichen an eine zentrale Datenbank. Aus den Informationen errechnet das Programm Kassiererprofile. Wessen Arbeit stark Durchschnitt abweicht, macht sich verdächtig. Die Kriterien" legen im Einzelnen die Revisionsabteilungen fest, doch generell gilt: "Bei Auffälligkeiten wie überdurchschnittlichvielenStornierungen, Off nen der Kassenschublade ohne Verkauf nach einem Storno oder Warenrücknahmen ohne Kassenbon, können die Vorgänge nachträglich einzelnen Personen zugeordnet werden", sagt Rene Schiller, Marketing-Chef des Lord-Herstellers Logware. Ein Kündigungsgrund ist eine solche Datensammlung vor Gericht nicht. Doch auf der Basis können Unternehmen gezielt Detektive einsetzen. Oder sie konfrontieren die Mitarbeiter mit dem Material; woraufhin Schuldige meist gestehen. Wilke sieht Programme wie Lord kritisch:"Jeder, der in dem Raster auffällt, kann ein potenzieller Betrüger oder Dieb sein und verdient besondere Beobachtung." Dabei könne man vom Standard abweichen, weil man unausgeschlafen und deshalb unkonzentriert sei. Hier tut sich für Wilke die Gefahr technisierter Leistungskontrolle auf. "Es ist ja nicht schwierig, mit den Programmen zu berechnen, wie lange beispielsweise das Kassieren eines Samstagseinkaufs durchschnittlich dauert." Die Betriebsräte - ihre Zustimmung ist beim Einsatz technischer Kon trolleinrichtungen nötig - verurteilen die wertende Software weniger eindeutig. Im Gegenteil: Bei Kaufhof und Edeka haben sie dem Einsatz zugestimmt. Denn: "Die wollen ja nicht, dass ganze Abteilungen wegen Inventurverlusten oder dergleichen unter Generalverdacht fallen", erklärt Gewerkschaftler Wilke: "Angesichts der Leistungen kommerzieller Data-Mining-Programme verblüfft es, dass in den Vereinigten Staaten das "Information Awareness Office" noch drei Jahre für Forschung und Erprobung der eigenen Programme veranschlagt. 2005 sollen frühe Prototypen zur Terroristensuche einesgetz werden. Doch schon jetzt regt sich Protest. Datenschützer wie Marc Botenberg vom Informationszentrum für Daten schutz sprechen vom "ehrgeizigsten öffentlichen Überwachungssystem, das je vorgeschlagen wurde". Sie warnen besonders davor, Daten aus der Internetnutzung und private Mails auszuwerten. Das Verteidigungsministerium rudert zurück. Man denke nicht daran, über die Software im Inland aktiv zu werden. "Das werden die Geheimdienste, die Spionageabwehr und die Strafverfolger tun", sagt Unterstaatssekretär Edward Aldridge. Man werde während der Entwicklung und der Tests mit konstruierten und einigen - aus Sicht der Datenschützer unbedenklichen - realen Informationen arbeiten. Zu denken gibt jedoch Aldriges Antwort auf die Frage, warum so viel Geld für die Entwicklung von Übersetzungssoftware eingeplant ist: Damit man Datenbanken in anderen Sprachen nutzen könne - sofern man auf sie rechtmäßigen Zugriff bekommt."
-
Leydesdorff, L.; Persson, O.: Mapping the geography of science : distribution patterns and networks of relations among cities and institutes (2010)
0.01
0.013763658 = product of:
0.06193646 = sum of:
0.021062955 = weight(_text_:of in 3704) [ClassicSimilarity], result of:
0.021062955 = score(doc=3704,freq=22.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.34381276 = fieldWeight in 3704, product of:
4.690416 = tf(freq=22.0), with freq of:
22.0 = termFreq=22.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.046875 = fieldNorm(doc=3704)
0.040873505 = weight(_text_:software in 3704) [ClassicSimilarity], result of:
0.040873505 = score(doc=3704,freq=2.0), product of:
0.15541996 = queryWeight, product of:
3.9671519 = idf(docFreq=2274, maxDocs=44218)
0.03917671 = queryNorm
0.2629875 = fieldWeight in 3704, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9671519 = idf(docFreq=2274, maxDocs=44218)
0.046875 = fieldNorm(doc=3704)
0.22222222 = coord(2/9)
- Abstract
- Using Google Earth, Google Maps, and/or network visualization programs such as Pajek, one can overlay the network of relations among addresses in scientific publications onto the geographic map. The authors discuss the pros and cons of various options, and provide software (freeware) for bridging existing gaps between the Science Citation Indices (Thomson Reuters) and Scopus (Elsevier), on the one hand, and these various visualization tools on the other. At the level of city names, the global map can be drawn reliably on the basis of the available address information. At the level of the names of organizations and institutes, there are problems of unification both in the ISI databases and with Scopus. Pajek enables a combination of visualization and statistical analysis, whereas the Google Maps and its derivatives provide superior tools on the Internet.
- Source
- Journal of the American Society for Information Science and Technology. 61(2010) no.8, S.1622-1634
-
Saggi, M.K.; Jain, S.: ¬A survey towards an integration of big data analytics to big insights for value-creation (2018)
0.01
0.013395603 = product of:
0.06028021 = sum of:
0.041947264 = weight(_text_:applications in 5053) [ClassicSimilarity], result of:
0.041947264 = score(doc=5053,freq=2.0), product of:
0.17247584 = queryWeight, product of:
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.03917671 = queryNorm
0.2432066 = fieldWeight in 5053, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.0390625 = fieldNorm(doc=5053)
0.018332949 = weight(_text_:of in 5053) [ClassicSimilarity], result of:
0.018332949 = score(doc=5053,freq=24.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.2992506 = fieldWeight in 5053, product of:
4.8989797 = tf(freq=24.0), with freq of:
24.0 = termFreq=24.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.0390625 = fieldNorm(doc=5053)
0.22222222 = coord(2/9)
- Abstract
- Big Data Analytics (BDA) is increasingly becoming a trending practice that generates an enormous amount of data and provides a new opportunity that is helpful in relevant decision-making. The developments in Big Data Analytics provide a new paradigm and solutions for big data sources, storage, and advanced analytics. The BDA provide a nuanced view of big data development, and insights on how it can truly create value for firm and customer. This article presents a comprehensive, well-informed examination, and realistic analysis of deploying big data analytics successfully in companies. It provides an overview of the architecture of BDA including six components, namely: (i) data generation, (ii) data acquisition, (iii) data storage, (iv) advanced data analytics, (v) data visualization, and (vi) decision-making for value-creation. In this paper, seven V's characteristics of BDA namely Volume, Velocity, Variety, Valence, Veracity, Variability, and Value are explored. The various big data analytics tools, techniques and technologies have been described. Furthermore, it presents a methodical analysis for the usage of Big Data Analytics in various applications such as agriculture, healthcare, cyber security, and smart city. This paper also highlights the previous research, challenges, current status, and future directions of big data analytics for various application platforms. This overview highlights three issues, namely (i) concepts, characteristics and processing paradigms of Big Data Analytics; (ii) the state-of-the-art framework for decision-making in BDA for companies to insight value-creation; and (iii) the current challenges of Big Data Analytics as well as possible future directions.
-
Gluck , M.: Multimedia exploratory data analysis for geospatial data mining : the case for augmented seriation (2001)
0.01
0.012816873 = product of:
0.057675928 = sum of:
0.016802425 = weight(_text_:of in 5214) [ClassicSimilarity], result of:
0.016802425 = score(doc=5214,freq=14.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.2742677 = fieldWeight in 5214, product of:
3.7416575 = tf(freq=14.0), with freq of:
14.0 = termFreq=14.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.046875 = fieldNorm(doc=5214)
0.040873505 = weight(_text_:software in 5214) [ClassicSimilarity], result of:
0.040873505 = score(doc=5214,freq=2.0), product of:
0.15541996 = queryWeight, product of:
3.9671519 = idf(docFreq=2274, maxDocs=44218)
0.03917671 = queryNorm
0.2629875 = fieldWeight in 5214, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9671519 = idf(docFreq=2274, maxDocs=44218)
0.046875 = fieldNorm(doc=5214)
0.22222222 = coord(2/9)
- Abstract
- To prevent type-one error, statisticians tend to accept the possibility of type-two error, which leads to the rejection of hypotheses later shown to be true. In both Exploratory Data Analysis and data mining the emphasis is more appropriately on the elimination of type-two error. Thus EDA methods, including its visualization tools may be appropriate for Data Mining. Seriation, creates a matrix of observations and variables, where the cells contain an icon whose size represents its value, and permits the movement of rows and columns in order to visually discern patterns. Augmented Seriation, a method of data mining, adds computer graphics, sound, color, and extra dimensions to the matrix so that the analyst has different modalities for pattern observation. Gluck has developed software for such analysis.
- Source
- Journal of the American Society for Information Science and technology. 52(2001) no.8, S.686-696
-
Tonkin, E.L.; Tourte, G.J.L.: Working with text. tools, techniques and approaches for text mining (2016)
0.01
0.0126480125 = product of:
0.056916054 = sum of:
0.041947264 = weight(_text_:applications in 4019) [ClassicSimilarity], result of:
0.041947264 = score(doc=4019,freq=2.0), product of:
0.17247584 = queryWeight, product of:
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.03917671 = queryNorm
0.2432066 = fieldWeight in 4019, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.0390625 = fieldNorm(doc=4019)
0.014968789 = weight(_text_:of in 4019) [ClassicSimilarity], result of:
0.014968789 = score(doc=4019,freq=16.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.24433708 = fieldWeight in 4019, product of:
4.0 = tf(freq=16.0), with freq of:
16.0 = termFreq=16.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.0390625 = fieldNorm(doc=4019)
0.22222222 = coord(2/9)
- Abstract
- What is text mining, and how can it be used? What relevance do these methods have to everyday work in information science and the digital humanities? How does one develop competences in text mining? Working with Text provides a series of cross-disciplinary perspectives on text mining and its applications. As text mining raises legal and ethical issues, the legal background of text mining and the responsibilities of the engineer are discussed in this book. Chapters provide an introduction to the use of the popular GATE text mining package with data drawn from social media, the use of text mining to support semantic search, the development of an authority system to support content tagging, and recent techniques in automatic language evaluation. Focused studies describe text mining on historical texts, automated indexing using constrained vocabularies, and the use of natural language processing to explore the climate science literature. Interviews are included that offer a glimpse into the real-life experience of working within commercial and academic text mining.
-
Kraker, P.; Kittel, C,; Enkhbayar, A.: Open Knowledge Maps : creating a visual interface to the world's scientific knowledge based on natural language processing (2016)
0.01
0.0122387 = product of:
0.055074148 = sum of:
0.014200641 = weight(_text_:of in 3205) [ClassicSimilarity], result of:
0.014200641 = score(doc=3205,freq=10.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.23179851 = fieldWeight in 3205, product of:
3.1622777 = tf(freq=10.0), with freq of:
10.0 = termFreq=10.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.046875 = fieldNorm(doc=3205)
0.040873505 = weight(_text_:software in 3205) [ClassicSimilarity], result of:
0.040873505 = score(doc=3205,freq=2.0), product of:
0.15541996 = queryWeight, product of:
3.9671519 = idf(docFreq=2274, maxDocs=44218)
0.03917671 = queryNorm
0.2629875 = fieldWeight in 3205, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9671519 = idf(docFreq=2274, maxDocs=44218)
0.046875 = fieldNorm(doc=3205)
0.22222222 = coord(2/9)
- Abstract
- The goal of Open Knowledge Maps is to create a visual interface to the world's scientific knowledge. The base for this visual interface consists of so-called knowledge maps, which enable the exploration of existing knowledge and the discovery of new knowledge. Our open source knowledge mapping software applies a mixture of summarization techniques and similarity measures on article metadata, which are iteratively chained together. After processing, the representation is saved in a database for use in a web visualization. In the future, we want to create a space for collective knowledge mapping that brings together individuals and communities involved in exploration and discovery. We want to enable people to guide each other in their discovery by collaboratively annotating and modifying the automatically created maps.
-
Li, D.; Tang, J.; Ding, Y.; Shuai, X.; Chambers, T.; Sun, G.; Luo, Z.; Zhang, J.: Topic-level opinion influence model (TOIM) : an investigation using tencent microblogging (2015)
0.01
0.011673733 = product of:
0.052531797 = sum of:
0.041947264 = weight(_text_:applications in 2345) [ClassicSimilarity], result of:
0.041947264 = score(doc=2345,freq=2.0), product of:
0.17247584 = queryWeight, product of:
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.03917671 = queryNorm
0.2432066 = fieldWeight in 2345, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
4.4025097 = idf(docFreq=1471, maxDocs=44218)
0.0390625 = fieldNorm(doc=2345)
0.010584532 = weight(_text_:of in 2345) [ClassicSimilarity], result of:
0.010584532 = score(doc=2345,freq=8.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.17277241 = fieldWeight in 2345, product of:
2.828427 = tf(freq=8.0), with freq of:
8.0 = termFreq=8.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.0390625 = fieldNorm(doc=2345)
0.22222222 = coord(2/9)
- Abstract
- Text mining has been widely used in multiple types of user-generated data to infer user opinion, but its application to microblogging is difficult because text messages are short and noisy, providing limited information about user opinion. Given that microblogging users communicate with each other to form a social network, we hypothesize that user opinion is influenced by its neighbors in the network. In this paper, we infer user opinion on a topic by combining two factors: the user's historical opinion about relevant topics and opinion influence from his/her neighbors. We thus build a topic-level opinion influence model (TOIM) by integrating both topic factor and opinion influence factor into a unified probabilistic model. We evaluate our model in one of the largest microblogging sites in China, Tencent Weibo, and the experiments show that TOIM outperforms baseline methods in opinion inference accuracy. Moreover, incorporating indirect influence further improves inference recall and f1-measure. Finally, we demonstrate some useful applications of TOIM in analyzing users' behaviors in Tencent Weibo.
- Source
- Journal of the Association for Information Science and Technology. 66(2015) no.12, S.2657-2673
-
Borgman, C.L.; Wofford, M.F.; Golshan, M.S.; Darch, P.T.: Collaborative qualitative research at scale : reflections on 20 years of acquiring global data and making data global (2021)
0.01
0.0110973455 = product of:
0.049938053 = sum of:
0.015876798 = weight(_text_:of in 239) [ClassicSimilarity], result of:
0.015876798 = score(doc=239,freq=18.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.25915858 = fieldWeight in 239, product of:
4.2426405 = tf(freq=18.0), with freq of:
18.0 = termFreq=18.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.0390625 = fieldNorm(doc=239)
0.034061253 = weight(_text_:software in 239) [ClassicSimilarity], result of:
0.034061253 = score(doc=239,freq=2.0), product of:
0.15541996 = queryWeight, product of:
3.9671519 = idf(docFreq=2274, maxDocs=44218)
0.03917671 = queryNorm
0.21915624 = fieldWeight in 239, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9671519 = idf(docFreq=2274, maxDocs=44218)
0.0390625 = fieldNorm(doc=239)
0.22222222 = coord(2/9)
- Abstract
- A 5-year project to study scientific data uses in geography, starting in 1999, evolved into 20 years of research on data practices in sensor networks, environmental sciences, biology, seismology, undersea science, biomedicine, astronomy, and other fields. By emulating the "team science" approaches of the scientists studied, the UCLA Center for Knowledge Infrastructures accumulated a comprehensive collection of qualitative data about how scientists generate, manage, use, and reuse data across domains. Building upon Paul N. Edwards's model of "making global data"-collecting signals via consistent methods, technologies, and policies-to "make data global"-comparing and integrating those data, the research team has managed and exploited these data as a collaborative resource. This article reflects on the social, technical, organizational, economic, and policy challenges the team has encountered in creating new knowledge from data old and new. We reflect on continuity over generations of students and staff, transitions between grants, transfer of legacy data between software tools, research methods, and the role of professional data managers in the social sciences.
- Source
- Journal of the Association for Information Science and Technology. 72(2021) no.6, S.667-682
-
Peters, G.; Gaese, V.: ¬Das DocCat-System in der Textdokumentation von G+J (2003)
0.01
0.010985063 = product of:
0.03295519 = sum of:
0.0059875157 = weight(_text_:of in 1507) [ClassicSimilarity], result of:
0.0059875157 = score(doc=1507,freq=4.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.09773483 = fieldWeight in 1507, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03125 = fieldNorm(doc=1507)
0.016351866 = weight(_text_:systems in 1507) [ClassicSimilarity], result of:
0.016351866 = score(doc=1507,freq=2.0), product of:
0.12039685 = queryWeight, product of:
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.03917671 = queryNorm
0.1358164 = fieldWeight in 1507, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.03125 = fieldNorm(doc=1507)
0.010615807 = product of:
0.021231614 = sum of:
0.021231614 = weight(_text_:22 in 1507) [ClassicSimilarity], result of:
0.021231614 = score(doc=1507,freq=2.0), product of:
0.13719016 = queryWeight, product of:
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.03917671 = queryNorm
0.15476047 = fieldWeight in 1507, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.5018296 = idf(docFreq=3622, maxDocs=44218)
0.03125 = fieldNorm(doc=1507)
0.5 = coord(1/2)
0.33333334 = coord(3/9)
- Abstract
- Wir werden einmal die Grundlagen des Text-Mining-Systems bei IBM darstellen, dann werden wir das Projekt etwas umfangreicher und deutlicher darstellen, da kennen wir uns aus. Von daher haben wir zwei Teile, einmal Heidelberg, einmal Hamburg. Noch einmal zur Technologie. Text-Mining ist eine von IBM entwickelte Technologie, die in einer besonderen Ausformung und Programmierung für uns zusammengestellt wurde. Das Projekt hieß bei uns lange Zeit DocText Miner und heißt seit einiger Zeit auf Vorschlag von IBM DocCat, das soll eine Abkürzung für Document-Categoriser sein, sie ist ja auch nett und anschaulich. Wir fangen an mit Text-Mining, das bei IBM in Heidelberg entwickelt wurde. Die verstehen darunter das automatische Indexieren als eine Instanz, also einen Teil von Text-Mining. Probleme werden dabei gezeigt, und das Text-Mining ist eben eine Methode zur Strukturierung von und der Suche in großen Dokumentenmengen, die Extraktion von Informationen und, das ist der hohe Anspruch, von impliziten Zusammenhängen. Das letztere sei dahingestellt. IBM macht das quantitativ, empirisch, approximativ und schnell. das muss man wirklich sagen. Das Ziel, und das ist ganz wichtig für unser Projekt gewesen, ist nicht, den Text zu verstehen, sondern das Ergebnis dieser Verfahren ist, was sie auf Neudeutsch a bundle of words, a bag of words nennen, also eine Menge von bedeutungstragenden Begriffen aus einem Text zu extrahieren, aufgrund von Algorithmen, also im Wesentlichen aufgrund von Rechenoperationen. Es gibt eine ganze Menge von linguistischen Vorstudien, ein wenig Linguistik ist auch dabei, aber nicht die Grundlage der ganzen Geschichte. Was sie für uns gemacht haben, ist also die Annotierung von Pressetexten für unsere Pressedatenbank. Für diejenigen, die es noch nicht kennen: Gruner + Jahr führt eine Textdokumentation, die eine Datenbank führt, seit Anfang der 70er Jahre, da sind z.Z. etwa 6,5 Millionen Dokumente darin, davon etwas über 1 Million Volltexte ab 1993. Das Prinzip war lange Zeit, dass wir die Dokumente, die in der Datenbank gespeichert waren und sind, verschlagworten und dieses Prinzip haben wir auch dann, als der Volltext eingeführt wurde, in abgespeckter Form weitergeführt. Zu diesen 6,5 Millionen Dokumenten gehören dann eben auch ungefähr 10 Millionen Faksimileseiten, weil wir die Faksimiles auch noch standardmäßig aufheben.
- Date
- 22. 4.2003 11:45:36
-
Srinivasan, P.: Text mining in biomedicine : challenges and opportunities (2006)
0.01
0.010864041 = product of:
0.048888184 = sum of:
0.014200641 = weight(_text_:of in 1497) [ClassicSimilarity], result of:
0.014200641 = score(doc=1497,freq=10.0), product of:
0.061262865 = queryWeight, product of:
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.03917671 = queryNorm
0.23179851 = fieldWeight in 1497, product of:
3.1622777 = tf(freq=10.0), with freq of:
10.0 = termFreq=10.0
1.5637573 = idf(docFreq=25162, maxDocs=44218)
0.046875 = fieldNorm(doc=1497)
0.034687545 = weight(_text_:systems in 1497) [ClassicSimilarity], result of:
0.034687545 = score(doc=1497,freq=4.0), product of:
0.12039685 = queryWeight, product of:
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.03917671 = queryNorm
0.28811008 = fieldWeight in 1497, product of:
2.0 = tf(freq=4.0), with freq of:
4.0 = termFreq=4.0
3.0731742 = idf(docFreq=5561, maxDocs=44218)
0.046875 = fieldNorm(doc=1497)
0.22222222 = coord(2/9)
- Abstract
- Text mining is about making serendipity more likely. Serendipity, the chance discovery of interesting ideas, has been responsible for many discoveries in science. Text mining systems strive to explore large text collections, separate the potentially meaningfull connections from a vast and mostly noisy background of random associations. In this paper we provide a summary of our text mining approach and also illustrate briefly some of the experiments we have conducted with this approach. In particular we use a profile-based text mining method. We have used these profiles to explore the global distribution of disease research, replicate discoveries made by others and propose new hypotheses. Text mining holds much potential that has yet to be tapped.
- Source
- Knowledge organization, information systems and other essays: Professor A. Neelameghan Festschrift. Ed. by K.S. Raghavan and K.N. Prasad
