Next step in text mining

Jack,
Thanks for taking the time to post on this. A very nice summary. I was a pleasure speaking to the group, even if I couldn't be there to enjoy the holiday festivities afterward. We're all very excited about this area of our business. We see it as one with significant growth, as our clients have told us time and time again that they need to find ways to add more value to the information they already have in "raw" form.
Glenn

There are other applications of text mining that have the potential for enormous payoff. I have appended an announcement notice, sent earlier this year, that describes our approaches to text mining for discovery and innovation.

Additionally, since your group appears to have interest in knowledge management, I published a chapter earlier this year on Science and Technology Knowledge Management in the book "New Frontiers of Knowledge Management. (Ed.) Kevin DeSouza. Palgrave Macmillan, United Kingdom". This chapter places text mining in its larger context of knowledge management, and present some problems and potential payoffs associated with text mining today.

APPENDIX - ANNOUNCEMENT

FROM: DR. RONALD N. KOSTOFF (Office of Naval Research)

TO: TECHNICAL DISTRIBUTION (BCC:)

SUBJECT: ACCELERATING RADICAL DISCOVERY AND INNOVATION

A recent report (1) describes a new family of approaches for systematically identifying and accelerating potentially radical discovery and innovation in science and technology. This systematic capability is applicable to all phases of the science and technology development cycle (planning, investment/ selection, execution, review, publication/ dissemination, transition). The report should be of interest to research managers, performers, administrators, investors, and journal editors who might benefit strongly from using such a systematic discovery and innovation approach in their work.

“Systematic Acceleration of Radical Discovery and Innovation in Science and Technology” (1) presents new approaches for solving problems in target technical disciplines by systematically extrapolating insights and principles from disparate technical disciplines. The Appendix to this e-mail briefly summarizes the approach fundamentals (separate forthcoming journal publications will describe the successful applications of the technique). Anyone interested in implementing the discovery and innovation approach should obtain the report (1) for the extra details.

Specifically, the technique is useful to the following members of the science and technology community:

1) Sponsoring agencies, for identifying radically new technical directions to support. For example, based on demonstration, an enormous increase in numbers of proposal responses to funding competition announcements, both in absolute numbers of proposals and especially proposals from disparate technical disciplines, is possible, using one of the discovery variants described in (1);

2) Researchers, for identifying potentially high-payoff research avenues to pursue. For example, based on demonstration, up to an order of magnitude (or more) increase in technically innovative approaches to solve problems can be hypothesized for further lab and field testing;

3) Journal Editors, for proactively using Special Issues as engines of radical innovation. For example, journal Special Issues featuring papers written by experts from very disparate disciplines could identify radically innovative approaches for solving problems related to the Special Issue’s theme;

4) Administrators, when restructuring organizations and teams to maximize innovation and discovery potential. For example, an improved mix of people representing very diverse relevant technical disciplines could be structured around core technologies to increase the potential of radical discovery and innovation;

5) Forecasters and Planners. For example, the possibility of identifying potentially radical solutions for technical problems could be estimated, and emerging technologies that could enable radical problem solving for many different core technologies could be identified. This capability would be of particular value to technology venture capital organizations;

6) Selected Researchers in informatics, bioinformatics, innovation management, science and technology management, interdisciplinary and multidisciplinary studies, and information retrieval. For example, representatives of these disciplines could apply their expertise to enhancing the approaches described in this note, and in turn their disciplines could benefit from such approaches.

RNK

APPENDIX – SUMMARY OF APPROACH

Radical discovery and innovation are systematically identified by extrapolating principles and insights from relevant disparate technical disciplines to solve problems of interest. To access these disparate technical disciplines, the following steps are necessary.

a) A query is developed to retrieve a core literature set (the literature describing the existing technology base for solving the problems of interest) from raw literature data sources (e.g., Science Citation Index, Medline)

b) The core literature is retrieved and characterized (technical structure, infrastructure).

c) The query used for generating the core literature is generalized/ expanded to retrieve a much broader literature set with direct and indirect connections to the core literature.

d) Potential discovery and innovation candidates (concepts) from this expanded literature are identified by technical experts.

e) The principles and insights from these potential discovery and innovation concepts are extrapolated to solve problems related to the core literature theme by either the authors of the expanded literature documents, or by independent analysts examining the contents of these expanded literature documents.

In summary, the key elements of the process are 1) developing the expanded query, 2) identifying potential discovery and innovation candidates, and 3) drawing the connections between the potential discovery and innovation candidates and solutions to the prevalent problems of interest.

For example, assume the problem of interest is to identify ‘improved’ water purification alternatives to existing practices, where ‘improved’ could reflect any combination of lower cost, lower energy use, lower maintenance, higher system reliability, lighter system weight, or improved system modularity for faster assembly. Then, the core literature would consist of the existing published water purification techniques. These publications could either be water purification science and technology output documents (papers, reports, patents, etc.), or funding agency narrative descriptions of water purification projects. Then, assume the core literature could be divided into two fundamental technical categories: mass separation (e.g., distillation, membrane filtering) and disinfection (e.g. ozonation, chlorination). The core literature would then be generalized/ expanded to contain all conceivable mass separation and disinfection techniques.

Radical discovery and innovation (i.e., extrapolation of insights and principles from these disparate literatures to solving the water purification problem) would be identified either by the authors associated with the expanded literature documents (through grant competitions and/ or workshops and/ or other multi-disciplinary group activities) or through independent analyses of these documents by technical experts. The authors of the expanded literature documents would also provide links to experts representing the disparate technical disciplines who may not be associated with the expanded literature documents. Membership in common professional societies, employment in same institution divisions, and attendance at same conferences and workshops, etc., would provide the linkages between experts accessed through the expanded literature documents, and those not accessed. This would ensure that all relevant expertise is accessed for solving the problem of interest.

RNK

REFERENCES
1). Kostoff, R.N. Systematic Acceleration of Radical Discovery and Innovation in Science and Technology. DTIC Technical Report Number ADA430720 (http://www.dtic.mil/). Defense Technical Information Center. Fort Belvoir, VA. 2005.

An MSWord version of the report’s final draft is available in downloadable form at http://www.onr.navy.mil/sci_tech/special/354/technowatch/textmine.asp (Press CTRL + click to follow link; GO TO FIRST PUBLICATION LISTED; click on Word Version.)

2). DISCLAIMER-The views in this e-mail and the referenced report are solely those of the author, and do not necessarily represent the views of the U.S. Department of the Navy, or any of its components.