Difference between revisions of "Learning to Link with Wikipedia"
(Infobox) |
(Adding embed) |
||
| Line 10: | Line 10: | ||
== Overview == | == Overview == | ||
This paper describes how to automatically cross-reference documents with [[Wikipedia]]: the largest knowledge base ever known. It explains how machine learning can be used to identify significant terms within unstructured text, and enrich it with links to the appropriate Wikipedia articles. The resulting link detector and disambiguator performs very well, with recall and precision of almost 75%. This performance is constant whether the system is evaluated on Wikipedia articles or "real world" documents. This work has implications far beyond enriching documents with explanatory links. It can provide structured knowledge about any unstructured fragment of text. Any task that is currently addressed with bags of words - indexing, clustering, retrieval, and summarization to name a few - could use the techniques described here to draw on a vast network of concepts and semantics. | This paper describes how to automatically cross-reference documents with [[Wikipedia]]: the largest knowledge base ever known. It explains how machine learning can be used to identify significant terms within unstructured text, and enrich it with links to the appropriate Wikipedia articles. The resulting link detector and disambiguator performs very well, with recall and precision of almost 75%. This performance is constant whether the system is evaluated on Wikipedia articles or "real world" documents. This work has implications far beyond enriching documents with explanatory links. It can provide structured knowledge about any unstructured fragment of text. Any task that is currently addressed with bags of words - indexing, clustering, retrieval, and summarization to name a few - could use the techniques described here to draw on a vast network of concepts and semantics. | ||
| + | |||
| + | == Embed == | ||
| + | === Wikipedia Quality === | ||
| + | <code> | ||
| + | <nowiki> | ||
| + | Milne, David N.; Witten, Ian H.. (2008). "[[Learning to Link with Wikipedia]]".DOI: 10.1145/1458082.1458150. | ||
| + | </nowiki> | ||
| + | </code> | ||
| + | |||
| + | === English Wikipedia === | ||
| + | <code> | ||
| + | <nowiki> | ||
| + | {{cite journal |last1=Milne |first1=David N. |last2=Witten |first2=Ian H. |title=Learning to Link with Wikipedia |date=2008 |doi=10.1145/1458082.1458150 |url=https://wikipediaquality.com/wiki/Learning_to_Link_with_Wikipedia}} | ||
| + | </nowiki> | ||
| + | </code> | ||
| + | |||
| + | === HTML === | ||
| + | <code> | ||
| + | <nowiki> | ||
| + | Milne, David N.; Witten, Ian H.. (2008). &quot;<a href="https://wikipediaquality.com/wiki/Learning_to_Link_with_Wikipedia">Learning to Link with Wikipedia</a>&quot;.DOI: 10.1145/1458082.1458150. | ||
| + | </nowiki> | ||
| + | </code> | ||
Revision as of 21:20, 29 January 2021
Authors | David N. Milne Ian H. Witten |
|---|---|
Publication date | 2008 |
DOI | 10.1145/1458082.1458150 |
Links | Original |
Learning to Link with Wikipedia - scientific work related to Wikipedia quality published in 2008, written by David N. Milne and Ian H. Witten.
Overview
This paper describes how to automatically cross-reference documents with Wikipedia: the largest knowledge base ever known. It explains how machine learning can be used to identify significant terms within unstructured text, and enrich it with links to the appropriate Wikipedia articles. The resulting link detector and disambiguator performs very well, with recall and precision of almost 75%. This performance is constant whether the system is evaluated on Wikipedia articles or "real world" documents. This work has implications far beyond enriching documents with explanatory links. It can provide structured knowledge about any unstructured fragment of text. Any task that is currently addressed with bags of words - indexing, clustering, retrieval, and summarization to name a few - could use the techniques described here to draw on a vast network of concepts and semantics.
Embed
Wikipedia Quality
Milne, David N.; Witten, Ian H.. (2008). "[[Learning to Link with Wikipedia]]".DOI: 10.1145/1458082.1458150.
English Wikipedia
{{cite journal |last1=Milne |first1=David N. |last2=Witten |first2=Ian H. |title=Learning to Link with Wikipedia |date=2008 |doi=10.1145/1458082.1458150 |url=https://wikipediaquality.com/wiki/Learning_to_Link_with_Wikipedia}}
HTML
Milne, David N.; Witten, Ian H.. (2008). "<a href="https://wikipediaquality.com/wiki/Learning_to_Link_with_Wikipedia">Learning to Link with Wikipedia</a>".DOI: 10.1145/1458082.1458150.
