Difference between revisions of "Annotating Documents by Wikipedia Concepts"
(Creating a new page - Annotating Documents by Wikipedia Concepts) |
(Int.links) |
||
| Line 1: | Line 1: | ||
| − | '''Annotating Documents by Wikipedia Concepts''' - scientific work related to Wikipedia quality published in 2008, written by Péter Schönhofen. | + | '''Annotating Documents by Wikipedia Concepts''' - scientific work related to [[Wikipedia quality]] published in 2008, written by [[Péter Schönhofen]]. |
== Overview == | == Overview == | ||
| − | Authors present a technique which is able to reliably label words or phrases of an arbitrary document with Wikipedia articles (concepts) best describing their meaning. First it scans the document content, and when it finds a word sequence matching the title of a Wikipedia article, it attaches the article to the constituent word(s). The collected articles are then scored based on three factors: (1) how many other detected articles they semantically relate to, according to the Wikipedia link structure; (2) how specific is the concept they represent; and (3) how similar is the title by which they were detected to their "official" title. If a text location refers to multiple Wikipedia articles, only the one with the highest score is retained. Experiments on 24,000 randomly selected Wikipedia article bodies showed that 81% of phrases annotated by article authors were correctly identified. Moreover, out of the 5 concepts deemed as the most important by algorithm during a final ranking, in average 72% was indeed marked in the original text. | + | Authors present a technique which is able to reliably label words or phrases of an arbitrary document with [[Wikipedia]] articles (concepts) best describing their meaning. First it scans the document content, and when it finds a word sequence matching the title of a Wikipedia article, it attaches the article to the constituent word(s). The collected articles are then scored based on three factors: (1) how many other detected articles they semantically relate to, according to the Wikipedia link structure; (2) how specific is the concept they represent; and (3) how similar is the title by which they were detected to their "official" title. If a text location refers to multiple Wikipedia articles, only the one with the highest score is retained. Experiments on 24,000 randomly selected Wikipedia article bodies showed that 81% of phrases annotated by article authors were correctly identified. Moreover, out of the 5 concepts deemed as the most important by algorithm during a final ranking, in average 72% was indeed marked in the original text. |
Revision as of 09:11, 11 October 2019
Annotating Documents by Wikipedia Concepts - scientific work related to Wikipedia quality published in 2008, written by Péter Schönhofen.
Overview
Authors present a technique which is able to reliably label words or phrases of an arbitrary document with Wikipedia articles (concepts) best describing their meaning. First it scans the document content, and when it finds a word sequence matching the title of a Wikipedia article, it attaches the article to the constituent word(s). The collected articles are then scored based on three factors: (1) how many other detected articles they semantically relate to, according to the Wikipedia link structure; (2) how specific is the concept they represent; and (3) how similar is the title by which they were detected to their "official" title. If a text location refers to multiple Wikipedia articles, only the one with the highest score is retained. Experiments on 24,000 randomly selected Wikipedia article bodies showed that 81% of phrases annotated by article authors were correctly identified. Moreover, out of the 5 concepts deemed as the most important by algorithm during a final ranking, in average 72% was indeed marked in the original text.
