Exploring Information Extraction Resilience

Gregg, Dawn
Journal of Universal Computer Science Vol. 14 Issue 11, p. 1911-1920

There are many challenges developers face when attempting to reliably extract data from the web. One of these challenges is the resilience of the extraction system to changes in the web pages information is being extracted from. This paper compares the resilience of information extraction systems that use position based extraction with an ontology based extraction system and a system that combines position based extraction with ontology based extraction. The findings demonstrate the advantages of using a system that combines multiple extraction techniques, especially in environments where websites change frequently and where data collection is conducted over an extended period of time.