Automated Dataset Construction from Web Resources with Tool Kayur
2016 (English)In: 2016 FOURTH INTERNATIONAL SYMPOSIUM ON COMPUTING AND NETWORKING (CANDAR), 2016, 98-104 p.Conference paper (Refereed)
Many text mining tools cannot be applied directly to documents available on web pages. There are tools for fetching and preprocessing of textual data, but combining them in one working tool chain can be time consuming. The preprocessing task is even more labor-intensive if documents are located on multiple remote sources with different storage formats. In this paper we propose the simplification of data preparation process for cases when data come from wide range of web resources. We developed an open-sourced tool, called Kayur, that greatly minimizes time and effort required for routine data preprocessing steps, allowing to quickly proceed to the main task of data analysis. The datasets generated by the tool are ready to be loaded into a data mining workbench, such as WEKA or Carrot2, to perform classification, feature prediction, and other data mining tasks.
Place, publisher, year, edition, pages
2016. 98-104 p.
International Symposium on Computing and Networking, ISSN 2379-1888
automation, information extraction, natural language processing, web content mining
Electrical Engineering, Electronic Engineering, Information Engineering
IdentifiersURN: urn:nbn:se:kth:diva-203189DOI: 10.1109/CANDAR.2016.71ISI: 000393284200012ISBN: 978-1-5090-2655-5 OAI: oai:DiVA.org:kth-203189DiVA: diva2:1081286
4th International Symposium on Computing and Networking (CANDAR), NOV 22-25, 2016, Hiroshima, JAPAN
QC 201703132017-03-132017-03-132017-03-13Bibliographically approved