A Visual Crawler Based on Collection Template Configuration

With the popularization of the Internet and the explosive growth of information, users are faced with the problem of mining and managing massive amounts of data. Traditional crawler systems have certain bottlenecks in configuration, operation and maintenance, which require users to have a high level of technical skills and need to write complex codes to define data extraction rules. This study aims to design and implement a visual crawler system that enables users to easily collect information without in-depth technical knowledge by means of a graphical interface and collection template configuration.