DEX8 - Web Crawler, Scraper, Data Extraction

DEX8 is a powerful web crawler, web spider, data scraper, data extraction and automation platform. With its unlimited number of deployed robots, it can reach Googlebot or Bingbot strength. This tool is for everybody. A beginner, intermediate or experienced data extraction master can quickly start a project collecting public data. JavaScript developers can create their own data extraction, web crawler scripts by utilising rich DEX8 Helper Library. Features: - Software installation is not required. Everything runs in the Cloud. - Extract data from Amazon, eBay, or similar websites. - Extract data from Forex - stock markets - in real-time. - Deploy infinite ∞ number of web robots in the Cloud. - Huge capacity - each robot is deployed on a different IP address. - Powerful extraction: the robots work simultaneously in asynchronous mode. - Each robot can run several scraping tasks. Alternatively, a single task can be carried out by multiple robots. - Integrate DEX8 platform with Web proxy and prevent crawler bouncing. - Robots are controlled via a Web Panel, which can start, stop and pause the robot(s). - Code your own scraping files & tasks in NodeJS by using NPM libraries. - Use premade robot tasks to extract data easily without coding/programming. - Real-time monitoring - use browser to track extracted data in real-time. - Scraped data can be filtered and modified before being transferred to a database. - Extracted data is stored in the NoSQL database. - HTTP client error reporting in real-time. - Errors are stored in databases for more effective debugging. - Schedule tasks - define the exact time when you want your robot to start/stop automatically. - Export extracted data to a CSV or XLS file. - Use extracted data via DEX8 API Connector. The basic platform parts: - robot - a web crawler, spider, scraper engine - task - the task refers to what the robot needs to do - web panel - browser GUI to start, stop and pause robot's task