Web Scraper IDE API
Getting started with the API
The Data scraper product offers a JSON API to control and inspect your data scrapers programmatically.
- Signup (or login) to our control panel
- Insert target URL (website to collect data from) or choose a ready-made template
- Set up the delivery preference of scraper: Batch or Real-Time
- Initiate by API
NOT A DEVELOPER? Contact our support for easy onboarding.
The data scraper is divided into two crawling systems:
This is an efficient way of handling large amounts of data. Data is collected in batches over a period of time. After the data is collected, entered, and processed, the batch results are generated. You can deliver the results all at once or stream them to your system as they’re collected.
The Data scraper API has four general workflows:
Was this page helpful?