1. Signup (or login) to our control panel
  2. Insert target URL (website to collect data from) or choose a ready-made template
  3. Set up the delivery preference of scraper: Batch or Real-Time
  4. Initiate by API
NOT A DEVELOPER? Contact our support for easy onboarding.
The data scraper is divided into two crawling systems:
This is an efficient way of handling large amounts of data. Data is collected in batches over a period of time. After the data is collected, entered, and processed, the batch results are generated. You can deliver the results all at once or stream them to your system as they’re collected.
The Data scraper API has four general workflows:
  1. Batch trigger + Push delivery
  2. Batch trigger + API polling
  3. Real-time trigger + Push delivery
  4. Real-time trigger + API polling