Bright Data Web Scraper API enables you to trigger a collection for automated web data extraction.
Use your Bright Data API Key as a Bearer token in the Authorization header.
How to authenticate:
Authorization: Bearer YOUR_API_KEYExample:
Authorization: Bearer b5648e1096c6442f60a6c4bbbe73f8d2234d3d8324554bd6a7ec8f3f251f07dfLearn how to get your Bright Data API key: https://docs.brightdata.com/api-reference/authentication
Your dataset ID
"gd_m6gjtfmeh43we6cqc"
Include errors report with the results. By setting "include_errors" to true, you will receive a detailed report of any errors that occur during the data collection.
true
The "custom_output_fields" parameter is used to filter the response data to include only the specified fields. You can list the output columns you want, separated by a pipe (|).
For example, if you want the response to include only the URL and the date it was last updated, you would set the parameter to "url|about.updated_on". This allows you to customize the data output to include only the fields relevant to your needs.
"url|about.updated_on"
You can provide the input data in either JSON or CSV format. The input specifies the URLs or other parameters required by the scraper.
Properties vary based on the dataset requirements. Most commonly includes 'url' field.
Example: [{"url":"https://www.airbnb.com/rooms/50122531"},{"url":"https://www.airbnb.com/rooms/50127677"}]
[
{
"url": "https://www.airbnb.com/rooms/50122531"
},
{
"url": "https://www.airbnb.com/rooms/50127677"
}
]Collection job successfully started
A Snapshot ID is a unique identifier for a specific data snapshot, used to retrieve results from a data collection job triggered via the API. Read more about Snapshot ID.
"s_m4x7enmven8djfqak"