Prerequisites
- A Bright Data account with an active API key
- Completed the Quickstart
Request structure
Every synchronous request follows the same pattern:dataset_id and the input shape.
The
/scrape endpoint is built for real-time, single-URL requests. Bright Data recommends 20 URLs or fewer per request, a best practice rather than a hard limit, and the endpoint waits up to 1 minute. If collection takes longer, the response is HTTP 202 with a snapshot_id instead of data, and collection continues asynchronously. Fetch the result with async requests or have it pushed to you with webhook delivery.Posts, Collect by URL
Scrape a specific Reddit post by its URL. Dataset ID:gd_lvz8ah06191smkebj4
200 response. Processing time varies with target-site conditions and scraper workload.
Example response
Example response
Which output fields does the Reddit posts scraper return?
The Reddit posts scraper (gd_lvz8ah06191smkebj4, collect_by_url) returns 27 output fields.
Output fields (27)
Output fields (27)
/scrapers/gd_lvz8ah06191smkebj4.json
Posts, Discover by subreddit URL
Scrape recent posts from a specific subreddit, optionally sorted withsort_by. Values are case-sensitive and match the labels on Reddit, for example Hot. Lowercase hot is rejected with a validation error.
Dataset ID: gd_lvz8ah06191smkebj4
Discovery endpoints are best used asynchronously via
/trigger since they may return many results. The sync example below is for quick testing.Posts, Discover by keyword
Find Reddit posts matching a search term, filtered by date. Dataset ID:gd_lvz8ah06191smkebj4
Comments, Collect by URL
Scrape all comments from a Reddit post or a specific comment thread, with optional filtering by age. Dataset ID:gd_lvzdpsdlw09j6t702
Example response
Example response
Which output fields does the Reddit comments scraper return?
The Reddit comments scraper (gd_lvzdpsdlw09j6t702, collect_by_url) returns 34 output fields.
Output fields (34)
Output fields (34)
/scrapers/gd_lvzdpsdlw09j6t702.json
Related
Async batch requests
Scrape thousands of posts or run keyword discovery jobs in a single async request.
API reference
Full endpoint specs, parameters and response schemas.