Skip to main content
The Bright Data Marketplace Dataset API gives you two endpoints to pull records from 250+ Marketplace datasets: Search for real-time lookups and Filter for bulk asynchronous jobs. Both endpoints share one filter schema, one authentication method and the same $2.5 CPM pricing.
Paste your API key into the authorization field. To get an API key, create an account and learn how to generate an API key.

What are the two Dataset API endpoints?

The Marketplace Dataset API exposes two ways to pull records, depending on the job:
  • Search (sync) is Elasticsearch-powered and returns records inline in sub-second responses. Use Search for real-time lookups, lead enrichment and sampling.
  • Filter (async) is snapshot-based and supports CSV/JSON file uploads and large payloads. Use Filter for bulk exports and value-list filtering.

Search dataset (sync)

Elasticsearch query, results inline, sub-second latency. Up to 1,000 records per call.

Filter dataset (async)

Snapshot-based job, CSV/JSON uploads, payloads up to 200 MiB. All 250+ datasets.

Which endpoint should I use?

Use Search for low-latency, single-call lookups and Filter for bulk or file-driven jobs.
NeedUse
Real-time lookup, up to 1,000 records, sub-second latencySearch
Lead enrichment on a single recordSearch
Quick sample of a dataset before buyingSearch with "sort": "random"
Bulk export or large pullsFilter
Filter by a list of 100k+ values from CSV/JSONFilter
Dataset not yet supported by SearchFilter

How do the two endpoints compare?

The Search and Filter endpoints accept the same filter object but differ in engine, latency and dataset coverage.
SearchFilter
PathPOST /datasets/search/:dataset_idPOST /datasets/filter
EngineElasticsearchSnapshot-based
ModeSync (results inline)Async (returns snapshot_id)
LatencySub-secondUp to 5 minutes per job
Datasets3 LinkedIn datasets (alpha)All 250+ Marketplace datasets
Max payloadSingle request bodyUp to 200 MiB (multipart)
File uploads (CSV/JSON)Not supportedSupported
Paginationsearch_after cursorrecords_limit on snapshot
Returnshits, total_hits, tooksnapshot_id (download separately)
Pricing$2.5 CPM$2.5 CPM
Results between the two engines can differ. Elasticsearch tokenizes text differently from the snapshot engine.

How do I authenticate?

Both endpoints use Bearer token authentication. Pass your API key in the Authorization header:
Authorization: Bearer YOUR_API_KEY
Get your key from account settings.

How much does the Dataset API cost?

Both endpoints cost $2.5 CPM (per 1,000 records returned), the same rate as the Marketplace. There is no premium for real-time Search, and there is no charge when a filter returns 0 records.
ItemPrice
Search and Filter$2.5 CPM (per 1,000 records returned)
Zero-match queriesFree (no charge when the filter returns 0 records)

Where is the filter syntax documented?

Both endpoints accept the same filter object, with the same operators and nesting rules. The filter syntax reference documents the operator list, filter groups, up to three levels of nesting and CSV/JSON file references.