Skip to main content
Send an X.com URL, get structured JSON back. The Bright Data X Scraper API handles proxies, CAPTCHAs, and parsing so you can focus on your data pipeline.
New to Bright Data? Create a free account and get $2 credit to start scraping.

​
How it works

You send one or more X (formerly Twitter) URLs to the Bright Data X Scraper API. Bright Data handles the scraping infrastructure and returns clean, structured JSON. 
Your app  -->  Bright Data API  -->  Structured JSON
           POST /datasets/v3/scrape
           Authorization: Bearer YOUR_API_TOKEN
All requests use a dataset_id to specify the data type (profiles or posts) and return results in JSON, NDJSON, or CSV.

​
What the response looks like

curl -X POST "https://api.brightdata.com/datasets/v3/scrape?dataset_id=gd_lwxmeb2u1cniijd7t4&format=json" \
  -H "Authorization: Bearer YOUR_API_TOKEN" \
  -H "Content-Type: application/json" \
  -d '[{"url": "https://x.com/elonmusk"}]'

{
  "user_name": "elonmusk",
  "name": "Elon Musk",
  "description": "Read @WallStreetSilv",
  "followers": 214000000,
  "following": 870,
  "number_of_tweets": 52000,
  "is_verified": true,
  "profile_image_link": "https://..."
}

​
Supported data types

Profiles

Follower counts, bios, verification status, profile images. Discover profiles by username.

Posts

Post text, likes, reposts, replies, media, and hashtags. Discover posts by profile URL.

​
Request methods

The Bright Data X Scraper API supports two request methods. Choose based on your volume and latency needs.
MethodEndpointBest for
Synchronous/scrapeReal-time lookups, up to 20 URLs
Asynchronous/triggerBatch jobs, 20+ URLs, production pipelines
Learn more in Understanding sync vs. async requests.

​
Capabilities and limits

CapabilityDetail
Output formatsJSON, NDJSON, CSV
Max URLs per sync request20
Max URLs per async request5,000
Data freshnessReal-time (scraped on demand)
Delivery optionsAPI download, Webhook, Amazon S3, Snowflake, Azure, GCS (all options)
PricingPay per successful record (see pricing)

​
Common questions

Yes. Each request triggers a live scrape. There is no cached or stale data. Response times vary by endpoint: profiles typically return in 10-30 seconds (sync), while discovery requests may take longer depending on result volume.
URL collection scrapes a specific X page you provide (e.g., a profile URL). Discovery finds X content matching search criteria (e.g., all posts from a profile URL) and scrapes the results. Discovery is only available via async requests.
When scraping using proxies or Web Unlocker, you still need to write and maintain your own parsing logic and update it whenever X changes its page structure. The X Scraper API handles the entire stack: proxy rotation, anti-bot bypassing and parsing. You simply send an X.com URL and get clean, structured JSON back with no scraping infrastructure or parser maintenance required on your end.

​
Next steps

Quickstart

Scrape your first X profile in 5 minutes.

Send your first request

Full code examples in cURL, Python, and Node.js.

API reference

Endpoint specs, parameters, and response schemas.