Scrapers

Structured data from any website

Send a URL, receive structured JSON/CSV. No proxies, browsers, anti-bot systems or parsing to manage. 660+ pre-built scrapers cover LinkedIn, Instagram, TikTok, Amazon, Google Maps and more.

Start building

Bright Data Web Scraper API overview illustration

💡 Not ready for a full integration? Run any scraper from the no-code dashboard.

## Your first request Replace `API_KEY` with a key from your [account settings](https://brightdata.com/cp/setting/users). You'll receive a JSON record with 200+ fields. The same request pattern works for every scraper in the library. ```bash cURL theme={null} curl "https://api.brightdata.com/datasets/v3/scrape?dataset_id=gd_l1viktl72bvl7bjuj0&format=json" \ -H "Authorization: Bearer API_KEY" \ -H "Content-Type: application/json" \ -d '[{"url": "https://www.linkedin.com/in/elad-moshe-05a90413/"}]' ``` ```python Python theme={null} import requests url = "https://api.brightdata.com/datasets/v3/scrape" headers = { "Authorization": "Bearer API_KEY", "Content-Type": "application/json", } params = {"dataset_id": "gd_l1viktl72bvl7bjuj0", "format": "json"} payload = [{"url": "https://www.linkedin.com/in/elad-moshe-05a90413/"}] response = requests.post(url, headers=headers, params=params, json=payload) print(response.json()) ``` ```javascript Node.js theme={null} const response = await fetch( "https://api.brightdata.com/datasets/v3/scrape?dataset_id=gd_l1viktl72bvl7bjuj0&format=json", { method: "POST", headers: { "Authorization": "Bearer API_KEY", "Content-Type": "application/json", }, body: JSON.stringify([ { url: "https://www.linkedin.com/in/elad-moshe-05a90413/" }, ]), } ); const data = await response.json(); console.log(data); ``` ## Which scrapers are most popular

Social

Pages, posts, events. Profiles and posts. Channels, videos, comments. Subreddits, posts, comments.

AI & Search

Conversations and prompts. SERPs, snippets, featured results. Places, reviews, hours. Browse all 660+ scrapers →

🛠️ Can't find the site you need? Build a custom scraper in minutes with AI-powered Scraper Studio.

## How it works Pick a request mode, then pick how you want the data delivered. ### Request modes One request, one response. Best for single URLs and real-time use cases. Trigger a job, retrieve later. Handles thousands of URLs per request. Find records by keyword or category when you don't have specific URLs. ### Which delivery options to use Pull results from the API once a job completes. Push results to your endpoint as soon as a snapshot is ready. Deliver to S3, GCS, Azure, or Snowflake. Receive results in batches as they are scraped. ## Beyond pre-built scrapers Build a scraper for any site using Scraper Studio. Pass a URL and describe the data you need. Bright Data's team builds and operates custom scrapers for your targets. **No code required.** Skip scraping entirely. Buy ready-made datasets refreshed on a schedule. **No code required.** ## How to combine scrapers and delivery End-to-end tutorials that combine a scraper with a delivery option and a target system. Pull profiles and company data with the LinkedIn scraper, then push them via webhook into HubSpot or Salesforce. Schedule an async job over your SKU list and stream results into S3 for daily price and stock tracking. Use Google SERP as a discovery engine, then fan out to Instagram, TikTok and X scrapers to track mentions by keyword. ## What you can build Pull LinkedIn profiles and company data into your CRM or sales pipeline. Track product prices, stock, and reviews across e-commerce sites. Aggregate social signals, competitor activity, and trending content. Build large, structured datasets to train and fine-tune models. Collect job listings from LinkedIn and other boards into a single feed. Track mentions, hashtags, and sentiment across social platforms. ## Where to learn more [Sync vs async](/datasets/scrapers/concepts/sync-vs-async) [Web Scraper API vs DIY](/datasets/scrapers/concepts/web-scraper-api-vs-diy) [Library overview](/datasets/scrapers/scrapers-library/overview) [Custom inputs](/datasets/scrapers/scrapers-library/custom-inputs) [Working with sources](/datasets/scrapers/scrapers-library/working-with-sources) [API reference](/api-reference/scrapers/asynchronous-requests) [Error catalog](/datasets/scrapers/scrapers-library/error-list-by-endpoint) [FAQs](/datasets/scrapers/scrapers-library/faqs) [Delivery options](/datasets/scrapers/scrapers-library/delivery-options) [Stream and file delivery](/datasets/scrapers/scrapers-library/stream-and-file-delivery) [Deadline feature](/datasets/scrapers/scrapers-library/deadline-feature)