Skip to main content

How to scrape with the CLI

Get clean content from any website

How to scrape with geo-targeting

How to take screenshots


How to run search workflows

Pagination


How to run browser workflows

Interact with pages

How to compare multiple sessions

Extract content from dynamic pages


Structured data extraction

How to find a pre-built scraper

brightdata pipelines runs any of the thousands of pre-built Scraper API scrapers. Look up the scraper first, then read the input fields of the method you want:
collect_by_url returns one record per URL. discover_by_* methods return many records per input, up to --limit-per-input (default 10). Use method names exactly as info lists them. An unknown field or a missing required field stops the command before the run starts, so nothing is billed.

How to extract e-commerce data

Social media profiles

Reviews and comments

Records with an error field explain inputs that failed, such as a URL of the wrong type.

Piping and automation

The CLI is designed to be pipe-friendly. When stdout is not a TTY, colors and spinners are automatically disabled.

Chain search → scrape

Scrape and read in terminal

Export to CSV for analysis

Extract specific fields with jq

Async jobs for heavy workloads


How to manage your account

Monitor costs

Manage configuration


AI agent integration

Add the MCP server to your coding agent

Install skills into coding agents

Skills are pre-packaged bundles of prompts and configuration that teach AI coding agents how to use Bright Data effectively. See For your coding agent and github.com/brightdata/skills for more details.

Supported environment variables

Override any stored configuration with environment variables: