> ## Documentation Index
> Fetch the complete documentation index at: https://docs.brightdata.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Crawl API Overview

> Use Crawl API to map full domains and extract content as Markdown, HTML, or JSON. Built for AI training data, SEO audits, and content workflows.

## Key Features

* Crawl Any Domain. Extract Any Data.
* Discover and map full domain structures with a single API call
* Collect static and dynamic content in Markdown, HTML, or plain text
* Automate at scale with scheduler support and webhook delivery
* Developer-first: works with Python, Node.js, BeautifulSoup, Cheerio, and more
* No-code option available via our Control Panel

## Use Cases

* AI/LLM training data collection
* SEO audits and site structure analysis
* Competitive research and content aggregation
* Compliance and accessibility checks
* Content migration and archiving