AI web scrapers documentation

This page lists the AI answer engines the Bright Data Scraper API can scrape by prompt and what each scraper returns.

Which AI scrapers are available

Bright Data has a scraper for each of these AI answer engines:

Each scraper takes a prompt as input and returns the engine’s answer as a record. What else the record carries differs by engine:

Scraper	What it returns	Includes
ChatGPT Scraper	Answer from OpenAI’s ChatGPT.	Hyperlinks Citations (when available) Product recommendations Embedded map data Available countries
Perplexity Scraper	Answer from Perplexity.	Hyperlinked citations for verification Available countries
Copilot Scraper	Answer from Microsoft Copilot.	Hyperlinked citations Contextual explanations Available countries
Gemini Scraper	Answer from Google Gemini, which may run a web search.	Web-based citations and sources Hyperlinked references (when available) Country targeting (European countries not available)
Google AI Scraper	Google AI Mode search result for the prompt.	Available countries
Grok Scraper Currently unavailable	Answer from Grok.	Hyperlinked citations Available countries

Web search control varies by scraper. ChatGPT and Grok support a web_search input that allows or disables live web search, and a web_search_triggered output that confirms whether a search actually ran. See Query fan-out and web search control for full details, plus the availability matrix for Google AI Mode and other LLM Scrapers. Gemini does not currently expose a web_search control, the decision is made internally by Gemini and prompt phrasing may influence whether a web search is triggered.

Pending review

Unreachable pages

AI web scrapers documentation

Which AI scrapers are available

​Which AI scrapers are available

Which AI scrapers are available