Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.brightdata.com/llms.txt

Use this file to discover all available pages before exploring further.

​
Overview

This integration provides your agents with enterprise-grade capabilities for web scraping, and multi-engine search operations with bot protection bypass.

​
Prerequisites

Before you begin, ensure you have:
  • Access to IBM watsonx Orchestrate
  • A Bright Data account with an active subscription
  • Your Bright Data API key

​
Steps to Get Started

1

Obtain Your Bright Data API Key

2

Open the Agent Toolset

  • Navigate to Manage Agents in IBM watsonx Orchestrate
  • Select your agent
  • In the left menu, click Toolset
  • Click Add Tool Steps to Get Started
3

Add MCP Server Connection

In the “Add tool” dialog:
Image
  • Select MCP server
  • Click on the Add MCP server button:
    Add MCP server button in IBM watsonx Orchestrate
  • Select Remote MCP and click Next:
    Selecting Remote MCP in IBM watsonx Orchestrate
  • Choose a name for your Bright Data MCP server, add an optional description, and paste the MCP server URL including your API token, then click Connect: 
    https://mcp.brightdata.com/sse?token=<your_api_token>
    Bright Data MCP server connection details in IBM watsonx Orchestrate
4

Enable Available Capabilities

Once installation completes, multiple capabilities will appear in your agent’s toolset. Enable the following:search_enginescrape_as_markdown
5

Test Your Connection

Verify the integration is working:
  • Open your agent’s chat interface
  • Ask the agent to perform a simple task (e.g., “Search for recent AI trends”)
  • Confirm the agent successfully retrieves and processes data from Bright Data

​
Example use cases

Once search_engine and scrape_as_markdown are enabled, your IBM watsonx Orchestrate agent can handle prompts like the ones below. Each example shows the user prompt, which Bright Data tool the agent will call, and the expected outcome.

​
Search the live web with search_engine

Use search_engine when the agent needs fresh SERP results from Google, Bing or Yandex without being blocked. 
Find the top 10 results on Google for "enterprise RAG platforms 2026"
and return the title, URL and snippet for each result as a table.
Expected behavior: the agent calls search_engine, parses the SERP JSON, and replies with a structured summary. No proxy setup or CAPTCHA handling is required on your side.

​
Extract page content with scrape_as_markdown

Use scrape_as_markdown when the agent needs the full content of a known URL, including pages protected by bot detection. 
Scrape https://www.ibm.com/products/watsonx-orchestrate and summarize
the key features and pricing tiers in a 5-bullet executive briefing.
Expected behavior: the agent calls scrape_as_markdown with the URL, receives clean markdown, and extracts the requested fields. Pages that would normally trigger CAPTCHAs or 403 responses are handled by Bright Data’s Unlocker infrastructure.

​
Combine both tools in one task

The agent can chain search_engine and scrape_as_markdown to answer multi-step questions.
Research workflow
Search Google for "top 5 vector databases 2026", then scrape the
homepage of each result and produce a comparison table with: product
name, pricing model, supported languages and a one-sentence positioning
statement.
The agent first calls search_engine to get the URLs, then calls scrape_as_markdown once per URL, then synthesizes the comparison. This pattern works for competitor analysis, lead enrichment and content aggregation flows.

​
What you can do next

Your agent is now connected to Bright Data and ready to:
  • Extract structured data from major platforms
  • Perform geo-targeted web searches
  • Scrape website content while bypassing bot protection
  • Process large-scale data extraction tasks

​
Where to get support

Need help? Contact Bright Data support or refer to the Bright Data documentation for detailed API references and troubleshooting guides.