How to Set Up Bright Data With Lindy.ai
Automate your web data workflows by integrating Bright Data with Lindy.ai. Learn how to connect APIs, trigger real-time data collection, and enhance business automation.
Expand to get your Bright Data Proxy Access Information
Expand to get your Bright Data Proxy Access Information
Your proxy access information
Bright Data proxies are grouped in “Proxy zones”. Each zone holds the configuration for the proxies it holds.
To get access to the proxy zone:
- Login to Bright Data control panel
- Select the proxy zone or setup a new one
- Click on the new zone name, and select the Overview tab.
- In the overview tab, under Access details you can find the proxy access details, and copy them to clipboard on click.
- You will need: Proxy Host, Proxy Port, Proxy Zone username and Proxy Zone password.
- Click on the copy icons to copy the text to your clipboard and paste in your tool’s proxy configuration.
Access Details Section Example
Residential proxy access
To access Bright Data’s Residential Proxies you will need to either get verified by our compliance team, or install a certificate. Read more…
Targeting search engines?
If you target a search engine like google, bing or yandex, you need a special Search Engine Results Page (SERP) proxy API. Use Bright Data SERP API to target search engines. Click here to read more about Bright Data SERP proxy API.
Correct setup of proxy test to avoid “PROXY ERROR”
In many tools you will see a “test proxy” function, which performs a conncectivity test to your proxy, and some add a geolocation test as well, to identify the location of the proxy.
To correctly test your proxy you should target those search queries to:
https://geo.brdtest.com/welcome.txt .
Some tools use popular search engines (like google.com) as a default test target. Bright Data will block those requests and you tool will show proxy error although your proxy is perfectly fine.
If your proxy test fails, this is probably the reason. Make sure that your test domain is not a search engine (this is done in the tool configuration, and not controlled by Bright Data).
What is Lindy.ai?
Lindy.ai is a no-code AI automation platform that enables users to create and deploy AI-powered agents, often referred to as “AI employees,” to automate a wide range of business tasks. These agents can handle functions such as email management, customer support, scheduling, CRM data entry, lead generation, and more, integrating seamlessly with over 200 applications including Gmail, Slack, Zoom, and HubSpot.
Why Use Bright Data With Lindy.ai?
Automate Web Data Collection Workflows
- Bright Data can scrape real-time data from websites (e.g., eCommerce, job boards, social media).
- Lindy.ai can automate when, how, and where that data is used (e.g., daily digests, alerts, CRM updates).
No-Code Integration of Complex Data Pipelines
- No need for developers or manual scripting.
- Build workflows visually in Lindy.ai using HTTP blocks to call Bright Data APIs.
Trigger Actions Based on Live Data
- Example: Scrape prices from competitor websites → If a product is cheaper than yours → Trigger a Slack alert or email team.
- Example: Monitor job postings → If a new listing matches your criteria → Add to Google Sheet or notify via SMS.
Boost Operational Efficiency
- Eliminate repetitive tasks like manual monitoring or copy-pasting scraped data.
- Your Lindy agents can act on web data automatically, 24/7.
Scalable & Reliable
- Bright Data handles proxy management, anti-bot bypassing, and data quality.
- Lindy handles logic, scheduling, and integrations with 200+ apps (CRM, Notion, Airtable, etc.).
How to Integrate Bright Data With Lindy.ai?
Prerequisites
Before starting, make sure you have:
- A Bright Data account with access to APIs (e.g., Browser API, Web Unlocker, or DCA)
- Your Bright Data API key
- A Lindy.ai account
- A basic understanding of APIs and HTTP requests
Choose and Configure Your Bright Data API
Depending on your use case, select the appropriate Bright Data API:
- Browser API – For rendering JavaScript-heavy pages
- Data Collector API (DCA) – For prebuilt scrapers
- Web Unlocker API – For bypassing anti-bot mechanisms
🔗 Example API endpoint (DCA):
Get Your Bright Data API Key
- Log in to your Bright Data dashboard.
- Navigate to API settings.
- Copy your API key.
Create a New Workflow in Lindy.ai
- Go to Lindy.ai and log in.
- Click Create Agent or New Workflow.
- Choose a Blank Workflow or start from a use-case template.
Add an HTTP Request Block
- Click “+” to add a block in your workflow.
- Select HTTP Request.
Configure as follows:
- Method:
POSTorGET(depends on API)- URL: Bright Data API endpoint (e.g., DCA trigger endpoint)
- Headers:
Authorization:Bearer <your_api_key>Content-Type:application/json- Body (if POST): JSON payload for your API
Example: Trigger a Data Collector
HTTP Request Body:
Response: Bright Data returns a collection_id, which you can use in another step fetch the results.”
Add Logic to Handle API Response
- Use Lindy’s built-in blocks to:
- Store the response
- Parse data (e.g., JSON extract)
- Trigger next steps (e.g., email, CRM update, Slack alert)
Test & Deploy
- Run the workflow with test data.
- Check response logs and tweak headers or body if needed.
- Once successful, activate the workflow or schedule it on a timer.
🎯 Bonus Use Case Example: Scrape + Notify
- Use Bright Data to scrape job listings.
- Use Lindy to filter for roles with keywords (e.g., “remote”, “Python”).
- Automatically email the relevant listings to your hiring team daily.
How to Set Up Bright Data With Lindy.ai
Automate your web data workflows by integrating Bright Data with Lindy.ai. Learn how to connect APIs, trigger real-time data collection, and enhance business automation.
Expand to get your Bright Data Proxy Access Information
Expand to get your Bright Data Proxy Access Information
Your proxy access information
Bright Data proxies are grouped in “Proxy zones”. Each zone holds the configuration for the proxies it holds.
To get access to the proxy zone:
- Login to Bright Data control panel
- Select the proxy zone or setup a new one
- Click on the new zone name, and select the Overview tab.
- In the overview tab, under Access details you can find the proxy access details, and copy them to clipboard on click.
- You will need: Proxy Host, Proxy Port, Proxy Zone username and Proxy Zone password.
- Click on the copy icons to copy the text to your clipboard and paste in your tool’s proxy configuration.
Access Details Section Example
Residential proxy access
To access Bright Data’s Residential Proxies you will need to either get verified by our compliance team, or install a certificate. Read more…
Targeting search engines?
If you target a search engine like google, bing or yandex, you need a special Search Engine Results Page (SERP) proxy API. Use Bright Data SERP API to target search engines. Click here to read more about Bright Data SERP proxy API.
Correct setup of proxy test to avoid “PROXY ERROR”
In many tools you will see a “test proxy” function, which performs a conncectivity test to your proxy, and some add a geolocation test as well, to identify the location of the proxy.
To correctly test your proxy you should target those search queries to:
https://geo.brdtest.com/welcome.txt .
Some tools use popular search engines (like google.com) as a default test target. Bright Data will block those requests and you tool will show proxy error although your proxy is perfectly fine.
If your proxy test fails, this is probably the reason. Make sure that your test domain is not a search engine (this is done in the tool configuration, and not controlled by Bright Data).
What is Lindy.ai?
Lindy.ai is a no-code AI automation platform that enables users to create and deploy AI-powered agents, often referred to as “AI employees,” to automate a wide range of business tasks. These agents can handle functions such as email management, customer support, scheduling, CRM data entry, lead generation, and more, integrating seamlessly with over 200 applications including Gmail, Slack, Zoom, and HubSpot.
Why Use Bright Data With Lindy.ai?
Automate Web Data Collection Workflows
- Bright Data can scrape real-time data from websites (e.g., eCommerce, job boards, social media).
- Lindy.ai can automate when, how, and where that data is used (e.g., daily digests, alerts, CRM updates).
No-Code Integration of Complex Data Pipelines
- No need for developers or manual scripting.
- Build workflows visually in Lindy.ai using HTTP blocks to call Bright Data APIs.
Trigger Actions Based on Live Data
- Example: Scrape prices from competitor websites → If a product is cheaper than yours → Trigger a Slack alert or email team.
- Example: Monitor job postings → If a new listing matches your criteria → Add to Google Sheet or notify via SMS.
Boost Operational Efficiency
- Eliminate repetitive tasks like manual monitoring or copy-pasting scraped data.
- Your Lindy agents can act on web data automatically, 24/7.
Scalable & Reliable
- Bright Data handles proxy management, anti-bot bypassing, and data quality.
- Lindy handles logic, scheduling, and integrations with 200+ apps (CRM, Notion, Airtable, etc.).
How to Integrate Bright Data With Lindy.ai?
Prerequisites
Before starting, make sure you have:
- A Bright Data account with access to APIs (e.g., Browser API, Web Unlocker, or DCA)
- Your Bright Data API key
- A Lindy.ai account
- A basic understanding of APIs and HTTP requests
Choose and Configure Your Bright Data API
Depending on your use case, select the appropriate Bright Data API:
- Browser API – For rendering JavaScript-heavy pages
- Data Collector API (DCA) – For prebuilt scrapers
- Web Unlocker API – For bypassing anti-bot mechanisms
🔗 Example API endpoint (DCA):
Get Your Bright Data API Key
- Log in to your Bright Data dashboard.
- Navigate to API settings.
- Copy your API key.
Create a New Workflow in Lindy.ai
- Go to Lindy.ai and log in.
- Click Create Agent or New Workflow.
- Choose a Blank Workflow or start from a use-case template.
Add an HTTP Request Block
- Click “+” to add a block in your workflow.
- Select HTTP Request.
Configure as follows:
- Method:
POSTorGET(depends on API)- URL: Bright Data API endpoint (e.g., DCA trigger endpoint)
- Headers:
Authorization:Bearer <your_api_key>Content-Type:application/json- Body (if POST): JSON payload for your API
Example: Trigger a Data Collector
HTTP Request Body:
Response: Bright Data returns a collection_id, which you can use in another step fetch the results.”
Add Logic to Handle API Response
- Use Lindy’s built-in blocks to:
- Store the response
- Parse data (e.g., JSON extract)
- Trigger next steps (e.g., email, CRM update, Slack alert)
Test & Deploy
- Run the workflow with test data.
- Check response logs and tweak headers or body if needed.
- Once successful, activate the workflow or schedule it on a timer.
🎯 Bonus Use Case Example: Scrape + Notify
- Use Bright Data to scrape job listings.
- Use Lindy to filter for roles with keywords (e.g., “remote”, “Python”).
- Automatically email the relevant listings to your hiring team daily.