How to Set Up Bright Data With WebHarvy
Integrating WebHarvey with Bright Data proxies improves automated web scraping by offering secure, flexible proxy management for seamless and reliable data extraction.
What is WebHarvy?
WebHarvy is a web scraping tool that can easily extract text, HTML, images, URLs, and emails from websites and save the extracted content in various formats. If you are running a large scraping operation, using one of the proxy services Bright Data offers will help you increase the success rates and send a lot more concurrent requests to the same target.
How to setup WebHarvy with Bright Data proxies:
- Download and install WebHarvy Web Scraper
- Go to Webharvy → Home tab → Settings → Proxy Settings
- Sign up for Bright Data’s Proxy Network
- Go to your Bright Data dashboard
- In the Integrate with Bright Data Proxy Network section, select With a crawler or a bot option
- On the API Examples page, you will see the following details:
- Proxy address, Port number, User name, and Password
- Go back to WebHarvy Proxy settings and paste the details from Bright Data to WebHarvy Proxy settings
- Click on the + button
- Click Apply
Please note: Webharvy will use proxy servers only during mining. The configuration browser of Webharvy will not use this proxy server, so if you check the IP address within the configuration browser, it will still be the original IP of your computer. To make the configuration browser use the proxy server, you should set the proxy address directly in Windows.
To disable the proxy server, you just need to uncheck the Enable Network connection via Proxy server checkbox at Webharvy → Home Menu → Settings → Proxy Settings Tab.
Alternatively, you can use our own data collection tool for a quicker and easier process.
Important note:
If you are using Bright Data’s Residential Proxies, Web Unlocker or SERP API, you need to install an SSL certificate to enable end-to-end secure connections to your target website(s).
This is a simple process, see this guide for instructions.
Was this page helpful?