Weekly Release Notes

Proxy products:

🚀 Improvements

• Added option to breakdown zone statistics by domain in zone overview page:

Web Unlocker:

🆕 New features

• You can now get HTML automatically converted into Markdown Language. It’s supported both in API and native proxy interfaces. See https://docs.brightdata.com/scraping-automation/web-unlocker/features#scrape-as-markdown

Datasets:

🆕 New features

• Support for Date Expressions in Dataset Filters:You can now use date expressions in dataset filters (Relative Date), making it easier to refine your data selection based on time-based criteria. This feature is supported in both the Filter API and Dataset Subscriptions, allowing for more flexible and dynamic filtering. Example Use Case: Suppose you want to filter records to include only those from the last 7 days. You can use the “Last” expression to retrieve all records from the past week while excluding older data.

🚀 Improvements

• We have enhanced the way Personally Identifiable Information (PII) is masked to improve data security and compliance.

• Improved Quote Generation Time on Checkout Page - loading time is now faster to get quote data and quote the final price.

• Released a new checkout page. Users can now see added and updated records directly on the checkout page.

🐞 Bug Fixes

• Fixed Preview Table Errors:Resolved an issue that caused slow loading times in the dataset preview table, ensuring faster and smoother data previews.

Scrapers:

🆕 New features

• Perplexity scraper - Introducing a brand-new Perplexity Scraper, similar to our chatGPT scraper! This scraper allows customers to interact with Perplexity programmatically, retrieving responses as structured data. Now, you can automate queries and extract insights from Perplexity effortlessly. Try it here

• Monitoring system for schema changes – The first release of a monitoring and alerting system for schema changes was implemented to improve data accuracy and stability. It detects changes and sends automatic notifications to ensure seamless data operation. Expect improvements to this system in the coming weeks.

• New delivery feature for the No-Code Scraper – We’ve added delivery methods, giving no-code users more flexibility in exporting and accessing their scraped data.

🚀 Improvements

• Enhanced search option to include new result types – The search functionality now displays data points along with their respective scrapers, making it easier to identify relevant scrapers according to their outputs.

• “Deliver to external storage” is now enabled by default – To streamline workflows, external storage delivery is now automatically enabled on the web scraper API, reducing manual setup steps.

• Custom scrapers request - We simplified the request process. Now, it only requires two URLs, and the rest will be handled automatically, to try and streamline the request process

🐞 Bug Fixes

• Resolved issues affecting custom scrapers and implemented an alert system to notify partners when action is required.

• Fixed undefined URL structure – Improved URL handling to ensure consistent and well-defined structures across different pages.

Proxy products:

🆕 New features

• New API will provide the list of proxies pending replacement in advance and prepare for. Try it here: Get proxies pending replacement API.

🚀 Improvements

• Integrate faster with pre-made connect strings for proxy access details (host, port, user and password) accompanied with new set of configuration guides Integration guides.

• We added error codes to our error catalog. Find and resolve issues faster by yourself Proxy errors catalog.

• We have increased our servers deployment in Asia, and added some performance boosts.

SERP API:

🆕 New features

• Google’s Generative AI Overviews - you can now increase the likelihood of this overview appearing in your SERP results:

  • https://docs.brightdata.com/scraping-automation/serp-api/query-parameters/google#ai-overview

• Google Trends - new parameters to get more accurate widget specific data:

  • `brd_trends = timeseries,geo_map`

  • https://docs.brightdata.com/scraping-automation/serp-api/query-parameters/google#trends

Datasets:

🆕 New features

• Delta Data for Dataset Subscriptions - Customers can now enable delta logic to receive only new or updated records instead of full datasets for every collection cycle. This improves data relevance and allows flexible snapshot comparisons. No more manually identifying changes, as our system does it for you.

🚀 Improvements

• New Pricing Table - A redesigned pricing table provides clearer information, making it easier for customers to understand pricing tiers and make informed decisions.

• Enhanced Dataset Checkout Confirmation Page - The confirmation page has been fixed to ensure a smoother and more reliable checkout experience.

• Improved Error Messaging for Missing Payment Details - Customers attempting to purchase without adding payment and billing details will now receive clearer and more informative error messages.

• Refined Delivery Methods - The order of delivery options has been reorganized, and UI improvements have been made for better usability.

• Keyboard Shortcuts for “Update Dataset” - New keyboard shortcuts have been implemented to streamline dataset updates and UI enhancements for a better user experience.

• Better Data Sample Preview Table - Users can now intuitively open table rows and view object data types in a popover for improved clarity and visibility.

🐞 Bug Fixes

• Fixed Routing Bug - Unnecessary query parameters no longer persist when navigating the dataset page.

• Resolved Promotions Card UI Issue - The promotions cards now display correctly according to the intended UI layout.

Scrapers:

🆕 New features

• AI Scraper Agents – Our first AI scraper agent allows users to extract data from any website by simply providing its domain. It automatically retrieves all URLs under that domain and extracts content in HTML, Markdown, or plain text. Ideal for AI companies, researchers, and developers needing high-quality text data for training models, analysis, or content generation. Try it here

• ChatGPT scraper - Introducing a brand-new ChatGPT Scraper, similar to our SERP scrapers! This scraper allows customers to interact with ChatGPT programmatically, retrieving responses as structured data. Now, you can automate queries and extract insights from ChatGPT effortlessly. Try it here

• “Run Again” Button in Logs Page - We’ve added a “Run Again” button to the Logs page, allowing users to quickly re-run the same request with a single click. making it easier to retry failed or past jobs without manually re-entering parameters.

🚀 Improvements

• My scrapers table- Scrapers that are currently running or the most recent scraper that was in use will now appear at the top of the “My Scraper” table. This makes it easier to track active jobs without having to scroll through completed ones.

• WSA API- To improve navigation and organization, we’ve moved the “Delivery Options” section to the “Management API” tab. This change makes it more intuitive for users managing API-based data deliveries.

🐞 Bug Fixes

• If a collection job fails in the No-Code Scraper, users can now download error details to better understand what went wrong. Previously, the download button was disabled, making debugging difficult. This improvement ensures better transparency and troubleshooting.

• We’ve resolved an issue where the “Report an Issue” feature did not correctly associate snapshots with tickets. Now, when customers report a problem, the correct snapshot is automatically linked, making it easier to troubleshoot and resolve issues efficiently.

Proxy products:

🆕 New features

• HTTP3 beta is live - The proxy network was upgraded to handle HTTP3/QUIC requests. Contact Bright Data sales - sales@brightdata.com if you want to try it out!

🚀 Improvements

• It is now easier to copy your proxy credentials on the ‘overview’ tab, in different formats.

🐞 Bug Fixes

• Fix broken code examples on account management API doc playground

• Added missing documentation for endpoint and some old doc links not redirecting properly.

Datasets:

🆕 New features

• “AI Filter Assistant” allows users to filter datasets using Natural Language - just describe desired filters in English and get the relevant records.

• Payment Link Sharing – Dashboard users can now generate and share payment links, making the purchasing process easier for others (e.g. their CFO) without logging in to the control panel.

• Additional Dataset Statistics – Each Dataset now includes additional statistics regarding its content, for example: geographical distribution of records. This information is updated every month.

🚀 Improvements

• Enhanced Filtering Experience – You can now move the filter window while reviewing and refining your filters and datasets. No more hiding of the table!

• Better data sample preview – We’ve limited the cell size for better readability. You can now click on fields to expand and view the full data point in the sample dataset.

🐞 Bug Fixes

• Fixed incorrect parsing of CSV files uploaded as inputs to the filter component.

• Made sure the record count always gets updated, to show the effect of the filter.

Scrapers:

🆕 New features

• Custom scrapers - Allows users to request a custom scraper if the domain is unavailable in our marketplace. Just supply 2 URLs to get the process started - see the video!

🚀 Improvements

• An automatic email notification that is being sent after a customer triggers a scraper for the first time, for better onboarding experience.

• Added code examples in multiple languages to allow users to copy the API code in their preferred language on all of our API requests

• Reduced the number of examples from 10 to 5 in the “Overview” tab to provide a “clear” view to the users

• Bright AI: Users can now ask questions about specific use cases and receive relevant suggestions along with a direct link to the dataset.

🐞 Bug Fixes

• Fixed broken links across the Scraper pages.