Gain better control over data collection from your website
Category | Description | Applicable Fields |
---|---|---|
Personal Information | Endpoints containing information which are related to an identified or identifiable natural person. | URL / Document Object |
Disallow | List interactive endpoint patterns such as ad links, likes, reviews, and posts. This instruction enables BrightBot to block these endpoints, aligning with our guidelines that prohibit data collection from these areas. | URL / Document Object |
Load | Report your organic traffic load on specific domains or subdomains and on specific time frames. Bright Bot will use this information instead of public load statistics when deciding how it should rate limit itself. | URL / Document Object Rate Time-frame |
Traffic peak time | Define time slots of peak organic traffic, reducing data collection during these times. | URL / Document Object Date | Weekday | Any Start time / End time |