How to Set Up Bright Data With NGINX

​

What is NGINX?

NGINX is a high-performance web server and reverse proxy used for load balancing, caching, and securing connections. By integrating NGINX with Bright Data, you can mask proxy domains, route traffic seamlessly, and optimize your infrastructure for better performance.

​

How to Set Up Bright Data With NGINX

Step 1. Install NGINX

1. Install NGINX on your server following the official installation guide. Ensure you’re using version 1.15.10 or higher.

3. Verify that your server’s IP is not added to the Bright Data proxy whitelist to avoid conflicts.

Step 2. Configure the NGINX Core Settings

1. Open the main NGINX configuration file:

sudo nano /etc/nginx/nginx.conf

2. Update the following parameters:

• Set worker_processes to auto for dynamic optimization.

• Set worker_connections to 200 (or more, depending on your required number of ports).

3. At the end of the http section, add:

include /etc/nginx/sites-enabled/*;

4. Save the changes and exit the editor.

5. Your updated nginx.conf should look like this:

worker_processes  auto;
user              www-data;

error_log         /var/log/nginx/error.log info;
events {
    worker_connections 200;
}

http {
    include         /etc/nginx/mime.types;
    access_log      /var/log/nginx/access.log combined;

    server {
        server_name   localhost;
        listen        127.0.0.1:80;
        error_page    500 502 503 504  /50x.html;
    }

    include /etc/nginx/sites-enabled/*;
}

Step 3. Create a Proxy Configuration File

1. Create the directory for custom configurations:

sudo mkdir -p /etc/nginx/sites-enabled

2. Create a new configuration file:

sudo nano /etc/nginx/sites-enabled/brightdata.conf

3. Add the following configuration to the file, adjusting the port range as needed:

server {
    listen 24000-24100;
    location / {
        resolver 8.8.8.8;
        proxy_pass http://127.0.0.1:$server_port;
        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
    }
}

3. Save and close the file.

Step 4. Restart NGINX

1. Apply the changes by restarting NGINX:

sudo service nginx restart

Step 5. Test the Proxy Configuration

1. Verify the proxy connection with the following command, replacing 10.0.2.15 with your server’s IP:

curl --proxy http://10.0.2.15:24000 "http://lumtest.com/myip.json" -v

2. Confirm that the response includes the expected proxy IP and location.

Expected output:

{
  "ip": "43.252.31.41",
  "country": "US",
  "asn": {
    "asnum": 207990,
    "org_name": "HostRoyale Technologies Pvt Ltd"
  },
  "geo": {
    "city": "Chicago",
    "region": "IL",
    "region_name": "Illinois",
    "postal_code": "60602",
    "latitude": 41.8874,
    "longitude": -87.6318,
    "tz": "America/Chicago",
    "lum_city": "chicago",
    "lum_region": "il"
  }
}

Step 4. Restart NGINX

1. To ensure that traffic routes through NGINX, monitor your proxy manager logs.

2. Confirm that the “sent from” IP matches your NGINX server’s IP address.

Your Bright Data are now successfully integrated with NGINX, providing secure, efficient traffic routing and domain masking. This setup is ideal for optimizing web scraping, load balancing, and secure proxy management. Enjoy streamlined operations!