Reddit scraper quickstart

This tutorial shows you how to scrape a Reddit post and get structured JSON data using the Bright Data Reddit Scraper API.

Prerequisites

A Bright Data account
cURL, Python 3 or Node.js 18+ installed

Get your API key

Go to the user settings page in your Bright Data account and create an API key, or use one you already have.If you don’t have an account yet, sign up at brightdata.com. New accounts get 5,000 free credits every month, no credit card required. See the free tier.

Your API key is shown only once when created. Copy and store it securely.

Send a request

We’ll use the Posts, Collect by URL endpoint with a synchronous request. Replace YOUR_API_KEY with your API key:

curl -X POST \
  "https://api.brightdata.com/datasets/v3/scrape?dataset_id=gd_lvz8ah06191smkebj4&format=json" \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '[{"url": "https://www.reddit.com/r/learnpython/comments/1w8chn8/found_a_for_loop_and_cant_find_an_explanation_can/"}]'

import requests

response = requests.post(
    "https://api.brightdata.com/datasets/v3/scrape",
    params={"dataset_id": "gd_lvz8ah06191smkebj4", "format": "json"},
    headers={
        "Authorization": "Bearer YOUR_API_KEY",
        "Content-Type": "application/json",
    },
    json=[{"url": "https://www.reddit.com/r/learnpython/comments/1w8chn8/found_a_for_loop_and_cant_find_an_explanation_can/"}],
)

data = response.json()
if response.status_code == 202:
    print(f"Job running. Snapshot ID: {data['snapshot_id']}")
else:
    print(data)

const response = await fetch(
  "https://api.brightdata.com/datasets/v3/scrape?dataset_id=gd_lvz8ah06191smkebj4&format=json",
  {
    method: "POST",
    headers: {
      "Authorization": "Bearer YOUR_API_KEY",
      "Content-Type": "application/json",
    },
    body: JSON.stringify([
      { url: "https://www.reddit.com/r/learnpython/comments/1w8chn8/found_a_for_loop_and_cant_find_an_explanation_can/" }
    ]),
  }
);

const data = await response.json();
if (response.status === 202) {
  console.log(`Job running. Snapshot ID: ${data.snapshot_id}`);
} else {
  console.log(data);
}

You should see a 200 status code and a JSON array. A 202 means the scrape needs longer than 1 minute; see the note below. Processing time varies with target-site conditions and scraper workload.

A synchronous request waits up to 1 minute. If the Bright Data Reddit Scraper API needs longer, the response is HTTP 202 with a snapshot_id instead of post data, and collection continues asynchronously. Fetch the result with the async workflow or have it pushed to you with webhook delivery.

Review the response

The Bright Data Reddit Scraper API returns a JSON array with structured post data:

[
  {
    "post_id": "t3_1w8chn8",
    "url": "https://www.reddit.com/r/learnpython/comments/1w8chn8/found_a_for_loop_and_cant_find_an_explanation_can/",
    "user_posted": "xq_***x",
    "title": "found a for loop and can't find an explanation. Can someone explain, please?",
    "description": "Hey there, I just started the Project Euler Archive and started with the classic \"Find the sum of all the multiples of 3 or 5 below 1000.\" And when I wanted...",
    "num_upvotes": 8,
    "num_comments": 14,
    "date_posted": "2026-09-05T21:03:33.625Z",
    "community_name": "learnpython",
    "community_url": "https://www.reddit.com/r/learnpython/"
  }
]

Each post object includes post details, community stats, engagement metrics and attached media. See the full response schema.

You’ve successfully scraped your first Reddit post using the Bright Data Reddit Scraper API.

Common questions

Can I scrape multiple posts in one request?

Yes. Add more objects to the input array. Synchronous requests support up to 20 URLs. For larger batches or for discovery by keyword or subreddit, use the async /trigger endpoint.

[
  {"url": "https://www.reddit.com/r/learnpython/comments/1w8chn8/found_a_for_loop_and_cant_find_an_explanation_can/"},
  {"url": "https://www.reddit.com/r/python/comments/1bsdf34/"},
  {"url": "https://www.reddit.com/r/programming/comments/1csdf56/"}
]

Can I scrape comments from a post?

Yes, with the separate Comments dataset. Use dataset ID gd_lvzdpsdlw09j6t702 and pass the post URL:

curl -X POST \
  "https://api.brightdata.com/datasets/v3/scrape?dataset_id=gd_lvzdpsdlw09j6t702&format=json" \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '[{"url": "https://www.reddit.com/r/learnpython/comments/1w8chn8/found_a_for_loop_and_cant_find_an_explanation_can/"}]'

You can also pass days_back to limit results to comments posted within the last N days.

Getting a 401 or 403 error?

Verify your API key is correct and hasn’t expired. Create a new API key in Account settings. See the authentication guide for details.

Request is timing out?

Synchronous requests have a 1-minute timeout. If the request exceeds this limit, the API returns HTTP 202 with a snapshot_id and finishes the job asynchronously. Use the async workflow for large batches.

Empty or partial response data?

Verify the Reddit post URL is publicly accessible and correctly formatted. The URL should follow the pattern https://www.reddit.com/r/{subreddit}/comments/{post_id}/{slug}/. Private subreddits and deleted posts cannot be scraped.

Do I have to call the API directly?

No. The Bright Data SDKs, the CLI and coding-agent tools call the same Scraper API, so you can start from whichever fits your stack.

Client	Install	First call
Python and Node.js SDK	`pip install brightdata-sdk` or `npm install @brightdata/sdk`	`client.scrape.reddit.posts(url="https://www.reddit.com/r/learnpython/comments/1w8chn8/found_a_for_loop_and_cant_find_an_explanation_can/")`; see the Python SDK and JavaScript SDK
CLI	`npm install -g @brightdata/cli`, then `bdata login`	`bdata pipelines reddit_posts "https://www.reddit.com/r/learnpython/comments/1w8chn8/found_a_for_loop_and_cant_find_an_explanation_can/" --pretty`; see the CLI commands
Coding agents	`npx skills add brightdata/skills` installs the skills; the Bright Data MCP server exposes the scrapers as tools	See the coding agent quickstart

Next steps

Endpoints

One request per endpoint, each with a captured response.

Async batch requests

Scrape hundreds of posts or run keyword discovery in a single batch job.

API reference

Endpoint specs, parameters and response schemas.

Get started

Data extraction

AI training data

Proxy networks

Prerequisites

Common questions

Can I scrape multiple posts in one request?

Can I scrape comments from a post?

Getting a 401 or 403 error?

Request is timing out?

Empty or partial response data?

Do I have to call the API directly?

Next steps

Endpoints

Async batch requests

API reference

​Prerequisites

​Common questions

​Can I scrape multiple posts in one request?

​Can I scrape comments from a post?

​Getting a 401 or 403 error?

​Request is timing out?

​Empty or partial response data?

​Do I have to call the API directly?

​Next steps

Endpoints

Async batch requests

API reference

Prerequisites

Common questions

Can I scrape multiple posts in one request?

Can I scrape comments from a post?

Getting a 401 or 403 error?

Request is timing out?

Empty or partial response data?

Do I have to call the API directly?

Next steps