在请求级别选择交付类型

1

更新您的爬虫

确保您的爬虫已更新到最新版本以提高成功率

2

将交付类型设置为批处理

当交付类型设置为实时时，批处理 API 将返回以下错误消息。

Error

"error": "Cannot trigger a batch job with a real-time scraper. Use /trigger_immediate endpoint instead"

3

使用首选 API 触发爬虫

启动批处理任务
启动实时任务

dca/trigger为批处理收集方法触发爬虫

curl "https://api.brightdata.com/dca/trigger?collector=ID_COLLECTOR&queue_next=1" -H "Content-Type: application/json" -H "Authorization: Bearer API_KEY" -d '[{"url":"https://targetwebsite.com/product_id/"}]'

{
    "collection_id":"j_l3daejgw1wnpjxxxxx",
    "start_eta":"2022-05-19T17:28:48.056Z"
}

dca/trigger_immediate为实时收集触发爬虫

curl "https://api.brightdata.com/dca/trigger_immediate?collector=ID_COLLECTOR" -H "Content-Type: application/json" -H "Authorization: Bearer API_KEY" -d '{"url":"https://targetwebsite.com/product_id/"}'

{
    "response_id":"z2805t1652973963340rg6252xxxxxx"
}

批处理响应以 j_**** 开头，实时响应以 z**** 开头

4

接收数据

概览

产品

管理 API

在请求级别选择交付类型