我们的网页抓取工具 API 提供两种选择:发现 (发现型抓取工具) 型抓取工具和产品详情页 (PDP 抓取工具 抓取工具) 抓取工具,了解如何使用此类 API 触发数据采集。 您可自定义请求、设置交付选项并高效检索数据。
端点:POST /datasets/v3/trigger
创建数据采集请求。
Example: dataset_id=gd_l1vikfnt1wgvvqz95w
type=discover_new
should always be sent when discover_by
is provided.
Example: type=discover_new
type=discover_new
Example:discover_by=keyword
Available options:
keyword
,best_sellers_url
,category_url
,location
and more (according to the specific API)
Example: discover by keywords - limit to 10 results per keyword
Example: include_errors=true
snapshot_id
and status
.
Example: notify=https://notify-me.com/
notify
URL or delivering data via webhook endpoint
Example: auth_header=QWxhZGRpbjpPcGVuU2VzYW1l
Example: endpoint=https://webhook-url.com
Supported formats:JSON
,NDJSON
,JSONL
,CSV
Example:format=json
Example: uncompressed_webhook=true
PDP 抓取工具 抓取工具
with URL inputPDP 抓取工具 抓取工具
is always a URL, pointing to the page to be scraped.
discovery
methoddiscovery
can vary according to the specific scraper. 其输入格式可以为:
snapshot_id
, which represents the ID of your request and can be used in the next APIs.