Documentation IndexFetch the complete documentation index at: /llms.txtUse this file to discover all available pages before exploring further.
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
cURL
curl --request POST \ --url https://api.example.com/scrape \ --header 'Content-Type: application/json' \ --data ' { "url": "<string>", "provider": "<string>" } '
{ "jobId": "<string>" }
Trigger a web scraping job to ingest content from a URL.
firecrawl
{ "url": "https://example.com/docs" }
{ "jobId": "job-789", "status": "queued" }