Scrapers

Choose a scraper, set its inputs, and start a run.

Runs

Runs wait in a queue and start one after another, so the server never runs out of memory.

Total runs0
Running0
Succeeded0
Items collected0

Run history

Scraper Status Items Started Run ID Actions
No runs yet. Start one from the Scrapers page.
Logs
Select a run to view its logs.

Datasets

Each finished run stores its results here. Filter, inspect, and export them.

All datasets

  • No datasets yet

No dataset selected

Pick a dataset from the list to see its records.

#Data
Pick a dataset from the list.

API

Start runs and fetch results from your own code. Requests need a Firebase ID token for a signed-in user.

Request

Endpoints

POST/api/v1/actors/:id/runStart a run with the JSON body as input
GET/api/v1/runs/:runIdRun status, item count and logs
POST/api/v1/runs/:runId/abortStop a run
GET/api/v1/datasets/:datasetId/items?format=csvResults as json, csv, jsonl or xml
DELETE/api/v1/datasets/:datasetIdDelete a dataset

Settings

Workspace settings. Only admins can see this page.

Search API keys

Used by LinkedIn post leads. Keys are tried from top to bottom. A key that runs out of credits is paused for 24 hours and the next one takes over.

Order Key Status Searches Last used On Actions
No keys yet. Add one above.