Skip to main content
GET
https://api.getcatalog.ai
/
v2
/
crawl
# Get all executions
curl -X GET "https://api.getcatalog.ai/v2/crawl" \
  -H "x-api-key: $CATALOG_API_KEY"

# Get only completed executions
curl -X GET "https://api.getcatalog.ai/v2/crawl?status=completed" \
  -H "x-api-key: $CATALOG_API_KEY"

# Get first 50 executions
curl -X GET "https://api.getcatalog.ai/v2/crawl?page_size=50" \
  -H "x-api-key: $CATALOG_API_KEY"
{
  "data": [
    {
      "execution_id": "crawl-skims-com-4ddfa1c9",
      "status": "processing",
      "created_at": "2026-01-09T23:45:35.570072+00:00"
    }
  ],
  "pagination": {
    "page": 1,
    "page_size": 20,
    "total_items": 1,
    "total_pages": 1,
    "has_next": false,
    "has_prev": false
  },
  "meta": {}
}
When to use: Monitor all your crawl operations in one place. Use this endpoint to:
  • See all crawl executions you’ve started
  • Filter by status (processing, completed, failed)
  • Track when crawls were initiated
  • Find execution IDs for status checks

Request

x-api-key
string
required
Your API key for authentication

Query Parameters

status
string
Filter executions by status. Possible values: "processing", "completed", "failed"Note: If not provided, all executions are returned regardless of status.
page_size
number
Number of executions to return per page (default: 20)Note: Executions are returned in reverse chronological order (most recent first).

Response

data
array
Array of execution summary objects
pagination
object
Pagination information for the response
meta
object
Metadata object (currently empty for this endpoint)
# Get all executions
curl -X GET "https://api.getcatalog.ai/v2/crawl" \
  -H "x-api-key: $CATALOG_API_KEY"

# Get only completed executions
curl -X GET "https://api.getcatalog.ai/v2/crawl?status=completed" \
  -H "x-api-key: $CATALOG_API_KEY"

# Get first 50 executions
curl -X GET "https://api.getcatalog.ai/v2/crawl?page_size=50" \
  -H "x-api-key: $CATALOG_API_KEY"
{
  "data": [
    {
      "execution_id": "crawl-skims-com-4ddfa1c9",
      "status": "processing",
      "created_at": "2026-01-09T23:45:35.570072+00:00"
    }
  ],
  "pagination": {
    "page": 1,
    "page_size": 20,
    "total_items": 1,
    "total_pages": 1,
    "has_next": false,
    "has_prev": false
  },
  "meta": {}
}