Scraping API

Web scraping API with JS rendering, stealth anti-bot bypass, and full spider toolkit. Search the web, fetch pages as clean markdown/text/html, extract data via CSS selectors, crawl entire sites, and discover URLs. ## Endpoints - POST /search — Web search via DuckDuckGo - POST /fetch — Fetch a URL (markdown/text/html) with optional JS render + stealth - POST /extract — Extract data via CSS selector - POST /crawl — BFS website crawling with depth/pages limits - POST /map — URL discovery via sitemaps and link parsing - GET /usage — View API usage ## Auth Pass your API key as: Authorization: Bearer <key> ## Features - JS Rendering with Playwright for dynamic sites - Anti-bot stealth mode bypasses basic detection - No vendor lock-in — fully self-hostable ## Examples Search: curl -H "Authorization: Bearer <key>" -d "{\"query\":\"web scraping\"}" /search Fetch with JS render: curl -H "Authorization: Bearer <key>" -d "{\"url\":\"https://example.com\",\"js_render\":true}" /fetch