Crawl4AIAIOpen
Open-source web crawler that turns pages into LLM-ready markdown
Crawl4AI is a Python crawler that turns websites into clean markdown and typed JSON for RAG pipelines, AI agents, and data pipelines.
Tag
7 catalogue entries use this topic; each Project's license policy is labeled separately.
Open-source web crawler that turns pages into LLM-ready markdown
Crawl4AI is a Python crawler that turns websites into clean markdown and typed JSON for RAG pipelines, AI agents, and data pipelines.
Headless browser built from scratch for AI agents and automation
Lightpanda is an AGPL-3.0-only headless browser written from scratch in Zig for AI agents and automation, driven via CDP and a JavaScript API.
Open-source AI agents that complete workflows in a real browser
Skyvern is a self-hosted AI platform that completes browser workflows with vision models, with a Playwright-compatible SDK and a managed cloud option.
No-code browser extension that automates repetitive web tasks
Automa is a no-code browser extension that automates repetitive web work by connecting visual blocks into workflows that run on demand or on a schedule.
Open-source no-code platform that turns websites into structured APIs
Maxun is an open-source web data platform that turns websites into structured APIs through no-code robots, full-site crawling, search, change monitoring, and agent-ready SDKs.
Open-source browser API for AI agents and apps
Steel is an open-source browser API for AI agents and apps, with managed cloud sessions or a self-hosted Docker image.
Self-hosted SERP API returning Google, Bing, and Yandex results as JSON
OpenSERP is a self-hosted, MIT-licensed SERP API that returns Google, Bing, Yandex, and other engine results as structured JSON for AI agents and SEO tools.