Tag

web-crawler

1 catalogue entry uses this topic; each Project's license policy is labeled separately.

Open-source web crawler that turns pages into LLM-ready markdown

Stars84.7K

Commitjust now

LicenseApache-2.0

Crawl4AI is a Python crawler that turns websites into clean markdown and typed JSON for RAG pipelines, AI agents, and data pipelines.

Alternative toBrowserbase