BuilderIO / gpt-crawler
Crawl a site to generate knowledge files to create your own custom GPT from a URL
β20,545Updated this week
Alternatives and similar repositories for gpt-crawler:
Users that are interested in gpt-crawler are comparing it to the libraries listed below
- π₯ Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.β22,924Updated this week
- A collection of GPT system prompts and various prompt injection/leaking knowledge.β8,486Updated last week
- Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)β67,303Updated this week
- ππ€ Crawl4AI: Open-source LLM Friendly Web Crawler & Scraperβ27,286Updated this week
- The Memory layer for your AI appsβ24,137Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your pβ¦