pixlie / SmartCrawlerLinks
A smart web crawler built in Rust that uses Claude AI to select the most relevant URLs from website sitemaps based on crawling objectives.
☆19Updated 7 months ago
Alternatives and similar repositories for SmartCrawler
Users that are interested in SmartCrawler are comparing it to the libraries listed below
Sorting:
- ☆28Updated last year
- This repo is for the demonstration of TSCE principles.☆32Updated 3 weeks ago
- Large Language Model Thin Client☆123Updated last week
- TypeScript framework to build robust, agent-ready MCP servers around your APIs.☆26Updated 4 months ago
- AI agent web app platform☆87Updated this week
- ☆150Updated 7 months ago
- Supercompat allows you to use any AI provider like Anthropic, Groq or Mistral with OpenAI-compatible Assistants API.☆94Updated last month
- Fine-grained control over model context protocol (MCP) clients, servers, and tools. Context is God.☆113Updated 7 months ago
- Your appetite for code + Claude's capabilities = Limitless creation. No experience required - just pure hunger! 🧠⚡💻☆58Updated 7 months ago
- Humbug: building an operating system for human-AI collaboration☆88Updated this week
- Command shell driver for LLMs☆66Updated this week
- The open source chat powered by LLMs with RAG. Kollektiv makes it easy to sync your custom data sources and get accurate, contextual repl…☆88Updated 11 months ago
- Hierarchical topic segmentation of meeting transcripts using embeddings and divisive clustering.☆54Updated last year
- Agent harness framework for building, running, and verifying LLM workflows☆194Updated this week
- A web-app to explore topics using LLM (less typing and more clicks)☆67Updated this week
- Local coding agent with neat UI☆344Updated 8 months ago
- DispatchMail is an open source locally run (though currently using OpenAI for queries) AI-powered email assistant that helps you manage y…☆91Updated 4 months ago
- Open Source LLMOps tool for AI teams☆129Updated 11 months ago
- Model Context Protocol Server that allows AI models to interact with JigsawStack models!☆23Updated 6 months ago
- Welcome!☆141Updated last year
- Chat strategies for LLMs☆129Updated 3 weeks ago
- ☆64Updated 3 weeks ago
- Your AI research assistant☆79Updated 10 months ago
- Automate anything with Codex CLI in a local Docker container with cron, file watchers, webhooks, search/indexing, speech, and hundreds of…☆92Updated last month
- A discovery and compression tool for your Python codebase. Creates a knowledge graph for a LLM context window, efficiently outlining your…☆112Updated last year
- George is an API leveraging AI to make it easy to control a computer with natural language.☆50Updated last year
- CoPa: Prompt Engineering Templating Language and CLI Tool☆44Updated 5 months ago
- Branch Out Your Conversations☆58Updated last month
- ☆85Updated 6 months ago
- An introduction to DSPy☆33Updated 5 months ago