Aavache / LLMWebCrawlerLinks
A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG.
☆95Updated last year
Alternatives and similar repositories for LLMWebCrawler
Users that are interested in LLMWebCrawler are comparing it to the libraries listed below
Sorting:
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆126Updated 8 months ago
- Using Langroid's Multi-Agent Framework to Build LLM Apps☆139Updated last month
- ☆60Updated last year
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆180Updated 6 months ago
- CAMEL framework-based multi-agent system for task-driven and dynamic environments☆96Updated last year
- ☆46Updated last year
- A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…☆83Updated last year
- A fork of OpenAI Swarm that supports Groq and Anthropic☆121Updated 4 months ago
- build_startup_using_AI_Agents☆46Updated last year
- Open Sourced NoteBookLM☆59Updated 8 months ago
- OpenAI document chatbot using llama-index, pinecone and chainlit. With incremental features, giving you the tools to go from a basic RAG …☆73Updated last year
- Chat Bot with LLM and Fact Reference. RAG(Retrieval Augmented Generation) and LangChain backed☆129Updated last year
- Crawl and convert any website into clean markdown☆53Updated last year
- This repository holds enhanced Agents, built for the Microsoft AutoGen Framework. Debuting with a MemoryEnabledAgent with improvements in…☆115Updated last year
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆92Updated 8 months ago
- Run CrewAI agent workflows on local LLM models with Llamafile and Ollama☆40Updated last year
- A Function Calls Proxy for Groq, the fastest AI alive!☆201Updated last year
- A Chat App built with embedchain and streamlit☆41Updated last year
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆145Updated last year
- High level tool use for LLMs☆34Updated 10 months ago
- A library to extract the main content from html. Developed for information on LLM and for feeding data into LangChain and LlamaIndex.☆42Updated last year
- low-code multi-agent automation framework☆255Updated last year
- A list of AI memory projects☆146Updated 5 months ago
- A tool for querying and interacting with PDF documents using AI. This application uses natural language processing to provide contextuall…☆113Updated 3 months ago
- Custom Websearch Agent Built with Local Models, vLLM, and OpenAI☆135Updated last year
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆104Updated 6 months ago
- Lightweight and Flexible Library for Creating Agents and Multi-Agent Conversations 🤖☆25Updated last week
- Visual node-edge graph GUI editor for LangGraph and run with local LLM or online API☆185Updated 2 weeks ago
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆128Updated last year
- A framework for agentic workflow creation and deployment☆236Updated 5 months ago