Aavache / LLMWebCrawlerLinks
A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG.
☆95Updated 2 years ago
Alternatives and similar repositories for LLMWebCrawler
Users that are interested in LLMWebCrawler are comparing it to the libraries listed below
Sorting:
- low-code multi-agent automation framework☆265Updated last month
- Your fully proficient, AI-powered and local chatbot assistant🤖☆248Updated last year
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆189Updated last year
- A list of AI memory projects☆258Updated 11 months ago
- A toolkit for building computer use AI agents☆180Updated 5 months ago
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆147Updated last year
- CAMEL framework-based multi-agent system for task-driven and dynamic environments☆105Updated last year
- Using Langroid's Multi-Agent Framework to Build LLM Apps☆145Updated 5 months ago
- A fork of OpenAI Swarm that supports Groq and Anthropic☆124Updated 10 months ago
- openperplex is an opensource AI search engine☆171Updated last year
- Research assistant for performing online research on a given topic, using Llamaindex Workflows and Tavily API. Inspired by GPT-Researcher☆168Updated last year
- Build Agents That Recall What Matters. Systematically engineer relevant context from chat history & business data. (Python Client)☆170Updated this week
- Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.☆385Updated last year
- Streamlit demo of Scrapegraph-ai for GPT4-hackaton☆107Updated this week
- Visual node-edge graph GUI editor for LangGraph and run with local LLM or online API☆223Updated last month
- Groqqle is a powerful web search and content summarization tool built with Python, leveraging Groq's LLM API for advanced natural languag…☆148Updated 9 months ago
- Not Diamond Python SDK☆89Updated last week
- Chat Bot with LLM and Fact Reference. RAG(Retrieval Augmented Generation) and LangChain backed☆129Updated last year
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆132Updated last year
- The easiest, and fastest way to run AI-generated Python code safely☆348Updated last year
- 🚀 The LLM Automatic Computer Framework: L2MAC☆144Updated 11 months ago
- A Function Calls Proxy for Groq, the fastest AI alive!☆206Updated last year
- A bot with memory, built on LangGraph Cloud.☆141Updated last year
- RESTai is an AIaaS (AI as a Service) open-source platform. Built on top of LlamaIndex & Langchain. Supports any public LLM supported by L…☆439Updated 3 months ago
- This project is a **proof of concept** that aims to replicate the reasoning capabilities of OpenAI's newly released O1 model.☆90Updated 10 months ago
- Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web scraping, image & webpage links extr …☆260Updated 3 weeks ago
- Teach LangChain using LangChain!☆270Updated 2 years ago
- ☆112Updated last year
- Structured information extraction from documents☆319Updated last year
- RAG example using DSPy, Gradio, FastAPI☆86Updated last year