spider-rs / spider-py
Spider ported to Python
โ63Updated this week
Alternatives and similar repositories for spider-py:
Users that are interested in spider-py are comparing it to the libraries listed below
- ๐๐ช๐ง๐ฃ๐๐ฃ๐ ๐จ๐ข๐๐ก๐ก ๐ฉ๐๐จ๐ ๐๐๐จ๐๐ง๐๐ฅ๐ฉ๐๐ค๐ฃ๐จ ๐๐ฃ๐ฉ๐ค ๐ข๐๐๐ ๐ฅ๐ง๐ค๐ข๐ฅ๐ฉ๐จ ๐๐ช๐ฉ๐ค๐ข๐ ๐๐๐๐๐ก๐ก๐ฎ.โ55Updated 6 months ago
- Pare is the easiest way to deploy Python Lambdas alongside your primary web application.โ48Updated 5 months ago
- converts url content into JSON with a simple prefixโ66Updated 8 months ago
- Remote web browser automation.โ20Updated 7 months ago
- โ17Updated last month
- Local & Private LLM that drafts responses LIKE you automaticallyโ75Updated 2 months ago
- Build reliable, secure, and production-ready AI apps easily.โ57Updated 2 weeks ago
- 90% of what you need for LLM app development. Nothing you don't.โ236Updated this week
- A discovery and compression tool for your Python codebase. Creates a knowledge graph for a LLM context window, efficiently outlining yourโฆโ71Updated last month
- A Lightweight Library for LLM I/Oโ106Updated 2 weeks ago
- Convert all files in git repository to .txt files. Useful for training LLMs on your codebase.โ37Updated last month
- Access the Cohere Command R family of modelsโ34Updated 9 months ago
- The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawlerโ106Updated last month
- โ40Updated this week
- โ57Updated 4 months ago
- A framework for hosting and scaling AI agents.โ28Updated 2 months ago
- Turns an Airtable base into a WebGL knowledge graph leveraging relational columnsโ35Updated 8 months ago
- The open source chat powered by LLMs with RAG. Kollektiv makes it easy to sync your custom data sources and get accurate, contextual replโฆโ74Updated this week
- ElasticSearch agent based on ElasticSearch, LangChain and ChatGPT 4โ43Updated last year
- SynerGPT demonstrates the power of collaboration between two or more Large Language Models (LLMs) to efficiently solve complex problems aโฆโ23Updated 9 months ago
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full โฆโ75Updated this week
- A guidance compatibility layer for llama-cpp-pythonโ34Updated last year
- Clean, filter and sample URLs to optimize data collection โ Python & command-line โ Deduplication, spam, content and language filtersโ133Updated last month
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing dโฆโ141Updated 9 months ago
- GuardRail: Advanced tool for data analysis and AI content generation using OpenAI GPT models. Features sentiment analysis, content classiโฆโ126Updated last year
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-tโฆโ29Updated 8 months ago
- โ27Updated 7 months ago
- Virtual environment stacks for Pythonโ210Updated 3 weeks ago
- Template for a new generative ai project using streamlit, fastapi, llms (cloud & local) with evaluation & redteaming toolsโ43Updated 3 weeks ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing โกโ63Updated 2 months ago