roshanlam / SpiderLinks
Web Crawler built using asynchronous Python and distributed task management that extracts and saves web data for analysis.
☆33Updated 5 months ago
Alternatives and similar repositories for Spider
Users that are interested in Spider are comparing it to the libraries listed below
Sorting:
- NoteMap: a handy tool for analyzing, organizing, and finding patterns in text files. It works with PDFs, TXTs, and DOCXs. You can also br…☆36Updated last year
- ☆22Updated last year
- ☆20Updated 4 months ago
- terminal client for browsing hacker news☆26Updated 6 months ago
- Extract structured data from any unstructured web page☆41Updated last year
- A simple app for downloading YouTube Shorts transcripts. Built to self-host with Python and Streamlit. Free and open source.☆32Updated 8 months ago
- AutoREADME is an AI-powered tool that genereates a README file for any given input repository.☆28Updated 10 months ago
- A Python-based parallel file chunking system designed for processing large codebases into LLM-friendly chunks.☆43Updated 2 weeks ago
- Local & Private LLM that drafts responses LIKE you automatically☆81Updated 9 months ago
- Find your GitHub stars easily with natural language search☆59Updated 8 months ago
- A Lightweight Library for LLM I/O☆117Updated 4 months ago
- 🐝 Create powerful, collaborative AI applications.☆64Updated 9 months ago
- Find out who is applying to the same job as you and whether you got ghosted☆51Updated 2 weeks ago
- A vim-like terminal reader to chat with your books☆38Updated 9 months ago
- Crawling framework, RSS reader and parser☆145Updated this week
- I’m trying to create something similar to Grammarly. Hail to open source!☆16Updated 2 months ago
- Turn any input document into a sophisticated, context-dependent mindmap that distills the meaning and structure of the document.☆86Updated 6 months ago
- DispatchMail is an open source locally run (though currently using OpenAI for queries) AI-powered email assistant that helps you manage y…☆77Updated last month
- Turn any application written in any programming language into an executable.☆55Updated 3 months ago
- An interface for llama.cpp, ChatGPT, Gemini, and Claude☆28Updated 2 weeks ago
- An fully autonomous agent that accesses the browser and performs tasks.☆17Updated 4 months ago
- Data Neuron is a powerful framework that enables you to build text-to-SQL applications with an easily maintainable semantic layer. Whethe…☆44Updated last year
- A Python package for zero-shot text anonymization using Transformer-based NER models.☆68Updated last month
- Boost Your Productivity with Nyro☆109Updated 11 months ago
- tsellm: LLMs in SQLite and DuckDB☆25Updated 4 months ago
- Acid Reflux for your Ears!☆71Updated last year
- Brower extension to convert web pages to clean Markdown and copy to clipboard so you can feed it to your favorite LLM model as context wi…☆167Updated 2 months ago
- ☆52Updated 5 months ago
- Deidentify people's names and gender specific pronouns☆41Updated 3 months ago
- Machine learning library, Distributed training, Deep learning, Reinforcement learning, Models, TensorFlow, PyTorch☆68Updated this week