roshanlam / SpiderLinks
Web Crawler built using asynchronous Python and distributed task management that extracts and saves web data for analysis.
☆33Updated 5 months ago
Alternatives and similar repositories for Spider
Users that are interested in Spider are comparing it to the libraries listed below
Sorting:
- NoteMap: a handy tool for analyzing, organizing, and finding patterns in text files. It works with PDFs, TXTs, and DOCXs. You can also br…☆36Updated last year
- ☆22Updated last year
- Find out who is applying to the same job as you and whether you got ghosted☆51Updated last month
- Humbug: building an operating system for human-AI collaboration☆74Updated last week
- A vim-like terminal reader to chat with your books☆38Updated 10 months ago
- A simple app for downloading YouTube Shorts transcripts. Built to self-host with Python and Streamlit. Free and open source.☆33Updated 9 months ago
- An interface for llama.cpp, ChatGPT, Gemini, and Claude☆27Updated 2 weeks ago
- ☆20Updated 5 months ago
- A Python-based parallel file chunking system designed for processing large codebases into LLM-friendly chunks.☆44Updated last month
- terminal client for browsing hacker news☆26Updated 7 months ago
- A Lightweight Library for LLM I/O☆117Updated 4 months ago
- Extract structured data from any unstructured web page☆41Updated last year
- 🐝 Create powerful, collaborative AI applications.☆64Updated 10 months ago
- Crawling framework, RSS reader and parser☆149Updated this week
- Acid Reflux for your Ears!☆71Updated last year
- Machine learning library, Distributed training, Deep learning, Reinforcement learning, Models, TensorFlow, PyTorch☆69Updated this week
- DispatchMail is an open source locally run (though currently using OpenAI for queries) AI-powered email assistant that helps you manage y…☆80Updated last month
- Find your GitHub stars easily with natural language search☆59Updated 9 months ago
- AutoREADME is an AI-powered tool that genereates a README file for any given input repository.☆28Updated 11 months ago
- Markify is an open source command line application written in python which scrapes data from your social media accounts and utilises mark…☆13Updated last year
- LLM-powered bookmark search engine☆28Updated 8 months ago
- Automatic Image Classification from SERP Data☆27Updated 2 years ago
- Local & Private LLM that drafts responses LIKE you automatically☆82Updated 10 months ago
- Python library for time-series projection.☆39Updated 2 months ago
- Deploy chat-with-your-data AI agents in minutes☆58Updated this week
- 360M model running in the browser on WebGPU☆22Updated last year
- Lightweight cli coding agent☆57Updated 4 months ago
- Turn any application written in any programming language into an executable.☆55Updated 4 months ago
- ☆29Updated 3 months ago
- Collecto is an open source & self-hosted forms backend.☆51Updated 8 months ago