roshanlam / SpiderLinks
Web Crawler built using asynchronous Python and distributed task management that extracts and saves web data for analysis.
☆34Updated 7 months ago
Alternatives and similar repositories for Spider
Users that are interested in Spider are comparing it to the libraries listed below
Sorting:
- NoteMap: a handy tool for analyzing, organizing, and finding patterns in text files. It works with PDFs, TXTs, and DOCXs. You can also br…☆36Updated last year
- ☆22Updated last year
- terminal client for browsing hacker news☆26Updated 8 months ago
- ☆20Updated 6 months ago
- Find your GitHub stars easily with natural language search☆59Updated 10 months ago
- Acid Reflux for your Ears!☆71Updated last year
- A Python-based parallel file chunking system designed for processing large codebases into LLM-friendly chunks.☆44Updated 2 months ago
- Turn any application written in any programming language into an executable.☆55Updated 5 months ago
- Humbug: building an operating system for human-AI collaboration☆82Updated last week
- A simple app for downloading YouTube Shorts transcripts. Built to self-host with Python and Streamlit. Free and open source.☆33Updated 10 months ago
- Extract structured data from any unstructured web page☆41Updated last year
- Local & Private LLM that drafts responses LIKE you automatically☆82Updated 11 months ago
- An interface for llama.cpp, ChatGPT, Gemini, and Claude☆27Updated this week
- A Lightweight Library for LLM I/O☆117Updated 6 months ago
- AI assisted web scraping and data extraction☆201Updated last week
- Crawling framework, RSS reader and parser☆165Updated this week
- Your AI research assistant☆79Updated 7 months ago
- A vim-like terminal reader to chat with your books☆39Updated 11 months ago
- Simple forum engine☆17Updated 8 months ago
- 🛤️ Pathik - High-Performance Web Crawler ⚡☆30Updated 7 months ago
- 🐝 Create powerful, collaborative AI applications.☆64Updated 11 months ago
- GPTAuthor is an AI tool for writing long form, multi-chapter stories given a story prompt.☆91Updated 7 months ago
- I’m trying to create something similar to Grammarly. Hail to open source!☆16Updated 4 months ago
- Find out who is applying to the same job as you and whether you got ghosted☆53Updated 2 months ago
- A simple utility script which allows you to analyze your python file☆49Updated last year
- Open Crawler || Open Source Crawler☆61Updated last year
- Machine learning library, Distributed training, Deep learning, Reinforcement learning, Models, TensorFlow, PyTorch☆69Updated this week
- fully local, temporally aware natural language file search on your pc! even without a GPU. find relevant files using natural language i…☆129Updated last month
- ☆12Updated 8 months ago
- An fully autonomous agent that accesses the browser and performs tasks.☆17Updated 6 months ago