roshanlam / SpiderLinks
Web Crawler built using asynchronous Python and distributed task management that extracts and saves web data for analysis.
☆31Updated 3 months ago
Alternatives and similar repositories for Spider
Users that are interested in Spider are comparing it to the libraries listed below
Sorting:
- NoteMap: a handy tool for analyzing, organizing, and finding patterns in text files. It works with PDFs, TXTs, and DOCXs. You can also br…☆35Updated last year
- ☆11Updated 10 months ago
- A GUI-based AI development tool with integrated Metaphor support☆46Updated this week
- Brower extension to convert web pages to clean Markdown and copy to clipboard so you can feed it to your favorite LLM model as context wi…☆114Updated last week
- Unlock Medium for free access.☆27Updated 4 months ago
- An interface for llama.cpp, ChatGPT, and Gemini☆26Updated this week
- A simple app for downloading YouTube Shorts transcripts. Built to self-host with Python and Streamlit. Free and open source.☆31Updated 6 months ago
- ☆22Updated last year
- Open Source Audio News Subscription Service (Google Trends, Hacker News & more).☆12Updated 2 months ago
- Dashb.io - Minimalist's Dashboard and Widgets.☆14Updated last year
- Crawling framework, RSS reader and parser☆110Updated last week
- LLM-powered bookmark search engine☆28Updated 5 months ago
- 🐝 Create powerful, collaborative AI applications.☆64Updated 7 months ago
- 360M model running in the browser on WebGPU☆22Updated 10 months ago
- ☆17Updated 2 months ago
- Find your GitHub stars easily with natural language search☆56Updated 6 months ago
- MCP that provides a persistent shell for multi-agent applications☆16Updated this week
- Web API that summarizes multimedia from various sources using modern AI tools.☆23Updated last year
- ☆53Updated last week
- Documentation for the Krixik Python client.☆38Updated 7 months ago
- A vim-like terminal reader to chat with your books☆37Updated 7 months ago
- Deidentify people's names and gender specific pronouns☆36Updated last month
- Piazza-Updater automates updates to a Weaviate database with real-time vectorial data. By continuously searching the internet and integra…☆31Updated 7 months ago
- Open-Source, Local, Pricvacy focused, LLM data gathering tool for your own Digital Twin☆17Updated 8 months ago
- Save your code to GitHub and never worry about losing your work. Vibe code safely with vibe saver.☆12Updated 2 months ago
- A Python-based parallel file chunking system designed for processing large codebases into LLM-friendly chunks.☆41Updated last month
- ☆22Updated 8 months ago
- An fully autonomous agent that accesses the browser and performs tasks.☆18Updated 2 months ago
- CoexistAI is a modular, developer-friendly research assistant framework . It enables you to build, search, summarize, and automate resear…☆75Updated this week
- Trim and timestamp audio, in the terminal☆15Updated 8 months ago