roshanlam / SpiderLinks
Web Crawler built using asynchronous Python and distributed task management that extracts and saves web data for analysis.
☆33Updated 3 months ago
Alternatives and similar repositories for Spider
Users that are interested in Spider are comparing it to the libraries listed below
Sorting:
- NoteMap: a handy tool for analyzing, organizing, and finding patterns in text files. It works with PDFs, TXTs, and DOCXs. You can also br…☆36Updated last year
- An interface for llama.cpp, ChatGPT, and Gemini☆26Updated this week
- A Python-based parallel file chunking system designed for processing large codebases into LLM-friendly chunks.☆41Updated this week
- Humbug: building an operating system for human-AI collaboration☆62Updated this week
- Extract structured data from any unstructured web page☆41Updated last year
- Unlock Medium for free access.☆27Updated 4 months ago
- ☆18Updated 3 months ago
- Crawling framework, RSS reader and parser☆131Updated 2 weeks ago
- ☆22Updated last year
- Automagically group and commit semantically related changes in your Git repository with AI.☆64Updated last month
- A vim-like terminal reader to chat with your books☆38Updated 8 months ago
- Piazza-Updater automates updates to a Weaviate database with real-time vectorial data. By continuously searching the internet and integra…☆31Updated 7 months ago
- 🐝 Create powerful, collaborative AI applications.☆64Updated 8 months ago
- A simple app for downloading YouTube Shorts transcripts. Built to self-host with Python and Streamlit. Free and open source.☆31Updated 7 months ago
- Find out who is applying to the same job as you and whether you got ghosted☆50Updated last month
- Lightweight cli coding agent☆55Updated 2 months ago
- ☆54Updated 2 weeks ago
- ☆11Updated 11 months ago
- terminal client for browsing hacker news☆26Updated 5 months ago
- Brower extension to convert web pages to clean Markdown and copy to clipboard so you can feed it to your favorite LLM model as context wi…☆119Updated last month
- YouTube Transcript Cleaner is a simple web-based application that improves the readability of YouTube transcripts.☆27Updated 4 months ago
- Local & Private LLM that drafts responses LIKE you automatically☆81Updated 8 months ago
- Find your GitHub stars easily with natural language search☆56Updated 7 months ago
- Open Source Audio News Subscription Service (Google Trends, Hacker News & more).☆12Updated 3 months ago
- ☆17Updated 6 months ago
- A modern, single-page web chat interface for local LLMs (Large Language Models), inspired by the visual style and UX of Anthropic's Claud…☆30Updated 2 months ago
- A Lightweight Library for LLM I/O☆116Updated 2 months ago
- A QT GUI for large language models☆37Updated last year
- Shared Memory Storage for Multi-Agent Systems☆102Updated 2 weeks ago
- Web application that converts audio and video to text using AI, supporting various formats and self-hosting.☆108Updated 3 months ago