roshanlam / SpiderLinks
Web Crawler built using asynchronous Python and distributed task management that extracts and saves web data for analysis.
☆34Updated 2 months ago
Alternatives and similar repositories for Spider
Users that are interested in Spider are comparing it to the libraries listed below
Sorting:
- NoteMap: a handy tool for analyzing, organizing, and finding patterns in text files. It works with PDFs, TXTs, and DOCXs. You can also br…☆36Updated last year
- Extract structured data from any unstructured web page☆44Updated last year
- ☆22Updated last year
- Production-ready Python library for multi-provider LLM orchestration☆40Updated 3 months ago
- terminal client for browsing hacker news☆28Updated 11 months ago
- An interface for llama.cpp, ChatGPT, Gemini, and Claude☆27Updated 3 weeks ago
- Acid Reflux for your Ears!☆71Updated last year
- Boost Your Productivity with Nyro☆111Updated last year
- Humbug: building an operating system for human-AI collaboration☆85Updated last week
- ☆20Updated last month
- A vim-like terminal reader to chat with your books☆40Updated last year
- An MCP server for Android's Tasker automation app.☆34Updated 10 months ago
- Find your GitHub stars easily with natural language search☆60Updated last year
- Lightweight AI agent library. Turn Python functions/classes into AI tools instantly. No verbose configs or complex abstractions.☆31Updated this week
- A Lightweight Library for LLM I/O☆121Updated 8 months ago
- Local & Private LLM that drafts responses LIKE you automatically☆84Updated last year
- A simple app for downloading YouTube Shorts transcripts. Built to self-host with Python and Streamlit. Free and open source.☆32Updated last year
- GPTAuthor is an AI tool for writing long form, multi-chapter stories given a story prompt.☆96Updated 9 months ago
- I’m trying to create something similar to Grammarly. Hail to open source!☆15Updated 7 months ago
- Progzee is a Python library for simplifying IP proxy usage in HTTP requests.☆16Updated 10 months ago
- Turn any application written in any programming language into an executable.☆55Updated 8 months ago
- Text Summarization using NLP to fetch BBC News Article and summarize its text and also it includes custom article Summarization☆41Updated 2 years ago
- The Python toolkit for converting Reddit threads into organized text data. Extract and process Reddit content with ease!☆114Updated last year
- ☆22Updated last year
- A Python package for zero-shot text anonymization using Transformer-based NER models.☆82Updated 3 weeks ago
- tsellm: LLMs in SQLite and DuckDB☆25Updated 8 months ago
- Create and Run Linux Workflows without Limits. Short for "nine" / "yaml" / "no-code" / "automation".☆296Updated 2 weeks ago
- Open source ai coding agent☆58Updated 7 months ago
- Collecto is an open source & self-hosted forms backend.☆51Updated last year
- Model Context Protocol (MCP) Gateway & Registry - Central hub for managing tools, resources, and prompts for MCP-compatible LLMs. Transla…☆34Updated last week