roshanlam / SpiderLinks
Web Crawler built using asynchronous Python and distributed task management that extracts and saves web data for analysis.
☆34Updated 6 months ago
Alternatives and similar repositories for Spider
Users that are interested in Spider are comparing it to the libraries listed below
Sorting:
- ☆22Updated last year
- NoteMap: a handy tool for analyzing, organizing, and finding patterns in text files. It works with PDFs, TXTs, and DOCXs. You can also br…☆36Updated last year
- Extract structured data from any unstructured web page☆41Updated last year
- Text Summarization using NLP to fetch BBC News Article and summarize its text and also it includes custom article Summarization☆41Updated 2 years ago
- ☆20Updated 6 months ago
- A Python-based parallel file chunking system designed for processing large codebases into LLM-friendly chunks.☆44Updated last month
- A Lightweight Library for LLM I/O☆117Updated 5 months ago
- Creating Intelligent Terminal Apps with ChatGPT and LLM Models☆31Updated 2 years ago
- Find your GitHub stars easily with natural language search☆59Updated 9 months ago
- An interface for llama.cpp, ChatGPT, Gemini, and Claude☆27Updated this week
- 360M model running in the browser on WebGPU☆22Updated last year
- Turn any input document into a sophisticated, context-dependent mindmap that distills the meaning and structure of the document.☆116Updated 7 months ago
- terminal client for browsing hacker news☆26Updated 8 months ago
- GPTAuthor is an AI tool for writing long form, multi-chapter stories given a story prompt.☆88Updated 6 months ago
- Find out who is applying to the same job as you and whether you got ghosted☆53Updated last month
- Humbug: building an operating system for human-AI collaboration☆82Updated this week
- Acid Reflux for your Ears!☆71Updated last year
- Performing set operations on files considered as sets of lines☆12Updated 3 years ago
- Boost Your Productivity with Nyro☆111Updated last year
- DispatchMail is an open source locally run (though currently using OpenAI for queries) AI-powered email assistant that helps you manage y…☆80Updated 2 weeks ago
- Web application that converts audio and video to text using AI, supporting various formats and self-hosting.☆120Updated 6 months ago
- AI assisted web scraping and data extraction☆201Updated 2 months ago
- Progzee is a Python library for simplifying IP proxy usage in HTTP requests.☆16Updated 7 months ago
- Local & Private LLM that drafts responses LIKE you automatically☆82Updated 10 months ago
- Markify is an open source command line application written in python which scrapes data from your social media accounts and utilises mark…☆13Updated last year
- I’m trying to create something similar to Grammarly. Hail to open source!☆16Updated 4 months ago
- An fully autonomous agent that accesses the browser and performs tasks.☆17Updated 5 months ago
- Lightweight cli coding agent☆57Updated 4 months ago
- Better auto-formatting for Markdown☆37Updated last month
- Crawling framework, RSS reader and parser☆154Updated this week