clemlesne / scrape-it-now
Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.
☆506Updated this week
Alternatives and similar repositories for scrape-it-now:
Users that are interested in scrape-it-now are comparing it to the libraries listed below
- An open-source OCR API that leverages OpenAI's powerful language models with optimized performance techniques like parallel processing an…☆812Updated 3 months ago
- Open-source framework for exporting your personal data.☆1,401Updated 3 weeks ago
- ➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are compl…☆295Updated 2 weeks ago
- A lightweight task engine for building stateful AI agents that prioritizes simplicity and flexibility.☆837Updated last week
- Visualise your CSV files in seconds without sending your data anywhere☆464Updated last week
- Attempt to create an Open Source Privacy Focused Rewind.ai Alternative for data capture☆189Updated last week
- Claude Memory: Long-term memory for Claude☆374Updated 2 months ago
- RAG Logger is an open-source logging tool designed specifically for Retrieval-Augmented Generation (RAG) applications. It serves as a lig…☆213Updated 3 weeks ago
- Taming LLMs: A Practical Guide to LLM Pitfalls with Open Source Software☆226Updated this week
- DOM to Semantic-Markdown for use with LLMs☆710Updated last week
- Detect whether or not an audio file was generated by NotebookLM☆129Updated last month
- LetterDrop is a secure and efficient newsletter management service powered by Cloudflare Workers, enabling easy creation, distribution, a…☆296Updated 6 months ago
- An experiment in meeting transcription and diarization with just an LLM. Maybe I went a little overboard though☆368Updated 2 months ago
- Create mind maps to learn new things using AI.☆522Updated 2 months ago
- Algolia alternative for technical docs☆464Updated 2 months ago
- The only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs.☆400Updated this week
- Easily copy all relevant source files in a repository to clipboard. For use in LLM code understanding and generation workflows☆200Updated 4 months ago
- clean & curate your data with LLMs.☆472Updated 6 months ago
- ☆430Updated 3 months ago
- ai for jq☆236Updated 3 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆216Updated last month
- Semantic Image Search CLI tool.☆539Updated 4 months ago
- Fullstack "Chat with your PDFs" RAG (Retrieval Augmented Generation) app built fully on Cloudflare☆504Updated 4 months ago
- Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit☆738Updated 5 months ago
- Dump selected files from your repo into single file to easily use in LLMs (Claude, Openai, etc..)☆141Updated 4 months ago
- GUI for selecting text files for concatenation and submission to LLMs☆133Updated 2 months ago
- Generate ideal question-answers for testing RAG☆125Updated 3 weeks ago
- Dropbase helps developers build and prototype web apps faster with AI. Dropbase is local-first and self hosted.☆1,112Updated 3 months ago
- A superfast full-text search application☆964Updated 3 weeks ago
- Dabbling with ReAct chatbots☆171Updated 5 months ago