clemlesne / scrape-it-now
Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.
☆510Updated last week
Alternatives and similar repositories for scrape-it-now:
Users that are interested in scrape-it-now are comparing it to the libraries listed below
- An open-source OCR API that leverages OpenAI's powerful language models with optimized performance techniques like parallel processing an…☆828Updated 4 months ago
- LetterDrop is a secure and efficient newsletter management service powered by Cloudflare Workers, enabling easy creation, distribution, a…☆299Updated 7 months ago
- Open-source framework for exporting your personal data.☆1,416Updated last month
- A lightweight task engine for building stateful AI agents that prioritizes simplicity and flexibility.☆886Updated last month
- DOM to Semantic-Markdown for use with LLMs☆755Updated 2 weeks ago
- Attempt to create an Open Source Privacy Focused Rewind.ai Alternative for data capture☆197Updated 3 weeks ago
- RAG Logger is an open-source logging tool designed specifically for Retrieval-Augmented Generation (RAG) applications. It serves as a lig…☆217Updated last month
- ➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are compl…☆345Updated last week
- Claude Memory: Long-term memory for Claude☆381Updated 3 months ago
- ai for jq☆238Updated 5 months ago
- Detect whether or not an audio file was generated by NotebookLM☆131Updated 2 months ago
- Open-source platform for extracting structured data from documents using AI.☆1,252Updated this week
- Algolia alternative for technical docs☆479Updated 3 months ago
- ☆434Updated 5 months ago
- Beautiful docs that write, translate, and optimize themselves☆164Updated last month
- Visualise your CSV files in seconds without sending your data anywhere☆493Updated last month
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆217Updated 2 months ago
- Create mind maps to learn new things using AI.☆536Updated 3 months ago
- ☆162Updated 7 months ago
- An experiment in meeting transcription and diarization with just an LLM. Maybe I went a little overboard though☆393Updated last week
- Open-source unstructured data (PDFs, Images, Audiofiles) processing platform built for knowledge workers☆253Updated 2 weeks ago
- AI powered cli coding agent that monitors your dev/test server and fixes errors and adds features☆195Updated 6 months ago
- Generate ideal question-answers for testing RAG☆126Updated 2 weeks ago