spider-rs / spider
A web crawler and scraper for Rust
β1,158Updated this week
Related projects β
Alternatives and complementary repositories for spider
- Rust library for OpenAIβ1,181Updated this week
- π¦ A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AIβ287Updated 8 months ago
- Rust library and CLI tool for OCR (extracting text from images)β1,255Updated last week
- π¦οΈπLangChain for Rust, the easiest way to write LLM-based programs in Rustβ623Updated last week
- Fast, streaming indexing and query library for AI (RAG) applications, written in Rustβ259Updated this week
- HTML parsing and querying with CSS selectorsβ1,941Updated 3 weeks ago
- crawl and scrape web pages in rustβ740Updated last year
- A high-level API for programmatically interacting with web pages through WebDriver.β1,679Updated last week
- Selenium WebDriver client for Rust, for automated testing of websitesβ1,067Updated last week
- OpenAI API client library for Rust (unofficial)β319Updated this week
- Chrome Devtools Protocol rust APIβ790Updated last month
- π± A dynamic SQL query builder for MySQL, Postgres and SQLiteβ1,201Updated last week
- `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasβ¦β1,357Updated 3 weeks ago
- Natural language detection library for Rust. Try demo online: https://whatlang.org/β972Updated 8 months ago
- LLM Orchestrator built in Rustβ267Updated 8 months ago
- A Rust library allowing to interact with the Ollama API.β539Updated 2 weeks ago
- A high-level API to control headless Chrome or Chromium over the DevTools Protocol. It is the Rust equivalent of Puppeteer, a Node librarβ¦β2,370Updated this week
- Library for generating vector embeddings, reranking in Rustβ288Updated this week
- A rust library for extracting content from pdfsβ420Updated last month
- Rust client for Qdrant vector search engineβ233Updated last month
- Rust library to read, manipulate and write PDF files.β1,314Updated last week
- A Rust library to extract useful data from HTML documents, suitable for web scraping.β975Updated 5 months ago
- Simple, Fast, Code first and Compile time generated OpenAPI documentation for Rustβ2,483Updated this week
- framework for composable networking servicesβ2,050Updated this week
- Build, bundle & ship your Rust WASM application to the web.β3,537Updated this week
- A Rust library for PDF document manipulation.β1,658Updated this week
- A high performance concurrent caching library for Rustβ1,638Updated 3 weeks ago
- Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Groq, Gemini, Cohere, ...)β208Updated this week
- Rust cache structures and easy function memoizationβ1,574Updated last week
- a mailer library for Rustβ1,876Updated last month