Alternatives and similar repositories for embeddedllm

Users that are interested in embeddedllm are comparing it to the libraries listed below

• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 8 months ago
• miralab-ai / autoreason
  ☆40Updated last year
• raphaelmansuy / iteration_of_tought
  Example implementation of Iteration of Tought - Gives a star if you like the project
  ☆41Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆162Updated 3 weeks ago
• AstraBert / PrAIvateSearch
  Own your AI, search the web with it🌐😎
  ☆94Updated 11 months ago
• gradio-app / sambanova-gradio
  ☆22Updated last year
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆78Updated last year
• sambanova / agents
  ☆57Updated this week
• ArturTanona / grpo_unsloth_docker
  ☆57Updated 10 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 11 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆57Updated last year
• OpenPipe / open_deep_research_training
  Training setup for Langchain's Open Deep Research
  ☆73Updated 3 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆137Updated 6 months ago
• kurakurai / Luth
  Luth is a state-of-the-art series of fine-tuned LLMs for French
  ☆40Updated 2 months ago
• substratusai / vllm-docker
  ☆66Updated 8 months ago
• justrach / bhumi
  ⚡ Bhumi – The fastest AI inference client for Python, built with Rust for unmatched speed, efficiency, and scalability 🚀
  ☆63Updated 2 months ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆60Updated 8 months ago
• AlexBodner / How_Much_VRAM
  ☆101Updated last year
• allenai / asta-paper-finder
  frozen-in-time version of our Paper Finder agent for reproducing evaluation results
  ☆214Updated 4 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆103Updated 7 months ago
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆150Updated 3 months ago
• sunnweiwei / PPP-Agent
  ☆92Updated last month
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆30Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆94Updated this week
• langfuse / oss-llmops-stack
  Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…
  ☆128Updated 10 months ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆52Updated last year
• darshil3011 / AutoMetaRAG
  Dynamic Metadata based RAG Framework
  ☆78Updated 2 weeks ago
• QuixiAI / dolphin-logger
  ☆107Updated last month
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated 2 months ago
• langchain-ai / langchain-elastic
  Elasticsearch integration into LangChain
  ☆69Updated last week