Alternatives and similar repositories for lone-arena

Users that are interested in lone-arena are comparing it to the libraries listed below

• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• cognitivecomputations / OpenChatML
  ☆157Updated last year
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆114Updated 7 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆140Updated 4 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆146Updated last year
• c0sogi / llama-api
  An OpenAI-like LLaMA inference API
  ☆112Updated last year
• nyunAI / PruneGPT
  ☆52Updated last year
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆221Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆89Updated 2 weeks ago
• codelion / pts
  Pivotal Token Search
  ☆109Updated this week
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆35Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆93Updated 11 months ago
• cognitivecomputations / kraken
  ☆66Updated last year
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆140Updated last month
• uukuguy / speechless
  LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.
  ☆104Updated last month
• teknium1 / ShareGPT-Builder
  ☆115Updated 6 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• rooben-me / tone-changer-open
  This project is a reverse-engineered version of Figma's tone changer. It uses Groq's Llama-3-8b for high-speed inference and to adjust th…
  ☆89Updated 11 months ago
• ahmed-moubtahij / TokenHealer
  ☆22Updated last year
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• kenhktsui / anyclassifier
  One Line To Build Zero-Data Classifiers in Minutes
  ☆58Updated 9 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆88Updated 2 months ago
• ritabratamaiti / AnyModal
  AnyModal is a Flexible Multimodal Language Model Framework for PyTorch
  ☆100Updated 6 months ago
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆217Updated last month
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆57Updated 7 months ago