mistralai / vllm-release

Related projects ⓘ

Alternatives and complementary repositories for vllm-release

• HammingHQ / bug-in-the-code-stack
  A new benchmark for measuring LLM's capability to detect bugs in large codebase.
  ☆27Updated 5 months ago
• cognitivecomputations / kraken
  ☆64Updated 5 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆98Updated 11 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated 10 months ago
• teknium1 / ShareGPT-Builder
  ☆104Updated 8 months ago
• cognitivecomputations / OpenChatML
  ☆150Updated 4 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆97Updated last year
• kyegomez / Andromeda
  An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
  ☆137Updated 2 months ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆221Updated 6 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆232Updated 5 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆115Updated 3 months ago
• PrimeIntellect-ai / prime
  prime is a framework for efficient, globally distributed training of AI models over the internet.
  ☆212Updated this week
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆62Updated 2 weeks ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆64Updated this week
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆83Updated 6 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆70Updated 3 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought"
  ☆83Updated 2 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆42Updated this week
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆237Updated 4 months ago
• Preemo-Inc / text-generation-inference
  ☆200Updated 9 months ago
• writer / writing-in-the-margins
  ☆106Updated 2 months ago
• agentsea / surfkit
  A toolkit for building multimodal AI agents
  ☆111Updated this week
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆86Updated 8 months ago
• Leeroo-AI / leeroo_orchestrator
  The implementation of "Leeroo Orchestrator: Elevating LLMs Performance Through Model Integration"
  ☆51Updated 6 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆84Updated last month
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆55Updated 3 months ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆155Updated last year
• xjdr-alt / llmri
  look how they massacred my boy
  ☆58Updated last month
• emrgnt-cmplxty / zero-shot-replication
  ☆72Updated last year
• teknium1 / transformers-gptq-quant
  ☆48Updated last year