Preemo-Inc / text-generation-inference

Related projects: ⓘ

• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆230Updated 3 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆129Updated last month
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆124Updated this week
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆106Updated 3 months ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆295Updated 3 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆217Updated 2 months ago
• cognitivecomputations / spectrum
  ☆75Updated 3 weeks ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆236Updated last week
• mixedbread-ai / batched
  ☆58Updated 3 weeks ago
• abacaj / train-with-fsdp
  ☆89Updated 11 months ago
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆192Updated 4 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆144Updated 2 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers model
  ☆154Updated 4 months ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆154Updated 11 months ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆139Updated 11 months ago
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆180Updated 8 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆306Updated 5 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆195Updated last month
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆223Updated 4 months ago
• kuutsav / llm-toys
  Small finetuned LLMs for a diverse set of useful tasks
  ☆119Updated last year
• cognitivecomputations / kraken
  ☆64Updated 3 months ago
• AnswerDotAI / bert24
  ☆56Updated this week
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆217Updated 6 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆195Updated 4 months ago
• cohere-ai / DiskVectorIndex
  ☆203Updated 2 months ago
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated last year
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆143Updated 3 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆93Updated 5 months ago