aneeshjoy / vllm-windows

Related projects: ⓘ

• nyunAI / PruneGPT
  ☆50Updated 3 months ago
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆79Updated last month
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers model
  ☆154Updated 4 months ago
• statchamber / ebook-to-chatml-conversion
  idea: https://github.com/nyxkrage/ebook-groupchat/
  ☆77Updated last month
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆96Updated 4 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated last month
• emrgnt-cmplxty / zero-shot-replication
  ☆71Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆172Updated 4 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆53Updated 3 weeks ago
• Dhaladom / TALIS
  Simple and fast server for GPTQ-quantized LLaMA inference
  ☆24Updated last year
• AUGMXNT / deccp
  Evaling and unaligning Chinese LLM censorship
  ☆23Updated 3 months ago
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆74Updated 5 months ago
• IlyaGusev / ping_pong_bench
  ☆53Updated this week
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆139Updated 11 months ago
• teknium1 / ShareGPT-Builder
  ☆101Updated 6 months ago
• uukuguy / multi_loras
  Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…
  ☆139Updated 7 months ago
• severian42 / MoA-Ollama-Chat
  This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…
  ☆101Updated 2 months ago
• bdambrosio / AllTheWorldAPlay
  All the world is a play, we are but actors in it.
  ☆46Updated 2 months ago
• writer / writing-in-the-margins
  ☆82Updated 3 weeks ago
• read-agent / read-agent.github.io
  ☆51Updated last month
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆119Updated this week
• nath1295 / LLMFlex
  A python package for developing AI applications with local LLMs.
  ☆137Updated 2 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆46Updated 4 months ago
• uukuguy / speechless
  LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.
  ☆85Updated this week
• Itachi-Uchiha581 / Auto-Data
  Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).
  ☆84Updated 2 weeks ago
• tcsenpai / multi1
  multi1: create o1-like reasoning chains with multiple AI providers (and locally)
  ☆64Updated this week
• swj0419 / detect-pretrain-code-contamination
  ☆73Updated 8 months ago
• SingularityMan / vector_companion
  A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…
  ☆68Updated 3 weeks ago
• RandomInternetPreson / Lucid_Autonomy
  An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3
  ☆33Updated last week
• agi-dude / chainlit-rag
  ☆21Updated this week