mzbac / gptq-cuda-api

Related projects: ⓘ

• emrgnt-cmplxty / zero-shot-replication
  ☆71Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆35Updated last year
• eryk-mazus / xoxo
  a tiny, exploitable chatbot that can use tools
  ☆30Updated last year
• Dhaladom / TALIS
  Simple and fast server for GPTQ-quantized LLaMA inference
  ☆24Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆102Updated last year
• mzbac / LLM_Web
  Host LLM via text-generation-inference
  ☆13Updated 9 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆36Updated 7 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆41Updated 6 months ago
• multiplexerai / Complex-to-Simple-RAG
  ☆40Updated 7 months ago
• itsPreto / VECTR8
  Embed anything.
  ☆30Updated 3 months ago
• fblgit / tree-of-knowledge
  ToK aka Tree of Knowledge for Large Language Models LLM. It's a novel dataset that inspires knowledge symbolic correlation in simple inpu…
  ☆43Updated last year
• nova-land / gbnf-compiler
  Plug n Play GBNF Compiler for llama.cpp
  ☆17Updated 10 months ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆23Updated 3 months ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated 7 months ago
• khaimt / qa_expert
  This repo is for handling Question Answering, especially for Multi-hop Question Answering
  ☆59Updated 9 months ago
• xmichaelmason / llama-docker
  Dockerized AI with CUDA. Llama-cpp-python and stable diffusion.
  ☆0Updated 7 months ago
• j-webtek / LLM-Learning
  A repository to store helpful information and emerging insights in regard to LLMs
  ☆20Updated 10 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆97Updated 9 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• the-crypt-keeper / tiny_starcoder
  Python examples using the bigcode/tiny_starcoder_py 159M model to generate code
  ☆43Updated last year
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆53Updated 8 months ago
• teknium1 / alpaca-discord
  A Simple Discord Bot for the Alpaca LLM
  ☆101Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆112Updated last month
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆69Updated 7 months ago
• discus-labs / discus
  A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ
  ☆63Updated 10 months ago
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆70Updated 7 months ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆139Updated 11 months ago