Alternatives and similar repositories for llama-int8:

Users that are interested in llama-int8 are comparing it to the libraries listed below

• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated last year
• AlpinDale / LLM-Shearing
  Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆28Updated last year
• lechmazur / nyt-connections
  Benchmark that evaluates LLMs using 436 NYT Connections puzzles
  ☆23Updated this week
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated 9 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• harubaru / convogpt
  Conversational Language model toolkit for training against human preferences.
  ☆40Updated 9 months ago
• facebookresearch / dual-system-for-visual-language-reasoning
  Github repo for Peifeng's internship project
  ☆13Updated last year
• camenduru / stable-fast-colab
  ☆28Updated last year
• lechmazur / writing
  This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…
  ☆38Updated last week
• NolanoOrg / llama-int4-quant
  ☆26Updated last year
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆18Updated 2 weeks ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated 7 months ago
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• finetunej / transformers
  🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
  ☆56Updated 3 years ago
• lachlansneff / sparsellama
  ☆40Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆29Updated 3 weeks ago
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆10Updated this week
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆53Updated 11 months ago
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆111Updated last year
• lechmazur / divergent
  LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each oth…
  ☆25Updated last week
• huggingface / discord-bots
  ☆48Updated last year
• catid / oaillama3
  Simple setup to self-host LLaMA3-70B model with an OpenAI API
  ☆20Updated 9 months ago
• calmstate / Itinerant
  A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.
  ☆12Updated 5 months ago
• slashml / awesome-finetuning
  ☆27Updated 5 months ago
• cyan2k / llama.cpp
  LLM inference in C/C++
  ☆20Updated 3 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated last year
• TheoCoombes / crawlingathome
  A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.
  ☆32Updated last year