cindysridykhan / instruct_storyteller_tinyllama2Links
Training and Fine-tuning an llm in Python and PyTorch.
☆43Updated 2 years ago
Alternatives and similar repositories for instruct_storyteller_tinyllama2
Users that are interested in instruct_storyteller_tinyllama2 are comparing it to the libraries listed below
Sorting:
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆161Updated 2 months ago
- Data preparation code for Amber 7B LLM☆93Updated last year
- ☆95Updated 2 years ago
- ☆88Updated last year
- Pre-training code for Amber 7B LLM☆169Updated last year
- ☆78Updated last year
- Experiments on speculative sampling with Llama models☆125Updated 2 years ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated last year
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆277Updated 2 years ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆139Updated 2 years ago
- A pipeline for LLM knowledge distillation☆109Updated 7 months ago
- Tune MPTs☆84Updated 2 years ago
- Small and Efficient Mathematical Reasoning LLMs☆72Updated last year
- experiments with inference on llama☆103Updated last year
- A bagel, with everything.☆324Updated last year
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆240Updated last year
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆169Updated last year
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆202Updated last year
- ☆94Updated 2 years ago
- minimal scripts for 24GB VRAM GPUs. training, inference, whatever☆43Updated this week
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated 2 years ago
- A compact LLM pretrained in 9 days by using high quality data☆332Updated 6 months ago
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…☆72Updated 2 years ago
- FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)☆242Updated last year
- [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation☆176Updated last year
- inference code for mixtral-8x7b-32kseqlen☆102Updated last year
- A list of LLM benchmark frameworks.☆71Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- ☆274Updated 2 years ago