mallik3006 / LLM_fine_tuning_llama3_8bLinks
Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed 
☆18Updated last year
Alternatives and similar repositories for LLM_fine_tuning_llama3_8b
Users that are interested in LLM_fine_tuning_llama3_8b are comparing it to the libraries listed below
Sorting:
- LoRA and DoRA from Scratch Implementations☆211Updated last year
- Sakura-SOLAR-DPO: Merge, SFT, and DPO☆116Updated last year
- Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow☆64Updated last year
- Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training☆73Updated last week
- A collection of LogitsProcessors to customize and enhance LLM behavior for specific tasks.☆369Updated 3 months ago
- Set of scripts to finetune LLMs☆38Updated last year
- Pretraining and finetuning for visual instruction following with Mixture of Experts☆16Updated last year
- The Universe of Evaluation. All about the evaluation for LLMs.☆228Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆110Updated last year
- minimal GRPO implementation from scratch☆98Updated 7 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated last month
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆240Updated last year
- ☆78Updated last year
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆188Updated last year
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆140Updated last year
- Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper☆152Updated last year
- ☆136Updated 2 months ago
- [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs☆314Updated 3 months ago
- Code for KaLM-Embedding models☆94Updated 4 months ago
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆161Updated 2 months ago
- ☆37Updated 2 years ago
- Let's build better datasets, together!☆262Updated 10 months ago
- ☆50Updated 2 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆202Updated last year
- Various installation guides for Large Language Models☆75Updated 6 months ago
- Repository containing awesome resources regarding Hugging Face tooling.☆48Updated last year
- experiments with inference on llama☆103Updated last year
- This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…☆23Updated last year