mallik3006 / LLM_fine_tuning_llama3_8b
Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed
☆16Updated 10 months ago
Alternatives and similar repositories for LLM_fine_tuning_llama3_8b:
Users that are interested in LLM_fine_tuning_llama3_8b are comparing it to the libraries listed below
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated 4 months ago
- Improving Text Embedding of Language Models Using Contrastive Fine-tuning☆62Updated 8 months ago
- Repository containing awesome resources regarding Hugging Face tooling.☆46Updated last year
- ☆74Updated last year
- Code for KaLM-Embedding models☆74Updated 3 weeks ago
- ☆89Updated 3 weeks ago
- minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever☆38Updated 3 weeks ago
- Set of scripts to finetune LLMs☆37Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆73Updated 5 months ago
- Scripts for text classification with llama and bert☆14Updated last week
- ☆46Updated 5 months ago
- ☆20Updated 3 years ago
- Small and Efficient Mathematical Reasoning LLMs☆71Updated last year
- Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow☆61Updated last year
- Unofficial implementation of https://arxiv.org/pdf/2407.14679☆44Updated 7 months ago
- Collection of autoregressive model implementation☆85Updated 2 months ago
- Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…☆62Updated 10 months ago
- Building GPT ...☆17Updated 4 months ago
- ☆14Updated 10 months ago
- The official evaluation suite and dynamic data release for MixEval.☆11Updated 6 months ago
- ☆40Updated 11 months ago
- LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.☆69Updated last year
- Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…☆23Updated 2 months ago
- Sakura-SOLAR-DPO: Merge, SFT, and DPO☆117Updated last year
- A minimal yet unstoppable blueprint for multi-agent AI—anchored by the rare, far-reaching “Multi-Agent AI DAO” (2017 Prior Art)—empowerin…☆23Updated 3 months ago
- ☆87Updated last year
- ☆45Updated 6 months ago
- A collection of notebooks for the Hugging Face blog series (https://huggingface.co/blog).☆45Updated 8 months ago
- ☆37Updated last year
- Simple GRPO scripts and configurations.☆58Updated 2 months ago