vedaldi / micro_llama
A tiny, didactical implementation of LLAMA 3
☆35Updated 2 months ago
Alternatives and similar repositories for micro_llama:
Users that are interested in micro_llama are comparing it to the libraries listed below
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆36Updated last year
- XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.☆37Updated 5 months ago
- A light-weight and high-efficient training framework for accelerating diffusion tasks.☆46Updated 5 months ago
- minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora☆40Updated 10 months ago
- Official repository for ICML 2024 paper "MoRe Fine-Tuning with 10x Fewer Parameters"☆17Updated this week
- 模型压缩的小白入门教程☆22Updated 7 months ago
- ☆52Updated 3 months ago
- [NAACL 2025] Representing Rule-based Chatbots with Transformers☆19Updated last week
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆28Updated 8 months ago
- ☆29Updated last month
- Multi-Layer Key-Value sharing experiments on Pythia models☆32Updated 8 months ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆40Updated 7 months ago
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Updated 4 months ago
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆30Updated 8 months ago
- A multimodal large-scale model, which performs close to the closed-source Qwen-VL-PLUS on many datasets and significantly surpasses the p…☆14Updated last year
- ☆30Updated 8 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Updated 8 months ago
- In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning☆33Updated last year
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆35Updated 8 months ago
- DPO, but faster 🚀☆34Updated 2 months ago
- mllm-npu: training multimodal large language models on Ascend NPUs☆90Updated 5 months ago
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆28Updated 11 months ago
- ☆27Updated 6 months ago
- differentiable top-k operator☆21Updated last month
- Empirical Study Towards Building An Effective Multi-Modal Large Language Model☆23Updated last year
- ☆14Updated 10 months ago