This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT) variant. The implementation focuses on the model architecture and the inference process. The code is restructured and heavily commented to facilitate easy understanding of the key parts of the architecture.
☆75Oct 1, 2023Updated 2 years ago
Alternatives and similar repositories for LLaMA2
Users that are interested in LLaMA2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inference Llama 2 in one file of pure Haskell (A port of llama2.c from Andrej Karpathy)☆14Oct 17, 2025Updated 10 months ago
- ☆17May 6, 2025Updated last year
- Code and data for the paper: IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Large Language Models …☆12Apr 27, 2024Updated 2 years ago
- Repo with code for NIR'24 challange☆13Apr 22, 2024Updated 2 years ago
- PyTorch Quantization Framework For OCP MX Datatypes.☆16May 30, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 論文輪読会での要約集☆12Oct 31, 2019Updated 6 years ago
- [ACL'26 Workshop] KoViDoRe: Korean Visual Document Retrieval Benchmark☆26Jul 2, 2026Updated 2 months ago
- ☆11Oct 11, 2023Updated 2 years ago
- CVPR 2023: PAniC-3D, Vtubers dataset downloader☆13Apr 22, 2023Updated 3 years ago
- working implimention of deepseek MLA☆44Jan 8, 2025Updated last year
- ☆11Feb 3, 2025Updated last year
- ☆12Sep 11, 2023Updated 2 years ago
- Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).☆27Aug 25, 2024Updated 2 years ago
- An implementation of the base GPT-3 Model architecture from the paper by OPENAI "Language Models are Few-Shot Learners"☆22Jun 29, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22May 9, 2025Updated last year
- サーベイした論文をissueにゆっくりまとめる。☆15May 15, 2024Updated 2 years ago
- arXiv-Chat: An AI research assistant and Discord bot☆13Jul 16, 2023Updated 3 years ago
- LLaMA 2 implemented from scratch in PyTorch☆376Sep 25, 2023Updated 2 years ago
- The official code and dataset for EMNLP 2022 paper "COPEN: Probing Conceptual Knowledge in Pre-trained Language Models".☆21Mar 9, 2023Updated 3 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆11Sep 4, 2025Updated last year
- ☆22Sep 26, 2024Updated last year
- ACL Workshop 2023☆16Jan 3, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Ultra-minimal autoregressive diffusion model for image generation☆21Jul 20, 2026Updated last month
- Small, simple agent task environments for training and evaluation☆20Nov 1, 2024Updated last year
- D.Com 학우들을 위한 커리어 조언 Repo☆12May 17, 2023Updated 3 years ago
- ☆24Sep 5, 2024Updated 2 years ago
- Fine-tuning, DPO, RLHF, RLAIF on LLMs - Qwen3, Zephyr 7B GPTQ with 4-Bit Quantization, Mistral-7B-GPTQ☆15Jul 5, 2025Updated last year
- ☆40Jun 2, 2026Updated 3 months ago
- Run a WAI application as the backend Lambda of an AWS API Gateway REST API☆25Updated this week
- Deepseek-CoT☆10Oct 6, 2024Updated last year
- 🚀 [ICLR '25] RocketEval: Efficient Automated LLM Evaluation via Grading Checklist☆18Aug 21, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆16Jan 14, 2025Updated last year
- Creates CMM script that can directly executed on Kaggle from easy merge script☆14Mar 6, 2026Updated 6 months ago
- Template repo for Python projects, especially those focusing on machine learning and/or deep learning.☆15Jan 14, 2026Updated 7 months ago
- Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…☆72Mar 7, 2024Updated 2 years ago
- Multi-LexSum is an abstractive summarization dataset for US Civil Rights Lawsuits☆23Dec 15, 2022Updated 3 years ago
- Code for Personalized Large Language Models via Selective Prompt Tuning☆10Jun 26, 2024Updated 2 years ago
- DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting☆19Mar 4, 2025Updated last year