A simple implementation of Llama 1, 2. Llama Architecture built from scratch using PyTorch all the models are built from scratch that includes GQA (Grouped Query Attention) , RoPE (Rotary Positional Embeddings) , RMS Norm, FeedForward Block, Encoder (as this is only for Inferencing the model) , SwiGLU (Activation Function),
☆14May 6, 2024Updated 2 years ago
Alternatives and similar repositories for llama-inference
Users that are interested in llama-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deep learning in time series analysis☆13May 21, 2018Updated 8 years ago
- Unlock the groundbreaking advances of deep learning with this extensively revised new edition of the bestselling original. Learn directly…☆10Feb 27, 2023Updated 3 years ago
- ☆12Dec 14, 2024Updated last year
- A collection of tools that explore giving LLMs agency.☆12Jan 7, 2024Updated 2 years ago
- Enhanced multi-needle retrieval testing framework for evaluating LLM long-context understanding capabilities☆12Oct 8, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Machine Learning algorithms implementation in Python from scratch.☆11Feb 10, 2019Updated 7 years ago
- download and load SA-1B☆11Apr 15, 2023Updated 3 years ago
- Codex, Claude Code 스킬: 한글 파일(.hwpx) 자동 분석 및 작성 도구☆16Sep 30, 2026Updated 3 weeks ago
- ☆13Sep 12, 2024Updated 2 years ago
- KnowledgeGraphLLM☆11Dec 1, 2023Updated 2 years ago
- [신발 Tag 상품번호 인식기] OCR 을 이용하여 신발 태그의 품번을 인식하여 사용자에게 신발 정보를 제공하는 서비스를 기획 및 구현하였습니다.☆12Apr 22, 2022Updated 4 years ago
- yolosegment2labelme - a Python package that allows you to convert YOLO segmentation prediction results to LabelMe and anylabeling JSON fo…☆10May 8, 2024Updated 2 years ago
- ☆18May 10, 2021Updated 5 years ago
- Official code of "A Model Can Help Itself: Reward-Free Self-Training for LLM Reasoning".☆13Oct 5, 2026Updated 3 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Mar 27, 2024Updated 2 years ago
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆19Sep 13, 2024Updated 2 years ago
- Utility of SMI (Secondary Memory Interface) of Raspberry Pi☆12Apr 29, 2017Updated 9 years ago
- ☆16Jul 1, 2026Updated 3 months ago
- Python client for Jikan.moe, MyAnimeList unofficial API with good intentions.☆15Dec 20, 2022Updated 3 years ago
- Course Project for COMP4471 on RWKV☆17Feb 11, 2024Updated 2 years ago
- Today I Learned☆21Aug 31, 2026Updated last month
- Files used for the evaluation of uiCA☆19Dec 14, 2022Updated 3 years ago
- how to deal with multi-armed bandit problem through different approaches☆13Jul 6, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- basic linear algebra with Python!☆25Oct 1, 2020Updated 6 years ago
- A repository-level metadata dataset intended to help researchers find GitHub repositories with evidence of non-English natural-language c…☆19Jun 15, 2026Updated 4 months ago
- ☆10Apr 16, 2019Updated 7 years ago
- ☆10Dec 12, 2013Updated 12 years ago
- ☆21Feb 2, 2025Updated last year
- Pytorch implementation of "Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions", ICASSP, 2018.☆19Jan 21, 2021Updated 5 years ago
- ☆22Sep 26, 2024Updated 2 years ago
- Fine-tuning large language models (LLMs) is crucial for enhancing performance across domain-specific task applications. This comprehensiv…☆13Sep 19, 2024Updated 2 years ago
- A Tiny, Pure Python implementation of Gradient Boosted Trees.☆14Dec 28, 2022Updated 3 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- This repo implements and trains DallE-1 on a synthetically generated dataset which has colored mnist images on texture/solid background a…☆14Oct 30, 2024Updated last year
- This repo implements Video generation model using Latent Diffusion Transformers(Latte) in PyTorch and provides training and inference cod…☆19Jan 6, 2025Updated last year
- A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks☆38Oct 31, 2024Updated last year
- A straightforward explanation of how DeepSeek R1 works☆20Feb 7, 2025Updated last year
- TensorFlow and TVM integration☆36Apr 27, 2020Updated 6 years ago
- ☆16Aug 18, 2025Updated last year
- Run the native 284B-A13B DeepSeek-V4-Flash-0731 LLM locally on one laptop CPU: pure C, 8 GB RAM minimum, no GPU, best TPOT 0.892 s/token,…☆28Sep 9, 2026Updated last month