A simple implementation of Llama 1, 2. Llama Architecture built from scratch using PyTorch all the models are built from scratch that includes GQA (Grouped Query Attention) , RoPE (Rotary Positional Embeddings) , RMS Norm, FeedForward Block, Encoder (as this is only for Inferencing the model) , SwiGLU (Activation Function),
☆14May 6, 2024Updated 2 years ago
Alternatives and similar repositories for llama-inference
Users that are interested in llama-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A barely barebone NumPy implementation of Hierarchical Temporal Memory.☆11Mar 26, 2023Updated 3 years ago
- Self-normalizing neural network implemented in PyTorch.☆12Apr 3, 2019Updated 7 years ago
- ☆12Dec 14, 2024Updated last year
- A collection of tools that explore giving LLMs agency.☆12Jan 7, 2024Updated 2 years ago
- Enhanced multi-needle retrieval testing framework for evaluating LLM long-context understanding capabilities☆12Oct 8, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Example project to take a shot at nginx unit☆11Dec 11, 2018Updated 7 years ago
- download and load SA-1B☆11Apr 15, 2023Updated 3 years ago
- code for Preprint paper at Arxiv: MoT: Pre-thinking and Recalling Enable ChatGPT to Self-Improve with Memory-of-Thoughts☆24Nov 29, 2023Updated 2 years ago
- ☆13Sep 12, 2024Updated 2 years ago
- yolosegment2labelme - a Python package that allows you to convert YOLO segmentation prediction results to LabelMe and anylabeling JSON fo…☆10May 8, 2024Updated 2 years ago
- tutorial for training a BPE tokenizer on multiple GPUs☆13May 5, 2025Updated last year
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Mar 27, 2024Updated 2 years ago
- Utility of SMI (Secondary Memory Interface) of Raspberry Pi☆12Apr 29, 2017Updated 9 years ago
- ☆10Mar 25, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official code of "A Model Can Help Itself: Reward-Free Self-Training for LLM Reasoning".☆13Oct 5, 2026Updated last month
- Python client for Jikan.moe, MyAnimeList unofficial API with good intentions.☆15Dec 20, 2022Updated 3 years ago
- A replication of the paper "Adaptive Mixtures of Local Experts" applied to the CIFAR-10 image classification dataset.☆12Mar 19, 2021Updated 5 years ago
- Compressed version of Tacotron 2 using Tensor Train + Waveglow.☆22Dec 26, 2019Updated 6 years ago
- Android app useful for car pooling☆16Aug 12, 2016Updated 10 years ago
- ☆18May 10, 2021Updated 5 years ago
- This repo implements DETR in PyTorch and provides training and inference code on VOC dataset☆13May 6, 2025Updated last year
- Realizing private and practical pharmacological collaboration☆15Oct 19, 2018Updated 8 years ago
- Course Project for COMP4471 on RWKV☆17Feb 11, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 《GPT-4, ChatGPT, 라마인덱스, 랭체인을 활용한 인공지능 프로그래밍》 예제 코드☆10Jan 16, 2024Updated 2 years ago
- Load and run Llama from safetensors files in C☆16Oct 24, 2024Updated 2 years ago
- SYN flood implementation using Boost.Asio☆12Nov 20, 2014Updated 11 years ago
- Files used for the evaluation of uiCA☆19Dec 14, 2022Updated 3 years ago
- Environment equipped with reinforcement learning algorithms to train agents to play tic-tac-toe.☆13Mar 4, 2023Updated 3 years ago
- A repository-level metadata dataset intended to help researchers find GitHub repositories with evidence of non-English natural-language c…☆19Jun 15, 2026Updated 5 months ago
- Mini-pytorch implemented from scratch using Python☆15Jan 19, 2022Updated 4 years ago
- ☆10Apr 16, 2019Updated 7 years ago
- Fine-tuning large language models (LLMs) is crucial for enhancing performance across domain-specific task applications. This comprehensiv…☆13Sep 19, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Mixture of Experts from scratch☆14Apr 12, 2024Updated 2 years ago
- This repo implements and trains DallE-1 on a synthetically generated dataset which has colored mnist images on texture/solid background a…☆14Oct 30, 2024Updated 2 years ago
- This repo implements Video generation model using Latent Diffusion Transformers(Latte) in PyTorch and provides training and inference cod…☆19Jan 6, 2025Updated last year
- Jax/Flax implementation of Denoising Diffusion Implicit Models☆20Jul 18, 2022Updated 4 years ago
- Pytorch implementation of "Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions", ICASSP, 2018.☆19Jan 21, 2021Updated 5 years ago
- A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks☆38Oct 31, 2024Updated 2 years ago
- Multi-Agent AI App from Scratch in python without any depedency of framework☆15Jan 7, 2025Updated last year
Are these results useful?