A simple implementation of Llama 1, 2. Llama Architecture built from scratch using PyTorch all the models are built from scratch that includes GQA (Grouped Query Attention) , RoPE (Rotary Positional Embeddings) , RMS Norm, FeedForward Block, Encoder (as this is only for Inferencing the model) , SwiGLU (Activation Function),
☆14May 6, 2024Updated 2 years ago
Alternatives and similar repositories for llama-inference
Users that are interested in llama-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MATLAB wrapper for LightGBM☆14Jul 30, 2017Updated 9 years ago
- ☆14Apr 26, 2024Updated 2 years ago
- Simple CTC implementation for PyTorch☆14Oct 25, 2017Updated 8 years ago
- Notes from Reinforcement Learning Specialisaiton☆11Jul 6, 2021Updated 5 years ago
- Graph Homomorphism Convolution (ICML'20)☆12Jul 6, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- How to build Text-to-Image app using stable diffusion via hugging face☆10May 28, 2023Updated 3 years ago
- DEPRECATED: research attempt to build e2e task oriented chatbot optimized over conversational data and content of DB (single table)☆11Sep 28, 2016Updated 9 years ago
- Another Unofficial Python Wrapper for Coinbase Pro☆10Oct 28, 2022Updated 3 years ago
- ☆14Apr 14, 2021Updated 5 years ago
- Self-normalizing neural network implemented in PyTorch.☆12Apr 3, 2019Updated 7 years ago
- A Python client for Chrome's DevTools protocol / a headless chrome control library☆15Aug 20, 2018Updated 7 years ago
- PyTorch library to accelerate super-resolution research☆11Jun 23, 2024Updated 2 years ago
- Reservoir computing for short-and long-term prediction of chaotic systems, with tasks Lorenz and Mackey-Glass systems. Bayesian optimizat…☆32Jul 19, 2025Updated last year
- Python script to convert AAX files to MP3☆21Jun 21, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Deep learning in time series analysis☆13May 21, 2018Updated 8 years ago
- Unlock the groundbreaking advances of deep learning with this extensively revised new edition of the bestselling original. Learn directly…☆10Feb 27, 2023Updated 3 years ago
- simple program that allows an Arduino to be re-programmed to emulate a USB keyboard that reads input from a serial connection.☆12Jan 17, 2025Updated last year
- AAX to MP3 script using FFMPEG☆22Dec 28, 2018Updated 7 years ago
- Deep neural parser for database query☆19Nov 20, 2022Updated 3 years ago
- Resources for GLUE benchmark in Spanish☆15Mar 29, 2021Updated 5 years ago
- ☆12Dec 14, 2024Updated last year
- This is the official repository for the HUI-Audio-Corpus-German. The corresponding paper is in the process of publication. With the repo…☆35Mar 31, 2023Updated 3 years ago
- A code sample demonstrating how to share and rebuild a PyTorch GPU tensor via its pointer/reference between different processes.☆15Aug 27, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Machine Learning algorithms implementation in Python from scratch.☆11Feb 10, 2019Updated 7 years ago
- code for Preprint paper at Arxiv: MoT: Pre-thinking and Recalling Enable ChatGPT to Self-Improve with Memory-of-Thoughts☆24Nov 29, 2023Updated 2 years ago
- A barely barebone NumPy implementation of Hierarchical Temporal Memory.☆11Mar 26, 2023Updated 3 years ago
- Allocation benchmarks☆31Jul 6, 2016Updated 10 years ago
- Monero: the secure, private, untraceable cryptocurrency☆20Jan 1, 2026Updated 7 months ago
- A replication of the paper "Adaptive Mixtures of Local Experts" applied to the CIFAR-10 image classification dataset.☆12Mar 19, 2021Updated 5 years ago
- ☆13Sep 12, 2024Updated last year
- A WebSocket proxy server using Python 3.☆22Mar 15, 2026Updated 4 months ago
- YouTubeGPT☆25Sep 24, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [신발 Tag 상품번호 인식기] OCR 을 이용하여 신발 태그의 품번을 인식하여 사용자에게 신발 정보를 제공하는 서비스를 기획 및 구현하였습니다.☆12Apr 22, 2022Updated 4 years ago
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Mar 27, 2024Updated 2 years ago
- yolosegment2labelme - a Python package that allows you to convert YOLO segmentation prediction results to LabelMe and anylabeling JSON fo…☆10May 8, 2024Updated 2 years ago
- Files used for the evaluation of uiCA☆19Dec 14, 2022Updated 3 years ago
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆19Sep 13, 2024Updated last year
- ☆40Updated this week
- ☆18May 10, 2021Updated 5 years ago