Inference code for LLaMA models
☆42Mar 13, 2023Updated 3 years ago
Alternatives and similar repositories for llama
Users that are interested in llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Example code snipped to visualize a neural network fitting a surface to random points in space☆12Dec 26, 2021Updated 4 years ago
- Ultra-low-latency, high-throughput multiprocess transport over SHM and mmap. LMAX-Disruptor-style cross-process ring substrate.☆20Aug 6, 2026Updated last month
- repository for the course Numerical Analysis for Machine Learning of Politecnico di Milano☆16Feb 1, 2025Updated last year
- Build a Kubernetes (K8s) cluster and configure the OAI 5G core network and UERANSIM GNB + UEs on it☆12Nov 10, 2025Updated 10 months ago
- ☆20Nov 4, 2025Updated 10 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- BFloat16 Fused Adam Operator for PyTorch☆20Nov 16, 2024Updated last year
- A guide for PhD students by a not so good PhD student☆17Dec 31, 2023Updated 2 years ago
- Sources for the Oak Ridge Leadership Computing Facility User Documentation☆67Updated this week
- ☆13Aug 13, 2024Updated 2 years ago
- Queue system for dispatching FFmpeg jobs, used for @uwutube, powered by @fastify and @redis☆11Feb 12, 2022Updated 4 years ago
- Student-driven collection of past exam papers and solutions for the 059432 – Quantum Computing course at Politecnico di Milano, updated a…☆21Jul 16, 2026Updated 2 months ago
- Dynamic per-token early exit for LLM inference. Skip layers tokens don't need☆33Sep 18, 2026Updated 2 weeks ago
- NUMA-Aware Reader-Writer Locks☆20Jun 12, 2014Updated 12 years ago
- ☆11Mar 10, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Switch-based Training Acceleration for Machine Learning (SwitchML)☆16Apr 13, 2021Updated 5 years ago
- A command line utility to manage the configuration of a system's high performance network interfaces for RoCE deployments☆36Jul 25, 2023Updated 3 years ago
- ☆18Oct 12, 2022Updated 3 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆20Oct 23, 2023Updated 2 years ago
- Reference implementations of MLPerf™ HPC training benchmarks☆51Feb 25, 2025Updated last year
- ☆14Mar 2, 2025Updated last year
- Datasets used in the tox21 challenge☆11Nov 6, 2019Updated 6 years ago
- Official codes for COLING 2024 paper "Robust and Scalable Model Editing for Large Language Models": https://arxiv.org/abs/2403.17431v1☆14Mar 27, 2024Updated 2 years ago
- A Challenge on Dialog Systems with Retrieval Augmented Generation (FutureDial-RAG), Co-located with SLT2024 FutureDial-RAG Challenge☆12Aug 10, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Blogging with Emacs and AI☆11Jun 4, 2023Updated 3 years ago
- An official codebase for "NormLens: Reading Books is Great, But Not if You Are Driving! Visually Grounded Reasoning about Defeasible Comm…☆10May 9, 2024Updated 2 years ago
- Android app for the fieldworkers.☆11Updated this week
- Dataset for AAAI paper "Natural Language Inference in Context - Investigating Contextual Reasoning over Long Texts"☆11Nov 18, 2022Updated 3 years ago
- Source code to accompany research paper on training multi token prediction language models using self-distillation.☆42Feb 21, 2026Updated 7 months ago
- Pre-computed IDF stats over all EN Wiki articles☆13Jan 30, 2020Updated 6 years ago
- ☆36Updated this week
- A library for calibrating classifiers and computing calibration metrics☆14Nov 28, 2022Updated 3 years ago
- ☆15Oct 17, 2023Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆13Sep 5, 2024Updated 2 years ago
- [WIP] Better (FP8) attention for Hopper☆33Aug 21, 2026Updated last month
- Distilling Task-Specific Knowledge from Teacher Model into BiLSTM☆31Dec 14, 2024Updated last year
- Materials and Information for Ethics of Artificial Intelligence and Machine Learning☆11Sep 29, 2023Updated 3 years ago
- Code release for "TempLM: Distilling Language Models into Template-Based Generators"☆14Jul 21, 2022Updated 4 years ago
- ☆11May 12, 2022Updated 4 years ago
- A Qualifying Exam for Coding Agent as Robot Learning Engineers☆65Updated this week