A side project that follows all the acceleration tricks in tinyllama, with the minimal modification to the huggingface transformers code.
☆13Sep 2, 2024Updated last year
Alternatives and similar repositories for tinyllama
Users that are interested in tinyllama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Dec 19, 2024Updated last year
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆157Apr 7, 2025Updated last year
- [ACL'24 Findings] Official code for "TLCR: Token-Level Continuous Reward for Fine-grained Reinforcement Learning from Human Feedback"☆12Dec 6, 2024Updated last year
- Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)☆17May 24, 2024Updated 2 years ago
- ☆22Dec 1, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆19Dec 4, 2025Updated 7 months ago
- Official codes for COLING 2024 paper "Robust and Scalable Model Editing for Large Language Models": https://arxiv.org/abs/2403.17431v1☆14Mar 27, 2024Updated 2 years ago
- Implementation of our ACL 2020 paper: Structured Tuning for Semantic Role Labeling☆19Apr 2, 2024Updated 2 years ago
- [NeurIPS 2024] Low rank memory efficient optimizer without SVD☆33Jul 1, 2025Updated last year
- Code for Pushdown Layers from our EMNLP 2023 paper☆28Dec 3, 2023Updated 2 years ago
- Code for Repl4NLP paper "A Cross-Task Analysis of Text Span Representations"☆21Nov 4, 2022Updated 3 years ago
- [ECCV 2024] Official repository of ECCV 2024 paper: Object-Conditioned Energy-Based Attention Map Alignment in Text-to-Image Diffusion M…☆16May 24, 2025Updated last year
- Conic10K: A large-scale dataset for closed-vocabulary math problem understanding. Accepted to EMNLP2023 Findings.☆33Dec 6, 2023Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆33May 25, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"☆31Jun 18, 2021Updated 5 years ago
- [NeurIPS 2024] Official implementation of NeurIPS 2024 paepr "Flow Priors for Linear Inverse Problems via Iterative Corrupted Trajectory …☆26Feb 24, 2025Updated last year
- Download all Cloudflare durable object state to a local SQLite database.☆24Mar 9, 2024Updated 2 years ago
- ☆52Jan 28, 2024Updated 2 years ago
- ☆16Aug 19, 2024Updated last year
- HGRN2: Gated Linear RNNs with State Expansion☆58Aug 20, 2024Updated last year
- Here we will test various linear attention designs.☆62Apr 25, 2024Updated 2 years ago
- Dataset for Unified Editing, EMNLP 2023. This is a model editing dataset where edits are natural language phrases.☆24Sep 4, 2024Updated last year
- Fork of NACA from Google Code☆13Feb 25, 2010Updated 16 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Tracking the latest and greatest research papers on diffusion large language models.☆32Mar 13, 2026Updated 4 months ago
- continous batching and parallel acceleration for RWKV6☆23Jun 28, 2024Updated 2 years ago
- DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention☆22May 25, 2026Updated 2 months ago
- [ICML 2023] "Data Efficient Neural Scaling Law via Model Reusing" by Peihao Wang, Rameswar Panda, Zhangyang Wang☆14Jan 4, 2024Updated 2 years ago
- RADLADS training code☆46May 7, 2025Updated last year
- Test Orchestrator for Performance and Scalability of AI pLatforms☆18Jun 23, 2026Updated last month
- ☆11Aug 20, 2024Updated last year
- Code for the Secure Triplet Loss approach for biometric template security.☆10Apr 22, 2021Updated 5 years ago
- Experiment on replacing the Scaled Dot-Product Attention in Transformers for a distance-based metric: the Radial Basis Function (RBF) ker…☆25Apr 19, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Run code-llama with 50k tokens using flash attention and better transformer☆12Nov 21, 2023Updated 2 years ago
- Commands that will make you more comfortable with the ROCm toolkit.☆18Aug 1, 2024Updated last year
- ☆11Feb 27, 2026Updated 4 months ago
- Vocabulary Parallelism☆26Mar 10, 2025Updated last year
- Secure Chat via NATS☆11Feb 23, 2016Updated 10 years ago
- [AAAI26] LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs☆55Dec 7, 2025Updated 7 months ago
- Deployment of ERPNext for a small service company☆12Jan 24, 2025Updated last year