brave-experiments / MELT-public
codebase for "MELTing Point: Mobile Evaluation of Language Transformers"
☆16Updated 6 months ago
Alternatives and similar repositories for MELT-public:
Users that are interested in MELT-public are comparing it to the libraries listed below
- One-size-fits-all model for mobile AI, a novel paradigm for mobile AI in which the OS and hardware co-manage a foundation model that is c…☆22Updated 10 months ago
- (HotMobile'24) Salted Inference: Enhancing Privacy while Maintaining Efficiency of Split Inference in Mobile Computing☆14Updated 11 months ago
- Awesome Mobile LLMs☆113Updated this week
- [DMLR 2024] FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things☆52Updated 4 months ago
- EE-LLM is a framework for large-scale training and inference of early-exit (EE) large language models (LLMs).☆52Updated 7 months ago
- Survey Paper List - Efficient LLM and Foundation Models☆238Updated 3 months ago
- [TOSN 2024] Artificial Intelligence of Things: A Survey☆47Updated 2 months ago
- Libraries for efficient and scalable group-structured dataset pipelines.☆23Updated last month
- Enhancing Efficiency in Multidevice Federated Learning through Data Selection☆13Updated 9 months ago
- ☆99Updated last year
- ☆192Updated last year
- [MobiCom '23] AccuMO: Accuracy-Centric Multitask Offloading in Edge-Assisted Mobile Augmented Reality☆13Updated last year
- Federated Few-shot Learning for Mobile NLP. Conditionally accepted by MobiCom'23.☆15Updated last year
- Efficient LLM Inference Acceleration using Prompting☆45Updated 2 months ago
- This is a list of awesome edgeAI inference related papers.☆91Updated last year
- ☆43Updated 6 months ago
- How much energy do GenAI models consume?☆41Updated 3 months ago
- ☆37Updated 3 months ago
- ☆17Updated last year
- Source code and datasets for Ekya, a system for continuous learning on the edge.☆104Updated 2 years ago
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆53Updated 3 months ago
- ☆11Updated 5 months ago
- InFi is a library for building input filters for resource-efficient inference.☆37Updated last year
- Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"☆29Updated 10 months ago
- Accommodating Large Language Model Training over Heterogeneous Environment.☆15Updated 2 months ago
- Miro[ACM MobiCom '23] Cost-effective On-device Continual Learning over Memory Hierarchy with Miro☆12Updated 11 months ago
- Federated Learning Systems Paper List☆68Updated 11 months ago
- ☆22Updated 6 months ago
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆34Updated 2 years ago
- ☆41Updated last year