Easy and Efficient Transformer : Scalable Inference Solution For Large NLP model
☆262Nov 30, 2024Updated last year
Alternatives and similar repositories for EET
Users that are interested in EET are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Easy and Efficient Quantization for Transformers☆205Mar 25, 2026Updated 7 months ago
- a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.☆1,553Jul 18, 2025Updated last year
- ☆13Aug 23, 2024Updated 2 years ago
- LightSeq: A High Performance Library for Sequence Processing and Generation☆3,293May 16, 2023Updated 3 years ago
- Serving Inside Pytorch☆170Jun 23, 2026Updated 4 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- GLM (General Language Model)☆24Mar 7, 2022Updated 4 years ago
- ACL 2021: HiTransformer☆13May 29, 2021Updated 5 years ago
- Efficient Inference for Big Models☆587Jul 7, 2026Updated 3 months ago
- Implementation of ICLR 2018 paper "Loss-aware Weight Quantization of Deep Networks"☆27Oct 24, 2019Updated 7 years ago
- Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo☆3,117May 9, 2024Updated 2 years ago
- Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀☆1,695Oct 23, 2024Updated 2 years ago
- Introduction to CPM☆17Jun 22, 2021Updated 5 years ago
- Inference framework for MoE layers based on TensorRT with Python binding☆40May 31, 2021Updated 5 years ago
- Parallelformers: An Efficient Model Parallelization Toolkit for Deployment☆789Apr 24, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆15Nov 3, 2022Updated 3 years ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,169Jan 22, 2024Updated 2 years ago
- Neural end-to-end Speech Translation Toolkit☆305Jun 28, 2022Updated 4 years ago
- ☆12Dec 9, 2015Updated 10 years ago
- A fast MoE impl for PyTorch☆1,859Feb 10, 2025Updated last year
- A plug-in of Microsoft DeepSpeed to fix the bug of DeepSpeed pipeline☆25Apr 16, 2021Updated 5 years ago
- Official implementation for EMNLP 2023 paper "Non-autoregressive Streaming Transformer for Simultaneous Translation"☆12Oct 19, 2023Updated 3 years ago
- ACL 2020: ScriptWriter: Narrative-Guided Script Generation☆34May 24, 2022Updated 4 years ago
- A plug-and-play library for parameter-efficient-tuning (Delta Tuning)☆1,047Sep 19, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- realize the reinforcement learning training for gpt2 llama bloom and so on llm model☆27Sep 19, 2023Updated 3 years ago
- [ICLR 2020] Lite Transformer with Long-Short Range Attention☆609Jul 11, 2024Updated 2 years ago
- Transformer related optimization, including BERT, GPT☆6,457Mar 27, 2024Updated 2 years ago
- A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models☆1,975Jun 12, 2023Updated 3 years ago
- kaldi cnn-tdnnf baseline☆13Aug 31, 2021Updated 5 years ago
- Boosting your Web Services of Deep Learning Applications.☆1,242May 13, 2021Updated 5 years ago
- SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.☆1,121Dec 26, 2024Updated last year
- Rethinking Perturbations in Encoder-Decoders for Fast Training☆18Nov 25, 2021Updated 4 years ago
- it's a train acoustics model code lib☆27May 20, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ICASSP 2021 accepted papers in term of voice conversion (VC)☆18Apr 11, 2021Updated 5 years ago
- Official repository for "PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation"☆31Apr 17, 2021Updated 5 years ago
- Data for DialogLM☆10Jan 6, 2022Updated 4 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆476Mar 7, 2024Updated 2 years ago
- Chinese Pre-Trained Language Models (CPM-LM) Version-I☆1,576Mar 18, 2023Updated 3 years ago
- 中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard☆4,288Feb 6, 2026Updated 8 months ago
- [ASRU 2021] Efficient Conformer: Progressive Downsampling and Grouped Attention for Automatic Speech Recognition☆219Jun 22, 2023Updated 3 years ago