Convert BART models to ONNX with quantization. 3X reduction in size, and upto 3X boost in inference speed
☆33Dec 11, 2024Updated last year
Alternatives and similar repositories for fast-Bart
Users that are interested in fast-Bart are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Using TensorRT and Triton Server to build BERT model as a service☆13Jan 10, 2022Updated 4 years ago
- ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.☆586Apr 24, 2023Updated 3 years ago
- Multi-task modelling extensions for huggingface transformers☆21Mar 3, 2023Updated 3 years ago
- bert-flat 简化版 添加了很多注释☆15Nov 25, 2021Updated 4 years ago
- ☆12Oct 10, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 针对LCSTS数据集，目前有两种预处理方式。☆14Dec 22, 2020Updated 5 years ago
- ☆13Jun 2, 2022Updated 4 years ago
- This is a sample code for AutoSimulTrans Workshop (https://autosimtrans.github.io)☆18Dec 25, 2020Updated 5 years ago
- Convenient Text-to-Text Training for Transformers☆18Dec 10, 2021Updated 4 years ago
- ☆46Apr 13, 2022Updated 4 years ago
- Experimental code used in pre-training the KBIR and KeyBART models☆27Jul 8, 2022Updated 4 years ago
- Adding new tasks to T0 without catastrophic forgetting☆33Oct 20, 2022Updated 3 years ago
- 互联网敏感词，敏感词检测系统☆12Oct 12, 2025Updated 11 months ago
- Code release for Type-Aware Bi-Encoders for Open-Domain Entity Retrieval☆19Sep 24, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Official code of our work, Representation Learning for Resource-Constrained Keyphrase Generation.☆11May 26, 2022Updated 4 years ago
- ☆10Apr 6, 2022Updated 4 years ago
- ☆11Oct 9, 2022Updated 3 years ago
- 定时爬取百度搜索风云榜实时热点.☆35Updated this week
- DialCoT Meets PPO: Decomposing and Exploring Reasoning Paths in Smaller Language Models☆13Nov 2, 2023Updated 2 years ago
- Non Metric Space ( Approximate ) Library in R☆12Feb 2, 2023Updated 3 years ago
- [KBS] PCAE: A Framework of Plug-in Conditional Auto-Encoder for Controllable Text Generation PyTorch Implementation☆26Apr 10, 2023Updated 3 years ago
- ☆13Apr 27, 2022Updated 4 years ago
- This repository contains the data and code for the paper "Diverse Text Generation via Variational Encoder-Decoder Models with Gaussian Pr…☆26Jun 27, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆31Aug 5, 2023Updated 3 years ago
- Checkout the new version at the link!☆22Dec 11, 2020Updated 5 years ago
- Pytorch Implementation of Value Retrieval with Arbitrary Queries for Form-like Documents.☆16May 1, 2025Updated last year
- Evaluating BERT for the Answer Selection Task.☆12Dec 8, 2022Updated 3 years ago
- ☆11May 23, 2023Updated 3 years ago
- [COLING'22] Code for our paper: "COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization"☆22Oct 21, 2022Updated 3 years ago
- Sara - the Rasa Demo Bot: An example of a contextual AI assistant built with the open source Rasa Stack☆11Jan 14, 2021Updated 5 years ago
- Code for the paper "XAI Beyond Classification: Interpretable Neural Clustering" (JMLR 2022)☆12Mar 12, 2022Updated 4 years ago
- This demo showcase the use of onnxruntime-rs with a GPU on CUDA 11 to run Bert in a data pipeline with Rust.☆16Feb 7, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- WordPress plugin to add feature of Japanese proofreading☆11Jul 31, 2021Updated 5 years ago
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models☆25Aug 24, 2024Updated 2 years ago
- 基于 onnxruntime 推理引擎的中文 ltp 词法分析☆14Oct 4, 2022Updated 3 years ago
- Hybrid List Aware Transformer Reranking☆19Oct 25, 2022Updated 3 years ago
- ☆58Apr 24, 2021Updated 5 years ago
- The code for Template-GPT-2 Generation Model for Logic2Text Dataset☆18Jun 1, 2020Updated 6 years ago
- One Repository of AI Series: Collecting the useful technology articles, opensource tutorials and opensource books. 我的AI系列仓库之一：收集有用的技术文章、开…☆10Nov 14, 2024Updated last year