This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
☆95Mar 11, 2024Updated 2 years ago
Alternatives and similar repositories for transformers-stream-generator
Users that are interested in transformers-stream-generator are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Aug 23, 2024Updated 2 years ago
- aigc evals☆10Dec 2, 2023Updated 2 years ago
- 针对qwen微调模型进行数据预处理☆13Jan 8, 2024Updated 2 years ago
- This is a Dockerfile to use stable_diffusion.openvino in Docker container.☆13Aug 29, 2022Updated 4 years ago
- A library for data streaming and augmentation☆22May 5, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- accelerate generating vector by using onnx model☆18Jan 23, 2024Updated 2 years ago
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆40Nov 11, 2024Updated last year
- Code for our Bioinformatics 2022 paper: "DxFormer: A Decoupled Automatic Diagnostic System Based on Decoder-Encoder Transformer with Dens…☆11Dec 24, 2022Updated 3 years ago
- 基于鼠标键盘操作的微信自动聊天机器人☆13Nov 26, 2024Updated last year
- Code for Paper "Bidirectional Aggregation Network with Occlusion Handling for Panoptic Segmentation"☆16Mar 25, 2020Updated 6 years ago
- See details in https://github.com/pytorch/xla/blob/r1.12/torch_xla/distributed/fsdp/README.md☆25Dec 22, 2022Updated 3 years ago
- ☆21Feb 15, 2024Updated 2 years ago
- Transformer related optimization, including BERT, GPT☆6,457Mar 27, 2024Updated 2 years ago
- 我的博客: 记录编程，论文，想法等其他☆22Oct 11, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆13Apr 24, 2024Updated 2 years ago
- This repository is TensorRT implement of PINet☆18Nov 1, 2022Updated 3 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆12Nov 14, 2025Updated 11 months ago
- An innovative method expediting LLMs via streamlined semi-autoregressive generation and draft verification.☆29Apr 15, 2025Updated last year
- A package for filtering sensitive data (parameters, keys) from a variety of JS objects☆10Updated this week
- 纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM☆13Aug 21, 2026Updated last month
- This is the LAION repository for creating open super-resolution models with the help of LAION-5B subsets.☆13May 9, 2022Updated 4 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆141Dec 6, 2024Updated last year
- Chinese CLIP models with SOTA performance.☆62Aug 28, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.☆5,065Apr 11, 2025Updated last year
- ☆10Oct 15, 2020Updated 6 years ago
- MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.☆2,114Jun 30, 2025Updated last year
- [CVPR 2022 Challenge Rank 1st] The official code for V2L: Leveraging Vision and Vision-language Models into Large-scale Product Retrieval…☆29Jul 30, 2022Updated 4 years ago
- A Sparse-tensor Communication Framework for Distributed Deep Learning☆13Nov 1, 2021Updated 4 years ago
- Webvision Challenge 2020 developer kit☆10Dec 8, 2022Updated 3 years ago
- Distributed IO-aware Attention algorithm☆24Sep 24, 2025Updated last year
- ☆38May 5, 2025Updated last year
- [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding☆1,343Mar 6, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆13Jan 8, 2024Updated 2 years ago
- ☆91Jul 4, 2024Updated 2 years ago
- Implementation of the content-aware image resizing algorithm presented in the paper "Seam carving for content-aware image resizing"☆13Jul 22, 2019Updated 7 years ago
- Code repository of the NAACL'21 paper "CoRT: Complementary Rankings from Transformers"☆12Jul 7, 2021Updated 5 years ago
- Research project leveraging Abstract Syntax Trees and Knowledge Graphs with Retrieval-Augmented Generation to develop an advanced, contex…☆13Jul 18, 2024Updated 2 years ago
- machine learning practice☆11May 3, 2018Updated 8 years ago
- Vistral-V: Visual Instruction Tuning for Vistral - Vietnamese Large Vision-Language Model.☆23Jul 1, 2024Updated 2 years ago