LowinLi / transformers-stream-generator

This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
96Updated 8 months ago

Related projects

Alternatives and complementary repositories for transformers-stream-generator