hemingkx / SWIFT

SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
26Updated last month

Related projects

Alternatives and complementary repositories for SWIFT