FMInference / FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.
9,198Updated 3 weeks ago

Related projects

Alternatives and complementary repositories for FlexLLMGen