FMInference / FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.
9,187Updated 2 weeks ago

Related projects

Alternatives and complementary repositories for FlexLLMGen