lunabrain-ai / dolly-v2-12b-8bit-example

This repo loads the Dolly V2 12b model (databricks/dolly-v2-12b) using the `transformers` library. The code loads it in 8-bit quantized mode.
26Updated last year

Related projects

Alternatives and complementary repositories for dolly-v2-12b-8bit-example