arrmansa / Basic-UI-for-GPT-J-6B-with-low-vram

A repository to run gpt-j-6b on low vram machines (4.2 gb minimum vram for 2000 token context, 3.5 gb for 1000 token context). Model loading takes 12gb free ram.
114Updated 2 years ago

Related projects

Alternatives and complementary repositories for Basic-UI-for-GPT-J-6B-with-low-vram