ENOT-AutoDL / gpt-j-6B-tensorrt-int8

GPT-J 6B inference on TensorRT with INT-8 precision
11Updated last year

Alternatives and similar repositories for gpt-j-6B-tensorrt-int8:

Users that are interested in gpt-j-6B-tensorrt-int8 are comparing it to the libraries listed below