AI-Hypercomputer / jetstream-pytorchLinks
PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
☆73Updated 3 weeks ago
Alternatives and similar repositories for jetstream-pytorch
Users that are interested in jetstream-pytorch are comparing it to the libraries listed below
Sorting:
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…