sdpython / onnxcustomLinks
Tutorial on how to convert machine learned models into ONNX
☆16Updated 2 years ago
Alternatives and similar repositories for onnxcustom
Users that are interested in onnxcustom are comparing it to the libraries listed below
Sorting:
- benchmarking some transformer deployments☆26Updated last month
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Updated 3 months ago
- ☆39Updated 3 years ago
- experiments with inference on llama☆103Updated last year
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…☆44Updated last year
- Make triton easier☆50Updated last year
- 🤝 Trade any tensors over the network☆30Updated 2 years ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated 2 years ago
- Prototype routines for GPU quantization written using PyTorch.☆21Updated this week
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆85Updated this week
- Torch Distributed Experimental☆117Updated last year
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated 2 months ago
- ☆19Updated 3 years ago
- Truly flash T5 realization!☆71Updated last year
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated 2 years ago
- Repository for CPU Kernel Generation for LLM Inference☆27Updated 2 years ago
- ML/DL Math and Method notes☆66Updated 2 years ago
- ☆21Updated 10 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆35Updated 2 years ago
- A place to store reusable transformer components of my own creation or found on the interwebs