Serving Example of CodeGen-350M-Mono-GPTJ on Triton Inference Server with Docker and Kubernetes
โ20May 30, 2023Updated 3 years ago
Alternatives and similar repositories for serving-codegen-gptj-triton
Users that are interested in serving-codegen-gptj-triton are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inference API server with echo and gRPC to triton server (golang)โ13Nov 16, 2022Updated 3 years ago
- generative language model training on top of the JAX and Huggingface ๐คโ10May 11, 2022Updated 4 years ago
- โ19Sep 20, 2022Updated 4 years ago
- Python monorepo template with Pantsโ21Aug 19, 2023Updated 3 years ago
- ์ธ์ด๋ชจ๋ธ์ ํ์ตํ๊ธฐ ์ํ ๊ณต๊ฐ ํ๊ตญ์ด instruction dataset๋ค์ ๋ชจ์๋์์ต๋๋ค.โ19Jul 16, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer โข AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ์ฌ์ ์์ ๋ํ ์๋ฌธ๋ง ์ถ์ถํ ๋ฐ์ดํฐโ16Apr 24, 2023Updated 3 years ago
- kogpt๋ฅผ oslo๋ก ํ์ธํ๋ํ๋ ์์ .โ23Aug 26, 2022Updated 4 years ago
- Beyond LM: How can language model go forward in the future?โ15Apr 30, 2023Updated 3 years ago
- Audio Signal Processing & Speech Recognitionโ26Jan 24, 2021Updated 5 years ago
- Train ๐คtransformers with DeepSpeed: ZeRO-2, ZeRO-3โ23May 20, 2021Updated 5 years ago
- Korean Moview Review Emotion (KMRE) Datasetโ22Sep 7, 2020Updated 6 years ago
- AWS SageMaker๋ฅผ ์ด์ฉํ MLOps์ LLMOpsโ30Aug 4, 2023Updated 3 years ago
- Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasetsโ131Nov 12, 2022Updated 3 years ago
- โ14Dec 9, 2021Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform โข AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- โ12Sep 23, 2020Updated 6 years ago
- โ23Oct 30, 2023Updated 3 years ago
- All-in-one repository for Fine-tuning & Pretraining (Large) Language Modelsโ15Mar 8, 2023Updated 3 years ago
- Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findingsโ15May 3, 2023Updated 3 years ago
- AI Poet | KoGPT2 ๋ชจ๋ธ์ ํ์ฉํ ์ ์์ฑ ๋ชจ๋ธโ24Jun 15, 2020Updated 6 years ago
- Convenient Text-to-Text Training for Transformersโ18Dec 10, 2021Updated 4 years ago
- OSLO: Open Source for Large-scale Optimizationโ178Sep 9, 2023Updated 3 years ago
- โ105May 8, 2024Updated 2 years ago
- ์ด์ฑ ํด์๊ธฐ based on ko-BARTโ29Mar 31, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean โข AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Record the movie list and share it!โ14Jan 25, 2015Updated 11 years ago
- Calculating Expected Time for training LLM.โ39Apr 17, 2023Updated 3 years ago
- #Paired Questionโ25Jun 16, 2020Updated 6 years ago
- โ10Oct 21, 2022Updated 4 years ago
- Simple example of FastAPI + Celery + Triton for benchmarkingโ65Aug 11, 2022Updated 4 years ago
- NSMC, KorSTS ... fine-tuningsโ18Feb 23, 2022Updated 4 years ago
- KorQuAD (Korean Question Answering Dataset) submission guide using PyTorch pretrained BERTโ31Jun 18, 2019Updated 7 years ago
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluationโ28Dec 9, 2022Updated 3 years ago
- โ11Nov 23, 2021Updated 4 years ago
- Managed Database hosting by DigitalOcean โข AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Large-scale language modeling tutorials with PyTorchโ294Nov 2, 2021Updated 5 years ago
- ๋ชจ๋์ ๋ง๋ญ์น ์ธ๊ณต ์ง๋ฅ ์ธ์ด ๋ฅ๋ ฅ ํ๊ฐ 1๋ฑ ์๋ฃจ์ ์ ๋๋ค.โ49Nov 20, 2021Updated 4 years ago
- Google ๊ณต์ Rouge Implementation์ ํ๊ตญ์ด์์ ์ฌ์ฉํ ์ ์๋๋ก ์ฒ๋ฆฌโ17Jan 3, 2024Updated 2 years ago
- annotated-transformer-krโ15May 16, 2019Updated 7 years ago
- https://challenge.enliple.com/โ16Jun 10, 2020Updated 6 years ago
- Refactoring contents and codes of CS20 : Tensorflow for Deep Learning Researchโ62Jan 18, 2019Updated 7 years ago
- โ10Oct 2, 2021Updated 5 years ago