Curt-Park / echo-grpc-tritonLinks
Inference API server with echo and gRPC to triton server (golang)
☆13Updated 3 years ago
Alternatives and similar repositories for echo-grpc-triton
Users that are interested in echo-grpc-triton are comparing it to the libraries listed below
Sorting:
- Serving Example of CodeGen-350M-Mono-GPTJ on Triton Inference Server with Docker and Kubernetes☆20Updated 2 years ago
- Simple example of FastAPI + Celery + Triton for benchmarking☆64Updated 3 years ago
- Weak Labeling (NER) using ChatGPT☆36Updated 2 years ago
- High-performance vector search engine with no loss of accuracy through GPU and dynamic placement☆31Updated 6 months ago
- Tiny configuration for Triton Inference Server☆45Updated last year
- 🎹 Instruct.KR 2025 Summer Meetup: 오픈소스 LLM, vLLM으로 Production까지 🎹☆24Updated 5 months ago
- The aim of this project is to publish and archive newsletters to a target email address.☆21Updated 2 years ago
- LINER PDF Chat Tutorial with ChatGPT & Pinecone☆49Updated 2 years ago
- AskUp Search ChatGPT Plugin☆20Updated 2 years ago
- 나무위키, 위키피디아, 다음블로그, 티스토리, 유튜브, 네이트판 크롤러☆12Updated 4 years ago
- 🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드☆59Updated 2 years ago
- Beyond LM: How can language model go forward in the future?☆15Updated 2 years ago
- StrategyQA 데이터 세트 번역☆23Updated last year
- A loader that lets you try running LLMs built for WebGPU.☆29Updated 2 years ago
- ☆19Updated 3 years ago
- CPython 파헤치기 스터디☆16Updated last year
- 🦕 A library that handles everything with 🤗 and supports batching to models in PORORO☆37Updated 3 years ago
- This project shows how to serve an TF based image classification model as a web service with TFServing, Docker, and Kubernetes(GKE).☆125Updated 3 years ago
- Deploy KoGPT with Triton Inference Server☆14Updated 3 years ago
- 금융 도메인에 특화된 한국어 임베딩 모델☆23Updated last year
- ☆26Updated 2 years ago
- Golang Boilerplate for OpenAI + PostgreSQL + go-chi☆19Updated 2 years ago
- 🔮 LLM GPU Calculator☆21Updated 2 years ago
- Coord: A Unified Interface for All Models☆18Updated 9 months ago
- Distilling Task-Specific Knowledge from Teacher Model into BiLSTM☆32Updated last year
- ANN server using faiss.☆14Updated 4 years ago
- Python monorepo template with Pants☆21Updated 2 years ago
- 한국어 중의성 해소 평가 데이터 세트☆52Updated last month
- 한국어 언어 모델 학습을 위한 프로젝트(Flax, Pytorch with Huggingface Accelerate)☆32Updated 2 years ago
- Python Project Template☆68Updated 3 years ago