viai957 / llama-inference

Related projects: ⓘ

• RahulSChand / llama2.c-for-dummies
  Step by step explanation/tutorial of llama2.c
  ☆207Updated 11 months ago
• NetEase-FuXi / EETQ
  Easy and Efficient Quantization for Transformers
  ☆172Updated 2 months ago
• hscspring / llama.np
  Inference Llama/Llama2 Modes in NumPy
  ☆18Updated 9 months ago
• likejazz / llama3.cuda
  llama3.cuda is a pure C/CUDA implementation for Llama 3 model.
  ☆287Updated 3 months ago
• deep-diver / keras-sd-serving
  showing various ways to serve Keras based stable diffusion
  ☆109Updated last year
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆65Updated 2 weeks ago
• tspeterkim / mixed-precision-from-scratch
  Mixed precision training from scratch with Tensors and CUDA
  ☆18Updated 4 months ago
• deep-diver / hf-daily-paper-newsletter
  Newsletter bot for 🤗 Daily Papers
  ☆101Updated this week
• deep-diver / ml-deployment-k8s-tfserving
  This project shows how to serve an TF based image classification model as a web service with TFServing, Docker, and Kubernetes(GKE).
  ☆120Updated 2 years ago
• UpstageAI / evalverse
  The Universe of Evaluation. All about the evaluation for LLMs.
  ☆205Updated 2 months ago
• deep-diver / PingPong
  manage histories of LLM applied applications
  ☆86Updated 10 months ago
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆58Updated 4 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆62Updated this week
• deep-diver / semantic-segmentation-ml-pipeline
  Machine Learning Pipeline for Semantic Segmentation with TensorFlow Extended (TFX) and various GCP products
  ☆93Updated last year
• vedantroy / gpu_kernels
  ☆22Updated 8 months ago
• triton-inference-server / vllm_backend
  ☆170Updated this week
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆91Updated 2 months ago
• deep-diver / janus
  generate synthetic data for LLM fine-tuning in arbitrary situations within systematic way
  ☆21Updated 6 months ago
• daemyung / practice-triton
  삼각형의 실전! Triton
  ☆14Updated 7 months ago
• deep-diver / llamaduo
  This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.
  ☆281Updated 3 weeks ago
• KyujinHan / Sakura-SOLAR-DPO
  Sakura-SOLAR-DPO: Merge, SFT, and DPO
  ☆114Updated 8 months ago
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆82Updated 3 weeks ago
• davidkim205 / nox
  Efficient fine-tuning for ko-llm models
  ☆184Updated 6 months ago
• codingpot / git-mlops
  ☆97Updated 2 years ago
• 2U1 / Phi3-Vision-Finetune
  An open-source implementaion for fine-tuning Phi3-Vision and Phi3.5-Vision by Microsoft.
  ☆44Updated this week
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆250Updated this week
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆129Updated last month
• synabreu / awskrusergroup
  AWS SageMaker를 이용한 MLOps와 LLMOps
  ☆32Updated last year
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆54Updated 9 months ago
• deep-diver / gpt2-ft-pipeline
  GPT2 fine-tuning pipeline with KerasNLP, TensorFlow, and TensorFlow Extended
  ☆33Updated last year