Alternatives and similar repositories for scratch-llm:

Users that are interested in scratch-llm are comparing it to the libraries listed below

• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆28Updated 2 years ago
• AmeyaWagh / llama2.cpp
  Inference Llama 2 in C++
  ☆44Updated 11 months ago
• shrimantasatpati / Microsoft-Phi-2-Streamlit
  Microsoft Phi 2 Streamlit App, deployed on HuggingFace Spaces is based on the Microsoft Phi 2 small language model (SLM) for text generat…
  ☆14Updated 11 months ago
• timothelaborie / text_classification_scripts
  Scripts for text classification with llama and bert
  ☆14Updated 3 weeks ago
• keith2018 / TinyGPT
  Tiny C++11 GPT-2 inference implementation from scratch
  ☆58Updated 2 weeks ago
• wenqiglantz / nvidia-sec-finetuning
  Fine-Tuning LLM and embedding models
  ☆27Updated last year
• FrancescoSaverioZuppichini / pytorch-2.0-benchmark
  Benchmarking PyTorch 2.0 different models
  ☆21Updated 2 years ago
• 99991 / pygguf
  GGUF parser in Python
  ☆26Updated 8 months ago
• Hemanthkumar2112 / Reward-Modeling-RLHF-Finetune-and-RAG
  Gemma2(9B), Llama3-8B-Finetune-and-RAG, code base for sample, implemented in Kaggle platform
  ☆21Updated 2 months ago
• rasbt / gradient-accumulation-blog
  Finetuning BLOOM on a single GPU using gradient-accumulation
  ☆30Updated 2 years ago
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆14Updated 2 months ago
• leloykun / llama2.cpp
  Inference Llama 2 in one file of pure C++
  ☆83Updated last year
• chu-tianxiang / llama-cpp-torch
  llama.cpp to PyTorch Converter
  ☆33Updated last year
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆50Updated 6 months ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 10 months ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆60Updated last year
• anyscale / long-context-fine-tuning-blogpost
  ☆18Updated last year
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆111Updated last year
• geronimi73 / 3090_shorts
  minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever
  ☆38Updated last month
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆86Updated this week
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆146Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• yhenon / llm-face-vision
  Benchmarking vision language vision on face tasks
  ☆12Updated 3 weeks ago
• msaroufim / mynotes
  ☆17Updated 2 months ago
• paperswithcode / model-index
  Create a source of truth for ML model results and browse it on Papers with Code
  ☆30Updated 3 years ago
• mlabonne / chessllm
  ☆35Updated last year
• modelize-ai / LLM-Inference-Deployment-Tutorial
  Tutorial for LLM developers about engine design, service deployment, evaluation/benchmark, etc. Provide a C/S style optimized LLM inferen…
  ☆19Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 4 months ago
• onnx / digestai
  Digest AI is a powerful model analysis tool that extracts insights from your models.
  ☆19Updated last month