groq / groqflow

Related projects: ⓘ

• langchain-ai / langchain-nvidia
  ☆49Updated this week
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 4 months ago
• rejunity / tiny-asic-1_58bit-matrix-mul
  Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit
  ☆103Updated 5 months ago
• TrelisResearch / one-click-llms
  One click templates for inferencing Language Models
  ☆97Updated last week
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆77Updated 5 months ago
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆37Updated last month
• EmbeddedLLM / vllm-rocm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆145Updated 2 months ago
• diicellman / dspy-gradio-rag
  RAG example using DSPy, Gradio, FastAPI
  ☆57Updated 5 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆47Updated 3 months ago
• mgerstgrasser / tacheles
  a lightweight, open-source blueprint for building powerful and scalable LLM chat applications
  ☆30Updated 3 months ago
• cognitivecomputations / kraken
  ☆64Updated 3 months ago
• teknium1 / ShareGPT-Builder
  ☆101Updated 6 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆97Updated 4 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆62Updated this week
• skypilot-org / sky-llama
  ☆26Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆48Updated 9 months ago
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆54Updated 4 months ago
• glaive-ai / function-calling-server
  ☆32Updated 7 months ago
• lamini-ai / lamini-examples
  ☆134Updated last week
• character-ai / MuKoe
  ☆50Updated 4 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆118Updated 2 months ago
• teknium1 / RawTransform
  A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.
  ☆29Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆28Updated 4 months ago
• agentsea / surfkit
  A toolkit for building AI agents that use devices
  ☆93Updated this week
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆97Updated 9 months ago
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆53Updated this week
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆68Updated 7 months ago
• remichu-ai / gallama
  ☆95Updated this week
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated 3 months ago