Alternatives and similar repositories for edge-slm:

Users that are interested in edge-slm are comparing it to the libraries listed below

• deepsense-ai / db-ally
  Efficient, consistent and secure library for querying structured data with natural language
  ☆148Updated 5 months ago
• Vaibhavs10 / optimise-my-whisper
  ☆200Updated 9 months ago
• NVIDIA / trt-llm-as-openai-windows
  This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…
  ☆120Updated last year
• deepsense-ai / ragbits
  Building blocks for rapid development of GenAI applications
  ☆54Updated this week
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆157Updated 5 months ago
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆200Updated 7 months ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆265Updated last week
• Picovoice / orca
  On-device streaming text-to-speech engine powered by deep learning
  ☆72Updated this week
• lamm-mit / Cephalo-Phi-3-Vision-MoE
  ☆11Updated 9 months ago
• AlexBodner / How_Much_VRAM
  ☆99Updated 6 months ago
• ritabratamaiti / AnyModal
  AnyModal is a Flexible Multimodal Language Model Framework for PyTorch
  ☆85Updated 2 months ago
• eustlb / speech-to-speech
  Speech To Speech: an effort for an open-sourced and modular GPT4-o
  ☆43Updated 5 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆61Updated last month
• luweigen / whisper_streaming
  Whisper realtime streaming for long speech-to-text transcription and translation
  ☆112Updated last year
• cognitivecomputations / spectrum
  ☆113Updated 5 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆136Updated 7 months ago
• NVIDIA-AI-IOT / whisper_trt
  A project that optimizes Whisper for low latency inference using NVIDIA TensorRT
  ☆74Updated 5 months ago
• PINTO0309 / whisper-onnx-cpu
  ONNX implementation of Whisper. PyTorch free.
  ☆92Updated 3 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆272Updated 8 months ago
• TrelisResearch / one-click-llms
  One click templates for inferencing Language Models
  ☆162Updated this week
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 4 months ago
• etalab-ia / albert-models
  Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
  ☆41Updated 8 months ago
• skrbnv / javad
  ☆53Updated last month
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆103Updated last month
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆104Updated 3 months ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆200Updated 10 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week