usefulsensors / useful-transformers

Related projects: ⓘ

• Chrisz236 / llm-rk3588
  Run Large Language Models on RK3588 with GPU-acceleration
  ☆79Updated last year
• airockchip / rknn-llm
  ☆331Updated 4 months ago
• marty1885 / llama.cpp
  My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend
  ☆62Updated last week
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆430Updated last month
• mtx512 / rk3588-npu
  Reverse engineering the rk3588 npu
  ☆58Updated 3 months ago
• Pelochus / ezrknn-llm
  Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series
  ☆52Updated last month
• Pelochus / ezrknpu
  Easy usage of Rockchip's NPUs found in RK3588 and similar chips
  ☆80Updated 2 months ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆342Updated 2 weeks ago
• PABannier / bark.cpp
  Suno AI's Bark model in C/C++ for fast text-to-speech
  ☆684Updated 2 months ago
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆147Updated 3 weeks ago
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆215Updated 5 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆125Updated 2 weeks ago
• shahizat / jetsonGPT
  Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech
  ☆97Updated last year
• usefulsensors / openai-whisper
  Robust Speech Recognition via Large-Scale Weak Supervision
  ☆65Updated last year
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆460Updated 6 months ago
• dusty-nv / NanoLLM
  Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector…
  ☆171Updated 2 weeks ago
• aarnphm / whispercpp
  Pybind11 bindings for Whisper.cpp
  ☆321Updated this week
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆173Updated 10 months ago
• MiscellaneousStuff / openai-whisper-cpu
  Improving transcription performance of OpenAI Whisper for CPU based deployment
  ☆234Updated last year
• marty1885 / paroli
  Streaming TTS based on Piper with optional RK3588 NPU support
  ☆36Updated last month
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆345Updated last year
• shashikg / WhisperS2T
  An Optimized Speech-to-Text Pipeline for the Whisper Model Supporting Multiple Inference Engine
  ☆276Updated 3 weeks ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆245Updated 7 months ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 2 weeks ago
• ggml-org / p1
  LLM-based code completion engine
  ☆172Updated last year
• abdeladim-s / pywhispercpp
  Python bindings for whisper.cpp
  ☆150Updated this week
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆443Updated last year
• zhuzilin / whisper-openvino
  openvino version of openai/whisper
  ☆157Updated 10 months ago
• nyadla-sys / whisper.tflite
  Optimized OpenAI's Whisper TFLite Port for Efficient Offline Inference on Edge Devices
  ☆148Updated 3 weeks ago
• Cornell-RelaxML / quip-sharp
  ☆478Updated 2 weeks ago