cartesia-ai / edge
On-device intelligence.
☆194Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for edge
- Joint speech-language model - respond directly to audio!☆356Updated 4 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆113Updated 3 weeks ago
- prime (previously called ZeroBand) is a framework for efficient, globally distributed training of AI models over the internet.☆212Updated this week
- Video+code lecture on building nanoGPT from scratch☆64Updated 5 months ago
- Fast parallel LLM inference for MLX☆149Updated 4 months ago
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆282Updated last month
- run paligemma in real time☆123Updated 6 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated 6 months ago
- A toolkit for building multimodal AI agents☆111Updated this week
- ☆84Updated last month
- Long context evaluation for large language models☆190Updated this week
- Solving data for LLMs - Create quality synthetic datasets!☆137Updated last month
- ☆228Updated last month
- FastMLX is a high performance production ready API to host MLX models.☆219Updated this week
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆173Updated 4 months ago
- Run GGML models with Kubernetes.☆173Updated 11 months ago
- 🤖 Headless IDE for AI agents☆133Updated this week
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated last month
- Start a server from the MLX library.☆161Updated 3 months ago
- ☆104Updated 8 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated 10 months ago
- Efficient vector database for hundred millions of embeddings.☆200Updated 6 months ago
- Just a bunch of benchmark logs for different LLMs☆115Updated 3 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆55Updated 2 weeks ago
- MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.☆498Updated this week
- WIP - Allows you to create DSPy pipelines using ComfyUI☆180Updated 3 months ago
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆237Updated 2 months ago
- 1.58 Bit LLM on Apple Silicon using MLX☆146Updated 6 months ago
- smolLM with Entropix sampler on pytorch☆139Updated 3 weeks ago
- ☆108Updated this week