abacaj / replit-3B-inference
Run inference on replit-3B code instruct model using CPU
☆154Updated last year
Related projects ⓘ
Alternatives and complementary repositories for replit-3B-inference
- ☆136Updated 11 months ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆102Updated last year
- An mlx project to train a base model on your whatsapp chats using (Q)Lora finetuning☆159Updated 9 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated 6 months ago
- 🔓 The open-source autonomous agent LLM initiative 🔓☆90Updated 8 months ago
- ☆103Updated 7 months ago
- The code we currently use to fine-tune models.☆108Updated 6 months ago
- ☆35Updated 9 months ago
- ☆148Updated 3 months ago
- Harnessing the Memory Power of the Camelids☆145Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆124Updated last year
- A fast batching API to serve LLM models☆172Updated 6 months ago
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- WebGPU LLM inference tuned by hand☆146Updated last year
- Full finetuning of large language models without large memory requirements☆93Updated 10 months ago
- Local LLM ReAct Agent with Guidance☆154Updated last year
- Scripts to create your own moe models using mlx☆86Updated 8 months ago
- Real-time Fallacy Detection using OpenAI whisper and ChatGPT/LLaMA/Mistral☆107Updated 11 months ago
- A multimodal, function calling powered LLM webui.☆205Updated last month
- llama.cpp with BakLLaVA model describes what does it see☆380Updated last year
- ☆110Updated 2 weeks ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆73Updated last year
- GPT-2 small trained on phi-like data☆65Updated 8 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆231Updated 5 months ago
- Your automated SWE fleet to get your tickets from the Backlog to Prod!☆95Updated 6 months ago
- Fast parallel LLM inference for MLX☆146Updated 4 months ago
- ☆38Updated 7 months ago
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆182Updated 6 months ago
- Small finetuned LLMs for a diverse set of useful tasks☆122Updated last year
- A strongly typed Python DSL for developing message passing multi agent systems☆50Updated 7 months ago