abacaj / replit-3B-inferenceLinks
Run inference on replit-3B code instruct model using CPU
☆155Updated last year
Alternatives and similar repositories for replit-3B-inference
Users that are interested in replit-3B-inference are comparing it to the libraries listed below
Sorting:
- ☆134Updated last year
- 🔓 The open-source autonomous agent LLM initiative 🔓☆91Updated last year
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated last year
- Command-line script for inferencing from models such as MPT-7B-Chat☆101Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆122Updated last year
- llama.cpp with BakLLaVA model describes what does it see☆383Updated last year
- Chat Bot with LLM and Fact Reference. RAG(Retrieval Augmented Generation) and LangChain backed☆129Updated last year
- Full finetuning of large language models without large memory requirements☆93Updated last year
- A Personalised AI Assistant Inspired by 'Diamond Age, Powered by SMS☆92Updated 2 years ago
- ☆113Updated 5 months ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- Your automated SWE fleet to get your tickets from the Backlog to Prod!☆96Updated last year
- Small finetuned LLMs for a diverse set of useful tasks☆125Updated last year
- An mlx project to train a base model on your whatsapp chats using (Q)Lora finetuning☆166Updated last year
- Extend the original llama.cpp repo to support redpajama model.☆117Updated 9 months ago
- automatically generate @openai plugins by specifying your API in markdown in smol-developer style☆120Updated 2 years ago
- A Simple Discord Bot for the Alpaca LLM☆100Updated last year
- ☆120Updated last year
- An Autonomous LLM Agent that runs on Wizcoder-15B☆335Updated 7 months ago
- Open Source Embeddings Optimisation and Eval Framework for RAG/LLM Applications. Documentations at https://docs.vectorboard.ai/introducti…☆49Updated last year
- inference code for mixtral-8x7b-32kseqlen☆99Updated last year
- ☆79Updated last year
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆187Updated last year
- QLoRA: Efficient Finetuning of Quantized LLMs☆78Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆40Updated 2 years ago
- The code we currently use to fine-tune models.☆113Updated last year
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- ☆48Updated last year
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆81Updated last year