AI-Commandos / LLaMa2lang
Convenience scripts to finetune (chat-)LLaMa3 and other models for any language
☆280Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for LLaMa2lang
- A fast batching API to serve LLM models☆172Updated 6 months ago
- ☆191Updated 5 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated 6 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆221Updated 2 weeks ago
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆162Updated 4 months ago
- Automatically evaluate your LLMs in Google Colab☆559Updated 6 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆493Updated 3 months ago
- A multimodal, function calling powered LLM webui.☆208Updated last month
- Toolkit for attaching, training, saving and loading of new heads for transformer models☆246Updated 2 weeks ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆126Updated 6 months ago
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆244Updated 3 weeks ago
- An Open Source Toolkit For LLM Distillation☆356Updated 2 months ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆145Updated last year
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆281Updated this week
- A library for easily merging multiple LLM experts, and efficiently train the merged LLM.☆408Updated 2 months ago
- function calling-based LLM agents☆278Updated 2 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆232Updated 5 months ago
- ☆718Updated 2 months ago
- A bagel, with everything.☆312Updated 7 months ago
- Web UI for ExLlamaV2☆445Updated last month
- A python application that routes incoming prompts to an LLM by category, and can support a single incoming connection from a front end to…☆167Updated this week
- Large-scale LLM inference engine☆1,134Updated this week
- Start a server from the MLX library.☆161Updated 3 months ago
- An AI assistant beyond the chat box.☆315Updated 8 months ago
- Low-Rank adapter extraction for fine-tuned transformers model☆162Updated 6 months ago
- FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)☆232Updated 10 months ago
- ☆149Updated 4 months ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆202Updated last month
- Experimenting with small language models☆47Updated 10 months ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆498Updated 3 weeks ago