pacman100 / openhathi_instructLinks
This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resulting model is meant to follow instructions and chat in Hindi and Hinglish.
☆23Updated last year
Alternatives and similar repositories for openhathi_instruct
Users that are interested in openhathi_instruct are comparing it to the libraries listed below
Sorting:
- Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"☆59Updated 7 months ago
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆105Updated 2 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆111Updated 8 months ago
- A simple, consistent and extendable toolkit for IndicTrans2☆34Updated 3 weeks ago
- Repository for fine-tuning gemma models using unsloth for indic languages☆94Updated last year
- A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages☆107Updated 8 months ago
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆46Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 11 months ago
- A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks☆36Updated last year
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆197Updated last year
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆231Updated 7 months ago
- ☆92Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated last month
- Various installation guides for Large Language Models☆70Updated 2 months ago
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 3 weeks ago
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆137Updated 10 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆137Updated last month
- experiments with inference on llama☆104Updated last year
- Solving data for LLMs - Create quality synthetic datasets!☆149Updated 5 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated last year
- ☆124Updated 7 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated 8 months ago
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆124Updated last year
- ☆47Updated 4 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆260Updated 11 months ago
- ☆144Updated 11 months ago
- ☆47Updated last year
- Iterate fast on your RAG pipelines☆23Updated 3 months ago
- ☆152Updated 6 months ago