pacman100 / openhathi_instruct
This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resulting model is meant to follow instructions and chat in Hindi and Hinglish.
☆23Updated 11 months ago
Alternatives and similar repositories for openhathi_instruct:
Users that are interested in openhathi_instruct are comparing it to the libraries listed below
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆77Updated 3 weeks ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆99Updated 2 months ago
- Repository for fine-tuning gemma models using unsloth for indic languages☆82Updated 9 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 5 months ago
- A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages☆92Updated 2 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆223Updated last month
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆196Updated 7 months ago
- Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"☆54Updated last month
- End-to-End LLM Guide☆97Updated 5 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- Set of scripts to finetune LLMs☆36Updated 8 months ago
- ☆118Updated this week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated this week
- ☆91Updated last year
- ☆16Updated last year
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆47Updated 6 months ago
- experiments with inference on llama☆104Updated 6 months ago
- ☆17Updated 8 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆98Updated 8 months ago
- ☆48Updated last year
- ☆95Updated 2 months ago
- ☆117Updated last month
- ☆75Updated 6 months ago
- Material for the series of seminars on Large Language Models☆24Updated 7 months ago
- code for training & evaluating Contextual Document Embedding models☆133Updated 2 weeks ago
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆136Updated 4 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆244Updated 5 months ago
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆121Updated last year
- Sample notebooks and prompts for LLM evaluation☆115Updated 2 weeks ago