rayliuca / T-RagxLinks
Enhancing Translation with RAG-Powered Large Language Models
☆80Updated 2 months ago
Alternatives and similar repositories for T-Ragx
Users that are interested in T-Ragx are comparing it to the libraries listed below
Sorting:
- ☆121Updated last month
- Easy to use, High Performant Knowledge Distillation for LLMs☆85Updated 3 weeks ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆63Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆139Updated 3 months ago
- ☆118Updated 9 months ago
- ☆53Updated last year
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆220Updated 7 months ago
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆59Updated 10 months ago
- Low-Rank adapter extraction for fine-tuned transformers models☆171Updated last year
- ☆76Updated last year
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Updated last year
- An unsupervised model merging algorithm for Transformers-based language models.☆104Updated last year
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆135Updated 6 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆30Updated 2 months ago
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆69Updated 2 weeks ago
- A pipeline parallel training script for LLMs.☆147Updated last month
- ☆116Updated 5 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 7 months ago
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆96Updated last year
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆151Updated last year
- Let's create synthetic textbooks together :)☆75Updated last year
- Open language modeling toolkit based on PyTorch☆120Updated 2 weeks ago
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆23Updated 2 months ago
- The FLORES+ Machine Translation Benchmark☆104Updated 6 months ago
- Set of scripts to finetune LLMs☆37Updated last year
- This repo is for handling Question Answering, especially for Multi-hop Question Answering☆67Updated last year
- A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.☆24Updated 3 weeks ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated 7 months ago
- ☆9Updated last year
- Fine-tuning Open-Source LLMs for Adaptive Machine Translation☆79Updated 2 weeks ago