swiss-ai / pretrain-dataLinks
Pretraining data reconstruction scripts for Apertus
☆43Updated this week
Alternatives and similar repositories for pretrain-data
Users that are interested in pretrain-data are comparing it to the libraries listed below
Sorting:
- Small python package to measure OCR quality and other related metrics.☆25Updated last year
- ☆49Updated 6 months ago
- Python library to use Pleias-RAG models☆61Updated 4 months ago
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆169Updated last year
- ☆56Updated 2 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 10 months ago
- ☆42Updated 4 months ago
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆52Updated 2 weeks ago
- ☆20Updated last year
- ☆67Updated last year
- ☆63Updated 11 months ago
- Using modal.com to process FineWeb-edu data☆20Updated 5 months ago
- Chat Markup Language conversation library☆55Updated last year
- A framework for evaluating function calls made by LLMs☆38Updated last year
- Source code for the collaborative reasoner research project at Meta FAIR.☆102Updated 4 months ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆43Updated last year
- ☆67Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆107Updated 8 months ago
- ☆58Updated 3 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Updated 10 months ago
- ☆19Updated 3 weeks ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆65Updated last year
- Simple GRPO scripts and configurations.☆59Updated 6 months ago
- ☆42Updated last year
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆84Updated last week
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆111Updated 4 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆88Updated this week
- Lightweight tools for quick and easy LLM demo's☆28Updated 11 months ago
- Dataset Viber is your chill repo for data collection, annotation and vibe checks.☆46Updated last year