abetlen / program-constrained-language-model-sampling
☆35Updated 2 years ago
Alternatives and similar repositories for program-constrained-language-model-sampling
Users that are interested in program-constrained-language-model-sampling are comparing it to the libraries listed below
Sorting:
- ☆22Updated 11 months ago
- Full finetuning of large language models without large memory requirements☆94Updated last year
- utilities for loading and running text embeddings with onnx☆44Updated 9 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- ☆40Updated 2 years ago
- Using modal.com to process FineWeb-edu data☆20Updated last month
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Chat Markup Language conversation library☆55Updated last year
- ☆22Updated last year
- Experiments for efforts to train a new and improved t5☆77Updated last year
- QLoRA with Enhanced Multi GPU Support☆37Updated last year
- ☆48Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- ☆61Updated last year
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated 2 years ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- Latent Large Language Models☆18Updated 8 months ago
- ☆49Updated last year
- A clone of OpenAI's Tokenizer page for HuggingFace Models☆45Updated last year
- A repository of projects and datasets under active development by Alignment Lab AI☆22Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 3 months ago
- Reimplementation of the task generation part from the Alpaca paper☆119Updated 2 years ago
- ☆38Updated 9 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆32Updated 2 months ago
- look how they massacred my boy☆63Updated 7 months ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆59Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- ☆66Updated 11 months ago
- Optimizing bit-level Jaccard Index and Population Counts for large-scale quantized Vector Search via Harley-Seal CSA and Lookup Tables☆18Updated this week