0-Shot Tokenizer Transplant
☆14May 16, 2025Updated 10 months ago
Alternatives and similar repositories for tokenadapt
Users that are interested in tokenadapt are comparing it to the libraries listed below
Sorting:
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆22Feb 14, 2024Updated 2 years ago
- FactNews is the first dataset to predict sentence-level factuality of news reporting. Furthemore, we provide baseline results for sentenc…☆11Jun 12, 2025Updated 9 months ago
- A private AI chatbot platform where users can upload real chat history and recreate bots that mimic their friends' personalities. Built u…☆36Nov 13, 2025Updated 4 months ago
- Plancraft is a minecraft environment and agent suite to test planning capabilities in LLMs☆26Nov 7, 2025Updated 4 months ago
- Tensor-Slayer : Manipulate weights and tensors of LLMs to achieve performance upgrades and introduce a novel inferenceless mechanistic in…☆28May 27, 2025Updated 9 months ago
- The repository for the course "Astroinformatics" offered at Institute of Astronomy, National Central University, from Sep/2022 to Jan/202…☆10Jun 4, 2024Updated last year
- A dataset of posters for movies from MovieLens-25M☆11May 17, 2021Updated 4 years ago
- ☆59Nov 18, 2025Updated 4 months ago
- Implementation and experiments for Partially Supervised NER via Expected Entity Ratio in TACL 2022☆14Nov 7, 2022Updated 3 years ago
- Final training script from HuggingFace Whisper Fine tuning event - to get best results on finetuned model.☆12Dec 24, 2022Updated 3 years ago
- 🎧 CLI Python tool for bulk downloading Darknet Diaries podcast. Hate being online? This is the way.☆14Sep 16, 2023Updated 2 years ago
- Deep Learning Gravity Optimizer Source Code Repository☆13Jul 26, 2021Updated 4 years ago
- A tutorial about how to define your comfyui custom nodes☆15Oct 29, 2024Updated last year
- The evalution suite for the 🚀 Open Portuguese LLM Leaderboard☆26Aug 31, 2025Updated 6 months ago
- DINOv2 module for use with Autodistill.☆15Dec 6, 2023Updated 2 years ago
- Pretraining and finetuning for visual instruction following with Mixture of Experts☆16Jan 30, 2024Updated 2 years ago
- A development kit for manifesting AI agents with a complete lack of conventional limitations☆17Jul 8, 2025Updated 8 months ago
- 🤗 Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch.☆17Jun 5, 2025Updated 9 months ago
- gzip Predicts Data-dependent Scaling Laws☆34May 28, 2024Updated last year
- ☆57Dec 27, 2025Updated 2 months ago
- A Python package to wrap a compiled soccer-twos reinforcement learning environment with gym-compatible interfaces.☆27Feb 25, 2023Updated 3 years ago
- ☆16Feb 25, 2023Updated 3 years ago
- Portuguese translation of the GLUE benchmark and Scitail dataset☆33Jun 27, 2022Updated 3 years ago
- Simple notebook to train (technically, fine-tune) llama 3 8B on your own text data!☆22May 5, 2024Updated last year
- decontamination☆26Mar 4, 2026Updated 2 weeks ago
- Fine-tune FLUX-dev ControlNet on a single A100 40GB GPU.☆23Sep 24, 2024Updated last year
- ☆22Jul 9, 2020Updated 5 years ago
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Jul 11, 2023Updated 2 years ago
- Pytorch/XLA SPMD Test code in Google TPU☆23Apr 3, 2024Updated last year
- Cookbooks showcasing various applications of Cleanlab☆22Jan 20, 2026Updated 2 months ago
- ☆10Dec 17, 2020Updated 5 years ago
- ☆10Oct 2, 2024Updated last year
- This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…☆23Dec 23, 2023Updated 2 years ago
- ☆13Jun 16, 2021Updated 4 years ago
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- Keras implementation of multi-label classification of movie genres from IMDB posters☆17May 14, 2020Updated 5 years ago
- This project implements a self-driving car system utilizing a Convolutional Neural Network (CNN) to predict steering angles based on inpu…☆20Apr 12, 2025Updated 11 months ago
- The official code of "PixelWorld: Towards Perceiving Everything as Pixels" [TMLR25]☆16Sep 12, 2025Updated 6 months ago
- Repository contains code to fine-tune WhisperASR model☆23Dec 16, 2022Updated 3 years ago