Tokun to can tokens
☆17Jun 19, 2025Updated last year
Alternatives and similar repositories for tokun
Users that are interested in tokun are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Testing paligemma2 finetuning on reasoning dataset☆18Dec 28, 2024Updated last year
- Natural language understanding benchmarks for Norwegian☆14Aug 29, 2025Updated 10 months ago
- LLM benchmarks☆13Feb 22, 2024Updated 2 years ago
- Showcasing the power of Ruby on Rails.☆12Jun 7, 2020Updated 6 years ago
- A Node.Js / Neo4J tool that translates words and relations into network graphs and shows you how it all connects.☆13Oct 24, 2019Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- QLoRA for Masked Language Modeling☆23Sep 11, 2023Updated 2 years ago
- Arabic edition of ALBERT pretrained language models☆15Apr 25, 2021Updated 5 years ago
- This app is intended to automatically create a corpus for ASR systems using pseudo-labeling.☆27Feb 15, 2024Updated 2 years ago
- let's you chat with website. crawls a website, embeds to vectors, stores to Chroma.☆26Sep 16, 2023Updated 2 years ago
- LTG-Bert☆34Jan 8, 2024Updated 2 years ago
- [IJCV 2025] OmniDrag: Enabling Motion Control for Omnidirectional Image-to-Video Generation☆16Feb 13, 2026Updated 5 months ago
- ☆22Jun 2, 2026Updated last month
- My Gen AI research☆11Jun 3, 2024Updated 2 years ago
- Arabic News Stance Corpus☆11Feb 5, 2021Updated 5 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A toy programming language you use to build other toys☆13May 15, 2025Updated last year
- Code Roberta version of RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder☆10Mar 16, 2023Updated 3 years ago
- T5Patches is a set of tools for fast and targeted editing of generative language models built with T5X.☆12May 31, 2024Updated 2 years ago
- These are tools I cheated with the help of ChatGPT to help me with Penetration Testing and Red Teaming☆13Feb 24, 2024Updated 2 years ago
- Few-shot Learning with Auxiliary Data☆31Dec 8, 2023Updated 2 years ago
- A vllm proxy server to add security and multi model management for vllm servers☆12May 30, 2024Updated 2 years ago
- Finetuning a codegen model with python instruction set using QLORA technique for better efficacy☆11Aug 31, 2023Updated 2 years ago
- My upgrade story of Mac Pro Early 2009 (5,1)☆18Sep 20, 2020Updated 5 years ago
- Internal diffusion for video inpainting☆17May 19, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆31Aug 5, 2023Updated 2 years ago
- ☆19Dec 29, 2025Updated 6 months ago
- "Artificial General Intelligence For All (AGIFA)" Project☆12Feb 25, 2024Updated 2 years ago
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Mar 6, 2023Updated 3 years ago
- Example of Langchain-Elasticsearch integrations & RAG.☆12Sep 20, 2024Updated last year
- A dual-chatbot system for learning languages based on LangChain☆13Jun 25, 2023Updated 3 years ago
- ☆29Dec 6, 2021Updated 4 years ago
- A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel® Extension For PyTor…☆15Feb 27, 2024Updated 2 years ago
- Repository for "Training Language Models To Explain Their Own Computations"☆23Jul 7, 2026Updated 2 weeks ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆12Jan 2, 2024Updated 2 years ago
- CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models☆11Jul 1, 2023Updated 3 years ago
- The official implementation of the paper "Text Classification in the Wild: a Large-scale Long-tailed Name Normalization Dataset"(ICASSP 2…☆12Feb 19, 2023Updated 3 years ago
- 🍄 A parser, interpreter and compiler for libmagic rule files in golang☆21Feb 22, 2026Updated 5 months ago
- ☆11Mar 22, 2024Updated 2 years ago
- ☆15Jul 14, 2026Updated last week
- The contrastive token loss function for reducing generative repetition of autoregressive neural language models.☆13May 11, 2022Updated 4 years ago