Fork of kingoflolz/mesh-transformer-jax with memory usage optimizations and support for GPT-Neo, GPT-NeoX, BLOOM, OPT and fairseq dense LM. Primarily used by KoboldAI and mtj-softtuner.
☆22Nov 14, 2022Updated 4 years ago
Alternatives and similar repositories for mesh-transformer-jax
Users that are interested in mesh-transformer-jax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning + ?☆19Jan 31, 2025Updated last year
- RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.☆67Sep 14, 2022Updated 4 years ago
- Conversion script adapting vicuna dataset into alpaca format for use with oobabooga's trainer☆12Jun 21, 2023Updated 3 years ago
- Expanded KR-BERT for Sentiment Analysis☆14Apr 23, 2021Updated 5 years ago
- Pile Deduplication Code☆18May 15, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax.☆39Feb 23, 2023Updated 3 years ago
- Script used to decode serial data stream of Contec KT88-2400 EEG amplifier and to stream it to the local network via LSL☆14Sep 10, 2025Updated last year
- Train HiFi-GAN on TPU☆10Apr 3, 2022Updated 4 years ago
- Code for the NAACL 2024 HCI+NLP Workshop paper "LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tool…☆12Mar 24, 2024Updated 2 years ago
- Efficiently computing & storing token n-grams from large corpora☆29Jun 15, 2026Updated 5 months ago
- ☆21May 24, 2023Updated 3 years ago
- Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.☆71Mar 30, 2023Updated 3 years ago
- ☆23Oct 30, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Idris libraries for hybrid classical-quantum programming☆15Feb 5, 2023Updated 3 years ago
- playlist4whisper manages media streams playlists for livestream_video.sh, plays media, and transcribes audio via AI with configurable tim…☆18Sep 8, 2026Updated 2 months ago
- author identification code☆12May 22, 2015Updated 11 years ago
- A (in-development) Coq mechanization of WebAssembly specification.☆21Sep 30, 2026Updated last month
- A friendly, automated chi-square test function which takes care of post-hoc tests and multiple comparisons.☆10Feb 14, 2018Updated 8 years ago
- ☆19Mar 31, 2020Updated 6 years ago
- Identify gender of personal names based on when a person may have been born☆10Feb 18, 2014Updated 12 years ago
- GreenLIT: Using GPT-J with Multi-Task Learning to Create New Screenplays☆16Nov 27, 2022Updated 3 years ago
- Automatically exported from code.google.com/p/pyvttbl☆10Mar 14, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Experimental validation of the Bayesian BM25 paper☆10Feb 16, 2026Updated 9 months ago
- ☆11Dec 4, 2016Updated 9 years ago
- ☆78Dec 7, 2023Updated 2 years ago
- Double taxation should be illegal.☆16Apr 8, 2026Updated 7 months ago
- Is it just a textarea? No. It's much fancier than that.☆10Sep 18, 2013Updated 13 years ago
- UC Berkeley LINGUIS 110 (Introduction to Phonetics and Phonology) Fall 2017☆13Aug 9, 2018Updated 8 years ago
- Secure, distributed single writer key/value store☆12Jun 20, 2020Updated 6 years ago
- streamlit-nginx is a Docker image with Streamlit and Nginx for web-based demo applications in Python 3.6 and above, in a single container…☆14Apr 28, 2021Updated 5 years ago
- BERT models for many languages created from Wikipedia texts☆33May 25, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Korean BERT model using character tokenizer☆27Apr 8, 2021Updated 5 years ago
- Deep learning models trained to correct input errors in short, message-like text☆11Sep 5, 2018Updated 8 years ago
- Sentencepiece based BPE tokenizer for English and Japanese language text.☆29Apr 4, 2024Updated 2 years ago
- village-tracker community volunteer coordination project☆14Jun 19, 2019Updated 7 years ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆32Sep 22, 2024Updated 2 years ago
- Image Diffusion block merging technique applied to transformers based Language Models.☆55May 8, 2023Updated 3 years ago
- Utility methods related to public key cryptography to be used with distributed mutable storage☆15May 13, 2020Updated 6 years ago
Are these results useful?