Fork of kingoflolz/mesh-transformer-jax with memory usage optimizations and support for GPT-Neo, GPT-NeoX, BLOOM, OPT and fairseq dense LM. Primarily used by KoboldAI and mtj-softtuner.
☆22Nov 14, 2022Updated 3 years ago
Alternatives and similar repositories for mesh-transformer-jax
Users that are interested in mesh-transformer-jax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning + ?☆19Jan 31, 2025Updated last year
- Efficient 3bit/4bit quantization of LLaMA models☆18May 18, 2023Updated 3 years ago
- Standalone pre-training recipe with JAX+Flax☆35Apr 3, 2023Updated 3 years ago
- Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax.☆39Feb 23, 2023Updated 3 years ago
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Jul 30, 2026Updated last week
- Efficiently computing & storing token n-grams from large corpora☆28Jun 15, 2026Updated last month
- ☆23Oct 30, 2023Updated 2 years ago
- ☆21May 24, 2023Updated 3 years ago
- Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance☆28Mar 1, 2023Updated 3 years ago
- Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.☆71Mar 30, 2023Updated 3 years ago
- An unsupervised model merging algorithm for Transformers-based language models.☆107Apr 29, 2024Updated 2 years ago
- GreenLIT: Using GPT-J with Multi-Task Learning to Create New Screenplays☆16Nov 27, 2022Updated 3 years ago
- ☆12Jul 25, 2018Updated 8 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Rendering Engine using C++ and CUDA to achieve Path Tracing techniques on GPU☆21May 19, 2019Updated 7 years ago
- ☆15Apr 18, 2022Updated 4 years ago
- Learning and experimenting with Kubernetes☆13Jun 10, 2021Updated 5 years ago
- ☆44Nov 17, 2024Updated last year
- ☆131Jun 9, 2022Updated 4 years ago
- Non Parallel Voice Conversion based on VITS☆24Mar 31, 2023Updated 3 years ago
- Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…☆21Feb 23, 2024Updated 2 years ago
- A cross-platform, header-only compute-shader-styled job dispatching API written in C++.☆21Aug 19, 2020Updated 5 years ago
- ☆33May 23, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Easy installer of kocohub dataset☆24May 31, 2020Updated 6 years ago
- BERT models for many languages created from Wikipedia texts☆33May 25, 2020Updated 6 years ago
- convert subtitles to raw text☆10Nov 23, 2016Updated 9 years ago
- GladOS is "Gladys' Lovely and Dynamic Operating System" - An operating environment for use by text-based AI personas..☆19Jan 1, 2026Updated 7 months ago
- A framework/template for those starting off with function replacement through SaltyNX☆21May 9, 2020Updated 6 years ago
- Uncensored fork of diffusers☆39Feb 13, 2023Updated 3 years ago
- gui for Merge-Stable-Diffusion-models-without-distortion-gui☆36Dec 31, 2022Updated 3 years ago
- ☆21Mar 15, 2023Updated 3 years ago
- Image Diffusion block merging technique applied to transformers based Language Models.☆55May 8, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A ready-to-deploy container for implementing an easy to use REST API to access Language Models.☆65Feb 14, 2023Updated 3 years ago
- Crawling engine that crawls a set of top-level domains looking for documents in a list of languages☆11Feb 6, 2024Updated 2 years ago
- Sentencepiece based BPE tokenizer for English and Japanese language text.☆29Apr 4, 2024Updated 2 years ago
- ☆10Sep 8, 2023Updated 2 years ago
- Anti AntiXray measures for annoying server admins☆34Feb 10, 2022Updated 4 years ago
- Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation☆15Aug 27, 2024Updated last year
- ☆33Feb 14, 2026Updated 5 months ago