Fork of kingoflolz/mesh-transformer-jax with memory usage optimizations and support for GPT-Neo, GPT-NeoX, BLOOM, OPT and fairseq dense LM. Primarily used by KoboldAI and mtj-softtuner.
☆22Nov 14, 2022Updated 3 years ago
Alternatives and similar repositories for mesh-transformer-jax
Users that are interested in mesh-transformer-jax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Efficient 3bit/4bit quantization of LLaMA models☆18May 18, 2023Updated 2 years ago
- RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.☆67Sep 14, 2022Updated 3 years ago
- GPT2 Byte Pair Encoding implementation in Golang☆25Jul 9, 2025Updated 9 months ago
- Pile Deduplication Code☆18May 15, 2023Updated 2 years ago
- Standalone pre-training recipe with JAX+Flax☆35Apr 3, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- Code for the NAACL 2024 HCI+NLP Workshop paper "LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tool…☆13Mar 24, 2024Updated 2 years ago
- ☆11Dec 11, 2024Updated last year
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- Idris libraries for hybrid classical-quantum programming☆13Feb 5, 2023Updated 3 years ago
- ☆23Oct 30, 2023Updated 2 years ago
- discord bot using AI to generate images based on discord messages☆11Oct 10, 2023Updated 2 years ago
- Efficiently computing & storing token n-grams from large corpora☆27Oct 6, 2024Updated last year
- Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts☆18Mar 15, 2021Updated 5 years ago
- Expanded KR-BERT for Sentiment Analysis☆13Apr 23, 2021Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆21May 24, 2023Updated 2 years ago
- Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance☆28Mar 1, 2023Updated 3 years ago
- A (in-development) Coq mechanization of WebAssembly specification.☆21Oct 1, 2021Updated 4 years ago
- Collection of scripts to download digitized manuscripts from various online libraries☆25Updated this week
- Encodes and decodes "Gödel Numbers" as described in the book "Gödel's Proof" by Ernest Nagel and James R. Newman.☆21Oct 24, 2016Updated 9 years ago
- Rendering Engine using C++ and CUDA to achieve Path Tracing techniques on GPU☆21May 19, 2019Updated 6 years ago
- Generative Agents: Interactive Simulacra of Human Behavior - with Local LLMs☆21Aug 15, 2023Updated 2 years ago
- Non Parallel Voice Conversion based on VITS☆24Mar 31, 2023Updated 3 years ago
- Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…☆21Feb 23, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- LLVM Forth Experiments☆26Jun 8, 2015Updated 10 years ago
- A notebook running TensorRT's StableDiffusion demo on Google Colaboratory☆18Feb 1, 2023Updated 3 years ago
- ☆20Sep 8, 2023Updated 2 years ago
- An OSINT tool to find data leaks on a targeted website☆17Mar 30, 2021Updated 5 years ago
- Korean BERT model using character tokenizer☆27Apr 8, 2021Updated 5 years ago
- Easy installer of kocohub dataset☆24May 31, 2020Updated 5 years ago
- Using queues, tqdm-multiprocess supports multiple worker processes, each with multiple tqdm progress bars, displaying them cleanly throug…☆43Jan 6, 2021Updated 5 years ago
- k_diffusion wrapper included for k_lms sampling. fixed for notebook.☆21Jun 9, 2023Updated 2 years ago
- The "Grown Biomes" approach, but implemented using a hex grid instead.☆13Mar 12, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Bash script to create an ebook from a list of web articles. Inspired by the now-defunct Readlists.org by Readability☆18Oct 13, 2019Updated 6 years ago
- Crawling engine that crawls a set of top-level domains looking for documents in a list of languages☆11Feb 6, 2024Updated 2 years ago
- BERT models for many languages created from Wikipedia texts☆33May 25, 2020Updated 5 years ago
- My OpenCode and Oh-My-OpenCode configuration files with API proxy setup documentation☆35Jan 5, 2026Updated 3 months ago
- A framework/template for those starting off with function replacement through SaltyNX☆21May 9, 2020Updated 5 years ago
- ☆21Mar 15, 2023Updated 3 years ago
- LocEmb: Location Embedding (Currently covering districts, roads, and businesses in Korea)☆11Aug 15, 2022Updated 3 years ago