249M-param MoE transformer built from scratch in PyTorch. GQA, RoPE, SwiGLU, sparse MoE with 3 aux losses, AMP training loop no Trainer abstractions. Architecture mirrors LLaMA/Mistral/Mixtral decisions, fully inspectable.
☆19May 22, 2026Updated 2 months ago
Alternatives and similar repositories for H64LM
Users that are interested in H64LM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of a fast semantic chunker in C++, installable in python 3.7+ projects.☆22Sep 20, 2025Updated 10 months ago
- YAML Fundamentals for DevOps, Cloud and IaC Engineers, published by Packt☆12Jan 30, 2023Updated 3 years ago
- Open-source AI agent that reasons by blending many AI models, does real work on its own, and keeps learning — safe, self-hostable, and fu…☆18Updated this week
- A zero-dependency Python module for inspecting and converting coding-agent session files (.jsonl) — Claude Code, Codex, and Pi — into the…☆46Jul 10, 2026Updated 3 weeks ago
- Making MoE fine-tuning accessible to anyone with consumer hardware.☆16Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A lightweight transformer language model built from scratch in PyTorch, trained on a single consumer GPU with a full pipeline for data pr…☆41Apr 1, 2026Updated 4 months ago
- Pretraining codebase for Apertus models, based on Megatron-LM☆21Sep 25, 2025Updated 10 months ago
- [COLM '24] Source-Aware Training Enables Knowledge Attribution in Language Models☆19Apr 1, 2025Updated last year
- Bridge Claude Code to OpenAI models — OpenAI API key or ChatGPT/Codex-plan OAuth☆33Updated this week
- Code for boomerang distillation enables zero-shot model size interpolation.☆22Jul 10, 2026Updated 3 weeks ago
- A very simple progress bar for python with accurate time prediction (linear).☆11Dec 30, 2021Updated 4 years ago
- Architected a distributed notebook execution environment simulating Kaggle Kernels. Utilized the Kubernetes K8s API for dynamic pod orche…☆20May 3, 2026Updated 3 months ago
- Demo of fine-tuning QA models for answering FAQ of cloud providers documentation☆11Jun 20, 2026Updated last month
- Backprop with Low-Precision Activations☆11Oct 28, 2019Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A machine learning library focused on deep learning☆11Jun 2, 2015Updated 11 years ago
- SwiftLet is a lightweight Python framework for running open-source Large Language Models (LLMs) locally using safetensors☆29Aug 6, 2025Updated 11 months ago
- Chew is a Go library for processing various content types into markdown/plaintext.☆42Feb 16, 2025Updated last year
- Precision Knowledge Editing (PKE): A novel method to reduce toxicity in LLMs while preserving performance, with robust evaluations and ha…☆12Nov 26, 2024Updated last year
- CIFAR10 ResNets implemented in JAX+Flax☆12Apr 6, 2022Updated 4 years ago
- LLM Context Manager for inference optimization☆25Jul 28, 2025Updated last year
- Fork of github.com/UCSBarchlab/OpenTPU for the TGPTPU project☆15Jun 1, 2025Updated last year
- ☆18Mar 20, 2017Updated 9 years ago
- Examples for the Activate conference☆11Sep 11, 2019Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The ALL Arduino Nano 33 BLE Sense Classifier is an experiment to explore how low powered microcontrollers, specifically the Arduino Nano …☆10Jul 21, 2021Updated 5 years ago
- Open CC BY 4.0 dataset: which local LLMs (Ollama) fit which hardware — params, quantization, RAM/VRAM. Powered by modelfit.io☆22Jul 6, 2026Updated 3 weeks ago
- Twitter Dataset and Finetuned Transformer Model for Turkish Sentiment Analysis☆14Jul 29, 2022Updated 4 years ago
- WASM BusyTeX API for TeX Live 2026 (01.03.26) supporting LuaTeX, PdfTeX, & XeTeX in the browser☆26Jul 5, 2026Updated 3 weeks ago
- Groq-powered MAD: The first work to explore Multi-Agent Debate with Large Language Models :D☆12Jul 5, 2024Updated 2 years ago
- The repo of the paper: Generalist Vision Foundation Models for Medical Imaging: A Case Study of Segment Anything Model on Zero-Shot Medic…☆11May 26, 2023Updated 3 years ago
- The curiosity machine doesn't just process queries - it awakens wonder.☆41Aug 29, 2025Updated 11 months ago
- ☆51Oct 1, 2025Updated 10 months ago
- Homebridge plugin for Midea devices☆61Jul 10, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Data Version Control, or DVC, is a data and ML experiment management tool that takes advantage of the existing engineering toolset that w…☆10Jun 23, 2021Updated 5 years ago
- Just another sentiment wrapper.☆18Dec 11, 2021Updated 4 years ago
- Grant users who hold an NFT from your collection a discount code they can use in your Shopify store!☆13May 2, 2023Updated 3 years ago
- resemble.ai API SDK☆15Apr 6, 2026Updated 3 months ago
- lets build claude code from scratch☆32May 13, 2026Updated 2 months ago
- Dissertation (Jeff Heaton)☆10Oct 10, 2019Updated 6 years ago
- TalkingData AdTracking Fraud Detection Challenge☆10May 8, 2018Updated 8 years ago