So, I trained a Llama a 130M architecture I coded from ground up to build a small instruct model from scratch. Trained on FineWeb dataset form HuggingFace consisting of 15 M texts (10BT snapshot) for a total of full 3 epochs
☆18Mar 26, 2025Updated last year
Alternatives and similar repositories for SmolLlama
Users that are interested in SmolLlama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Notes of ADRL course taught at IISC as part of MTech AI curriculum☆15Nov 30, 2024Updated last year
- Learning notes and code from CS 329S: Machine Learning Systems Design series.☆25Jun 23, 2025Updated last year
- This is a simple example of how to serve a DeepSeek model with Azure ML.☆10Feb 10, 2025Updated last year
- An Efficent BPE Algorithm Faster then Hugging Face Tokenizer's Implementation☆13Sep 9, 2024Updated last year
- Single-step image generation at 306 FPS. Drifting vs Diffusion head-to-head on CIFAR-10.☆45Feb 13, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This GUI aims to simplify the process of converting GGUF files to llamafile format by providing an intuitive and convenient way for users…☆14Jan 2, 2026Updated 6 months ago
- ☆16Jan 6, 2025Updated last year
- 🔍 Code Search Tools & Experiments☆12Jun 4, 2026Updated last month
- Agent CLI☆13Updated this week
- The UnisonAI Multi-Agent Framework built on custom workflow which allows ai agents to talk together and provides a flexible and extensibl…☆23Feb 24, 2026Updated 4 months ago
- ☆12Dec 20, 2024Updated last year
- A guide to structured generation using constrained decoding☆18Jun 9, 2024Updated 2 years ago
- Tutorial for DSPy☆28May 1, 2024Updated 2 years ago
- Real time faster whisper gradio☆24Aug 17, 2025Updated 10 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ChatBot App built using LangChain and Lightning AI☆16Mar 4, 2023Updated 3 years ago
- JAX port of FLUX.1 models using flax.nnx☆23Sep 28, 2024Updated last year
- ☆23Jun 6, 2025Updated last year
- Samples of good AI generated CUDA kernels☆105May 30, 2025Updated last year
- Simply drag and drop your PDF files into Preve to get started. Ask Preve questions about your document. Get Summaries, key points, specif…☆11Apr 9, 2026Updated 3 months ago
- A small streamlit app to visualize the output of sentence clustering☆14Dec 15, 2020Updated 5 years ago
- A NodeJS application to upload, watch and stream live videos.☆12Jan 24, 2023Updated 3 years ago
- Code and scripts for NAACL 2022 industry track paper "Fast and Light-weight Answer Text Retrieval in Dialogue Systems". Built on top of C…☆13Sep 17, 2025Updated 9 months ago
- An empirical study on patch correctness☆15Nov 5, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Rust FTL + WebRTC live streaming software.☆13Mar 12, 2022Updated 4 years ago
- This is the official implementation of the voxel-based humanoid locomotion in "Gallant: Voxel Grid-based Humanoid Locomotion and Local-na…☆84Apr 24, 2026Updated 2 months ago
- Transformer-based autoregressive varitional autoencoder☆12Feb 10, 2020Updated 6 years ago
- The SQL-RL-GEN is an algorithm based on a Reinforcement Learning approach with a reward function generated by a LLM to guide the agent's …☆25Sep 18, 2025Updated 9 months ago
- Secure FTP client & multithreaded server (using threadpool) with on-the-fly Gzip compression/decompression, secure packet transmission us…☆15Jan 4, 2025Updated last year
- Reverse engineered Twitter's API☆12Nov 28, 2023Updated 2 years ago
- Brax + Pufferlib + CARBS for gpu-accelerated robotics RL☆12Jun 12, 2025Updated last year
- Using Seq2Seq transformers for Text2SQL task on WikiSQL dataset.☆12Jan 8, 2022Updated 4 years ago
- Optimizing diffusion for production-ready speeds☆40Jan 10, 2026Updated 5 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Expand -> Retrieve -> Rerank - simple method with strong results on BRIGHT benchmark☆22Aug 22, 2025Updated 10 months ago
- A T5 based sequence generation model for WikiSQL task. Achieving 90.3% on test data set using sequence generation.☆17Nov 11, 2020Updated 5 years ago
- ☆32Nov 5, 2024Updated last year
- smolbox of recipies☆29Apr 23, 2025Updated last year
- ☆102Feb 11, 2026Updated 4 months ago
- AutoLog: Anomaly Detection by Deep Autoencoding of System Logs☆11Oct 28, 2021Updated 4 years ago
- WhisperMesh is an advanced chatbot that integrates voice and text interactions, delivering personalized responses through LLM models and …☆16Apr 23, 2025Updated last year