So, I trained a Llama a 130M architecture I coded from ground up to build a small instruct model from scratch. Trained on FineWeb dataset form HuggingFace consisting of 15 M texts (10BT snapshot) for a total of full 3 epochs
☆17Mar 26, 2025Updated last year
Alternatives and similar repositories for SmolLlama
Users that are interested in SmolLlama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Notes of ADRL course taught at IISC as part of MTech AI curriculum☆14Nov 30, 2024Updated last year
- Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed☆21May 27, 2024Updated last year
- This repository includes examples of using Microsoft Semantic Kernel with local LLMS via Ollama☆10May 14, 2024Updated last year
- This is a simple example of how to serve a DeepSeek model with Azure ML.☆10Feb 10, 2025Updated last year
- Serverless RAG application with LlamaIndex and code interperter on Azure Container Apps☆12Jan 30, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- https://github.com/juliakorea/translate-doc 로 옮깁니다☆10Nov 21, 2017Updated 8 years ago
- This GUI aims to simplify the process of converting GGUF files to llamafile format by providing an intuitive and convenient way for users…☆14Jan 2, 2026Updated 4 months ago
- ☆16Jan 6, 2025Updated last year
- Agent CLI☆13Updated this week
- ☆12Dec 20, 2024Updated last year
- [NeurIPS 2025 𝐒𝐩𝐨𝐭𝐥𝐢𝐠𝐡𝐭] AutoToM: Scaling Model-based Mental Inference via Automated Agent Modeling☆44Mar 28, 2026Updated last month
- [WIP] Better (FP8) attention for Hopper☆33Feb 24, 2025Updated last year
- 가벼운 멀티에이전트 오케스트레이션을 탐구하는 교육 프레임워크입니다. OpenAI 솔루션 팀에서 관리합니다.☆16Oct 20, 2024Updated last year
- Tutorial for DSPy☆27May 1, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Template repository of a machine-learning Python project powered by FastAPI and PyTorch☆15Aug 26, 2021Updated 4 years ago
- ChatBot App built using LangChain and Lightning AI☆17Mar 4, 2023Updated 3 years ago
- P5js sketches (Processing for JavaScript)☆18Jan 21, 2026Updated 3 months ago
- A tool to build a graph from a codebase☆14Feb 19, 2025Updated last year
- Samples of good AI generated CUDA kernels☆103May 30, 2025Updated 11 months ago
- Jarvis made by Kaushik Shresth Reverse Engineered by Likhi☆15Feb 16, 2025Updated last year
- ☆14Aug 29, 2023Updated 2 years ago
- LCM OpenVINO model converter☆24Mar 27, 2024Updated 2 years ago
- Simply drag and drop your PDF files into Preve to get started. Ask Preve questions about your document. Get Summaries, key points, specif…☆11Apr 9, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A NodeJS application to upload, watch and stream live videos.☆12Jan 24, 2023Updated 3 years ago
- ☆39Mar 25, 2026Updated last month
- Code and scripts for NAACL 2022 industry track paper "Fast and Light-weight Answer Text Retrieval in Dialogue Systems". Built on top of C…☆13Sep 17, 2025Updated 7 months ago
- Rust FTL + WebRTC live streaming software.☆13Mar 12, 2022Updated 4 years ago
- ☆40Feb 18, 2024Updated 2 years ago
- Transformer-based autoregressive varitional autoencoder☆12Feb 10, 2020Updated 6 years ago
- The SQL-RL-GEN is an algorithm based on a Reinforcement Learning approach with a reward function generated by a LLM to guide the agent's …☆22Sep 18, 2025Updated 7 months ago
- https://openreview.net/forum?id=OC1o4_OI6Jw☆13May 27, 2022Updated 3 years ago
- Reverse engineered Twitter's API☆13Nov 28, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Expand -> Retrieve -> Rerank - simple method with strong results on BRIGHT benchmark☆22Aug 22, 2025Updated 8 months ago
- A T5 based sequence generation model for WikiSQL task. Achieving 90.3% on test data set using sequence generation.☆17Nov 11, 2020Updated 5 years ago
- ☆31Nov 5, 2024Updated last year
- smolbox of recipies☆29Apr 23, 2025Updated last year
- 🛰 Monitor how many tokens your code and configs consume in AI tools. Set budgets and get alerts when limits are hit☆64Apr 26, 2026Updated last week
- WhisperMesh is an advanced chatbot that integrates voice and text interactions, delivering personalized responses through LLM models and …☆15Apr 23, 2025Updated last year
- ☆21Sep 6, 2021Updated 4 years ago