So, I trained a Llama a 130M architecture I coded from ground up to build a small instruct model from scratch. Trained on FineWeb dataset form HuggingFace consisting of 15 M texts (10BT snapshot) for a total of full 3 epochs
☆18Mar 26, 2025Updated last year
Alternatives and similar repositories for SmolLlama
Users that are interested in SmolLlama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Ask shortgpt for instant and concise answers☆14May 7, 2023Updated 3 years ago
- This repository includes examples of using Microsoft Semantic Kernel with local LLMS via Ollama☆10May 14, 2024Updated 2 years ago
- Semantic Kernel connector for ONNX models.☆12Jun 10, 2024Updated 2 years ago
- The UnisonAI Multi-Agent Framework built on custom workflow which allows ai agents to talk together and provides a flexible and extensibl…☆23Feb 24, 2026Updated 5 months ago
- This is a simple example of how to serve a DeepSeek model with Azure ML.☆10Feb 10, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆17May 6, 2025Updated last year
- Demo of Open AI with ASP.NET Blazor☆16Dec 29, 2025Updated 7 months ago
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 4 months ago
- https://github.com/juliakorea/translate-doc 로 옮깁니다☆10Nov 21, 2017Updated 8 years ago
- ☆12Dec 20, 2024Updated last year
- This GUI aims to simplify the process of converting GGUF files to llamafile format by providing an intuitive and convenient way for users…☆14Jan 2, 2026Updated 6 months ago
- An repository of 2025-2026 AI Safety and Alignment programs, camps, and workshops.☆22May 18, 2025Updated last year
- Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.☆31Jul 8, 2026Updated 3 weeks ago
- ☆23Nov 4, 2024Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- MDM-Prime-v2: Binary Encoding and Index Shuffling Enable Scaling of Diffusion Language Models☆27May 23, 2026Updated 2 months ago
- ☆15Jan 6, 2025Updated last year
- ☆27Jun 7, 2026Updated last month
- Learning notes and code from CS 329S: Machine Learning Systems Design series.☆25Jun 23, 2025Updated last year
- [WIP] Better (FP8) attention for Hopper☆33Feb 24, 2025Updated last year
- 가벼운 멀티에이전트 오케스트레이션을 탐구하는 교육 프레임워크입니다. OpenAI 솔루션 팀에서 관리합니다.☆16Oct 20, 2024Updated last year
- It shows how to use AgentCore Runtime based on LangGraph, Strands SDK and Claude Agent SDK with MCP.☆15Updated this week
- Agent CLI☆13Updated this week
- Real time faster whisper gradio☆24Aug 17, 2025Updated 11 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Implementation of CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation☆26Feb 18, 2025Updated last year
- A tool to build a graph from a codebase☆14Feb 19, 2025Updated last year
- An empirical study on patch correctness☆15Nov 5, 2022Updated 3 years ago
- ☆28Jul 2, 2026Updated 3 weeks ago
- This chat application is built using .NET Aspire and uses Semantic Kernel to connect to locally running Phi-3 model by Ollama to respond …☆21May 29, 2024Updated 2 years ago
- Jarvis made by Kaushik Shresth Reverse Engineered by Likhi☆16Feb 16, 2025Updated last year
- The best ChatGPT that $100 can buy.☆56Updated this week
- AutoLog: Anomaly Detection by Deep Autoencoding of System Logs☆11Oct 28, 2021Updated 4 years ago
- Web Structured Data Extraction Agent☆16Mar 10, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Building your own AI Agent using Semantic Kernel - Microsoft Learn Zero to Hero Community 2024☆20May 23, 2024Updated 2 years ago
- General Fine-Tuning: A little language for Deep Nets (ACL-2022 Tutorial)☆16Oct 1, 2023Updated 2 years ago
- Transformer-based autoregressive varitional autoencoder☆12Feb 10, 2020Updated 6 years ago
- https://openreview.net/forum?id=OC1o4_OI6Jw☆13May 27, 2022Updated 4 years ago
- Run Stable diffusion 3 on low VRAM systems☆29Jun 13, 2024Updated 2 years ago
- A NodeJS application to upload, watch and stream live videos.☆12Jan 24, 2023Updated 3 years ago
- ☆51Jan 28, 2025Updated last year