RahulSChand / llama2.c-for-dummiesLinks
Step by step explanation/tutorial of llama2.c
☆224Updated 2 years ago
Alternatives and similar repositories for llama2.c-for-dummies
Users that are interested in llama2.c-for-dummies are comparing it to the libraries listed below
Sorting:
- llama3.cuda is a pure C/CUDA implementation for Llama 3 model.☆344Updated 6 months ago
- Easy and Efficient Quantization for Transformers☆202Updated 4 months ago
- Sakura-SOLAR-DPO: Merge, SFT, and DPO☆116Updated last year
- Efficient fine-tuning for ko-llm models☆182Updated last year
- OSLO: Open Source for Large-scale Optimization☆174Updated 2 years ago
- Newsletter bot for 🤗 Daily Papers☆128Updated this week
- Inference of Mamba models in pure C☆192Updated last year
- Extension of Langchain for RAG. Easy benchmarking, multiple retrievals, reranker, time-aware RAG, and so on...☆283Updated last year
- Ditto is an open-source framework that enables direct conversion of HuggingFace PreTrainedModels into TensorRT-LLM engines.☆49Updated 3 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆266Updated last year
- 1-Click is all you need.☆62Updated last year
- manage histories of LLM applied applications☆90Updated last year
- Inference Llama/Llama2/Llama3 Modes in NumPy☆21Updated last year
- 삼각형의 실전! Triton☆16Updated last year
- A performance library for machine learning applications.☆184Updated 2 years ago
- A collection of all available inference solutions for the LLMs☆91Updated 7 months ago
- evolve llm training instruction, from english instruction to any language.☆118Updated 2 years ago
- Inference Llama 2 in one file of pure C++☆84Updated 2 years ago
- Python bindings for ggml☆146Updated last year
- llama3.np is a pure NumPy implementation for Llama 3 model.☆989Updated 6 months ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆277Updated last year
- Simple implementation of Speculative Sampling in NumPy for GPT-2.☆96Updated 2 years ago
- The Universe of Evaluation. All about the evaluation for LLMs.☆228Updated last year
- A lightweight adjustment tool for smoothing token probabilities in the Qwen models to encourage balanced multilingual generation.☆94Updated 3 months ago
- ☆27Updated last year
- Comparison of Language Model Inference Engines☆232Updated 10 months ago
- ☆302Updated this week
- Python Project Template☆68Updated 3 years ago
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆161Updated 2 months ago
- An innovative library for efficient LLM inference via low-bit quantization☆349Updated last year