deepshard / mixtral-8x7b-Inference
Eh, simple and works.
☆27Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for mixtral-8x7b-Inference
- ☆104Updated 8 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated 10 months ago
- inference code for mixtral-8x7b-32kseqlen☆98Updated 11 months ago
- Scripts to create your own moe models using mlx☆86Updated 8 months ago
- Score LLM pretraining data with classifiers☆54Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hours☆55Updated 3 months ago
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated 10 months ago
- RAFT, or Retrieval-Augmented Fine-Tuning, is a method comprising of a fine-tuning and a RAG-based retrieval phase. It is particularly sui…☆75Updated 2 months ago
- LLM reads a paper and produce a working prototype☆36Updated last week
- tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.☆37Updated 2 months ago
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆29Updated last year
- ☆66Updated this week
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- ☆57Updated 11 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated 10 months ago
- entropix style sampling + GUI☆25Updated 3 weeks ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- ☆94Updated 2 months ago
- Track the progress of LLM context utilisation☆53Updated 4 months ago
- ☆48Updated last year
- A repository of projects and datasets under active development by Alignment Lab AI☆22Updated 10 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 8 months ago
- Collection of autoregressive model implementation☆67Updated this week
- BH hackathon☆14Updated 7 months ago
- Implementation of nougat that focuses on processing pdf locally.☆73Updated 6 months ago
- Set of scripts to finetune LLMs☆36Updated 7 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆20Updated 9 months ago
- Routing on Random Forest (RoRF)☆84Updated last month
- Command-line script for inferencing from models such as MPT-7B-Chat☆102Updated last year
- Chat Markup Language conversation library☆54Updated 10 months ago