abacaj / transformers
Understanding large language models
☆118Updated 2 years ago
Alternatives and similar repositories for transformers:
Users that are interested in transformers are comparing it to the libraries listed below
- inference code for mixtral-8x7b-32kseqlen☆99Updated last year
- Full finetuning of large language models without large memory requirements☆93Updated last year
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆100Updated last year
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆186Updated 10 months ago
- ☆45Updated last year
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆153Updated last year
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆198Updated 10 months ago
- ☆153Updated 2 years ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆230Updated 4 months ago
- ☆92Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- ☆136Updated last year
- Convert all of libgen to high quality markdown☆248Updated last year
- ☆106Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated 11 months ago
- Just a bunch of benchmark logs for different LLMs☆119Updated 7 months ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆101Updated last year
- [Added T5 support to TRLX] A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆47Updated 2 years ago
- ☆195Updated 10 months ago
- ☆48Updated last year
- ☆75Updated last year
- A miniature version of Modal☆20Updated 9 months ago
- experiments with inference on llama☆104Updated 9 months ago
- ☆77Updated 9 months ago
- Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)☆101Updated last year
- GPT-based Conversation Summarizer☆148Updated last year
- A really tiny autograd engine☆90Updated 11 months ago
- Reimplementation of the task generation part from the Alpaca paper☆119Updated last year
- An mlx project to train a base model on your whatsapp chats using (Q)Lora finetuning☆164Updated last year