abacaj / transformers
Understanding large language models
☆116Updated last year
Related projects: ⓘ
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆152Updated last year
- Full finetuning of large language models without large memory requirements☆94Updated 8 months ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆99Updated 8 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- Reimplementation of the task generation part from the Alpaca paper☆118Updated last year
- ☆141Updated last year
- GPT-based Conversation Summarizer☆144Updated last year
- ☆89Updated 11 months ago
- Just a bunch of benchmark logs for different LLMs☆112Updated last month
- Convert all of libgen to high quality markdown☆240Updated 9 months ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆102Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆117Updated 8 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆217Updated 6 months ago
- ☆58Updated 3 weeks ago
- [Added T5 support to TRLX] A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆47Updated last year
- ☆172Updated 4 months ago
- The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…☆122Updated last year
- ☆48Updated 11 months ago
- ☆45Updated last year
- A comprehensive deep dive into the world of tokens☆212Updated 2 months ago
- ☆152Updated last year
- Efficient vector database for hundred millions of embeddings.☆196Updated 4 months ago
- A puzzle to learn about prompting☆106Updated last year
- ☆133Updated 9 months ago
- ☆105Updated last year
- ☆171Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆96Updated 10 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆93Updated 5 months ago
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆181Updated 4 months ago
- inference code for mixtral-8x7b-32kseqlen☆97Updated 9 months ago