Alternatives and similar repositories for Pretraining-LLMs

Users that are interested in Pretraining-LLMs are comparing it to the libraries listed below

• ChanCheeKean / DataScience
  ☆83Updated last year
• alexriggio / BERT-LoRA-TensorRT
  This repository contains a custom implementation of the BERT model, fine-tuned for specific tasks, along with an implementation of Low Ra…
  ☆77Updated last year
• huggingface / transformers-research-projects
  Research projects built on top of Transformers
  ☆58Updated 3 months ago
• mallik3006 / LLM_fine_tuning_llama3_8b
  Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed
  ☆18Updated last year
• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆175Updated last year
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆96Updated last year
• Praveen76 / LLMs-Interview-Prep-Guide
  Welcome to the LLMs Interview Prep Guide! This GitHub repository offers a curated set of interview questions and answers tailored for Dat…
  ☆137Updated last year
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆70Updated 2 months ago
• Abonia1 / Fine-Tuning-LLMs-Key-Concepts-and-Terms
  Fine-tuning large language models (LLMs) is crucial for enhancing performance across domain-specific task applications. This comprehensiv…
  ☆12Updated 9 months ago
• medmcqa / medmcqa
  A large-scale (194k), Multiple-Choice Question Answering (MCQA) dataset designed to address realworld medical entrance exam questions.
  ☆218Updated 2 years ago
• dmis-lab / self-biorag
  [ISMB '24] Self-BioRAG: Improving Medical Reasoning through Retrieval and Self-Reflection with Retrieval-Augmented Large Language Models
  ☆63Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 9 months ago
• GURPREETKAURJETHRA / Advanced_RAG
  Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 , A…
  ☆69Updated last year
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆45Updated 9 months ago
• rohan-paul / LLM-FineTuning-Large-Language-Models
  LLM (Large Language Model) FineTuning
  ☆542Updated 2 months ago
• smallporridge / AssistRAG
  ☆24Updated 5 months ago
• abachaa / MEDEC
  ☆37Updated 3 weeks ago
• Rs-py / HowToFineTuneLlama3.1
  Quick tutorial showing how to fine-tune Llama3.1 with nothing but free tools and text data. All code included in ipynb. For a step by ste…
  ☆9Updated 10 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated 8 months ago
• AIAnytime / Medical-RAG-using-Meditron-7B-LLM
  Medical RAG QA App using Meditron 7B LLM, Qdrant Vector Database, and PubMedBERT Embedding Model.
  ☆54Updated last year
• docugami / KG-RAG-datasets
  Knowledge Graph Retrieval Augmented Generation (KG-RAG) Eval Datasets
  ☆160Updated last year
• Zefty / rag-end2end-retriever
  ☆20Updated 3 years ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated last year
• aymeric-roucher / benchmark_agents
  ☆27Updated last year
• lamm-mit / LLM-finetuning
  ☆26Updated 9 months ago
• dataprofessor / langchain-ask-the-data
  Build an LLM powered Ask the Data App with LangChain (using the Pandas DataFrame Agent) and Streamlit
  ☆28Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆90Updated 3 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆91Updated last year
• githubpradeep / notebooks
  ☆54Updated 4 months ago
• som-shahlab / Clinfo.AI
  This is Clinfo.AI Demo Instruction
  ☆34Updated 10 months ago