ksm26 / Pretraining-LLMs
Master the essential steps of pretraining large language models (LLMs). Learn to create high-quality datasets, configure model architectures, execute training runs, and assess model performance for efficient and effective LLM pretraining.
☆13Updated 7 months ago
Alternatives and similar repositories for Pretraining-LLMs:
Users that are interested in Pretraining-LLMs are comparing it to the libraries listed below
- Challenging myself to learn CUDA (Basics → Intermediate) these 100 days.☆12Updated this week
- Various projects using Large Language Model (GPT & LLAMA) other open source model from HuggingFace and OpenAI. OpenAI API required for ru…☆97Updated 4 months ago
- Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 , A…☆60Updated 11 months ago
- ☆80Updated last year
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆152Updated 10 months ago
- ☆49Updated this week
- A LLM based chatbot Recommender engine☆25Updated last year
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆151Updated 7 months ago
- All the code and materials related to our YouTube channel (TwoSetAI)☆103Updated 2 months ago
- This project aims to introduce and demonstrate the practical applications of RAG using Python code in a Jupyter Notebook environment.☆50Updated last year
- ☆36Updated this week
- ☆18Updated 7 months ago
- 🌼 ShoppingGPT 🛒: AI-powered Shopping Assistant - RAG + LLMs + Semantic Router +Vietnamese☆20Updated 6 months ago
- A code repository that cointains all the code for finetuning some of the popular LLMs on medical data☆41Updated 11 months ago
- RAG-VectorDB-Embedings-LlamaIndex-Langchain☆216Updated 4 months ago
- LLM (Large Language Model) FineTuning☆521Updated this week
- Agentic RAG implementation using LangGraph☆24Updated 8 months ago
- ChatCSV bot using Llama 2, Sentence Transformers, CTransformers, Langchain, and Streamlit.☆67Updated 10 months ago
- Self-paced bootcamp on Generative AI. Tutorials on ML fundamentals, LLMs, RAGs, LangChain, LangGraph, Fine-tuning Llama 3 & AI Agents (Cr…☆502Updated 2 weeks ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆305Updated 3 months ago
- Web scraping AI that leverages the crawl4ai library to extract structured data from web pages using various large language models (LLMs).…☆43Updated last month
- Welcome to the LLMs Interview Prep Guide! This GitHub repository offers a curated set of interview questions and answers tailored for Dat…☆129Updated last year
- ☆107Updated 4 months ago
- A naive implementation of GraphRAG for Movie Recommendation on IMDB Top 1000 movies dataset.☆60Updated 8 months ago
- Integrating knowledge graphs (KG) with large language models (LLM)☆140Updated 3 months ago
- Multimodal RAG using Langchain☆46Updated last year
- This is a repository which uses LangChain LangGraph and DuckduckGo to create a Perplexity Clone☆78Updated 5 months ago
- This playlab encompasses a multitude of projects crafted through the utilization of Large Language Models, showcasing the versatility and…☆102Updated last week
- GenAI Experimentation☆58Updated 2 months ago
- A notebook based tutorial series on buildling a LLM from scratch☆24Updated 6 months ago