ducnh279 / LLMs-Pretraining-with-PyTorch
Code example for pretraining an LLM with vanilla PyTorch training loop
☆10Updated 7 months ago
Alternatives and similar repositories for LLMs-Pretraining-with-PyTorch:
Users that are interested in LLMs-Pretraining-with-PyTorch are comparing it to the libraries listed below
- Supervised Instruction Finetuning for Mistral 7B using Dolly-15K dataset☆8Updated 8 months ago
- Variable Selection Network with PyTorch☆11Updated 7 months ago
- Baseline achieving 0.8 accuracy on the private test set in the ZaloAI Challenge 2023 Elementary Math Solving☆24Updated 8 months ago
- Use LoRA technique to improve training Large Language Model☆12Updated last year
- RAG for Vietnamese Wikipedia corpus.☆26Updated last year
- ☆26Updated 11 months ago
- This is the official repository for Vista dataset - A Vietnamese multimodal dataset contains more than 700,000 samples of conversations a…☆25Updated 8 months ago
- ☆12Updated 2 years ago
- Xây dựng tập dữ liệu 500GB (20% done) văn bản tiếng Việt để huấn luyện mô hình ngôn ngữ lớn☆25Updated last year
- Vistral-V: Visual Instruction Tuning for Vistral - Vietnamese Large Vision-Language Model.☆20Updated 6 months ago
- ☆9Updated 7 months ago
- Baseline for ZaloAI Challenge 2023 Elementary Math Solving☆68Updated 11 months ago
- MLOPs human pose estimation end-to-end.☆33Updated 8 months ago
- ☆49Updated 5 months ago
- ☆34Updated 3 years ago
- ☆16Updated 3 years ago
- ☆46Updated last year
- Ai cũng có thể tự tạo chatbot bằng huấn luyện chỉ dẫn, với 12G GPU (RTX 3060) và khoảng vài chục MB dữ liệu☆111Updated last year
- A collection for AI Engineer☆38Updated 5 months ago
- This is our solution dealing with BKAI challenge☆61Updated 2 years ago
- Quy Nhon AI Hackathon 2022 - Challenge 2: Review Analytics - Top 1 Solution☆10Updated 2 years ago
- Pre-training script for BART in JAX/Flax☆37Updated 2 years ago
- Vietnamese self-supervised Wav2vec2 model☆61Updated 2 years ago
- ☆62Updated last year
- ☆51Updated 3 years ago
- ☆12Updated last year
- Build English-Vietnamese machine translation with ProtonX Transformer. :D☆64Updated 3 years ago
- Solution for Zalo AI Challenge 2022 - E2E Question Answering☆109Updated 2 years ago
- Dịch máy giữa ngôn ngữ anh-viet☆51Updated 4 years ago
- Top 1 Quy Nhon AI Hackathon 2022 Challenge Smart Menu☆31Updated 2 years ago