hkproj / bert-from-scratch

Related projects ⓘ

Alternatives and complementary repositories for bert-from-scratch

• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 5 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆92Updated last month
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆116Updated last year
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆58Updated 10 months ago
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆27Updated 10 months ago
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆83Updated 7 months ago
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆97Updated 4 months ago
• sangmichaelxie / cs324_p2
  Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)
  ☆101Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆42Updated 7 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆64Updated 5 months ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆160Updated 6 months ago
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆220Updated last year
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated 10 months ago
• Sakil786 / LLM-PlayLab
  This playlab encompasses a multitude of projects crafted through the utilization of Large Language Models, showcasing the versatility and…
  ☆74Updated last month
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 4 months ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆242Updated last week
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆188Updated 8 months ago
• hkproj / pytorch-llama-notes
  Notes about LLaMA 2 model
  ☆47Updated last year
• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆111Updated 6 months ago
• geronimi73 / qlora-minimal
  ☆80Updated 11 months ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆113Updated 5 months ago
• kuleshov-group / aml-book
  ☆35Updated 5 months ago
• jcolano / DPO
  Direct Preference Optimization Implementation
  ☆14Updated 9 months ago
• neubig / anlp-code
  ☆150Updated 9 months ago
• arpita8 / Awesome-Mixture-of-Experts-Papers
  Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.
  ☆64Updated 2 months ago
• ThinamXx / build-GPT
  Building GPT ...
  ☆17Updated 2 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆236Updated 4 months ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆57Updated 11 months ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆194Updated 6 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆251Updated last year