Alternatives and similar repositories for training:

Users that are interested in training are comparing it to the libraries listed below

• instructlab / sdg
  Python library for Synthetic Data Generation
  ☆35Updated this week
• instructlab / eval
  Python library for Evaluation
  ☆14Updated this week
• instructlab / instructlab-bot
  GitHub bot to assist with the taxonomy contribution workflow
  ☆16Updated 4 months ago
• foundation-model-stack / fms-hf-tuning
  🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
  ☆38Updated this week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated 3 months ago
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• IBM / unitxt
  🦄 Unitxt: a python library for getting data fired up and set for training and evaluation
  ☆181Updated this week
• instructlab / ui
  Place to hack on UI for InstructLab
  ☆24Updated this week
• instructlab / taxonomy
  Taxonomy tree that will allow you to create models tuned with your data
  ☆242Updated this week
• caikit / caikit-nlp
  ☆12Updated this week
• foundation-model-stack / fm-training-estimator
  Estimate resources needed to train LLMs
  ☆13Updated last month
• IBM / dolomite-engine
  Dolomite Engine is a library for pretraining/finetuning LLMs
  ☆44Updated this week
• instructlab / community
  InstructLab Community wide collaboration space including contributing, security, code of conduct, etc
  ☆83Updated this week
• openshift-psap / llm-load-test
  ☆37Updated last week
• GraphIndex-org / semantic-mapper
  ☆18Updated last year
• IBM / ensemble-instruct
  codebase release for EMNLP2023 paper publication
  ☆19Updated last year
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆72Updated last week
• dottxt-ai / benchmarks
  Benchmark structured generation libraries
  ☆26Updated 5 months ago
• alonsosilvaallende / knowledge-graph-generator
  Knowledge Graph Generator app
  ☆30Updated 11 months ago
• graphcore / Gradient-HuggingFace
  Tasks and tutorials using Graphore's IPU with Hugging Face. Originally at https://github.com/gradient-ai/Graphcore-HuggingFace
  ☆13Updated last year
• ibm-ecosystem-engineering / SuperKnowa
  Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…
  ☆109Updated 8 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 4 months ago
• lancedb / ragged
  ☆18Updated 5 months ago
• openshift / lightspeed-service
  Core repository for an AI-powered OCP assistant service
  ☆42Updated this week
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆41Updated 7 months ago
• weaviate / generator9000
  Web App for generating synthetic data
  ☆46Updated 6 months ago
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated last year
• mozilla-ai / lm-buddy
  Your buddy in the (L)LM space.
  ☆63Updated 6 months ago
• peterjohnlawrence / IntelligentGraph
  Python package that adds IntelligentGraph capabilities to RDFLib RDF graph package
  ☆55Updated last year
• jlewi / foyle
  Foyle is a copilot to help developers deploy and operate their applications.
  ☆121Updated last week