Alternatives and similar repositories for llm-hosting-container

Users that are interested in llm-hosting-container are comparing it to the libraries listed below

• huggingface / optimum-neuron
  Training and inference on AWS Trainium and Inferentia chips.
  ☆254Updated last week
• awslabs / extending-the-context-length-of-open-source-llms
  ☆56Updated 6 months ago
• cohere-ai / cohere-aws
  ☆64Updated 8 months ago
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆46Updated last year
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆30Updated 2 years ago
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• aws-neuron / transformers-neuronx
  ☆111Updated last year
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆155Updated this week
• fw-ai / cookbook
  Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.
  ☆131Updated last month
• arunprsh / knowledge-augmented-LLMs
  Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment
  ☆31Updated 2 years ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆32Updated last year
• wenqiglantz / edd-recursive-doc-agent-vs-metadata-replacement
  Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines
  ☆31Updated 2 years ago
• baileytec-labs / llama-on-lambda
  Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!
  ☆177Updated last year
• TuanaCelik / unstructuredio-haystack
  💙 Unstructured Data Connectors for Haystack 2.0
  ☆17Updated 2 years ago
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆11Updated last year
• aws-samples / aiml-genai-multimodal-agent
  ☆54Updated last year
• aws-samples / rag-with-amazon-opensearch-and-sagemaker
  Question Answering Generative AI application with Large Language Models (LLMs) and Amazon OpenSearch Service
  ☆28Updated last year
• anyscale / ray-summit-2023-training
  ☆89Updated 2 years ago
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated 2 years ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• amazon-science / CodeSage
  CodeSage: Code Representation Learning At Scale (ICLR 2024)
  ☆115Updated last year
• aws-samples / llm-evaluation-methodology
  ☆46Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• apple / ml-superposition-prompting
  ☆147Updated last year
• aws-neuron / upstreaming-to-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆25Updated 2 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆111Updated last year
• lancedb / ragged
  ☆21Updated last year
• JGalego / RAGmap
  A simple Streamlit application to visualize document chunks and queries in embedding space 🗺️🔍
  ☆13Updated 9 months ago