kemingy / vllm-env

Related projects ⓘ

Alternatives and complementary repositories for vllm-env

• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆15Updated last year
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆14Updated last year
• hpcaitech / Titans
  A collection of models built with ColossalAI
  ☆32Updated last year
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated 3 months ago
• qdrant / bm42_eval
  Evaluation of bm42 sparse indexing algorithm
  ☆60Updated 4 months ago
• MooreThreads / TurboRAG
  ☆30Updated 3 weeks ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆27Updated last year
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 3 years ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆34Updated 10 months ago
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆55Updated last year
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆99Updated last year
• DunZhang / Stella
  ☆41Updated 3 months ago
• laramohan / wikillm
  LLMs as Collaboratively Edited Knowledge Bases
  ☆42Updated 8 months ago
• UmerHA / triton_util
  Make triton easier
  ☆41Updated 4 months ago
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆83Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆73Updated 9 months ago
• allenai / recoma
  Reasoning by Communicating with Agents
  ☆21Updated last month
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆60Updated 2 weeks ago
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆35Updated 9 months ago
• CodeGeeX / codegeex-fastertransformer
  fastertransformer for codegeex model
  ☆64Updated last year
• codefuse-ai / D2LLM
  ☆22Updated 3 months ago
• cnmoro / MiniVectorDB
  Lightning Fast: Faiss CPU + Onnx Quantized Multilingual Embedding Model
  ☆22Updated last month
• anyscale / long-context-fine-tuning-blogpost
  ☆18Updated 8 months ago
• ray-project / distml
  Distributed ML Optimizer
  ☆31Updated 3 years ago
• etrobot / nextArtifacts
  A Next.js version of Claude Aritfacts , inspired by llamacoder
  ☆16Updated last month
• The-Swarm-Corporation / swarms-memory
  A collection of pre-build wrappers over common RAG systems like ChromaDB, Weaviate, Pinecone, and othersz!
  ☆19Updated this week
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆58Updated this week
• stanford-oval / ovalchat
  OVALChat is a customizable Web app aimed at conducting user studies with chatbots
  ☆26Updated 10 months ago
• onesuper / HuggingFace-Datasets-Text-Quality-Analysis
  Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…
  ☆50Updated last year