mlc-ai / web-llm-assistant

Related projects ⓘ

Alternatives and complementary repositories for web-llm-assistant

• mlc-ai / llm-perf-bench
  ☆114Updated 7 months ago
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆100Updated 3 weeks ago
• Josephrp / LablabAutogen
  A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.
  ☆25Updated 11 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆29Updated 6 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆74Updated last week
• Tonic-AI / EasyAGI
  🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.
  ☆23Updated 11 months ago
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆73Updated 6 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆73Updated 2 months ago
• skypilot-org / sky-llama
  ☆26Updated last year
• Cornell-RelaxML / qtip
  ☆69Updated this week
• stanford-oval / chainlite
  LangChain + LiteLLM that works
  ☆25Updated 3 weeks ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆89Updated this week
• run-ai / runai-model-streamer
  ☆120Updated this week
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆32Updated 6 months ago
• efeslab / fiddler
  Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆172Updated this week
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆22Updated this week
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆74Updated last month
• lm-sys / lm-sys.github.io
  ☆50Updated 2 months ago
• n4ze3m / vexasearch
  A function to do all
  ☆35Updated 7 months ago
• BorealisAI / neuzip
  Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…
  ☆32Updated 3 weeks ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 6 months ago
• dbos-inc / durable-swarm
  Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.
  ☆72Updated 2 weeks ago
• bdytx5 / open_answer_engine
  ☆21Updated 3 months ago
• The-Swarm-Corporation / swarms-cloud
  Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.
  ☆27Updated this week
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated 5 months ago
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆56Updated 6 months ago
• Mozilla-Ocho / formulaic-python
  The official Python library for Formulaic
  ☆14Updated 6 months ago
• AIAnytime / Zephyr-7B-beta-RAG-Demo
  Zephyr 7B beta RAG Demo inside a Gradio app powered by BGE Embeddings, ChromaDB, and Zephyr 7B Beta LLM.
  ☆35Updated last year
• TrelisResearch / one-click-llms
  One click templates for inferencing Language Models
  ☆120Updated this week
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆11Updated this week