Alternatives and similar repositories for smc-inference-server

Users that are interested in smc-inference-server are comparing it to the libraries listed below

• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆72Updated 8 months ago
• doomslide / autoloom
  Approximating the joint distribution of language models via MCTS
  ☆22Updated 11 months ago
• samefarrar / entropix_mlx
  Modify Entropy Based Sampling to work with Mac Silicon via MLX
  ☆49Updated 11 months ago
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆58Updated last year
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 3 weeks ago
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated last year
• teknium1 / ShareGPT-Builder
  ☆116Updated 10 months ago
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆62Updated 11 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated last year
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated last year
• xjdr-alt / muzero_sketch
  ☆40Updated last year
• doomslide / hyperobject
  Plotting (entropy, varentropy) for small LMs
  ☆98Updated 5 months ago
• QuixiAI / bridge-protocol
  ☆22Updated 4 months ago
• yoheinakajima / babyagi_og
  The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)
  ☆21Updated last year
• lumpenspace / FRAG
  Flexible, efficient, and context-aware generation from large unstructured knowledge sources.
  ☆17Updated last year
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆51Updated last year
• QuixiAI / kraken
  ☆67Updated last year
• impel-intelligence / dippy-bittensor-subnet
  ☆54Updated last month
• nateraw / modal-examples
  Apps that run on modal.com
  ☆12Updated last month
• aidenaistar / local-gpt-author
  ☆17Updated last year
• granawkins / latent-dictionary
  A dictionary, but it shows you position in embedding space relative to some synonyms/antonyms instead of a definition.
  ☆74Updated 8 months ago
• JD-P / minihf
  MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…
  ☆181Updated 2 weeks ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 9 months ago
• knowrohit / know_medical_dialogues
  KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…
  ☆24Updated last year
• vgel / logitloom
  explore token trajectory trees on instruct and base models
  ☆148Updated 5 months ago
• NousResearch / forge-api-demo
  Simple demo showing how to use the Forge API by Nous Research
  ☆13Updated 11 months ago
• ai8hyf / OpenResearchAssistant
  An automated tool for discovering insights from research papaer corpora
  ☆138Updated last year
• kyegomez / NeoSapiens
  The next evolution of Agents
  ☆47Updated 2 weeks ago
• Alignment-Lab-AI / AutoMaticAssistant
  ☆24Updated last year
• interstellarninja / MeeseeksAI
  A framework for orchestrating AI agents using a mermaid graph
  ☆77Updated last year