Simple and fast server for GPTQ-quantized LLaMA inference
☆24May 18, 2023Updated 3 years ago
Alternatives and similar repositories for TALIS
Users that are interested in TALIS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Jun 16, 2023Updated 3 years ago
- Source code for the paper "Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data"☆20Feb 24, 2024Updated 2 years ago
- Streamlines the creation of dataset to train a Large Language Model with triplets : instruction-input-output . The default configuration …☆13Apr 17, 2023Updated 3 years ago
- 🎨 Imagine what Picasso could have done with AI. Self-host your StableDiffusion API.☆50May 8, 2023Updated 3 years ago
- Minimalistic batching application for LLMs using ASP.NET Core and LLamaSharp☆12Oct 23, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Discord bot for [oobabooga webui](https://github.com/oobabooga/text-generation-webui)☆12Mar 21, 2025Updated last year
- Like system requirements lab but for LLMs☆31Jun 10, 2023Updated 3 years ago
- Easily create LLM automation/agent workflows☆60Feb 13, 2024Updated 2 years ago
- RLVR Testing and Training☆21Aug 28, 2025Updated last year
- chatsnack is the easiest Python library for rapid development with OpenAI's ChatGPT API. It's an intuitive interface for creating and man…☆29Oct 27, 2026Updated last week
- (NBCE)Naive Bayes-based Context Extension on ChatGLM-6b☆15Jun 7, 2023Updated 3 years ago
- BabyAGI to run with locally hosted models using the API from https://github.com/oobabooga/text-generation-webui☆86May 6, 2023Updated 3 years ago
- Buzz AI, aka gt-chat, is a fast and intuitive question-answering chatbot for Georgia Tech. Powered by Next.js, FastAPI, and OpenAI, it so…☆30Apr 13, 2023Updated 3 years ago
- ☆11Aug 15, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Local LLM ReAct Agent with Guidance☆156May 23, 2023Updated 3 years ago
- Extensible Go microkernel for LLM guardrails, quota enforcement and policy plugins.☆10Oct 16, 2026Updated 2 weeks ago
- ☆12Apr 4, 2024Updated 2 years ago
- Llama cute voice assistant☆28Sep 10, 2023Updated 3 years ago
- pi + rainbowhat + touchscreen + usb sound card (mic or aux in) + open ai = audio logic anaklyzer☆12Apr 23, 2023Updated 3 years ago
- Train Large Language Models (LLM) using LoRA☆26May 22, 2023Updated 3 years ago
- A (nicer) tokenizer you want to use for model inference and training: with all known peventable gotchas normalized or auto-fixed.☆12Oct 16, 2026Updated 2 weeks ago
- ☆16Jun 5, 2023Updated 3 years ago
- Open Source Memory Layer for Your AI☆14Oct 18, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆12Sep 29, 2026Updated last month
- ☆30Apr 23, 2025Updated last year
- OCEAN – Open-source CXL Emulation at Hyperscale Architecture and Networking☆14Feb 9, 2026Updated 8 months ago
- 4 bits quantization of LLaMa using GPTQ☆130Jun 3, 2023Updated 3 years ago
- Local CLI coding agent☆12Jun 11, 2026Updated 4 months ago
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆10Nov 3, 2023Updated 3 years ago
- ☆11Sep 5, 2025Updated last year
- A Simple Discord Bot for the Alpaca LLM☆103Jun 22, 2023Updated 3 years ago
- GPT programs written in POWER-KI - Chat and PDF management☆19Jul 30, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Mobile-MMLU: A Mobile Intelligence Language Understanding Benchmark. Paper at: https://arxiv.org/abs/2503.20786☆11Mar 27, 2025Updated last year
- 4 bits quantization of LLaMa using GPTQ☆12Jun 2, 2023Updated 3 years ago
- Trying to deconstruct RWKV in understandable terms☆14May 6, 2023Updated 3 years ago
- OpenAI compatible API for open source LLMs☆16Oct 30, 2023Updated 3 years ago
- APEX defines how AI agents communicate with brokers, exchanges, dealers, and other execution venues. One protocol. Realtime state. Autono…☆16Jul 23, 2026Updated 3 months ago
- The Voxseg implementation in PyTorch. Voxseg is a python library for voice activity detection (VAD) for speech/non-speech segmentation.☆12Oct 18, 2023Updated 3 years ago
- Code for the paper "Abstractive Summarization Guided by Latent Hierarchical Document Structure"☆13May 20, 2023Updated 3 years ago