grctest / FastAPI-BitNet
Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.
☆17Updated last week
Related projects ⓘ
Alternatives and complementary repositories for FastAPI-BitNet
- Running Microsoft's BitNet via Electron, React & Astro☆14Updated 2 weeks ago
- LLM backed Fantasy Tribe Game☆18Updated 2 weeks ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆21Updated 4 months ago
- Crow is a Desktop AI Assistant☆28Updated 3 months ago
- Testing the different LLM and RAG Tests while I learn along the way☆17Updated 2 months ago
- SoftWhisper simplifies audio and video transcription using the powerful Whisper model. Easily select custom models, languages, and tasks,…☆34Updated last month
- Gradio based tool to run opensource LLM models directly from Huggingface☆87Updated 4 months ago
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆23Updated 2 months ago
- Turn text from websites into spoken audio with edge-tts, F5, etc. and save as mp3 files☆29Updated this week
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Updated this week
- ☆15Updated 6 months ago
- A stock market bot that automatically, once a day, rebalances your Robinhood portfolio by gathering information about each ticker in the …☆34Updated 3 weeks ago
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆28Updated 2 weeks ago
- ☆25Updated last month
- 100% Local Document deep search with LLMs☆25Updated 2 months ago
- Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…☆16Updated 5 months ago
- Your Python AI Coder!☆29Updated 3 weeks ago
- Mycomind Daemon: A mycelium-inspired, advanced Mixture-of-Memory-RAG-Agents (MoMRA) cognitive assistant that combines multiple AI models …☆31Updated 4 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆35Updated 3 weeks ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆53Updated 3 weeks ago
- ☆32Updated 2 weeks ago
- An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intellig…☆43Updated 3 months ago
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated 5 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆41Updated last month
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆47Updated last month
- ☆28Updated this week
- ☆112Updated this week
- These agents work based on any local model. You ask your question and simply indicate the number of agents and experts who will answer it…☆17Updated 8 months ago
- ☆19Updated 3 weeks ago
- Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…☆15Updated 2 months ago