Nero10578 / LLM-Inference-BenchmarkLinks
☆14Updated last year
Alternatives and similar repositories for LLM-Inference-Benchmark
Users that are interested in LLM-Inference-Benchmark are comparing it to the libraries listed below
Sorting:
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Updated last year
- Easily view and modify JSON datasets for large language models☆87Updated 8 months ago
- ☆135Updated last month
- Gradio based tool to run opensource LLM models directly from Huggingface☆96Updated last year
- Complex RAG backend☆29Updated last year
- ☆17Updated last year
- ☆68Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆112Updated last year
- run ollama & gguf easily with a single command☆52Updated last year
- ☆30Updated last year
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆105Updated last year
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆193Updated last year
- Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)☆52Updated last year
- An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intellig…☆57Updated last year
- ☆119Updated last year
- LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …☆38Updated last year
- Create text chunks which end at natural stopping points without using a tokenizer☆26Updated 2 months ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆23Updated last year
- Embed anything.☆27Updated last year
- Experimental LLM Inference UX to aid in creative writing☆128Updated last year
- Open source LLM UI, compatible with all local LLM providers.☆177Updated last year
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated last year
- ☆51Updated 11 months ago
- ☆107Updated 3 months ago
- Kosmos-2.5 is a cutting-edge Multimodal-LLM (MLLM) specializing in image OCR. However, its stringent software requirements & Python-scrip…☆67Updated last year
- Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma☆34Updated last year
- Something similar to Apple Intelligence?☆60Updated last year
- ☆30Updated last year
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆103Updated 5 months ago
- No longer maintained:Your personal ArXiv Curator☆41Updated last year