joshuasundance-swca / llamacpp-langchain-neuralbeagle-demoLinks
a small demo repo to show how I got neuralbeagle14-7b running locally on my 8GB GPU
☆14Updated last year
Alternatives and similar repositories for llamacpp-langchain-neuralbeagle-demo
Users that are interested in llamacpp-langchain-neuralbeagle-demo are comparing it to the libraries listed below
Sorting:
- Very little code to make PyTorch Lightning models☆16Updated last year
- Test LLMs automatically with Giskard and CI/CD☆30Updated 9 months ago
- Mistral + Haystack: build RAG pipelines that rock 🤘☆105Updated last year
- A collection of fine-tuning notebooks!☆27Updated last year
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆167Updated last year
- ☆20Updated last year
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆105Updated 2 months ago
- Scripts, notebooks, and articles about data science in general.☆47Updated last year
- ☆77Updated last year
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆46Updated last year
- How to serve ML predictions 100x faster☆54Updated 9 months ago
- ☆29Updated last year
- GenAI Experimentation☆57Updated last month
- ☆15Updated 9 months ago
- Large Language Model (LLM) Inference API and Chatbot☆125Updated last year
- ☆15Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 10 months ago
- This playlab encompasses a multitude of projects crafted through the utilization of Large Language Models, showcasing the versatility and…☆122Updated last month
- ☆185Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆111Updated last week
- everything i know about cuda and triton☆13Updated 4 months ago
- Includes examples on how to evaluate LLMs☆23Updated 7 months ago
- A template to kick-start your Python project ✨🚀☆51Updated 5 months ago
- ☆86Updated last year
- Iterate fast on your RAG pipelines☆23Updated 3 months ago
- Example code and notebooks related to mlflow, llmops, etc.☆43Updated 11 months ago
- ☆78Updated last year
- Includes material (code + description) that I turned into notebooks☆51Updated last year
- Data extraction with LLM on CPU☆84Updated last year
- SynthGenAI - Package for Generating Synthetic Datasets using LLMs.☆37Updated 4 months ago