GusLovesMath / Llama3_MacSilicon
Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework, with install guide & perf tips. Aims to optimize LLM performance on Mac silicon for devs & researchers.
☆9Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for Llama3_MacSilicon
- A python command-line tool to download & manage MLX AI models from Hugging Face.☆16Updated 2 months ago
- Tools for merging pretrained large language models.☆19Updated 5 months ago
- Use Grounding DINO, Segment Anything, and CLIP to label objects in images.☆23Updated 10 months ago
- ☆15Updated 6 months ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆11Updated last week
- AI_Powered_Dev_Search_Engine☆12Updated 8 months ago
- Python scripts performing optical flow estimation using the NeuFlowV2 model in ONNX.☆32Updated 2 months ago
- BH hackathon☆14Updated 7 months ago
- Github repo for Peifeng's internship project☆12Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆15Updated last week
- ☆14Updated last year
- ☆20Updated 9 months ago
- A collection of pre-build wrappers over common RAG systems like ChromaDB, Weaviate, Pinecone, and othersz!☆20Updated last week
- ☆11Updated last year
- This is a repository that collects common audio noise reduction models, using Gradio to demonstrate the use of each model, which is very …☆16Updated last month
- Modified Beam Search with periodical restart☆12Updated 2 months ago
- The open source implementation of "NeVA: NeMo Vision and Language Assistant"☆18Updated last year
- Tool to take your ML model from local to production with one-line of code.☆23Updated 10 months ago
- Integrate an LLM copilot within your Keras model development workflow☆28Updated last year
- Streamlit app for recommending eval functions using prompt diffs☆25Updated 10 months ago
- GGUF Quantization of any LLM.☆31Updated 8 months ago
- OpenAI compatible API for open source LLMs☆15Updated last year
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.☆25Updated 11 months ago
- Simple Implementation of a Transformer in the new framework MLX by Apple☆21Updated this week
- Simple CogVLM client script☆14Updated 11 months ago
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆23Updated 11 months ago
- Chat Complex PDF with Tables Using IBM WatsonX, Langchain and LlamaParser.☆11Updated 7 months ago
- a simple create-llama template using llama-index v0.10 and integrated with Ollama☆9Updated 6 months ago
- ☆12Updated 8 months ago
- Visual RAG using less than 300 lines of code.☆23Updated 8 months ago