ictorv / Large-Language-Pretraining
Building large language foundational model
☆9Updated last month
Alternatives and similar repositories for Large-Language-Pretraining:
Users that are interested in Large-Language-Pretraining are comparing it to the libraries listed below
- alternative way to calculating self attention☆18Updated 10 months ago
- The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)☆21Updated 6 months ago
- In this repository I have a code and brief explanations of the attempts that I made at the ARC-AGI (2024) challenges :)☆23Updated 5 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated 2 months ago
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆13Updated last week
- Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…☆21Updated last month
- OmegaViT (ΩViT) is a cutting-edge vision transformer architecture that combines multi-query attention, rotary embeddings, state space mod…☆14Updated last week
- The Swarm Ecosystem☆20Updated 8 months ago
- An intelligent code optimization system leveraging AI analysis, automated refactoring, and test generation. Built with DSPy and Gradio, i…☆18Updated 2 months ago
- ☆11Updated 10 months ago
- BH hackathon☆14Updated last year
- Convert Everything to PDF☆23Updated last week
- AI_Powered_Dev_Search_Engine☆12Updated last year
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated last month
- ☆20Updated last year
- ☆16Updated last month
- The official evaluation suite and dynamic data release for MixEval.☆11Updated 6 months ago
- ☆31Updated last week
- A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.☆22Updated 2 weeks ago
- A collection of pre-build wrappers over common RAG systems like ChromaDB, Weaviate, Pinecone, and othersz!☆32Updated this week
- ☆13Updated this week
- Example implementation of Iteration of Tought - Gives a star if you like the project☆40Updated 3 months ago
- ☆10Updated 10 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆46Updated 6 months ago
- ☆29Updated last year
- tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.☆38Updated 7 months ago
- ☆26Updated 4 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆16Updated 6 months ago
- ☆11Updated last year