rentruewang / bocoel
Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few lines of modular code.
☆281Updated last month
Alternatives and similar repositories for bocoel:
Users that are interested in bocoel are comparing it to the libraries listed below
- Dead Simple LLM Abliteration☆210Updated last month
- Visualize the intermediate output of Mistral 7B☆354Updated 2 months ago
- a curated list of data for reasoning ai☆133Updated 8 months ago
- Agent accuracy measurements for LLMs☆205Updated 10 months ago
- LLM Analytics☆654Updated 5 months ago
- A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…☆606Updated 3 weeks ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆220Updated 3 months ago
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆249Updated last year
- ai for jq☆240Updated 6 months ago
- ☆163Updated 10 months ago
- Implement recursion using English as the programming language and an LLM as the runtime.☆137Updated 2 years ago
- The Fast Vector Similarity Library is designed to provide efficient computation of various similarity measures between vectors.☆385Updated last month
- A pure NumPy implementation of Mamba.☆221Updated 9 months ago
- ☆742Updated 11 months ago
- Applying the ideas of Deepseek R1 to computer use☆211Updated 2 months ago
- Lightweight Nearest Neighbors with Flexible Backends☆264Updated last month
- Run and explore Llama models locally with minimal dependencies on CPU☆189Updated 6 months ago
- Revealing example of self-attention, the building block of transformer AI models☆131Updated last year
- Enforce structured output from LLMs 100% of the time☆249Updated 8 months ago
- Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so yo…☆104Updated last year
- A BERT that you can train on a (gaming) laptop.☆209Updated last year
- Official codebase for the paper "Beyond A* Better Planning with Transformers via Search Dynamics Bootstrapping".☆365Updated 10 months ago
- See Through Your Models☆376Updated last month
- Tiny inference-only implementation of LLaMA☆92Updated last year
- OpenAI's Structured Outputs with Logprobs☆155Updated last week
- Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.☆275Updated last month
- ☆238Updated this week
- Neural Search☆353Updated last month
- Fully neural approach for text chunking☆26Updated this week
- Controlled Text Generation via Language Model Arithmetic☆217Updated 6 months ago