logikon-ai / logikon
Analyzing and scoring reasoning traces of LLMs
☆42Updated 5 months ago
Alternatives and similar repositories for logikon:
Users that are interested in logikon are comparing it to the libraries listed below
- AI Evaluation Platform☆46Updated this week
- Sphynx Hallucination Induction☆52Updated 3 weeks ago
- Factored Cognition Primer: How to write compositional language model programs☆48Updated last year
- A set of utilities for running few-shot prompting experiments on large-language models☆118Updated last year
- LLM finetuning☆42Updated last year
- Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.☆46Updated 8 months ago
- LLMs as Collaboratively Edited Knowledge Bases☆44Updated last year
- Query language for blending SQL logic and LLM reasoning across structured + unstructured data. [Findings of ACL 2024]☆85Updated 3 months ago
- LLM-powered autonomous agent with hierarchical task management☆47Updated last year
- Plug in and Play implementation of "Certified Reasoning with Language Models" that elevates model reasoning by 40%☆15Updated last year
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆31Updated last year
- A re-implementation of Meta-Prompt in LangChain for building self-improving agents.☆63Updated last year
- Small, simple agent task environments for training and evaluation☆18Updated 3 months ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆48Updated 2 months ago
- A Python micro framework for creating LLM-driven agents☆24Updated 10 months ago
- LMQL implementation of tree of thoughts☆33Updated last year
- Explore the use of DSPy for extracting features from PDFs 🔎☆38Updated 11 months ago
- Reasoning by Communicating with Agents☆24Updated 4 months ago
- The data and implementation for the experiments in the paper "Flows: Building Blocks of Reasoning and Collaborating AI".☆31Updated last year
- Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents☆116Updated 8 months ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆40Updated last year
- Learn how to use logit bias with OpenAI models to create highly-powerful classifiers in minutes.☆29Updated last year
- A better way of testing, inspecting, and analyzing AI Agent traces.☆28Updated this week
- Chrome Extension for exploring Hugging Face datasets 🔎☆49Updated 5 months ago
- An implementation of Deepmind's Promptbreeder.☆20Updated last year
- Large-language Model Evaluation framework with Elo Leaderboard and A-B testing☆50Updated 3 months ago
- Use context-free grammars with an LLM☆168Updated 11 months ago
- Backtracing: Retrieving the Cause of the Query, EACL 2024 Long Paper, Findings.☆88Updated 7 months ago
- Prototype advanced LLM algorithms for reasoning and planning.☆96Updated 6 months ago