katsumiok / pyaskit
AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
☆75Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for pyaskit
- ☆26Updated last year
- ReLM is a Regular Expression engine for Language Models☆104Updated last year
- r2e: turn any github repository into a programming agent environment☆89Updated 3 weeks ago
- Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."☆63Updated last year
- Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents☆110Updated 5 months ago
- [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation☆145Updated 8 months ago
- ☆54Updated 6 months ago
- ☆75Updated last year
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆37Updated last year
- A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.☆74Updated last month
- Cascade Speculative Drafting☆26Updated 7 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆97Updated last year
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"☆56Updated last month
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆92Updated 5 months ago
- ☆66Updated 2 months ago
- AskIt (for JavaScript/TypeScript): Unified programming interface for large language models (GPT-4, GPT-3.5)☆34Updated last year
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆128Updated 3 weeks ago
- ☆35Updated 3 weeks ago
- Visualize expert firing frequencies across sentences in the Mixtral MoE model☆17Updated 10 months ago
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆63Updated last month
- Just a bunch of benchmark logs for different LLMs☆115Updated 3 months ago
- Code repo for "CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs".☆11Updated 2 months ago
- Data preparation code for CrystalCoder 7B LLM☆42Updated 6 months ago
- A collection of all available inference solutions for the LLMs☆73Updated 2 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆113Updated 5 months ago
- Tutorial to get started with SkyPilot!☆56Updated 6 months ago
- RepoQA: Evaluating Long-Context Code Understanding☆100Updated 2 weeks ago
- Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆79Updated this week
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 6 months ago