Cohere-Labs-Community / llm-profiling-toolkitLinks
☆20Updated last year
Alternatives and similar repositories for llm-profiling-toolkit
Users that are interested in llm-profiling-toolkit are comparing it to the libraries listed below
Sorting:
- lossily compress representation vectors using product quantization☆59Updated 4 months ago
- Code for the paper "Fishing for Magikarp"☆164Updated 3 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆68Updated 4 months ago
- Pre-train Static Word Embeddings☆85Updated this week
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated last year
- utilities for loading and running text embeddings with onnx☆44Updated 3 weeks ago
- An introduction to LLM Sampling☆79Updated 8 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆146Updated 6 months ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆103Updated last year
- Thorn in a HaizeStack test for evaluating long-context adversarial robustness.☆26Updated last year
- ☆49Updated 6 months ago
- Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…☆64Updated 10 months ago
- Understanding how features learned by neural networks evolve throughout training☆37Updated 10 months ago
- Sparse autoencoders for Contra text embedding models☆25Updated last year
- Lightweight tools for quick and easy LLM demo's☆28Updated 11 months ago
- Latent Large Language Models☆18Updated last year
- Storing long contexts in tiny caches with self-study☆149Updated this week
- A demonstration of how a toy (but usable!) semantic search engine can be quickly built using Cohere's platform.☆117Updated 2 years ago
- Supercharge huggingface transformers with model parallelism.☆77Updated last month
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated 2 years ago
- Sphynx Hallucination Induction☆53Updated 7 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆65Updated last year
- Your buddy in the (L)LM space.☆64Updated 11 months ago
- ☆52Updated 10 months ago
- Training-Ready RL Environments + Evals☆65Updated this week
- Experiments for efforts to train a new and improved t5☆76Updated last year
- Model implementation for the contextual embeddings project☆35Updated 3 months ago
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆180Updated last month
- Documentation effort for the BookCorpus dataset☆34Updated 4 years ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆186Updated last month