fabiocannizzo / FastBinarySearchLinks
Fast and vectorizable algorithms for searching in a vector of sorted floating point numbers
☆149Updated 9 months ago
Alternatives and similar repositories for FastBinarySearch
Users that are interested in FastBinarySearch are comparing it to the libraries listed below
Sorting:
- LLM training in simple, raw C/CUDA☆104Updated last year
- High-Performance SGEMM on CUDA devices☆101Updated 7 months ago
- Make triton easier☆47Updated last year
- Simple high-throughput inference library☆127Updated 4 months ago
- A tracing JIT compiler for PyTorch☆13Updated 3 years ago
- A stand-alone implementation of several NumPy dtype extensions used in machine learning.☆298Updated this week
- Implementation of the paper "Lossless Compression of Vector IDs for Approximate Nearest Neighbor Search" by Severo et al.☆82Updated 7 months ago
- Benchmarks to capture important workloads.☆31Updated 7 months ago
- Implementation of "Efficient Multi-vector Dense Retrieval with Bit Vectors", ECIR 2024☆65Updated 11 months ago
- Inference of Mamba models in pure C☆191Updated last year
- A minimalistic C++ Jinja templating engine for LLM chat templates☆180Updated last week
- Standalone commandline CLI tool for compiling Triton kernels☆18Updated last year
- ☆28Updated 8 months ago
- ☆74Updated 5 months ago
- Clover: Quantized 4-bit Linear Algebra Library☆114Updated 7 years ago
- FlexAttention w/ FlashAttention3 Support☆27Updated 11 months ago
- benchmarking some transformer deployments☆26Updated 2 years ago
- ☆24Updated last year
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆89Updated this week
- ☆61Updated last week
- A thin, highly portable toolkit for efficiently compiling dense loop-based computation.☆148Updated 2 years ago
- llama.cpp to PyTorch Converter☆34Updated last year
- 🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.☆64Updated 7 months ago
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆181Updated 3 weeks ago
- Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.☆73Updated 7 months ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆277Updated last year
- TORCH_LOGS parser for PT2☆60Updated last week
- ☆124Updated last week
- No-GIL Python environment featuring NVIDIA Deep Learning libraries.☆63Updated 5 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆161Updated this week