Alternatives and similar repositories for SandLogic-Lexicons:

Users that are interested in SandLogic-Lexicons are comparing it to the libraries listed below

• JINO-ROHIT / fastapi_with_celery_redis
  serving a torch model using Celery, Redis and RabbitMQ to serve users asynchronously
  ☆20Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 2 months ago
• sayakpaul / deploy-hf-tf-vision-models
  This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.
  ☆29Updated 2 years ago
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 3 months ago
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆38Updated 2 months ago
• ashishpatel26 / MLFlow-End-to-End-Workshop-at-Chandigarh-University
  MLFlow End to End Workshop at Chandigarh University
  ☆11Updated 2 years ago
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆35Updated 9 months ago
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆70Updated last year
• cosmo3769 / Quantized-LLMs
  Quantization of LLMs and benchmarking.
  ☆10Updated 10 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 8 months ago
• aniketmaurya / agents
  Build Agentic workflows with function calling using open LLMs
  ☆26Updated 2 weeks ago
• dnth / timm-flutter-pytorch-lite-blogpost
  PyTorch at the Edge: Deploying Over 964 TIMM Models on Android with TorchScript and Flutter.
  ☆44Updated last year
• chsasank / device-benchmarks
  Benchmarks of different devices I have come across
  ☆19Updated 2 months ago
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆27Updated 2 years ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 10 months ago
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆102Updated 4 months ago
• SqueezeAILab / open_source_projects
  Open Source Projects from Pallas Lab
  ☆20Updated 3 years ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆55Updated 10 months ago
• tspeterkim / mixed-precision-from-scratch
  Mixed precision training from scratch with Tensors and CUDA
  ☆21Updated 9 months ago
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆55Updated 4 months ago
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆137Updated this week
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆159Updated last week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆171Updated this week
• philschmid / optimum-static-quantization
  ☆28Updated last year
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• nvidia-riva / tutorials
  NVIDIA Riva runnable tutorials
  ☆123Updated 2 months ago
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆93Updated last month