#

post-training-quantization

Here are 91 public repositories matching this topic...

intel / neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

sparsity pruning quantization knowledge-distillation auto-tuning int8 low-precision quantization-aware-training post-training-quantization awq int4 large-language-models gptq smoothquant sparsegpt fp4 mxformat

Updated Sep 9, 2026
Python

666DZY666 / micronet

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、reg…

Updated May 6, 2025
Python

alibaba / TinyNeuralNetwork

TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.

deep-neural-networks deep-learning pytorch pruning model-compression model-converter quantization-aware-training post-training-quantization

Updated Mar 3, 2026
Python

SqueezeAILab / SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

natural-language-processing text-generation transformer llama quantization model-compression efficient-inference post-training-quantization large-language-models llm small-models localllm

Updated Aug 13, 2024
Python

Xiuyu-Li / q-diffusion

[ICCV 2023] Q-Diffusion: Quantizing Diffusion Models.

pytorch quantization model-compression diffusion-models post-training-quantization ddim stable-diffusion

Updated Mar 21, 2024
Python

megvii-research / FQ-ViT

[IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer

pytorch imagenet quantization post-training-quantization vision-transformer

Updated Apr 11, 2023
Python

megvii-research / Sparsebit

A model compression and acceleration toolbox based on pytorch.

deep-learning sparse pruning quantization tensorrt quantization-aware-training post-training-quantization

Updated Jan 12, 2024
Python

IST-DASLab / qutlass

QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning

cuda blackwell quantization-aware-training post-training-quantization

Updated Sep 2, 2026
C++

Hsu1023 / DuQuant

[NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.

quantization post-training-quantization large-language-models llm

Updated Apr 24, 2026
Python

sayakpaul / Adventures-in-TensorFlow-Lite

This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.

inference pruning tensorflow-lite tensorflow-2 on-device-ml tf-hub model-quantization model-optimization quantization-aware-training post-training-quantization tf-lite-model

Updated Jan 23, 2023
Jupyter Notebook

hkproj / quantization-notes

Notes on quantization in neural networks

deep-learning pytorch neural-networks quantization quantization-aware-training post-training-quantization

Updated Dec 14, 2023
Jupyter Notebook

ModelTC / TFMQ-DM

[CVPR 2024 Highlight & TPAMI 2025] This is the official PyTorch implementation of "TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models".

highlight quantization cvpr ldm diffusion-models tpami post-training-quantization ddim stable-diffusion cvpr2024 tpami2025

Updated Sep 29, 2025
Jupyter Notebook

IST-DASLab / GSQ

Gumbel-Softmax post-training quantization for LLMs (1–3 bit scalar, INT/GGUF-compatible).

quantization post-training-quantization llm gguf

Updated Jul 11, 2026
Python

ModelTC / QLLM

[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"

transformers pytorch llama quantization post-training-quantization llm llama2

Updated Mar 11, 2024
Python

Sanjana7395 / static_quantization

Post-training static quantization using ResNet18 architecture

pytorch mnist-classification quantization resnet-18 post-training-quantization floatfunctional fbgemm float32-to-int8 reduce-inference-time reduce-memory-storage

Updated Aug 1, 2020
Jupyter Notebook

shieldforever / NeuronQuant

[ASP-DAC 2025] "NeuronQuant: Accurate and Efficient Post-Training Quantization for Spiking Neural Networks" Official Implementation

spiking-neural-networks neuromorphic neuromorphic-computing brain-inspired-computing post-training-quantization

Updated Mar 6, 2025
Python

zysxmu / FDDA

Pytorch implementation of our paper accepted by ECCV 2022-- Fine-grained Data Distribution Alignment for Post-Training Quantization

acceleration compression post-training-quantization

Updated Sep 13, 2022
Python

SamsungLabs / NanoQuant

[ICML 2026] NanoQuant: Efficient Sub-1-Bit Quantization of Large Language Models

cuda pytorch quantization post-training-quantization ptq llm icml-2026

Updated Jul 3, 2026
Python

darren-fzq1 / EAQuant

EAQuant: Enhancing Post-Training Quantization for MoE Models via Expert-Aware Optimization

moe post-training-quantization

Updated Feb 6, 2026
Python

KwangHoonAn / Quantizations

quantization dfq post-training-quantization data-free-quantization

Updated Apr 6, 2021
Python

Add this topic to your repo

To associate your repository with the post-training-quantization topic, visit your repo's landing page and select "manage topics."