#

quantization-aware-training

Here are 67 public repositories matching this topic...

intel / neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

sparsity pruning quantization knowledge-distillation auto-tuning int8 low-precision quantization-aware-training post-training-quantization awq int4 large-language-models gptq smoothquant sparsegpt fp4 mxformat

Updated Dec 5, 2024
Python

666DZY666 / micronet

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、reg…

Updated Oct 6, 2021
Python

openvinotoolkit / nncf

Neural Network Compression Framework for enhanced OpenVINO™ inference

nlp sparsity compression deep-learning tensorflow transformers pytorch classification pruning object-detection quantization semantic-segmentation bert onnx openvino mixed-precision-training quantization-aware-training llm genai

Updated Dec 5, 2024
Python

alibaba / TinyNeuralNetwork

TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.

deep-neural-networks deep-learning pytorch pruning model-compression model-converter quantization-aware-training post-training-quantization

Updated Dec 2, 2024
Python

SpursLipu / YOLOv3v4-ModelCompression-MultidatasetTraining-Multibackbone

YOLO ModelCompression MultidatasetTraining

yolo pruning object-detection modelcompression mobilenetv3 quantization-aware-training multidataset

Updated Jun 21, 2022
Python

megvii-research / Sparsebit

A model compression and acceleration toolbox based on pytorch.

deep-learning sparse pruning quantization tensorrt quantization-aware-training post-training-quantization

Updated Jan 12, 2024
Python

hls4ml-tutorial

fastmachinelearning / hls4ml-tutorial

Tutorial notebooks for hls4ml

machine-learning tutorial fpga pruning quantization-aware-training hls4ml

Updated Oct 28, 2024
Jupyter Notebook

Beomi / BitNet-Transformers

0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

transformers quantization quantization-aware-training llm

Updated Mar 17, 2024
Python

THU-MIG / torch-model-compression

针对pytorch模型的自动化模型结构分析和修改工具集，包含自动分析模型结构的模型压缩算法库

pytorch pruning quantization tensorrt model-compression qat onnx reparameterization tensorrt-conversion quantization-aware-training acnet

Updated Apr 19, 2023
Python

sayakpaul / Adventures-in-TensorFlow-Lite

This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.

inference pruning tensorflow-lite tensorflow-2 on-device-ml tf-hub model-quantization model-optimization quantization-aware-training post-training-quantization tf-lite-model

Updated Jan 23, 2023
Jupyter Notebook

clovaai / frostnet

FrostNet: Towards Quantization-Aware Network Architecture Search

computer-vision deep-learning pytorch style-transfer classification object-detection quantization network-architecture semantic-segmentation optimizers quantization-aware-training int8-quantization post-quantization quantization-efficient-network

Updated May 3, 2024
Python

openvinotoolkit / mmdetection

OpenVINO Training Extensions Object Detection

sparsity compression computer-vision deep-learning pytorch ssd faster-rcnn object-detection instance-segmentation mask-rcnn retinanet onnx openvino cascade-rcnn fcos onnxruntime atss quantization-aware-training nncf

Updated Mar 8, 2023
Python

jahongir7174 / YOLOv8-qat

Quantization Aware Training

python pytorch object-detection int8-inference quantization-aware-training int8-quantization yolov8

Updated Jan 13, 2024
Python

hkproj / quantization-notes

Notes on quantization in neural networks

deep-learning pytorch neural-networks quantization quantization-aware-training post-training-quantization

Updated Dec 14, 2023
Jupyter Notebook

mlzxy / qsparse

Train neural networks with joint quantization and pruning on both weights and activations using any pytorch modules

neural-network pytorch pruning model-compression quantization-aware-training

Updated Sep 19, 2022
Python

jeshraghian / QSNNs

Quantization-aware training with spiking neural networks

deep-learning neuroscience networks spiking-neural-networks quantization backpropagation neural snn spiking quantization-aware-training

Updated Feb 18, 2022
Python

yashbhalgat / QualcommAI-MicroNet-submission-MixNet

3rd place solution for NeurIPS 2019 MicroNet challenge

competition quantization mixnet model-pruning model-compression neurips-2019 micronet-challenge unstructured-pruning quantization-aware-training

Updated Nov 8, 2019
Python

DeadAt0m / LSQFakeQuantize-PyTorch

FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch

lsq pytorch quantization qat quantization-aware-training learned-step-size torchlsq fakequantize

Updated Dec 18, 2021
C++

bharathsudharsan / CNN_on_MCU

Code for paper 'Multi-Component Optimization and Efficient Deployment of Neural-Networks on Resource-Constrained IoT Hardware'

optimization quantization neuralnetworks edge-computing graph-optimization efficient-inference tflite cmsis-nn c-code-generator tflite-conversion tinyml quantization-aware-training

Updated Apr 22, 2022
Jupyter Notebook

saqibjaved1 / QT-DoG

QT-DOG: QUANTIZATION-AWARE TRAINING FOR DOMAIN GENERALIZATION

deep-neural-networks compression ensemble resnet-50 domain-generalization quantization-aware-training vision-transformer

Updated Oct 10, 2024
Python

Improve this page

Add a description, image, and links to the quantization-aware-training topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the quantization-aware-training topic, visit your repo's landing page and select "manage topics."