Skip to content

SsisyphusTao/Pytorch-TensorRT-Plugins

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Plugins for Pytorch & TensorRT

It's a personal backup repository, but I will try my best to help you understand how to use them.

Now it contains:

Plugins Support
DCNv2 pytorch1.5+/tensorrt7
yolov5 detection tensorrt7/tensorrt8
Models Support
mobilenetv3-centernet pytorch1.5+/tensorrt7
yolov5 (integrated with detection and nms) tensorrt7/tensorrt8

Installation

Pytorch

cd pytorch
python setup.py install --user(optioanl)
cd ../examples python
from dcn_v2_wrapper import DeformableConv2DLayer as DCN

TensorRT

  1. Copy plugin folders from tensorrt to NVIDIA/TensorRT/plugin

  2. Add relative head file and initializePlugin() to InferPlugin.cpp at proper place, for example

#include "dcnv2Plugin.h"
#include "yoloPlugin.h"

initializePlugin<nvinfer1::plugin::DCNv2PluginCreator>(logger, libNamespace); initializePlugin<nvinfer1::plugin::YoloPluginCreator>(logger, libNamespace);

  1. Add name of plugin folder to PLUGIN_LISTS in CMakeLists.txt

  2. Build and use libnvinfer_plugin.so following offical introduction.

EXAMPLES

There are two pytorch2tensorrt transfer scripts in examples to show how these plugins work.

Evaluation

cd examples
python mbv3_centernet_trt7.py

The evaluation output is as follow which are mean values of hm, wh, reg
eval

About

Useful plugins for Pytorch1.5+ and TensorRT7/8.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published