[Jetson][转载]Comparison of DeepStream SSD Object Detection Performance on NVIDIA Nano, Xavier NX and

In this tutorial, we tested our NVIDIA Jetson Nano, Xavier NX and AGX Xavier's DeepStream performance in object detector sample. Our test sources are a video file (FPS:60, resolution:1920x1080, type:MP4) and 4 different cameras (FPS:25, resolution:1920x1080, type:RTSP).

NVIDIA Jetson Nano Info:

• Software: JetPack 4.5 (L4T-32.5)
• Hardware: Jetson Nano with DSBoard-NX2 Carrier Board
• DeepStream Version: 5.0.1
• Power Mode: MAXN

NVIDIA Jetson Xavier NX Info:

• Software: JetPack 4.5 (L4T-32.5)
• Hardware: Jetson Xavier NX with DSBoard-NX2 Carrier Board
• DeepStream Version: 5.0.1
• Power Mode: 15W 6CORE

NVIDIA Jetson AGX Xavier Info:

• Software: JetPack 4.4 (L4T-32.4.3)
• Hardware: Jetson AGX Xavier Developer Kit
• DeepStream Version: 5.0.0
• Power Mode: MAXN

Performance Test Setup

To begin with, let's set our test environment with maximum power mode:

(for Xavier NX)

• sudo nvpmodel -m 2

(for AGX Xavier and Nano)

• sudo nvpmodel -m 0

Type these commands and continue other steps in both of them:

• sudo jetson_clocks
• sudo chown -hR nvidia /opt/nvidia/deepstream/
• cd /opt/nvidia/deepstream/deepstream/sources/objectDetector_SSD/
• cd nvdsinfer_custom_impl_ssd
• sed -i 's/CUDA_VER?=/CUDA_VER=10.2/g' Makefile
• make
• cd /home/nvidia/Downloads/
• wget https://raw.githubusercontent.com/bower-media-samples/big-buck-bunny-1080p-60fps-30s/master/video.mp4
• cd /opt/nvidia/deepstream/deepstream/sources/objectDetector_SSD/

Then, copy sample_ssd_relu6.uff, ssd_coco_labels.txt and all configuration text files into /opt/nvidia/deepstream/deepstream/sources/objectDetector_SSD/ folder.

Change source URL (for source0, source1, source2 and source3) in each deepstream_app_config_ssd_rtsp... file (3 files).

DeepStream_SSD_files

Download ZIP • 92.59MB

https://download-files.wixmp.com/archives/bd25a2_8632369cf1924e4a9ddcfe6e78dd981d.zip?token=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJ1cm46YXBwOmU2NjYzMGU3MTRmMDQ5MGFhZWExZjE0OWIzYjY5ZTMyIiwic3ViIjoidXJuOmFwcDplNjY2MzBlNzE0ZjA0OTBhYWVhMWYxNDliM2I2OWUzMiIsImF1ZCI6WyJ1cm46c2VydmljZTpmaWxlLmRvd25sb2FkIl0sImlhdCI6MTYxNzA3NTU1NCwiZXhwIjoxNjE3MTExNTY0LCJqdGkiOiI4NGM2ZGM4NzdjZDYiLCJvYmoiOltbeyJwYXRoIjoiL2FyY2hpdmVzL2JkMjVhMl84NjMyMzY5Y2YxOTI0ZTRhOWRkY2ZlNmU3OGRkOTgxZC56aXAifV1dfQ.QYDjmpsVcXm15neaT5UQBHw18XSjkfynSYPO9GW8pQg&filename=DeepStream_SSD_files.zip

Jetson Nano Test Results

The performance of each test command:

• deepstream-app -c deepstream_app_config_ssd_fp32.txt (~3 FPS)

• deepstream-app -c deepstream_app_config_ssd_rtsp_fp32.txt (~3 FPS)

• deepstream-app -c deepstream_app_config_ssd_fp16.txt (~5 FPS)

• deepstream-app -c deepstream_app_config_ssd_rtsp_fp16.txt (~5 FPS)

Jetson Xavier NX Test Results

The performance of each test command:

• deepstream-app -c deepstream_app_config_ssd_fp32.txt (12-13 FPS)

• deepstream-app -c deepstream_app_config_ssd_rtsp_fp32.txt (12-13 FPS)

• deepstream-app -c deepstream_app_config_ssd_fp16.txt (~36 FPS)

• deepstream-app -c deepstream_app_config_ssd_rtsp_fp16.txt (~25 FPS - max FPS)

Jetson AGX Xavier Test Results

The performance of each test command:

• deepstream-app -c deepstream_app_config_ssd_fp32.txt (21-22 FPS)

• deepstream-app -c deepstream_app_config_ssd_rtsp_fp32.txt (21-22 FPS)

• deepstream-app -c deepstream_app_config_ssd_fp16.txt (55-56 FPS)

• deepstream-app -c deepstream_app_config_ssd_rtsp_fp16.txt (25-26 FPS - max FPS)

Comparison of Results

Jetson Nano - Video Results (1080p, 60 FPS)

FP32 -> ~3 FPS * 4 (~12 FPS)

FP16 -> ~5 FPS * 4 (~20 FPS)

Jetson Nano - RTSP Results (1080p, 25 FPS)

FP32 -> ~3 FPS * 4 (~12 FPS)

FP16 -> ~5 FPS (max) * 4 (~20 FPS)

Jetson Xavier NX - Video Results (1080p, 60 FPS)

FP32 -> 12-13 FPS * 4 (48-52 FPS)

FP16 -> ~36 FPS * 4 (~144 FPS)

Jetson Xavier NX - RTSP Results (1080p, 25 FPS)

FP32 -> 12-13 FPS * 4 (48-52 FPS)

FP16 -> ~25 FPS (max) * 4 (~100 FPS)

Jetson AGX Xavier - Video Results (1080p, 60 FPS)

FP32 -> 21-22 FPS * 4 (84-88 FPS)

FP16 -> 55-56 FPS * 4 (220-224 FPS)

Jetson AGX Xavier - RTSP Results (1080p, 25 FPS)

FP32 -> 21-22 FPS * 4 (84-88 FPS)

FP16 -> 25-26 FPS (max) * 4 (100-104 FPS)

Thanks for reading.