Is it normal to have huge fps loss when I switch yolov5 to use DLA?

[berkay-karlik]

I have followed the exact yolov5 export process described here and I got 9 fps on full gpu.
but when I add/modify the following on config_infer_primary_yoloV5.txt:

enable-dla=1
use-dla-core=0
network-mode=2

My fps drops to 3. In JTOP I observe gpu usage is around %1 and dla0 is definitely getting used. Is it just that dla0 is that underperforming compared to gpu or Did I do something wrong?

Also thanks for the project, great work.

[marcoslucianops]

I noticed that, but I'm not using DLA, so I didn't check the issue yet.

[berkay-karlik]

Okay good to know, just to give more info I have compared ultralytics gpu and dla versions and there is similar amount of difference. After all it might be due to layers that are falling back to gpu. In that case there is nothing to solve. I will be using the gpu too.

[SarperYurttas]

According to the datasheet of Jetson ORIN NX, the total(GPU+DLA0+DLA2) AI performance is 100(60+20+20) TOPS. Each DLA engine has 20 TOPS individually so the GPU-DLA performance difference should be around 3:1. However in practice, this difference may differ from model to model.