Make your existing NVIDIA Jetson Orin devices faster with Super Mode
Summary
Users can expect to see up to 1.7 times improvement (depending on the AI model and other system conditions) in their AI workloads with their existing system with just a software update. The software update to JP 6.1 rev 1 allows users to set MAXN power mode on Orin Nano and Orin NX devices. Fig 2: Performance Improvement of NanoOwl ViT Model with Super Mode On (Source: NVIDIA) e-con Systems tried to benchmark the increased performance that is possible with a small test setup running the YOLOv8n model for object detection on an Orin Nano running JP 5.1.2 vs. JP 6.1 with super mode enabled. These are the configuration details of test case one: This is what was observed: Fig 3: Screenshot Showing JTOP and Camera Preview with YOLO Object Detection Running in Real Time Next, e-con Systems updated the same system to JP 6.1.2 and modified the power mode as follows: These were the observations with super mode enabled in a more complex scene: That is about a 3ms reduction in average inference time on a more complex scene. Fig 4: Screenshot with JTOP, Inference Time, and Camera Preview with YOLO Running in Realtime with Super Mode On With the increased bandwidth and AI computing of existing kits, users can process more frames per second from their existing camera setup and systems.