EIZO Rugged Solutions Blog

  1. Home
  2. »
  3. Blog
  4. »
  5. NVIDIA Holoscan: The Future of AI Sensor Processing

NVIDIA Holoscan: The Future of AI Sensor Processing

What is Holoscan?

NVIDIA Holoscan is an open-source software platform that enables high-performance sensor data processing on edge GPU systems. Originally developed as NVIDIA Clara Holoscan for medical imaging, the platform has since evolved into a domain-agnostic solution suitable for industries such as aerospace, defense, robotics, industrial automation, and more.

Holoscan provides developers and system integrators with a unified framework for deploying AI workloads at the edge with scalability, reliability, and real-time performance.

NVIDIA Holoscan includes optimized libraries for network connectivity, data processing, and AI. It provides examples to create and run low-latency data-streaming applications across industries using C++, Python, or Graph Composer. Using the SDK, developers can build pipelines for sensor data processing that meet latency requirements and scale from the cloud to the data center to the edge.

NVIDIA Holoscan SDK Platform

How Can Holoscan Benefit Your Project?

Holoscan simplifies the development of sensor processing pipelines by offering a modular architecture built around operators (reusable software components with defined inputs and outputs) and applications that orchestrate these operators into a complete workflow. Developers familiar with frameworks like GStreamer or Video4Linux will find Holoscan intuitive.

Holohub includes a wide library of reference operators—many highly relevant for aerospace and defense applications:

  • Distributed computing
  • Object detection
  • Fast Fourier transforms
  • Real-time streaming analytics
  • Video ingest (SMPTE 2110-20, RTSP over UDP, WebRTC)
  • Video encoding and decoding
  • Video processing
  • VITA 49.2 packetization and transmission

Another core benefit is Holoscan’s containerized deployment model, which brings three major advantages:

  1. Simplified deployment – Packages can easily be distributed and installed on edge systems.
  2. Edge orchestration – Supports integration with container orchestration platforms like Kubernetes for GPU load balancing and scalability.
  3. Rapid prototyping – Developers can spin up environments quickly, accelerating proof-of-concept and field testing.

Holoscan also provides performance optimization tools. For example, the Advanced Networking Operator (available on Holohub) supports GPUDirect RDMA and RoCE, reducing CPU load and latency by up to 90% compared to traditional TCP/UDP protocols, while enabling bandwidth up to 100 Gbps on supported NICs such as the ConnectX-7.

Furthermore, Holoscan integrates with NVIDIA’s performance-optimized libraries, such as TensorRT. Using TensorRT-LLM, you can achieve up to a 70% performance increase when deploying models like LLaMa.

Hardware Overview: The Condor AGX-IOX

At GTC 2025, EIZO Rugged Solutions showcased a live demo featuring NVIDIA Holoscan running on our Jetson AGX Orin-based Condor AGX-IOX single board computer. Using a USB webcam and NVIDIA’s PeopleNet model, we performed real-time object detection at the edge—drawing bounding boxes around individuals passing our booth.

Our demonstration was powered by the Condor AGX-IOX, a rugged, SOSA®-aligned 3U OpenVPX single board computer designed for extreme environments. Built with the NVIDIA Jetson AGX Orin module, the Condor AGX-IOX offers high-performance AI processing in a compact and durable 3U VPX form factor.

The Condor AGX-IOX was integrated into a custom chassis and backplane with a dedicated rear transition module (RTM) that enabled USB webcam input. With minimal setup, we leveraged the open-source tao_peoplenet application from Holohub to deliver a live demo that performed efficient edge-based object detection.

Condor AGX-IOX

System Architecture Diagram

The diagram below outlines how this system is organized from a high-level view:

As shown above, Holoscan runs entirely on the Condor AGX-IOX. Thanks to containerization, this solution can easily be redeployed to other Condor AGX-IOX units—ideal for field demonstrations or operational deployment across multiple platforms and vehicles.

Software Setup Guide

These instructions were validated on a Condor AGX-IOX using the default board support package provided by EIZO Rugged Solutions. The same process may work on a Jetson AGX Orin Developer Kit.

 

Prerequisites
  • Install Docker (version < 30)
    • After installing Docker, the following commands need to be entered in a terminal:

sudo groupadd docker
sudo usermod -aG docker $USER
newgrp docker

  • Install the cuda-toolkit Ubuntu package that is provided as part of the board support package:

sudo apt install -y cuda-toolkit

  • Install and configure nvidia-container-toolkit, which is the glue that provides GPU functionality to the Docker engine:

sudo nvidia-ctk runtime configure –runtime=docker
sudo systemctl restart docker

  • Install git, the source control software that provides access to NVIDIA Holohub’s code:

sudo apt install -y git

export v4l2_lib=”/usr/lib/aarch64-linux-gnu/libv4l2.so”
sudo mv ${v4l2_lib}.0 ${v4l2_lib}.0.old
sudo ln -s ${v4l2_lib}.0.0.0 ${v4l2_lib}.0

Setup
  • In a terminal window, browse to the directory where you would like to install NVIDIA Holohub 2.9.0 (by using the cd command) and enter the following commands:

git clone https://github.com/nvidia-holoscan/holohub
cd holohub
git checkout tags/holoscan-sdk-2.9.0

  • Holohub provides an application called tao_peoplenet. We can start and run the application using the following commands:

./dev_container build_and_run tao_peoplenet

It may take a few minutes to compile and run the model as TensorRT needs to compile the PeopleNet model to a format that is highly optimized to run for your GPU. But after it has completed, you should see a the webcam display with green bounding boxes drawn around people detected, and red bounding boxes drawn around faces:

Troubleshooting

There are some issues that may prevent the tao_peoplenet application from running. If you see this error in your terminal window for example:

Traceback (most recent call last):
File “/workspace/holohub/applications/tao_peoplenet/tao_peoplenet.py”, line 370, in <module>
    app.run()
RuntimeError: Unsupported pixel format NV12

You may need to make modifications to the file applications/tao_peoplenet/tao_peoplenet.py:


source = V4L2VideoCaptureOp(
        self,
        name=”v4l2_source”,
        allocator=pool,
        pixel_format=”YUYV”, # Add this line
        **v4l2_args,
)

Likewise, if the following error is encountered:

ERROR: failed to solve: process “/bin/sh -c pip install -r /tmp/benchmarking_requirements.txt” did not complete successfully: exit code: 1

You may need to make modifications to benchmarks/holoscan_flow_benchmarking/requirements.txt to set pygobject to 3.50.0:

pygobject==3.50.0

This is due to the latest version of pygobject relying on girepository-2.0, which is not available for versions of Ubuntu prior to 24.04. There is more information about this here.

How can we start using Holoscan in our own projects?

EIZO Rugged Solutions offers NVIDIA-based VPX hardware platforms that integrate seamlessly with Holoscan to support AI-powered tasks across embedded edge architectures. Whether you’re building situational awareness applications or deploying multi-sensor edge compute nodes, Holoscan accelerates development and deployment.

Thanks to the portability of containerized applications, developers can build and test on a Jetson AGX Orin Developer Kit and quickly transition to production deployment on a rugged Condor AGX-IOX.

We recommend exploring the following resources to get started:

NVIDIA Holoscan Documentation

NVIDIA Holohub GitHub

Share
Facebook
Twitter
LinkedIn

Get Started with NVIDIA Blackwell

Looking to integrate NVIDIA’s next-gen GPU architecture? Click below to contact sales for more information.