[isaacsim.sensors.camera.ui] Isaac Sim Camera Simulation UI Components#

Version: 0.7.1

Overview#

This extension provides UI integration for creating camera and depth sensors in Isaac Sim. It adds menu items to the Create menu and context menus that enable users to create various camera and depth sensor prims from multiple vendors including Orbbec, Leopard Imaging, RealSense, Sensing, SICK, and Stereolabs.

Functionality#

The extension automatically registers sensor creation actions and organizes them into a hierarchical menu structure by vendor. Users can access sensor creation through two main pathways: the main Create menu under “Sensors > Camera and Depth Sensors” and context menus accessible via right-click in the viewport under “Isaac > Sensors”.

Supported camera sensors include:

  • Leopard Imaging: Hawk, Owl

  • Sensing: Multiple SG series models with various configurations

  • SICK: Inspector83x

Supported depth sensors include:

  • Orbbec: Gemini 2, FemtoMega, Gemini 335, Gemini 335L

  • RealSense: D455, D457, D555

  • Stereolabs: ZED_X

Key Components#

Sensor Creation Actions#

The extension creates specialized actions for each supported sensor type using the action registry. For depth sensors, it generates SingleViewDepthSensorAsset instances with proper initialization, while regular camera sensors create standard Xform prims with appropriate USD references.

Integration#

The extension uses omni.kit.actions.core to register sensor creation actions and omni.kit.context_menu to provide right-click access to sensor creation tools. It currently integrates with the deprecated isaacsim.sensors.camera for the underlying sensor implementation (pending migration to isaacsim.sensors.experimental.rtx) and isaacsim.gui.components for UI component support.

Preview

Enable Extension#

The extension can be enabled (if not already) in one of the following ways:

Define the next entry as an application argument from a terminal.

APP_SCRIPT.(sh|bat) --enable isaacsim.sensors.camera.ui

Define the next entry under [dependencies] in an experience (.kit) file or an extension configuration (extension.toml) file.

[dependencies]
"isaacsim.sensors.camera.ui" = {}

Open the Window > Extensions menu in a running application instance and search for isaacsim.sensors.camera.ui. Then, toggle the enable control button if it is not already active.

Actions in isaacsim.sensors.camera.ui#

ID

Display Name

Description

create_camera_hawk

Create Hawk camera sensor

create_camera_inspector83x

Create Inspector83x camera sensor

create_camera_inspectorp61x

Create InspectorP61x camera sensor

create_camera_luxonis_oak4_d

Create Luxonis OAK4-D camera sensor

create_camera_luxonis_oak4_d_wide

Create Luxonis OAK4-D Wide camera sensor

create_camera_luxonis_oak_d_pro_poe

Create Luxonis OAK-D Pro PoE camera sensor

create_camera_luxonis_oak_d_pro_w_poe

Create Luxonis OAK-D Pro W PoE camera sensor

create_camera_luxonis_oak_d_tof

Create Luxonis OAK-D ToF camera sensor

create_camera_orbbec_femtomega

Create Orbbec FemtoMega camera sensor

create_camera_orbbec_gemini_2

Create Orbbec Gemini 2 camera sensor

create_camera_orbbec_gemini_335

Create Orbbec Gemini 335 camera sensor

create_camera_orbbec_gemini_335l

Create Orbbec Gemini 335L camera sensor

create_camera_owl

Create Owl camera sensor

create_camera_realsense_d455

Create Realsense D455 camera sensor

create_camera_realsense_d457

Create Realsense D457 camera sensor

create_camera_realsense_d555

Create Realsense D555 camera sensor

create_camera_safevisionary2

Create safeVisionary2 camera sensor

create_camera_sensing_sg2_ar0233c_5200_g2a_h100f1a

Create Sensing SG2-AR0233C-5200-G2A-H100F1A camera sensor

create_camera_sensing_sg2_ox03cc_5200_gmsl2_h60ya

Create Sensing SG2-OX03CC-5200-GMSL2-H60YA camera sensor

create_camera_sensing_sg3_isx031c_gmsl2f_h190xa

Create Sensing SG3-ISX031C-GMSL2F-H190XA camera sensor

create_camera_sensing_sg5_imx490c_5300_gmsl2_h110sa

Create Sensing SG5-IMX490C-5300-GMSL2-H110SA camera sensor

create_camera_sensing_sg8s_ar0820c_5300_g2a_h120ya

Create Sensing SG8S-AR0820C-5300-G2A-H120YA camera sensor

create_camera_sensing_sg8s_ar0820c_5300_g2a_h30ya

Create Sensing SG8S-AR0820C-5300-G2A-H30YA camera sensor

create_camera_sensing_sg8s_ar0820c_5300_g2a_h60sa

Create Sensing SG8S-AR0820C-5300-G2A-H60SA camera sensor

create_camera_visionary_t_mini

Create Visionary-T Mini camera sensor

create_camera_zed_x

Create ZED_X camera sensor