RTX Sensors

RTX sensors in Isaac Sim use the Omniverse RTX Renderer’s RTX Sensor SDK to sense the environment, enabling interaction with materials in visual and non-visual spectra. This means an RTX-based Lidar can model returns from light interaction with transparent or reflective surfaces, and an RTX-based Radar can model returns accounting for material emissivity and reflectivity in the radio spectrum.

Isaac Sim organizes utilities supporting RTX sensors into the isaacsim.sensors.rtx extension, which includes the following sensors:

• RTX Lidar Sensor
• RTX Radar Sensor
• RTX Sensor Annotators
• RTX Sensor Visual Materials
• RTX Sensor Non-Visual Materials

RTX sensors are built using the omni.sensors extension suite. To understand more about how RTX sensors are modeled, and how to build your own, please review the following documentation:

• Omniverse Common Extension

• Omniverse Lidar Extension

• Omniverse Radar Extension

• Omniverse Materials Extension