Passthrough

Extension introduces

XR_HTC_passthrough allows developers to create an application with Passthrough (Underlay for now). Passthrough Underlay is a feature that shows passthrough image under content layer.

How to use ViveOpenXR Passthrough Feature

1. Please make sure ViveOpenXR is enabled.
2. Edit > Project Settings > Plugins > Vive OpenXR > Click Enable Passthrough under Passthrough to enable OpenXR Passthrough extension.
3. Restart the engine to apply new settings after clicking Enable Passthrough.
4. For the available Passthrough functions, please refer to ViveOpenXRPassthroughFunctionLibrary.h.
5. Passthrough Blueprint functions.
   Type Passthrough to get the Passthrough blueprint functions your content needs.
   

Create Passthrough Underlay

1. Create Passthrough Underlay
   
   Use this function to create a Passthrough Underlay .
   The InPassthroughLayerForm parameter specifies the type of Passthrough Underlay to be created.
   Planar: a full screen passthrough that covers the entire FOV.
   Projected: a passthrough only covers part of the FOV, in which the area is determined by a custom mesh and its transform.

2. Switch Passthrough Underlay
   
   Use this function to switch passthrough layer form.

3. Destroy Passthrough Underlay
   
   Use this function to destroy Passthrough Underlay by handle.

4. Is Passthrough Enabled
   
   Use this function to check if the Passthrough feature is enabled or not.

5. Set Passthrough Alpha
   
   Use this function to set the opacity of the Passthrough Underlay.
   The “alpha” parameter specifies the target opacity (Clamped to range [0,1]).

6. Set Passthrough Mesh
   
   Use this function to specify the mesh data of the customized mesh for Projected Passthrough Underlay.
   “ vertices ” specifies the vertices of the mesh.
   “ indices ” specifies the triangle indices of the mesh.
   Note: If you derive vertices and indices from GetSectionfromStaticMesh.
   
   Please make sure the setting Allow CPUAccess of the static mesh which In Mesh referenced is enabled . The setting is at Details > Advanced of the static mesh asset.
   

7. Set Passthrough Mesh Transform
   
   Use this function to set the space type and the transformation of the mesh to be used by Projected Passthrough Underlay.
   ” meshSpaceType ” specifies the XrSpace configuration to be used by Projected Passthrough Underlay, which is defined as follows:
   

8. Set Passthrough Mesh Transform Location
   
   Use this function to set the scale of the Projected Passthrough Underlay.

9. Set Passthrough Mesh Transform Rotation
   
   Use this function to set the orientation of the Projected Passthrough Underlay.

10. Set Passthrough Mesh Transform Scale
    
    Use this function to set the scale of the Projected Passthrough Underlay.

11. Set Passthrough Mesh Transform Space
    
    Use this function to set the space type to be used by Projected Passthrough Underlay.
    Refer to “ 7. ” for details on “meshSpaceType”.

Passthrough Configuration

1. Setup passthrough configuration in ProjectSettings.
   

2. Set Passthrough Quality.
   
   Modifying the image quality of the passthrough.
   Value from 0 to 1. Default is 1. Decrease the value will downgrade passthrough quality.

3. Set Passthrough Rate.
   
   Adjusting the image rate of the passthrough.
   Normal: default rate.
   Boost: reduce passthrough image rate to gain performance.

Play the sample map

1. Make sure the OpenXR Passthrough extension is enabled, the setting is in Edit > Project Settings > Plugins > Vive OpenXR .

2. The sample map is under Content > Passthrough > Map .
   

3. Sample map controls.
   Right A Press: Create Planar & Projected Passthrough handles, and will auto switch to Planar Passthrough.
   Right B Press: Switch between Planar & Projected Passthrough.
   Right X Press: Delete Planar Passthrough handle.
   Right Y Press: Delete Projected Passthrough handle.
   Right Thumb Stick: Move ProjectedPassthrough mesh.
   Left Thumb Stick: Rotate ProjectedPassthrough mesh.