Announcing VIVE SDKs For The VIVE Pro Front Facing Cameras And VIVE Audio
VIVE SRWorks SDK
With the launch of VIVE Pro, developers will now have access to the stereo front facing cameras to create new experiences that can mix the see-through stereo camera view and their virtual worlds. This will enable developers to perform 3D perception and depth sensing with the stereo RGB sensors, opening new worlds for more creative, interactive experiences.
In addition to the updated OpenVR camera APIs that can now handle more than the mono camera of the original VIVE, the VIVE Software team is also providing developers the VIVE SRWorks SDK. With this SDK you can access more than just the raw camera images:
- Depth
- Spatial Mapping (static and dynamic meshes)
- Placing virtual objects in the foreground or background
- Live interactions with virtual objects and simple hand interactions
These features are provided by three service modules, a Depth module, a See-through module and a 3D reconstruction module thus allowing developers to focus on the content.
The SDK includes support for native development with plugins for Unity and Unreal.
See illustrative videos here .
VIVE Audio SDKs
We are also announcing two VIVE audio SDKs, available for Unity, with support for UE4 coming soon.
– VIVE 3DSP SDK
The VIVE 3D Sound Perception SDK provides a Unity compatible, audio spatialization plugin with the following features:
- Higher Order Ambisonics
- HRTFs based on refined real-world modeling (horizontally and vertically)
- Support for Hi-Res audio source files and playback.
- Acoustic distance effect with real-world modeling.
- The VIVE 3DSP plugin supports room effect, room reverberation and reflection, and acoustic occlusion that is tuned for the VIVE Pro, however the VIVE and other HMDs and headphones are also supported.
– VIVE Pro Audio Mode
Since the VIVE Pro has dual microphones with support for alert and conversation modes, APIs are provided so that you can toggle between the three audio modes. This provides applications with the ability to toggle between listening to foreground or background audio or a mix of both. Additionally, a USB Type-C high power mode setting (on/off) is also available.
Initially available as early access (beta) SDKs, you can find the downloads under the “Resource” tab .