# Does VTK support VR?

**URL:** https://discourse.vtk.org/t/does-vtk-support-vr/13534
**Category:** VR/AR
**Created:** [March 14, 2024, 11:27am UTC](https://discourse.vtk.org/t/does-vtk-support-vr/13534 "2024-03-14T11:27:24Z")
**Posts on this page:** 8
**Page:** 1

<div class="post-metadata">

### Author: ![gpu](https://discourse.vtk.org/letter_avatar_proxy/v4/letter/g/e47c2d/32.png) [@gpu](https://discourse.vtk.org/u/gpu)
#### Post date: [March 14, 2024, 11:27am UTC](https://discourse.vtk.org/t/does-vtk-support-vr/13534/1 "2024-03-14T11:27:24Z")

</div>

Does VTK support VR?

---

<div class="post-metadata">

### Author: ![cory.quammen](https://discourse.vtk.org/user_avatar/discourse.vtk.org/cory.quammen/32/6751_2.png) [@cory.quammen](https://discourse.vtk.org/u/cory.quammen)
#### Post date: [March 14, 2024, 2:38pm UTC](https://discourse.vtk.org/t/does-vtk-support-vr/13534/2 "2024-03-14T14:38:55Z")

</div>

Yes.

Some blog posts on the topic:

- [Using Virtual Reality Devices with VTK](https://www.kitware.com/using-virtual-reality-devices-with-vtk/)
- [Activiz holographic remoting: Stream VTK to the Hololens 2](https://www.kitware.com/activiz-holographic-remoting-stream-vtk-to-hololens-2/)
- [Holograms with VTK: Stream VTK to the Hololens 2](https://www.kitware.com/stream-vtk-to-the-hololens-2/)

If you really want to learn how to use VR with VTK, Kitware Europe is offering a live training on [VTK for augmented and virtual reality (XR) Training](https://www.kitware.eu/vtk-for-augmented-and-virtual-reality-xr-training/) next week on March 19.

---

<div class="post-metadata">

### Author: ![gpu](https://discourse.vtk.org/letter_avatar_proxy/v4/letter/g/e47c2d/32.png) [@gpu](https://discourse.vtk.org/u/gpu)
#### Post date: [March 15, 2024, 12:35am UTC](https://discourse.vtk.org/t/does-vtk-support-vr/13534/3 "2024-03-15T00:35:58Z")

</div>

[any solution to Render in Server(better without SteamVR) then send the left/right eye framebuffer as image(need compress here?) through internet to Client(better in Browser) in VR headset? - VR/AR - VTK](https://discourse.vtk.org/t/any-solution-to-render-in-server-better-without-steamvr-then-send-the-left-right-eye-framebuffer-as-image-need-compress-here-through-internet-to-client-better-in-browser-in-vr-headset/13535)

---

<div class="post-metadata">

### Author: ![gpu](https://discourse.vtk.org/letter_avatar_proxy/v4/letter/g/e47c2d/32.png) [@gpu](https://discourse.vtk.org/u/gpu)
#### Post date: [March 20, 2024, 3:11am UTC](https://discourse.vtk.org/t/does-vtk-support-vr/13534/4 "2024-03-20T03:11:15Z")

</div>

thanks! is there any successful project to Stream to XR device by VTK through no-local network? How is its latency?

---

<div class="post-metadata">

### Author: ![pieper](https://discourse.vtk.org/user_avatar/discourse.vtk.org/pieper/32/17_2.png) [@pieper](https://discourse.vtk.org/u/pieper)
#### Post date: [March 20, 2024, 11:26am UTC](https://discourse.vtk.org/t/does-vtk-support-vr/13534/5 "2024-03-20T11:26:21Z")

</div>

I gave a presentation at GTC a couple years ago demonstrating some CloudXR with SlicerVR (VTK-based) experiments. Video was streamed from an AWS GPU VM to a local headset.  
Performance and latency were surprisingly good. More details in the video linked here: [GTC Keynote MONAI and Slicer - #3 by pieper - Announcements - 3D Slicer Community](https://discourse.slicer.org/t/gtc-keynote-monai-and-slicer/22653/3?u=pieper)

---

<div class="post-metadata">

### Author: ![gpu](https://discourse.vtk.org/letter_avatar_proxy/v4/letter/g/e47c2d/32.png) [@gpu](https://discourse.vtk.org/u/gpu)
#### Post date: [March 24, 2024, 1:19pm UTC](https://discourse.vtk.org/t/does-vtk-support-vr/13534/6 "2024-03-24T13:19:32Z")

</div>

thank you very much!  
how about the resolution?  
and how about if it was an interactive APP?  
Thanks!

---

<div class="post-metadata">

### Author: ![pieper](https://discourse.vtk.org/user_avatar/discourse.vtk.org/pieper/32/17_2.png) [@pieper](https://discourse.vtk.org/u/pieper)
#### Post date: [March 25, 2024, 2:08pm UTC](https://discourse.vtk.org/t/does-vtk-support-vr/13534/7 "2024-03-25T14:08:53Z")

</div>

Watch the video for more details and to see it in action.

Basically the resolution adjusts dynamically according to network bandwidth, but generally was quite good and there was little or no noticeable lag.

---

<div class="post-metadata">

### Author: ![jcfr](https://discourse.vtk.org/user_avatar/discourse.vtk.org/jcfr/32/466_2.png) [@jcfr](https://discourse.vtk.org/u/jcfr)
#### Post date: [March 26, 2024, 6:24pm UTC](https://discourse.vtk.org/t/does-vtk-support-vr/13534/8 "2024-03-26T18:24:41Z")

</div>

> re: OpenXR

Earlier this year, we also added support for OpenXR and OpenXRRemoting to the [SlicerVirtualReality](https://github.com/KitwareMedical/SlicerVirtualReality#slicervirtualreality) extension.

This was made possible by leveraging VTK capabilities.
