# VR/AR

**URL:** https://discourse.vtk.org/c/vr-ar/10.md

[Latest](https://discourse.vtk.org/latest.md) · [Categories](https://discourse.vtk.org/categories.md) · [Tags](https://discourse.vtk.org/tags.md)

---

## [About the VR/AR category](https://discourse.vtk.org/t/about-the-vr-ar-category/43)

<div class="topic-metadata">

**Author:** [@cory.quammen](https://discourse.vtk.org/u/cory.quammen)\
**Replies:** 0

</div>

A place for questions about VR/AR and VTK.

---

## [VR updates, some fun demos and a few questions](https://discourse.vtk.org/t/vr-updates-some-fun-demos-and-a-few-questions/16502)

<div class="topic-metadata">

**Author:** [@fraseyboo](https://discourse.vtk.org/u/fraseyboo)\
**Replies:** 5\
**Last updated:** [August 4, 2026, 3:58pm UTC](https://discourse.vtk.org/t/vr-updates-some-fun-demos-and-a-few-questions/16502 "2026-08-04T15:58:33Z")

</div>

So the VR functionalities of VTK have always been a bit under realised and so I thought I’d make a quick demo video of the 3D widgets VTK uses working in VR, I implemented an in-VR menu that attaches to the controllers a…

---

## [OpenVR problems with VTK 9.5.0](https://discourse.vtk.org/t/openvr-problems-with-vtk-9-5-0/15837)

<div class="topic-metadata">

**Author:** [@Hallo2World](https://discourse.vtk.org/u/Hallo2World)\
**Replies:** 0\
**Last updated:** [July 18, 2025, 6:42am UTC](https://discourse.vtk.org/t/openvr-problems-with-vtk-9-5-0/15837 "2025-07-18T06:42:03Z")

</div>

---

## [OpenXR and the Oculus Quest 2](https://discourse.vtk.org/t/openxr-and-the-oculus-quest-2/15706)

<div class="topic-metadata">

**Author:** [@fraseyboo](https://discourse.vtk.org/u/fraseyboo)\
**Replies:** 7\
**Last updated:** [June 10, 2025, 3:20pm UTC](https://discourse.vtk.org/t/openxr-and-the-oculus-quest-2/15706 "2025-06-10T15:20:42Z")

</div>

So I’ve revisited using VTK in VR on the Quest, this time inspired by developments in the recent blog post and some support from @LucasGandel. I’ve produced a small example to test the VR capabilities. In general the fun…

---

## [VTK on the Oculus Quest 2: Ongoing](https://discourse.vtk.org/t/vtk-on-the-oculus-quest-2-ongoing/4432)

<div class="topic-metadata">

**Author:** [@fraseyboo](https://discourse.vtk.org/u/fraseyboo)\
**Replies:** 10\
**Last updated:** [May 29, 2025, 12:36pm UTC](https://discourse.vtk.org/t/vtk-on-the-oculus-quest-2-ongoing/4432 "2025-05-29T12:36:15Z")

</div>

So I created this thread to document any progress I make on getting VTK visualization to run on the standalone VR headset the Oculus Quest 2. Currently the VR example found in the VTK.js project doesn’t work within the n…

---

## [OpenVR problems with VTK 9.2](https://discourse.vtk.org/t/openvr-problems-with-vtk-9-2/10992)

<div class="topic-metadata">

**Author:** [@codeling](https://discourse.vtk.org/u/codeling)\
**Replies:** 30\
**Last updated:** [October 23, 2024, 8:07am UTC](https://discourse.vtk.org/t/openvr-problems-with-vtk-9-2/10992 "2024-10-23T08:07:00Z")

</div>

For our OpenVR + VTK based program, we noticed a strange issue in VTK 9.2.(2/5): Only the left eye actually gets the rendered image, the right eye only sees the empty surroundings. We have tested the exact same code on …

---

## [TimerEvent observer not working for VR (OpenXR)](https://discourse.vtk.org/t/timerevent-observer-not-working-for-vr-openxr/14611)

<div class="topic-metadata">

**Author:** [@petr.raunigr](https://discourse.vtk.org/u/petr.raunigr)\
**Replies:** 1\
**Last updated:** [September 25, 2024, 12:31pm UTC](https://discourse.vtk.org/t/timerevent-observer-not-working-for-vr-openxr/14611 "2024-09-25T12:31:59Z")

</div>

Hello, I came across a problem when trying to execute a TImerEvent callback in my VR (OpenXR) c++ app. The problem is: The TimerEvent callback is never called when working with VR. When in a non-VR enviroment an observ…

---

## [OpenXR Issue](https://discourse.vtk.org/t/openxr-issue/14191)

<div class="topic-metadata">

**Author:** [@stocke20](https://discourse.vtk.org/u/stocke20)\
**Replies:** 2\
**Last updated:** [July 16, 2024, 1:51pm UTC](https://discourse.vtk.org/t/openxr-issue/14191 "2024-07-16T13:51:14Z")

</div>

Hello, I am currently trying to use OpenXR with VTK instead of OpenVR for VR support and I’ve run into an issue where the OpenXR initialization fails. I have tried to start OpenXR manually via the vtkOpenXRManager class…

---

## [OpenXR 1.1.36 - crash](https://discourse.vtk.org/t/openxr-1-1-36-crash/13744)

<div class="topic-metadata">

**Author:** [@codeling](https://discourse.vtk.org/u/codeling)\
**Replies:** 2\
**Last updated:** [July 16, 2024, 1:49pm UTC](https://discourse.vtk.org/t/openxr-1-1-36-crash/13744 "2024-07-16T13:49:08Z")

</div>

Did anyone have a chance yet to try the newest version 1.1.36 of OpenXR? The OpenXR tests compile just fine, but when running them, there’s a vtkOutputWindow showing ERROR: In vtkOpenXRManager.cxx, line 546 (nullptr): F…

---

## [How can beginners implement this example on Hololens2 with vtk.js?](https://discourse.vtk.org/t/how-can-beginners-implement-this-example-on-hololens2-with-vtk-js/14225)

<div class="topic-metadata">

**Author:** [@ZunnOfficial](https://discourse.vtk.org/u/ZunnOfficial)\
**Replies:** 0\
**Last updated:** [July 13, 2024, 5:33pm UTC](https://discourse.vtk.org/t/how-can-beginners-implement-this-example-on-hololens2-with-vtk-js/14225 "2024-07-13T17:33:50Z")

</div>

AR\_Medical I am a beginner and have a Hololens 2 at hand. Can this be implemented through VTK.js? Is there a detailed tutorial suitable for beginners? I just registered on the forum and this is my first time posting…

---

## [Does VTK support VR?](https://discourse.vtk.org/t/does-vtk-support-vr/13534)

<div class="topic-metadata">

**Author:** [@gpu](https://discourse.vtk.org/u/gpu)\
**Replies:** 7\
**Last updated:** [March 26, 2024, 6:24pm UTC](https://discourse.vtk.org/t/does-vtk-support-vr/13534 "2024-03-26T18:24:41Z")

</div>

Does VTK support VR?

---

## [does web Browser in VR support render using user’s custom renderBuffer as the eyeBuffer of the XR device?](https://discourse.vtk.org/t/does-web-browser-in-vr-support-render-using-user-s-custom-renderbuffer-as-the-eyebuffer-of-the-xr-device/13599)

<div class="topic-metadata">

**Author:** [@gpu](https://discourse.vtk.org/u/gpu)\
**Replies:** 0\
**Last updated:** [March 21, 2024, 1:57am UTC](https://discourse.vtk.org/t/does-web-browser-in-vr-support-render-using-user-s-custom-renderbuffer-as-the-eyebuffer-of-the-xr-device/13599 "2024-03-21T01:57:33Z")

</div>

does web Browser in VR support render using user’s custom renderBuffer as the eyeBuffer of the XR device? Thanks!

---

## [does VTK support Apple Vision Pro?](https://discourse.vtk.org/t/does-vtk-support-apple-vision-pro/13584)

<div class="topic-metadata">

**Author:** [@gpu](https://discourse.vtk.org/u/gpu)\
**Replies:** 0\
**Last updated:** [March 20, 2024, 3:34am UTC](https://discourse.vtk.org/t/does-vtk-support-apple-vision-pro/13584 "2024-03-20T03:34:56Z")

</div>

does VTK support Apple Vision Pro?

---

## [does VTK have or support Pixel Streaming as Unreal?](https://discourse.vtk.org/t/does-vtk-have-or-support-pixel-streaming-as-unreal/13545)

<div class="topic-metadata">

**Author:** [@gpu](https://discourse.vtk.org/u/gpu)\
**Replies:** 0\
**Last updated:** [March 15, 2024, 3:43am UTC](https://discourse.vtk.org/t/does-vtk-have-or-support-pixel-streaming-as-unreal/13545 "2024-03-15T03:43:29Z")

</div>

does VTK have or support Pixel Streaming as Unreal?

---

## [any solution to Render in Server(better without SteamVR) then send the left/right eye framebuffer as image(need compress here?) through internet to Client(better in Browser) in VR headset?](https://discourse.vtk.org/t/any-solution-to-render-in-server-better-without-steamvr-then-send-the-left-right-eye-framebuffer-as-image-need-compress-here-through-internet-to-client-better-in-browser-in-vr-headset/13535)

<div class="topic-metadata">

**Author:** [@gpu](https://discourse.vtk.org/u/gpu)\
**Replies:** 0\
**Last updated:** [March 14, 2024, 11:28am UTC](https://discourse.vtk.org/t/any-solution-to-render-in-server-better-without-steamvr-then-send-the-left-right-eye-framebuffer-as-image-need-compress-here-through-internet-to-client-better-in-browser-in-vr-headset/13535 "2024-03-14T11:28:09Z")

</div>

any solution to Render in Server(better without SteamVR) then send the left/right eye framebuffer as image(need compress here?) through internet to Client(better in Browser) in VR headset?

---

## [vtk.js rendering on Hololens](https://discourse.vtk.org/t/vtk-js-rendering-on-hololens/11263)

<div class="topic-metadata">

**Author:** [@aliceb](https://discourse.vtk.org/u/aliceb)\
**Replies:** 8\
**Last updated:** [May 26, 2023, 2:18pm UTC](https://discourse.vtk.org/t/vtk-js-rendering-on-hololens/11263 "2023-05-26T14:18:47Z")

</div>

Hello, I’m trying to display a hologram by launching AR on a web page in vtk.js. The hologram should be displayed on a Hololens 2 device. I currently observe a stereo effect on Hololens, as I am seeing two times the sam…

---

## [Node.js and webpack deployment of GeometryViewer with AR](https://discourse.vtk.org/t/node-js-and-webpack-deployment-of-geometryviewer-with-ar/10482)

<div class="topic-metadata">

**Author:** [@Lois\_Vazquez](https://discourse.vtk.org/u/Lois_Vazquez)\
**Replies:** 8\
**Last updated:** [May 11, 2023, 5:01pm UTC](https://discourse.vtk.org/t/node-js-and-webpack-deployment-of-geometryviewer-with-ar/10482 "2023-05-11T17:01:23Z")

</div>

Hello. I’m new to vtk.js so I apologize if I’m skipping some basic point that I don’t know. I am trying to deploy the GeometryViewer example with node.js and webpack in order to test the augmented reality support. My de…

---

## [DLL load failed while importing vtkRenderingOpenVR](https://discourse.vtk.org/t/dll-load-failed-while-importing-vtkrenderingopenvr/10449)

<div class="topic-metadata">

**Author:** [@banesullivan](https://discourse.vtk.org/u/banesullivan)\
**Replies:** 3\
**Last updated:** [January 19, 2023, 7:11pm UTC](https://discourse.vtk.org/t/dll-load-failed-while-importing-vtkrenderingopenvr/10449 "2023-01-19T19:11:37Z")

</div>

After building VTK (latest release branch) on Windows succussfully and generating a wheel, when I try to import vtk in Python, I get an error loading the DLL for vtkRenderingOpenVR: \>\>\> import vtk Traceback (most recent…

---

## [Unable to move around in VR](https://discourse.vtk.org/t/unable-to-move-around-in-vr/10450)

<div class="topic-metadata">

**Author:** [@banesullivan](https://discourse.vtk.org/u/banesullivan)\
**Replies:** 2\
**Last updated:** [January 17, 2023, 8:34am UTC](https://discourse.vtk.org/t/unable-to-move-around-in-vr/10450 "2023-01-17T08:34:58Z")

</div>

I’ve managed to build a VTK python wheel with OpenVR enabled and I’m toying with the following example. I’m unable to move around the scene. The sphere renders, but I cannot fly around or translate. I notice an error o…

---

## [\[OpenVR\] Set scale or motion factor from UI crashes](https://discourse.vtk.org/t/openvr-set-scale-or-motion-factor-from-ui-crashes/10474)

<div class="topic-metadata">

**Author:** [@banesullivan](https://discourse.vtk.org/u/banesullivan)\
**Replies:** 1\
**Last updated:** [January 17, 2023, 8:33am UTC](https://discourse.vtk.org/t/openvr-set-scale-or-motion-factor-from-ui-crashes/10474 "2023-01-17T08:33:39Z")

</div>

If I try to use the UI to change the Scale Factor or Motion Factor, the VR app crashes without any error messages… I’ve also tried programmatically calling SetPhysicalScale(), but that has seemingly no affect. Any tips …

---

## [VR scenes are rotated](https://discourse.vtk.org/t/vr-scenes-are-rotated/10451)

<div class="topic-metadata">

**Author:** [@banesullivan](https://discourse.vtk.org/u/banesullivan)\
**Replies:** 4\
**Last updated:** [January 16, 2023, 9:03pm UTC](https://discourse.vtk.org/t/vr-scenes-are-rotated/10451 "2023-01-16T21:03:21Z")

</div>

Whenever rendering with OpenVR, the scene is rotated. This is clearly visible with an vtkAxesActor. The Z axis is parallel to the floor… this is not expected. import vtk from vtkmodules.vtkRenderingOpenVR import ( …

---

## [Re-introducing a generic RenderingVR API for retrieving tracker state](https://discourse.vtk.org/t/re-introducing-a-generic-renderingvr-api-for-retrieving-tracker-state/10394)

<div class="topic-metadata">

**Author:** [@jcfr](https://discourse.vtk.org/u/jcfr)\
**Replies:** 2\
**Last updated:** [January 6, 2023, 7:48am UTC](https://discourse.vtk.org/t/re-introducing-a-generic-renderingvr-api-for-retrieving-tracker-state/10394 "2023-01-06T07:48:07Z")

</div>

This post summarizes offline discussions between @LucasGandel and @jcfr and is intended to help converge to having an API associated with the vtkRenderingVR module allowing to retrieve metadata associated with devices (a…

---

## [An error about openxr demo?](https://discourse.vtk.org/t/an-error-about-openxr-demo/10065)

<div class="topic-metadata">

**Author:** [@Rain-BBking](https://discourse.vtk.org/u/Rain-BBking)\
**Replies:** 3\
**Last updated:** [December 6, 2022, 6:25am UTC](https://discourse.vtk.org/t/an-error-about-openxr-demo/10065 "2022-12-06T06:25:16Z")

</div>

I’m writing a project recently that needs to achieve VR effect. I’m going to use vtkOpenXRRenderWindow to implement it, but I had a problem when I used the official demo( Rendering/OpenXR/Testing/Cxx/TestOpenXRInitializa…

---

## [Maximum Intensity Projection](https://discourse.vtk.org/t/maximum-intensity-projection/6514)

<div class="topic-metadata">

**Author:** [@aleena98](https://discourse.vtk.org/u/aleena98)\
**Replies:** 5\
**Last updated:** [October 6, 2022, 8:56pm UTC](https://discourse.vtk.org/t/maximum-intensity-projection/6514 "2022-10-06T20:56:02Z")

</div>

I am working on a project to detect cerebral aneurysm using UNET CNN. I am using MRA images in this project. I would need to convert the 3D images into 2D images before feeding it into the neural network or get MIP for t…

---

## [How to label model according to cell data?](https://discourse.vtk.org/t/how-to-label-model-according-to-cell-data/9406)

<div class="topic-metadata">

**Author:** [@graysuit](https://discourse.vtk.org/u/graysuit)\
**Replies:** 0\
**Last updated:** [September 20, 2022, 11:46am UTC](https://discourse.vtk.org/t/how-to-label-model-according-to-cell-data/9406 "2022-09-20T11:46:01Z")

</div>

I have model (\*.vtu) containing several blocks like: I want to label values on each block like: How can I do it ? I can access values using: vtkActor actor = ...; var output = actor.GetMapper().GetInputAsDataSet(…

---

## [A Multi Volume Problem of VTK9.2](https://discourse.vtk.org/t/a-multi-volume-problem-of-vtk9-2/9287)

<div class="topic-metadata">

**Author:** [@YRFPC03](https://discourse.vtk.org/u/YRFPC03)\
**Replies:** 1\
**Last updated:** [September 6, 2022, 1:40pm UTC](https://discourse.vtk.org/t/a-multi-volume-problem-of-vtk9-2/9287 "2022-09-06T13:40:48Z")

</div>

When I use multi volume to render multi-body data, the rendering result I get becomes very dim, which is not the case when I render single body data. I have used vtk9，i don’t change the ColorTransferFunction and else be…

---

## [Can't color a XML Unstructured Grid (\*.vtu)](https://discourse.vtk.org/t/cant-color-a-xml-unstructured-grid-vtu/8660)

<div class="topic-metadata">

**Author:** [@graysuit](https://discourse.vtk.org/u/graysuit)\
**Replies:** 11\
**Last updated:** [August 16, 2022, 8:05am UTC](https://discourse.vtk.org/t/cant-color-a-xml-unstructured-grid-vtu/8660 "2022-08-16T08:05:55Z")

</div>

Hi I have code, which can color \*.vtp, \*.vtk. But same code fails to color \*.vtu. I have list of vtkactors. And I specify which actor to set properties from. This code which gets all column names from actor index: …

---

## [How to color 3D model according to magnitude of specific column ?](https://discourse.vtk.org/t/how-to-color-3d-model-according-to-magnitude-of-specific-column/8588)

<div class="topic-metadata">

**Author:** [@graysuit](https://discourse.vtk.org/u/graysuit)\
**Replies:** 3\
**Last updated:** [May 29, 2022, 5:36pm UTC](https://discourse.vtk.org/t/how-to-color-3d-model-according-to-magnitude-of-specific-column/8588 "2022-05-29T17:36:09Z")

</div>

The paraview has ability to get no. of columns in file and then can color each column according to magnitude we specify. The color range is what we specify in scale. Please see screenshots: I want to do this C# us…

---

## [Mandibular, teeth and nerve segmentation from cbct](https://discourse.vtk.org/t/mandibular-teeth-and-nerve-segmentation-from-cbct/7827)

<div class="topic-metadata">

**Author:** [@Fatihhamircu](https://discourse.vtk.org/u/Fatihhamircu)\
**Replies:** 1\
**Last updated:** [February 15, 2022, 4:54pm UTC](https://discourse.vtk.org/t/mandibular-teeth-and-nerve-segmentation-from-cbct/7827 "2022-02-15T16:54:57Z")

</div>

Is there a easier way of segmenting multiple teeth, mandibular jaw and inferior alveolar nerve easily from a CBCT ? Also if someone has done these segmentations from CBCT what is the normal work flow that worked the bes…

---

## [VTK 9.1 OpenVR Demo Render Volume Problem](https://discourse.vtk.org/t/vtk-9-1-openvr-demo-render-volume-problem/7663)

<div class="topic-metadata">

**Author:** [@zist8888](https://discourse.vtk.org/u/zist8888)\
**Replies:** 0\
**Last updated:** [January 18, 2022, 9:57am UTC](https://discourse.vtk.org/t/vtk-9-1-openvr-demo-render-volume-problem/7663 "2022-01-18T09:57:53Z")

</div>

I use VTK9.1 OpenVR demo，and render volume by Dicom data ,which can show ,but obtained Incorrect viewing angle from HTC comos device. but VTK9.0 is good!

[Next page](https://discourse.vtk.org/c/vr-ar/10.md?page=1)