I have a workaround going into vtk.js for now: fix(web-worker-loader): patch/fix vite prod build by floryst · Pull Request #2361 · Kitware/vtk-js · GitHub. This workaround should get your project running in prod.
Hopefully the upstream issue with rollup-plugin-web-worker can be resolved.