Can't change vertex visibility after first render

[Julien_Champagnol]

For context I am using vtk 9.5.0