vtkAppendPolyData - performance increase?

Showing 60k points is easy, it should be work without any extra effort at screen refresh rate.

Interacting with 60k points is a completely different story. You can certainly not use a separate actor for each point as it would be extremely slow. You need to use a glyph filter or mapper and take care of point interactions yourself, since existing interactive VTK widgets use a few actors for each interactive handle. There is an implementation of point and curve widgets in 3D Slicer that allow interaction with thousands of points (interaction starts to become less fluid when you reach about 10k, because we stopped optimizing performance when everything was fluid at 1k). See some more details in this post: picking glyphs vtkGlyph3DMapper - #2 by lassoan.