Thank you Jaswant! using an assembly for selection sounds promising.
Regarding the backface property, I tried creating a backface property with a color for the actor. But after adding that, the actor becomes invisible when looking from the back. I tried set BackfaceCullingOff but it does not work. Does the backface property work with vtkGlyph3DMapper?