By way of summary, I never was able to get things to work with vtkGlyph3DMapper. However, vtkProgrammableGlyphFilter did eventually work, using vtkIdFilter to attach IDs to glyphs so I could match both point (vtkCellPicker) and area (vtkAreaPicker + vtkExtractGeometry) picking information to underlying glyphs.