Using vtkImageViewer2 should be fine.
As a test, can you add a vtkJPEGWriter to your code and use it to write the output of vtkImageMapToColors as a set of jpeg images? Add it immediately after self.color.SetInputConnection(rectify.GetOutputPort()).