The Python server should work well because all VTK classes are Python-wrapped and you can wrap your C++ classes as well. If your classes are VTK-based then you can use VTK’s Python wrapper.
If you are not comfortable using Python then you can try Paraview render server. Or put together a simple rendering server and communicate with it using json-rpc or zmq (or if frame rate is not critical, then even web requests).