You can make your own wheels with just what you need from VTK by using a build with all the other stuff disabled, but the PyPI installs will almost always be bigger (because, AFAIK, I can’t put part of VTK in one wheel and other parts in other wheels and also guarantee that you don’t mix-and-match the wrong versions/builds together).