Using an offscreen renderer influences completely separate interactive renderer

We are rendering a pdf report with pictures showing different views of the model or models other than the one in the viewport.
The background thread is used to keep the gui responsive and give the user the opportunity to cancel the report production.

Producing the image without using a background thread works without issues.
It also works without issues (using a background thread) if I use actors with fewer vertices.