I returned to explore the Ambient and Diffuse settings and found that if i increase Ambient to 3, I got very similar brightness between image rendering and vr rendering now!
So I think the original suggestion solves the issue. I just needed to increase the Ambient from 1 to 3.
