Forward-scattering-light interferometry has become the most commonly used position detection scheme in optical levitation systems. Usually, three-set detectors are required to obtain the three-dimensional motion information. Here, we simplify the three-set detectors to one set by inserting a Dove prism. We investigate the role of a Dove prism in the position measurement process with an optical levitation system in vacuum. The relationship between the power spectral density and the rotation angle of a Dove prism is experimentally demonstrated and analyzed. This work shows that the Dove prism can greatly reduce the complexity of the experimental setup, which can be applied to compact optical levitation systems for studies in metrology, quantum physics, and biology.