I tested it on my laptop and that bug doesn't happen there.
So, I can only think of the reason being my refresh rate of 144hz on my desktop which does cause issues with certain games where it's meant to be played at 60FPS, although this game was already locked at that.
After some testing, I finally figured out the solution. I manually configured this game on NVIDIA Control Panel and set monitor technology from G-Sync to Fixed Refresh Rate, and that fixed the issue for me.
Edit: Actually, I noticed I had VSync globally set to fast. Simply turning that off also fixes the issue without requiring to configure the game.
