FPS drop in Forza Horizon 5 with Moza R5

FPS drops in Forza Horizon 5 as soon as I use the Moza R5 steering wheel or pedals. The fps of 165 Hz drops to around 65 when I react with the moza set, sometimes the fps even drops to 15 or 16. Also, when I follow the Nvidia performance data when the FPS drops, the "Rendering Latency" 400-500. But when I touch the keyboard or mouse buttons, the fps goes back up to 165 and the latency drops to 20s.