Well not exactly just use the joystick instead of the D-Pad. I have also found out you can hold a direction after fleeing/winning and you should be able to move one grass tile at a time.
How exactly did you get the gamepad to work in the first place? I've tried both my ps5, and switch controllers, and the game doesn't seem to recognize them.