My guess is that your joystick has a twist grip that is used for the rudder in FS (same as mine). After you release it, it centers itself and so the planes rudder will center itself as well. I try to slowly twist my joystick back to the center so that it isn't a sudden movement for the plane.