Return Address for FBA Shipments

Since the default return address is set to the one we give in our account, It makes sense that products will be returned to this address if I am doing FBM. I wonder do I need to update or change it to the address of any amazon warehouse when doing FBA, or I should just leave this address as it is and FBA shipment automatically goes to the warehouse they were shipped from. Please?