You can disconnect your Wise business account from Xero anytime. This only works on the web.
Go on your business account on the web:
Go to Settings from your profile in the top corner
Go on Connected accounts
Select View app marketplace
Select Xero and then Disconnect
Alternatively, from your Connection settings you can also choose to turn off certain features or disconnect your accounts.