In order to remove a Slack App from a channel, you need to do the following:
In Slack:
/remove @windmill
@ the channel you want to remove
In Windmill:
Go to connections
Select Slack
Click "Settings"
Go to the channel you'd like to remove and click the three dots
Select "leave channel"