You can stop monetizing your tracks at any time, by simply disabling the monetization for a track via your tracks page. There you can control monetization for each track or turn it off for all tracks. Once you have stopped monetization for a track you will receive the last payout with the next payout cycle.
See how to start/stop monetization here.
Should you want to leave the program please file a ticket here.