You can set your course as private. In this way it will hide the buy button on the banner section. You can delete the payment plan options and this won't affect students that are already enrolled with this option. They will continue paying until all the payments are made.
If you are using our updated page builder, you can simply delete the buy buttons that are linking to the payment plan.
Hope this helps!
Awesome - thanks Oliver!