You can't void or cancel issued penalties inside of Paidnice. But you can quickly jump into your accounting system to delete or edit the penalties from the invoice setting itself, when selecting View Details:
To freeze future processing of penalties that have been issued by Paidnice select the button in the image below: