The IRS penalizes taxpayers for late filing and late payment.  On top of these two fines, the IRS also charges interest for taxes that have not been paid.