Penalties can sometimes get very large over time. Many times they can be reduced or eliminated altogether. There are multiple ways to reduce or eliminate them, like having reasonable cause or under a special first time abatement rule, but they all have specific guidelines. This can be a good option when also used with other tax relief solutions or at times when a penalty is the only thing owed.