You can delete the last budget year record in the grid. When you delete a budget year, all budget periods for that year are deleted.
To delete a budget year: