In a conference call Monday with reporters, Walker said his first budget would undo tax increases approved this year by the Legislature. This year's state budget included increases in business taxes; the capital gains tax; and the income tax for the wealthiest residents. Walker said he would do away with those increases.