According to the Herald Palladium, for tax purposes small businesses should keep records such as expenses, income and bank statements for a minimum of seven years.