While some states might have better taxes or regulations, reports the SF Gate, the best state to start your small business in, is the state you are currently living in.