It is possible to find affordable small business funding, reports Business.com. Some cheaper alternatives to high interest loans include a business line of credit or Paypal Working Credit.