That is not necessary a big deal. I own a private Computer Compliance Consulting business that I run from my house as well. It entirely depends if the outside partners that you have selected to work with live in the same area, are working full or part-time with other companies, etc. I worked with a larger consulting company in New Jersey that had well over 500 upper level consultants and their main office employed only 8 people; most are clerks, etc.
The important thing is, is the guy creditable, does he have the contacts and resources to do what he says he can do, and can he demonstrate his current projects and his past successes. Just my two pennies worth.