Would I be unfair to my brother?

Maybe ask him where his head is at on it, an explain that u all want to remain together so each will do what they can. Surely its best a family stays together!