Emerging firms are quickly making inroads into critical financial services, and often taking on more risk than traditional banks.