There are usually two reasons why the other driver doesn't want to go through his insurance company. First, he doesn't want his insurance premiums to go up after an accident. Or second, he doesn't have any insurance.
Even if you don't seem injured and your car's damages are minor, always get the other driver's insurance information. If he refuses to give it, tell him that you have no other choice than to call law enforcement to take an accident report.