Replaced std::multimap with std::map<key,std::vector<>>

A callgrind analysis showed, that we spend much of our time inside the
multimap functions. It seems that the multimap implementation provided
by gcc requires memory allocations for equal_range and other lookups.

This change results in a 120% performance increase on my system.