tests: fix overflow error in map helpers

Cast to unsigned was in wrong place. We casted result of assignemnt
which already overflowed which resulted in the follwowing error in
multiple radix tests under UBSAN:

"runtime error: signed integer overflow: 5 + 2147483647 cannot be
represented in type 'int'"