explicitly install libgmp in Travis for Ubuntu 20.04

Seems some of the Ubuntu 20.04 VMs don't have libgmp pre-installed. Not sure why
only the fuzzing job is failing currently, but yet another Travis mystery I
guess.