remove GCC 4 testing on newer Ubuntu

Testing such a old compiler on a newer Linux doesn't seem to fit many relevant
use cases. If a user can upgrade their OS, they should be able to upgrade their
compiler.

Github: related to #170 "optimise testing"