[libc][fix] Only add the hermetic test flags in GPU mode

Summary:
This is a little broken, what we really need is a separate target to use
with the hermetic tests, but this is a stop-gap to get the bots green
again.