clang/AMDGPU: Don't set implicit arg attribute to default size

Since 2959e082, we conservatively
assume all inputs are enabled by default. This isn't the best
interface for controlling these anyway, since it's not granular and
only allows trimming the last fields.