This is more robust than trying to enumerate the architectures/compilers where we need to link against libatomic. This reverts the other part of 6d918427.