Exclude Always from stderr

We are using Always not for errors, but for output we don't want the user to
be able to mute. So it makes some sense to still output it to stdout.