1. sanity check on rate and fixed quality values

2. set rate of 1 equal to 0 - fixes bug with feasible truncation algo where a lossless encode with multiple layers was
not in fact lossless