encode: increase max encoded byte stream size

This helps avoid running out of space for small images, where
header overhead is relatively large