[Offload][Fix] Fix lazy initialization with multiple images

Summary:
There was a bug here where we would initialize the plugin multiple times
when there were multiple images. Fix it by putting the `is_initliaized`
check later.