Persistent Ubuntu Live USB setup
Persistent Ubuntu Live USB setup
You can save your persistent changes to another USB drive after installing Ubuntu Live. Just connect the second USB, follow the installation steps, and it will apply the updates there.
I understand peristenct files can be stored on another partition of the same USB drive where the Live OS runs, though I don't know the exact method or if it's feasible. It might actually be more complicated than helpful.