Hi, @Laszlo
I haven't tried it myself, but I believe the following step-by-step tutorial in the "It's FOSS" web site may help you ("How to Install Ubuntu Linux on an External USB Drive to Make an Actual, Portable Linux System on USB"):
I hope that helps 