Using portal after finishing trial....

Just tried this two times, but I finished the Strength Trial and ended with some keys (and was able to buy a few more). But... Full inventory so portalled back to town only to find you cannot go back to the endpoint where I left the chests unopened.
The portal still shown in the Caravan, you just can not make use of it.