Unable to click on portal in Act 2/5 when on the caravan

I had this now two times in a row while doing the Trials of Sekhema. When I portal to the caravan I cannot go back to the Trials. Players are standing in the portal, not sure if this is the reason or if it's broken with the Trials. I don't recall such problems during Campaign.

Use the waypoint to get back. The portal doesn't work and it has been this way since release.