I think VNC (like RealVNC software) can do what you are asking. The "user" would have to logon to the particular device, each one with a different address. Then you would be looking at the desktop of that machine. Then just use it.
Access from outside your local network would be harder, but should be doable.
VG