For our therapy app it would be highly beneficial if the therapist could also wear a headset and engage in the experience with the patient. That way they will be able to guide patients through the learnings easily. To do this with Metahumans I will need to use remote streaming from a PC so that the heavy lifting is done by the PC and not the Hololens. I’ve finally got it all working – just with basic shapes for now, but next stop will be Metahumans!
Spech Therapy
UE4 Hololens Multiplayer
I found two excellent resources that showed me how to do this.
Microsoft Tutorial – https://docs.microsoft.com/en-us/samples/microsoft/mixedreality-unreal-samples/hl2collab—hololens-multiplayer-networking-in-unreal/
Unreal Engine Multiplayer docs – https://docs.unrealengine.com/5.0/en-US/networking-and-multiplayer-in-unreal-engine/
Unreal UMG spawned on hand gestures
This is a really neat way to introduce a control panel to your Hololens app, which hides away when not in use. Here I have it changing the Metahuman displayed, and the emotional animation I have for them.
Metahumans in the Hololens 2 – First Steps!
Hololens 2 – Creating a Comfortable Experience
EPIC TUTORIALS – Check out this fantastic quick video tutorial about optimal fields for elements when you are creating a Hololens experience. There’s so much to think about when designing AR for therapy.
You must be logged in to post a comment.