An Imaginary Screen in the Air

Control your camera like there is an imaginary screen in the air

A Deep Dive into Camera Control

Example:

In my Beginner Template(Default model when you click the load model button) there is a Hands Control Camera Link:

Process

1**.** Raise both your left and right hand simultaneously to activate camera control 2**.** Lower your left arm before your right arm to exit camera control—this prevents your right hand from dragging

the camera down as you exit.

Learn more on triggering and exiting similarity please check out: Similarity

Avoid Mistriggers

1**.** If beginners keep accidentally raising their hands and making the camera look up, try increasing the “stay”(count in frames) in the camera control pose—this adds a slight delay before camera control activates

2. If beginners often accidentally move the camera to face the ground, you can draw a hitbox to restrict the right hand from lowering the view too much:

Hold Left or Right Mouse Button

In some games (especially online MMORPGS), you usually have to hold the left/right mouse button to rotate the camera or character.

More on Hold a key please check Keyboard&Mouse

ReCenter Mouse Before Camera Control

During intense gameplay, sometimes your mouse might accidentally move over a UI element, which can prevent your camera or character from responding.

We can move the mouse to the center of the screen each time before starting camera control.

Rotate Your Body, Rotate Your Character

In my Beginner Template,

For beginners, this matches intuition: rotating your body rotates your character.

Process

Customize Your In-Game Turn Key (Remember to Select “Hold”)

Re-capture a turn angle that feels comfortable for you

Adjust the upper % for the similarity for triggering the turn key.

Adjust the lower % for the similarity needed to release the turn key.

Please refer to Pose Recognition and Keyboard&Mouse, as well as Wrist To Mouse, to fine-tune turning effects.

Play with a Controller

For games that require moving, turning the camera, and attacking with both hands at the same time, you can try to use a controller to improve user experience:

Finger Ring Mouse

For camera control in first person RPG game

Wireless TrackBall

For camera control in first person RPG game

4 Key Mini Wireless Keyboard

Mini wireless keyboards are simple, cheap, and plug-and-play. Just note that holding them in your hand might not be very comfortable.

Joy-Con Controllers

If you have experimenting with Joycon and are willing to invest, buying a pair of third-party Joy-Cons (the official ones are prone to Bluetooth disconnections) and pairing with JoyToKey, DS4Windows, JoyShockMapper, reWASD (paid but powerful), or other free mapping software, you can theoretically use them to play any game. So it can compensate anything you currently can't do with the link

Remember, the ultimate goal of The Link is to enable completely hands-free interaction with your computer using only a camera and a mic.

In certain games, or for those who are not yet fully accustomed to motion control, using an extra controller can be a temporary workaround.

But one day, with Mason’s ongoing improvements to the algorithm, everyone will be able to play any game—completely hands free.