{"schemaVersion":1,"record":{"key":"mechanic/phone-camera--family-face-actions","type":"mechanic","id":"phone-camera--family-face-actions","lang":"en","title":"Eyes, mouth and facial actions","summary":"A visible facial action becomes a command. iOS Head Tracking can map eyebrow raises or an open mouth to actions; facial shape does not prove emotion.","updatedAt":"2026-10-22","status":"active","url":"https://gamemechanics.pro/en/knowledge/mechanic/phone-camera--family-face-actions/","jsonUrl":"https://gamemechanics.pro/api/v1/knowledge/en/mechanic/phone-camera--family-face-actions.json","markdownUrl":"https://gamemechanics.pro/content/knowledge/en/mechanic/phone-camera--family-face-actions.md","aliases":[],"tags":["Phone camera interactions","Mechanics catalog"],"sourceIds":["source-17820b3f136aa433","source-778351bee9d86030"],"sources":[{"id":"source-17820b3f136aa433","title":"MediaPipe Face Landmarker","url":"https://developers.google.com/edge/mediapipe/solutions/vision/face_landmarker","verifiedAt":null},{"id":"source-778351bee9d86030","title":"Head Tracking (iOS)","url":"https://support.apple.com/guide/iphone/control-iphone-with-the-movement-of-your-head-iph9c3dc17cf/ios","verifiedAt":null}],"sections":[{"id":"principle","title":"How it works","body":"The game rule reacts to the visible action of a person. Need calibration and alternate input. The facial form does not prove emotion; blinking is involuntary. Accurate eye tracking with an RGB camera should not be promised."},{"id":"variants","title":"Variants","body":"### Variants and applications\n\n<a id=\"family-face-actions-variants\"></a>\n\n- Blinking like a button. Action: Intentionally close and open your eyes to perform an action. Application: Shooting, jumping, experimental contactless input. Technologies: Recognition or machine learning model. <a id=\"variant-cam-081\"></a>\n- Wink. Action: Close left and right eyes separately for different commands. Application: Two-button game, hidden signals, side control. Technologies: Recognition or machine learning model. <a id=\"variant-cam-082\"></a>\n- Closed eyes. Action: Keep your eyes closed; the world changes over time or when opened. Application: Horror, memory game, audio-visual mystery. Technologies: Recognition or machine learning model. <a id=\"variant-cam-083\"></a>\n- Rough direction of view. Action: After calibration, distinguish several large directions of eye movement. Application: Choice of two zones, experiment on attention, character control. Technologies: Recognition or machine learning model; Experimental prototype. <a id=\"variant-cam-084\"></a>\n- Opening the mouth. Action: Change the degree of mouth opening as a continuous parameter. Application: Eating targets, vocal avatar without sound analysis, virtual instrument. Technologies: Recognition or machine learning model. <a id=\"variant-cam-085\"></a>\n- Smile and eyebrows. Action: Take a given mouth shape or raise eyebrows for a command. Application: Facial trainer, comic arcade, avatar control. Technologies: Recognition or machine learning model. <a id=\"variant-cam-086\"></a>\n- Repeat expression. Action: Reproduce the combination of facial movements shown. Application: Facial memory, acting, accuracy competition. Technologies: Recognition or machine learning model. <a id=\"variant-cam-087\"></a>\n- Mimic animation. Action: Transfer facial parameters to a digital character in real time. Application: Virtual theater, animation creation, video chat character. Technologies: Recognition or machine learning model. <a id=\"variant-cam-088\"></a>"},{"id":"context","title":"Context and limits","body":"Games, learning, creativity and interactive applications. Author's systematization of game rules based on proven technical capabilities. Examples are application ideas and not statements of released products."}],"relations":[],"placements":[{"catalogId":"phone-camera","id":"family-face-actions","title":"Phone camera interactions","url":"https://gamemechanics.pro/en/mechanics/phone-camera/#family-face-actions","categoryIds":["section-1"]}],"supersededBy":[],"attributes":{"preview":{"updatedAt":"2026-10-22","title":"Eyes, mouth and facial actions","description":"A visible facial action becomes a command. iOS Head Tracking can map eyebrow raises or an open mouth to actions; facial shape does not prove emotion.","image":{"src":"images/mechanics/camera-apple-head-tracking.webp","width":490,"height":1008,"crop":{"x":25,"y":105,"width":440,"height":815},"game":"Head Tracking (iOS)","sourceUrl":"https://support.apple.com/guide/iphone/control-iphone-with-the-movement-of-your-head-iph9c3dc17cf/ios","originalUrl":"https://ipcdn-web.apple.com/assets/v2/web/e44793cc-1a1a-4ac0-a00b-345b478691f8","credit":"Apple","rights":"© Apple. Official documentation or publisher-distributed image; respective rights retained. Excluded from portal MIT and CC BY 4.0.","caption":"iOS Head Tracking: separate mappings for facial actions","alt":"iOS Head Tracking: separate mappings for facial actions","markers":[{"x":32,"y":42,"label":"Open Mouth can map to an action; this screenshot still shows None"}]},"tips":["Calibrate thresholds and distinguish intentional commands from blinking or speech."],"examples":[{"title":"Head Tracking (iOS)","url":"https://support.apple.com/guide/iphone/control-iphone-with-the-movement-of-your-head-iph9c3dc17cf/ios"}]}},"endsAt":null,"provenance":"Original editorial design catalog consolidated from project discussions on 2026-10-20. Complete discussion item lists and contextual limitations are preserved; linked primary sources support specific techniques, not the entire classification. English translation was prepared with machine assistance and editorial review.","license":"CC-BY-4.0","codeLicense":"MIT","attribution":"gamemechanics.pro contributors","catalogKey":"catalog/phone-camera"}}