--- key: mechanic/phone-camera--family-face-actions type: mechanic id: phone-camera--family-face-actions lang: en title: 'Eyes, mouth and facial actions' summary: >- A visible facial action becomes a command. iOS Head Tracking can map eyebrow raises or an open mouth to actions; facial shape does not prove emotion. updatedAt: '2026-10-22' status: active url: >- https://gamemechanics.pro/en/knowledge/mechanic/phone-camera--family-face-actions/ jsonUrl: >- https://gamemechanics.pro/api/v1/knowledge/en/mechanic/phone-camera--family-face-actions.json markdownUrl: >- https://gamemechanics.pro/content/knowledge/en/mechanic/phone-camera--family-face-actions.md aliases: [] tags: - Phone camera interactions - Mechanics catalog sourceIds: - source-17820b3f136aa433 - source-778351bee9d86030 sources: - id: source-17820b3f136aa433 title: MediaPipe Face Landmarker url: >- https://developers.google.com/edge/mediapipe/solutions/vision/face_landmarker verifiedAt: null - id: source-778351bee9d86030 title: Head Tracking (iOS) url: >- https://support.apple.com/guide/iphone/control-iphone-with-the-movement-of-your-head-iph9c3dc17cf/ios verifiedAt: null relations: [] placements: - catalogId: phone-camera id: family-face-actions title: Phone camera interactions url: 'https://gamemechanics.pro/en/mechanics/phone-camera/#family-face-actions' categoryIds: - section-1 supersededBy: [] attributes: preview: updatedAt: '2026-10-22' title: 'Eyes, mouth and facial actions' description: >- A visible facial action becomes a command. iOS Head Tracking can map eyebrow raises or an open mouth to actions; facial shape does not prove emotion. image: src: images/mechanics/camera-apple-head-tracking.webp width: 490 height: 1008 crop: x: 25 'y': 105 width: 440 height: 815 game: Head Tracking (iOS) sourceUrl: >- https://support.apple.com/guide/iphone/control-iphone-with-the-movement-of-your-head-iph9c3dc17cf/ios originalUrl: >- https://ipcdn-web.apple.com/assets/v2/web/e44793cc-1a1a-4ac0-a00b-345b478691f8 credit: Apple rights: >- © Apple. Official documentation or publisher-distributed image; respective rights retained. Excluded from portal MIT and CC BY 4.0. caption: 'iOS Head Tracking: separate mappings for facial actions' alt: 'iOS Head Tracking: separate mappings for facial actions' markers: - x: 32 'y': 42 label: Open Mouth can map to an action; this screenshot still shows None tips: - >- Calibrate thresholds and distinguish intentional commands from blinking or speech. examples: - title: Head Tracking (iOS) url: >- https://support.apple.com/guide/iphone/control-iphone-with-the-movement-of-your-head-iph9c3dc17cf/ios endsAt: null provenance: >- Original editorial design catalog consolidated from project discussions on 2026-10-20. Complete discussion item lists and contextual limitations are preserved; linked primary sources support specific techniques, not the entire classification. English translation was prepared with machine assistance and editorial review. license: CC-BY-4.0 codeLicense: MIT attribution: gamemechanics.pro contributors catalogKey: catalog/phone-camera --- # Eyes, mouth and facial actions id: phone-camera--family-face-actions type: mechanic key: mechanic/phone-camera--family-face-actions lang: en status: active url: https://gamemechanics.pro/en/knowledge/mechanic/phone-camera--family-face-actions/ A visible facial action becomes a command. iOS Head Tracking can map eyebrow raises or an open mouth to actions; facial shape does not prove emotion. ## At a glance ![iOS Head Tracking: separate mappings for facial actions](https://gamemechanics.pro/images/mechanics/camera-apple-head-tracking.webp) [Head Tracking (iOS)](https://support.apple.com/guide/iphone/control-iphone-with-the-movement-of-your-head-iph9c3dc17cf/ios) · © Apple. Official documentation or publisher-distributed image; respective rights retained. Excluded from portal MIT and CC BY 4.0. 1. Open Mouth can map to an action; this screenshot still shows None - Calibrate thresholds and distinguish intentional commands from blinking or speech. - [Head Tracking (iOS)](https://support.apple.com/guide/iphone/control-iphone-with-the-movement-of-your-head-iph9c3dc17cf/ios) ## How it works The game rule reacts to the visible action of a person. Need calibration and alternate input. The facial form does not prove emotion; blinking is involuntary. Accurate eye tracking with an RGB camera should not be promised. ## Variants ### Variants and applications - Blinking like a button. Action: Intentionally close and open your eyes to perform an action. Application: Shooting, jumping, experimental contactless input. Technologies: Recognition or machine learning model. - Wink. Action: Close left and right eyes separately for different commands. Application: Two-button game, hidden signals, side control. Technologies: Recognition or machine learning model. - Closed eyes. Action: Keep your eyes closed; the world changes over time or when opened. Application: Horror, memory game, audio-visual mystery. Technologies: Recognition or machine learning model. - Rough direction of view. Action: After calibration, distinguish several large directions of eye movement. Application: Choice of two zones, experiment on attention, character control. Technologies: Recognition or machine learning model; Experimental prototype. - Opening the mouth. Action: Change the degree of mouth opening as a continuous parameter. Application: Eating targets, vocal avatar without sound analysis, virtual instrument. Technologies: Recognition or machine learning model. - Smile and eyebrows. Action: Take a given mouth shape or raise eyebrows for a command. Application: Facial trainer, comic arcade, avatar control. Technologies: Recognition or machine learning model. - Repeat expression. Action: Reproduce the combination of facial movements shown. Application: Facial memory, acting, accuracy competition. Technologies: Recognition or machine learning model. - Mimic animation. Action: Transfer facial parameters to a digital character in real time. Application: Virtual theater, animation creation, video chat character. Technologies: Recognition or machine learning model. ## Context and limits Games, learning, creativity and interactive applications. Author's systematization of game rules based on proven technical capabilities. Examples are application ideas and not statements of released products. ## Connected materials ## Sources and provenance Original editorial design catalog consolidated from project discussions on 2026-10-20. Complete discussion item lists and contextual limitations are preserved; linked primary sources support specific techniques, not the entire classification. English translation was prepared with machine assistance and editorial review. - [MediaPipe Face Landmarker](https://developers.google.com/edge/mediapipe/solutions/vision/face_landmarker) (id: source-17820b3f136aa433) - [Head Tracking (iOS)](https://support.apple.com/guide/iphone/control-iphone-with-the-movement-of-your-head-iph9c3dc17cf/ios) (id: source-778351bee9d86030) CC-BY-4.0 · gamemechanics.pro contributors