{"schemaVersion":1,"record":{"key":"mechanic/phone-microphone--family-body-objects","type":"mechanic","id":"phone-microphone--family-body-objects","lang":"en","title":"Sounds of the body and objects","summary":"Claps, clicks or taps can become game input. Event recognition uses temporal and spectral sound features.","updatedAt":"2026-10-22","status":"active","url":"https://gamemechanics.pro/en/knowledge/mechanic/phone-microphone--family-body-objects/","jsonUrl":"https://gamemechanics.pro/api/v1/knowledge/en/mechanic/phone-microphone--family-body-objects.json","markdownUrl":"https://gamemechanics.pro/content/knowledge/en/mechanic/phone-microphone--family-body-objects.md","aliases":["Body and object sounds"],"tags":["Phone microphone interactions","Mechanics catalog"],"sourceIds":["source-2a01d488bdebda56","source-bdbe910fe2426deb"],"sources":[{"id":"source-2a01d488bdebda56","title":"Google MediaPipe: Audio Classification","url":"https://developers.google.com/edge/mediapipe/solutions/audio/audio_classifier","verifiedAt":null},{"id":"source-bdbe910fe2426deb","title":"phyphox","url":"https://apps.apple.com/us/app/phyphox/id1127319693?uo=4","verifiedAt":null}],"sections":[{"id":"principle","title":"How it works","body":"The microphone receives the acoustic result of the action. He does not always determine what particular gesture or object caused it."},{"id":"variants","title":"Variants","body":"### Variants and applications\n\n<a id=\"family-body-objects-variants\"></a>\n\n- Palm clapping. Signal: Sharp characteristic impulse. Application: Control the jump, beat the rhythm, start the round. Access level: Recognition. <a id=\"variant-mic-065\"></a>\n- Finger snapping. Signal: Short high frequency pulse. Application: Shoot, switch modes, collect a musical chain. Access level: Recognition. <a id=\"variant-mic-066\"></a>\n- Clicking tongue and lips. Signal: A set of mouth sounds. Application: Give quiet commands or play a character without words. Access level: Recognition. <a id=\"variant-mic-067\"></a>\n- Knocking on the table. Signal: The time and nature of the blows. Application: Use the table as a drum or enter a code. Access level: Signal analysis. <a id=\"variant-mic-068\"></a>\n- Steps and stomps. Signal: Repeated beats and their pattern. Application: March to the rhythm; actual steps if necessary to confirm the IMU. Access level: Recognition. <a id=\"variant-mic-069\"></a>\n- Rustling and friction. Signal: Continuous noise pattern. Application: Awaken a creature with the rustle of paper or draw a sound texture. Access level: Recognition. <a id=\"variant-mic-070\"></a>\n- Ringing and clicking of objects. Signal: The sound class of a real object. Application: Use a bunch of keys, a bell or a cap as a playing tool. Access level: Recognition. <a id=\"variant-mic-071\"></a>\n- Transfer and bulk materials. Signal: The characteristic sound of the process. Application: Collect acoustic ingredients or voice an alchemical recipe. Access level: Recognition. <a id=\"variant-mic-072\"></a>"},{"id":"context","title":"Context and limits","body":"Author's design map for mobile games and interactive applications. 144 techniques in 18 groups, including basic signals, rules and combinations. Applications are design ideas and not a list of released games."}],"relations":[],"placements":[{"catalogId":"phone-microphone","id":"family-body-objects","title":"Phone microphone interactions","url":"https://gamemechanics.pro/en/mechanics/phone-microphone/#family-body-objects","categoryIds":["section-1"]}],"supersededBy":[],"attributes":{"preview":{"updatedAt":"2026-10-22","title":"Body and object sounds","description":"Claps, clicks or taps can become game input. Event recognition uses temporal and spectral sound features.","image":{"src":"images/mechanics/sensor-phyphox-3.webp","width":663,"height":1440,"crop":{"x":0,"y":88,"width":663,"height":867},"game":"phyphox","sourceUrl":"https://apps.apple.com/us/app/phyphox/id1127319693?uo=4","originalUrl":"https://is1-ssl.mzstatic.com/image/thumb/PurpleSource221/v4/97/4c/8c/974c8c83-6b57-a61d-6f00-26079b8534e6/iphone-04-audio-spectrum.png/720x1560bb.jpg","credit":"RWTH Aachen University","rights":"© RWTH Aachen University. Developer-distributed App Store screenshot. All rights reserved; excluded from MIT and CC BY 4.0.","caption":"phyphox: a spectrum shows the sound’s frequency structure over time","alt":"phyphox: a spectrum shows the sound’s frequency structure over time","markers":[{"x":52,"y":43,"label":"Bands represent energy distributed across frequencies"}]},"tips":["Distinguish event recognition from merely crossing a loudness threshold."],"examples":[{"title":"phyphox","url":"https://apps.apple.com/us/app/phyphox/id1127319693?uo=4"}]}},"endsAt":null,"provenance":"Original editorial design catalog consolidated from project discussions on 2026-10-20. Complete discussion item lists and contextual limitations are preserved; linked primary sources support specific techniques, not the entire classification. English translation was prepared with machine assistance and editorial review.","license":"CC-BY-4.0","codeLicense":"MIT","attribution":"gamemechanics.pro contributors","catalogKey":"catalog/phone-microphone"}}