---
key: mechanic/phone-microphone--family-body-objects
type: mechanic
id: phone-microphone--family-body-objects
lang: en
title: Sounds of the body and objects
summary: >-
Claps, clicks or taps can become game input. Event recognition uses temporal
and spectral sound features.
updatedAt: '2026-10-22'
status: active
url: >-
https://gamemechanics.pro/en/knowledge/mechanic/phone-microphone--family-body-objects/
jsonUrl: >-
https://gamemechanics.pro/api/v1/knowledge/en/mechanic/phone-microphone--family-body-objects.json
markdownUrl: >-
https://gamemechanics.pro/content/knowledge/en/mechanic/phone-microphone--family-body-objects.md
aliases:
- Body and object sounds
tags:
- Phone microphone interactions
- Mechanics catalog
sourceIds:
- source-2a01d488bdebda56
- source-bdbe910fe2426deb
sources:
- id: source-2a01d488bdebda56
title: 'Google MediaPipe: Audio Classification'
url: >-
https://developers.google.com/edge/mediapipe/solutions/audio/audio_classifier
verifiedAt: null
- id: source-bdbe910fe2426deb
title: phyphox
url: 'https://apps.apple.com/us/app/phyphox/id1127319693?uo=4'
verifiedAt: null
relations: []
placements:
- catalogId: phone-microphone
id: family-body-objects
title: Phone microphone interactions
url: >-
https://gamemechanics.pro/en/mechanics/phone-microphone/#family-body-objects
categoryIds:
- section-1
supersededBy: []
attributes:
preview:
updatedAt: '2026-10-22'
title: Body and object sounds
description: >-
Claps, clicks or taps can become game input. Event recognition uses
temporal and spectral sound features.
image:
src: images/mechanics/sensor-phyphox-3.webp
width: 663
height: 1440
crop:
x: 0
'y': 88
width: 663
height: 867
game: phyphox
sourceUrl: 'https://apps.apple.com/us/app/phyphox/id1127319693?uo=4'
originalUrl: >-
https://is1-ssl.mzstatic.com/image/thumb/PurpleSource221/v4/97/4c/8c/974c8c83-6b57-a61d-6f00-26079b8534e6/iphone-04-audio-spectrum.png/720x1560bb.jpg
credit: RWTH Aachen University
rights: >-
© RWTH Aachen University. Developer-distributed App Store screenshot.
All rights reserved; excluded from MIT and CC BY 4.0.
caption: 'phyphox: a spectrum shows the sound’s frequency structure over time'
alt: 'phyphox: a spectrum shows the sound’s frequency structure over time'
markers:
- x: 52
'y': 43
label: Bands represent energy distributed across frequencies
tips:
- Distinguish event recognition from merely crossing a loudness threshold.
examples:
- title: phyphox
url: 'https://apps.apple.com/us/app/phyphox/id1127319693?uo=4'
endsAt: null
provenance: >-
Original editorial design catalog consolidated from project discussions on
2026-10-20. Complete discussion item lists and contextual limitations are
preserved; linked primary sources support specific techniques, not the entire
classification. English translation was prepared with machine assistance and
editorial review.
license: CC-BY-4.0
codeLicense: MIT
attribution: gamemechanics.pro contributors
catalogKey: catalog/phone-microphone
---
# Sounds of the body and objects
id: phone-microphone--family-body-objects
type: mechanic
key: mechanic/phone-microphone--family-body-objects
lang: en
status: active
url: https://gamemechanics.pro/en/knowledge/mechanic/phone-microphone--family-body-objects/
Claps, clicks or taps can become game input. Event recognition uses temporal and spectral sound features.
## At a glance
[phyphox](https://apps.apple.com/us/app/phyphox/id1127319693?uo=4) · © RWTH Aachen University. Developer-distributed App Store screenshot. All rights reserved; excluded from MIT and CC BY 4.0.
1. Bands represent energy distributed across frequencies
- Distinguish event recognition from merely crossing a loudness threshold.
- [phyphox](https://apps.apple.com/us/app/phyphox/id1127319693?uo=4)
## How it works
The microphone receives the acoustic result of the action. He does not always determine what particular gesture or object caused it.
## Variants
### Variants and applications
- Palm clapping. Signal: Sharp characteristic impulse. Application: Control the jump, beat the rhythm, start the round. Access level: Recognition.
- Finger snapping. Signal: Short high frequency pulse. Application: Shoot, switch modes, collect a musical chain. Access level: Recognition.
- Clicking tongue and lips. Signal: A set of mouth sounds. Application: Give quiet commands or play a character without words. Access level: Recognition.
- Knocking on the table. Signal: The time and nature of the blows. Application: Use the table as a drum or enter a code. Access level: Signal analysis.
- Steps and stomps. Signal: Repeated beats and their pattern. Application: March to the rhythm; actual steps if necessary to confirm the IMU. Access level: Recognition.
- Rustling and friction. Signal: Continuous noise pattern. Application: Awaken a creature with the rustle of paper or draw a sound texture. Access level: Recognition.
- Ringing and clicking of objects. Signal: The sound class of a real object. Application: Use a bunch of keys, a bell or a cap as a playing tool. Access level: Recognition.
- Transfer and bulk materials. Signal: The characteristic sound of the process. Application: Collect acoustic ingredients or voice an alchemical recipe. Access level: Recognition.
## Context and limits
Author's design map for mobile games and interactive applications. 144 techniques in 18 groups, including basic signals, rules and combinations. Applications are design ideas and not a list of released games.
## Connected materials
## Sources and provenance
Original editorial design catalog consolidated from project discussions on 2026-10-20. Complete discussion item lists and contextual limitations are preserved; linked primary sources support specific techniques, not the entire classification. English translation was prepared with machine assistance and editorial review.
- [Google MediaPipe: Audio Classification](https://developers.google.com/edge/mediapipe/solutions/audio/audio_classifier) (id: source-2a01d488bdebda56)
- [phyphox](https://apps.apple.com/us/app/phyphox/id1127319693?uo=4) (id: source-bdbe910fe2426deb)
CC-BY-4.0 · gamemechanics.pro contributors