--- key: mechanic/phone-microphone--family-music type: mechanic id: phone-microphone--family-music lang: en title: Musical performance summary: >- The phone receives singing or instrument sound and compares the performance with notes, rhythm or another participant’s part. updatedAt: '2026-10-22' status: active url: >- https://gamemechanics.pro/en/knowledge/mechanic/phone-microphone--family-music/ jsonUrl: >- https://gamemechanics.pro/api/v1/knowledge/en/mechanic/phone-microphone--family-music.json markdownUrl: >- https://gamemechanics.pro/content/knowledge/en/mechanic/phone-microphone--family-music.md aliases: [] tags: - Phone microphone interactions - Mechanics catalog sourceIds: - source-f8d1cacd47b7c58b - source-2a01d488bdebda56 - source-6fdde9fcfaa4c9d8 sources: - id: source-f8d1cacd47b7c58b title: 'Android: Audio Capture and Input Processing' url: 'https://developer.android.com/media/platform/mediarecorder' verifiedAt: null - id: source-2a01d488bdebda56 title: 'Google MediaPipe: Audio Classification' url: >- https://developers.google.com/edge/mediapipe/solutions/audio/audio_classifier verifiedAt: null - id: source-6fdde9fcfaa4c9d8 title: 'Simply Sing: My Singing App' url: 'https://apps.apple.com/us/app/simply-sing-my-singing-app/id1592900217?uo=4' verifiedAt: null relations: [] placements: - catalogId: phone-microphone id: family-music title: Phone microphone interactions url: 'https://gamemechanics.pro/en/mechanics/phone-microphone/#family-music' categoryIds: - section-1 supersededBy: [] attributes: preview: updatedAt: '2026-10-22' title: Musical performance description: >- The phone receives singing or instrument sound and compares the performance with notes, rhythm or another participant’s part. image: src: images/mechanics/sensor-simply-sing-0.webp width: 665 height: 1440 crop: x: 0 'y': 592 width: 665 height: 471 game: 'Simply Sing: My Singing App' sourceUrl: >- https://apps.apple.com/us/app/simply-sing-my-singing-app/id1592900217?uo=4 originalUrl: >- https://is1-ssl.mzstatic.com/image/thumb/PurpleSource211/v4/d3/18/5a/d3185ac5-d85f-6939-c048-38ade193b110/7.png/720x1560bb.jpg credit: Simply Ltd rights: >- © Simply Ltd. Developer-distributed App Store screenshot. All rights reserved; excluded from MIT and CC BY 4.0. caption: 'Simply Sing: notes and a voice trace during song performance' alt: 'Simply Sing: notes and a voice trace during song performance' markers: - x: 62 'y': 57 label: The target note and performance trace provide feedback tips: - Allow range and latency adjustment before evaluating a performance. examples: - title: 'Simply Sing: My Singing App' url: >- https://apps.apple.com/us/app/simply-sing-my-singing-app/id1592900217?uo=4 endsAt: null provenance: >- Original editorial design catalog consolidated from project discussions on 2026-10-20. Complete discussion item lists and contextual limitations are preserved; linked primary sources support specific techniques, not the entire classification. English translation was prepared with machine assistance and editorial review. license: CC-BY-4.0 codeLicense: MIT attribution: gamemechanics.pro contributors catalogKey: catalog/phone-microphone --- # Musical performance id: phone-microphone--family-music type: mechanic key: mechanic/phone-microphone--family-music lang: en status: active url: https://gamemechanics.pro/en/knowledge/mechanic/phone-microphone--family-music/ The phone receives singing or instrument sound and compares the performance with notes, rhythm or another participant’s part. ## At a glance ![Simply Sing: notes and a voice trace during song performance](https://gamemechanics.pro/images/mechanics/sensor-simply-sing-0.webp) [Simply Sing: My Singing App](https://apps.apple.com/us/app/simply-sing-my-singing-app/id1592900217?uo=4) · © Simply Ltd. Developer-distributed App Store screenshot. All rights reserved; excluded from MIT and CC BY 4.0. 1. The target note and performance trace provide feedback - Allow range and latency adjustment before evaluating a performance. - [Simply Sing: My Singing App](https://apps.apple.com/us/app/simply-sing-my-singing-app/id1592900217?uo=4) ## How it works Here the sound is assessed as performance: melody, rhythm, texture and coordination with other parts. ## Variants ### Variants and applications - Karaoke. Signal: Notes, durations and beginnings of phrases. Application: Sing a part and get a separate assessment of rhythm and pitch. Access level: Signal analysis. - Sing the tune. Signal: The similarity of the melody to the sample. Application: Open musical locks or search for a fictitious song by tune. Access level: Recognition. - Vocal percussion. Signal: Classes of percussive mouth sounds. Application: Play a drum part with a beatbox. Access level: Recognition. - A real tool. Signal: The notes or acoustic events of an instrument. Application: Use a guitar, flute or keys as a controller. Access level: Recognition. - Checking the system. Signal: The fundamental frequency of a single note. Application: Tuning virtual strings and learning to hear intervals. Access level: Signal analysis. - Harmonic compatibility. Signal: The note relative to the current chord. Application: Select suitable tones and complete accompaniment. Access level: Recognition. - Musical dialogue. Signal: Alternating question and answer with motives. Application: Answer the creature with a musical phrase and develop the motive. Access level: Recognition. - Execution drawing. Signal: A combination of rhythm, dynamics and articulation. Application: Different executions of one phrase can create different effects. Access level: Recognition. ## Context and limits Author's design map for mobile games and interactive applications. 144 techniques in 18 groups, including basic signals, rules and combinations. Applications are design ideas and not a list of released games. ## Connected materials ## Sources and provenance Original editorial design catalog consolidated from project discussions on 2026-10-20. Complete discussion item lists and contextual limitations are preserved; linked primary sources support specific techniques, not the entire classification. English translation was prepared with machine assistance and editorial review. - [Android: Audio Capture and Input Processing](https://developer.android.com/media/platform/mediarecorder) (id: source-f8d1cacd47b7c58b) - [Google MediaPipe: Audio Classification](https://developers.google.com/edge/mediapipe/solutions/audio/audio_classifier) (id: source-2a01d488bdebda56) - [Simply Sing: My Singing App](https://apps.apple.com/us/app/simply-sing-my-singing-app/id1592900217?uo=4) (id: source-6fdde9fcfaa4c9d8) CC-BY-4.0 · gamemechanics.pro contributors