{"schemaVersion":1,"record":{"key":"mechanic/phone-microphone--family-music","type":"mechanic","id":"phone-microphone--family-music","lang":"en","title":"Musical performance","summary":"The phone receives singing or instrument sound and compares the performance with notes, rhythm or another participant’s part.","updatedAt":"2026-10-22","status":"active","url":"https://gamemechanics.pro/en/knowledge/mechanic/phone-microphone--family-music/","jsonUrl":"https://gamemechanics.pro/api/v1/knowledge/en/mechanic/phone-microphone--family-music.json","markdownUrl":"https://gamemechanics.pro/content/knowledge/en/mechanic/phone-microphone--family-music.md","aliases":[],"tags":["Phone microphone interactions","Mechanics catalog"],"sourceIds":["source-f8d1cacd47b7c58b","source-2a01d488bdebda56","source-6fdde9fcfaa4c9d8"],"sources":[{"id":"source-f8d1cacd47b7c58b","title":"Android: Audio Capture and Input Processing","url":"https://developer.android.com/media/platform/mediarecorder","verifiedAt":null},{"id":"source-2a01d488bdebda56","title":"Google MediaPipe: Audio Classification","url":"https://developers.google.com/edge/mediapipe/solutions/audio/audio_classifier","verifiedAt":null},{"id":"source-6fdde9fcfaa4c9d8","title":"Simply Sing: My Singing App","url":"https://apps.apple.com/us/app/simply-sing-my-singing-app/id1592900217?uo=4","verifiedAt":null}],"sections":[{"id":"principle","title":"How it works","body":"Here the sound is assessed as performance: melody, rhythm, texture and coordination with other parts."},{"id":"variants","title":"Variants","body":"### Variants and applications\n\n<a id=\"family-music-variants\"></a>\n\n- Karaoke. Signal: Notes, durations and beginnings of phrases. Application: Sing a part and get a separate assessment of rhythm and pitch. Access level: Signal analysis. <a id=\"variant-mic-057\"></a>\n- Sing the tune. Signal: The similarity of the melody to the sample. Application: Open musical locks or search for a fictitious song by tune. Access level: Recognition. <a id=\"variant-mic-058\"></a>\n- Vocal percussion. Signal: Classes of percussive mouth sounds. Application: Play a drum part with a beatbox. Access level: Recognition. <a id=\"variant-mic-059\"></a>\n- A real tool. Signal: The notes or acoustic events of an instrument. Application: Use a guitar, flute or keys as a controller. Access level: Recognition. <a id=\"variant-mic-060\"></a>\n- Checking the system. Signal: The fundamental frequency of a single note. Application: Tuning virtual strings and learning to hear intervals. Access level: Signal analysis. <a id=\"variant-mic-061\"></a>\n- Harmonic compatibility. Signal: The note relative to the current chord. Application: Select suitable tones and complete accompaniment. Access level: Recognition. <a id=\"variant-mic-062\"></a>\n- Musical dialogue. Signal: Alternating question and answer with motives. Application: Answer the creature with a musical phrase and develop the motive. Access level: Recognition. <a id=\"variant-mic-063\"></a>\n- Execution drawing. Signal: A combination of rhythm, dynamics and articulation. Application: Different executions of one phrase can create different effects. Access level: Recognition. <a id=\"variant-mic-064\"></a>"},{"id":"context","title":"Context and limits","body":"Author's design map for mobile games and interactive applications. 144 techniques in 18 groups, including basic signals, rules and combinations. Applications are design ideas and not a list of released games."}],"relations":[],"placements":[{"catalogId":"phone-microphone","id":"family-music","title":"Phone microphone interactions","url":"https://gamemechanics.pro/en/mechanics/phone-microphone/#family-music","categoryIds":["section-1"]}],"supersededBy":[],"attributes":{"preview":{"updatedAt":"2026-10-22","title":"Musical performance","description":"The phone receives singing or instrument sound and compares the performance with notes, rhythm or another participant’s part.","image":{"src":"images/mechanics/sensor-simply-sing-0.webp","width":665,"height":1440,"crop":{"x":0,"y":592,"width":665,"height":471},"game":"Simply Sing: My Singing App","sourceUrl":"https://apps.apple.com/us/app/simply-sing-my-singing-app/id1592900217?uo=4","originalUrl":"https://is1-ssl.mzstatic.com/image/thumb/PurpleSource211/v4/d3/18/5a/d3185ac5-d85f-6939-c048-38ade193b110/7.png/720x1560bb.jpg","credit":"Simply Ltd","rights":"© Simply Ltd. Developer-distributed App Store screenshot. All rights reserved; excluded from MIT and CC BY 4.0.","caption":"Simply Sing: notes and a voice trace during song performance","alt":"Simply Sing: notes and a voice trace during song performance","markers":[{"x":62,"y":57,"label":"The target note and performance trace provide feedback"}]},"tips":["Allow range and latency adjustment before evaluating a performance."],"examples":[{"title":"Simply Sing: My Singing App","url":"https://apps.apple.com/us/app/simply-sing-my-singing-app/id1592900217?uo=4"}]}},"endsAt":null,"provenance":"Original editorial design catalog consolidated from project discussions on 2026-10-20. Complete discussion item lists and contextual limitations are preserved; linked primary sources support specific techniques, not the entire classification. English translation was prepared with machine assistance and editorial review.","license":"CC-BY-4.0","codeLicense":"MIT","attribution":"gamemechanics.pro contributors","catalogKey":"catalog/phone-microphone"}}