Voice and sound
A working design-space map: 27 families, 81 branches and 324 variants. Voice control, audio-based play and communication can combine or exist separately. Released-game examples support particular techniques; supplementary combinations are design proposals.
No matches
Change your query or reset the filters.
Speech as meaning
1Direct voice commandsOverview and example ↗Specify an action, select a target and check the result.12
Character actions
- Movement: walk, run, turn, stop.
- Interaction: open, take, inspect, activate.
- Items: select, use, transfer, combine.
- Abilities: attack, defend, heal, switch modes.
Selection and addressing
- Name a particular character or object.
- Select a target by a property: nearest, red, damaged.
- Assign custom names and spoken aliases.
- Specify relationships: behind the door, left of the tower, near an ally.
Compound commands
- Clarify, correct or cancel an existing order.
- Combine actions into a sequence.
- Specify a conditional action: hide if an enemy appears.
- Specify an exception: everyone except the scout.
2Dialogue with game charactersOverview and example ↗Choose a line or question to obtain information or consequences.12
Obtaining information
- Ask about objects, events and characters.
- Request clarification, an example or an explanation.
- Present evidence and ask about a contradiction.
- Check what someone knows, remembers or conceals.
Response format
- Speak one of the offered responses.
- Select a topic or keyword.
- Ask within a known set of intentions.
- Formulate a free response interpreted against the game state.
Conversation control
- Choose when to enter a conversation.
- Interrupt, continue, change topic or end a conversation.
- Obtain an answer through a chain of questions.
- Revisit a previous line and use a promise or admission.
3Command and delegationOverview and example ↗Give other agents goals and coordinate their actions.12
Managing actors
- Assign roles and tasks to squad members.
- Control groups or several groups simultaneously.
- Delegate an outcome while leaving execution to a character.
- Choose a priority: survive, hold a point, rescue an ally.
Coordination
- Prepare actions and trigger them with a shared command.
- Coordinate attacks, distractions, retreats and reinforcements.
- Specify formation, route, patrol area or observation sector.
- Transfer control to another actor or commander.
Indirect control
- Guide a character by radio using complementary information.
- Receive reports and revise the plan.
- Resolve misunderstood or incomplete orders.
- Manage autonomous actors with different knowledge and skills.
4Verbal and language puzzlesOverview and example ↗Find an utterance satisfying a linguistic or logical rule.12
Finding a word or answer
- Answer a riddle or quiz question.
- Name a word from a definition, description or association.
- Continue a word chain, category or sequence.
- Guess a word through questions and answer constraints.
Speech constraints
- Explain a concept without forbidden words.
- Form a phrase with required words, rhyme or length.
- Follow rules about letters, syllables or word order.
- Say a tongue twister or distinguish similar-sounding words.
Discovering a language
- Find a password, spell or sequence of code phrases.
- Infer fictional words' meanings from context.
- Assemble formula fragments into a working expression.
- Interpret an ambiguous line or wordplay correctly.
5Negotiation, persuasion and deceptionOverview and example ↗Influence a decision using the other person's goals and available evidence.12
Influence
- Match an argument to a character's interests.
- Offer a deal, exchange or concession.
- Set a condition, threaten or establish a boundary.
- Reassure, support or gain trust.
Hidden information
- Bluff with incomplete or invented information.
- Choose what to reveal and withhold.
- Maintain a cover story consistent with previous responses.
- Detect contradictions in what someone says.
Relationship dynamics
- Build trust or damage reputation through decisions.
- Make a promise with delayed consequences.
- Bargain over several rounds.
- Mediate between characters with incompatible goals.
Hearing as perception
6Sound-source localization and trackingOverview and example ↗Determine where sound comes from and how its source moves.12
Position
- Distinguish left, right, front and rear sources.
- Estimate approach and retreat through changing sound.
- Distinguish near and distant sources through specified acoustic cues.
- Determine height with suitable spatial audio.
Movement
- Track a moving source.
- Predict a trajectory from a sound sequence.
- Distinguish source movement from one's own movement.
- Catch the moment an object crosses a target zone.
Multiple sources
- Separate simultaneously sounding objects.
- Select the nearest or most dangerous target.
- Match a source to its voice or sound signature.
- Locate a source from several listening positions.
7Navigation and spatial memoryOverview and example ↗Build a spatial model and guide oneself or another character to a goal.12
Landmarks
- Move toward an audio beacon.
- Follow a guide's voice or moving sound source.
- Recognize places by characteristic soundscapes.
- Track a fictional trail represented by changing sound.
Routes
- Navigate a maze while remembering junctions.
- Bypass an obstacle through changing landmark audibility.
- Choose a safe route among several sounding paths.
- Retrace a route without a continuous guide.
Mental map
- Connect rooms into an overall layout.
- Remember objects' relative positions.
- Navigate by steps, turns and surface changes.
- Revise a route after landmarks move or passages close.
8Recognizing objects and statesOverview and example ↗Identify an object, action or state through sound.12
Identification
- Recognize a person by voice.
- Recognize enemies, animals, objects or tools by sound signature.
- Identify material or surface through interaction sounds.
- Identify a song, melody or musical instrument.
State
- Assess a mechanism's condition through its operating sound.
- Hear threat, health or resource changes through a designed cue.
- Distinguish preparation, execution and completion.
- Find an object sounding different from the others.
Classification
- Select a countermeasure for the sounding threat type.
- Group sounds by a common property.
- Detect a new or unfamiliar sound.
- Infer a mapping between sound and game properties.
9Reaction, timing and predictionOverview and example ↗Recognize a cue and perform the appropriate action at the right time.12
Action windows
- Attack, block or parry after an audio warning.
- Dodge an approaching danger.
- Jump, stop or change lanes on cue.
- Press a button or speak within a short time window.
Waiting
- Wait for the right phase of a repeating mechanism.
- Continue counting after an audible beat disappears.
- Predict collision time from an intensifying sound.
- Act between noisy events or during a pause.
Selecting a reaction
- Respond to one cue and ignore another.
- Select an action from combined warning sounds.
- Suppress an early response to a false cue.
- Switch response rules when the game phase changes.
10Selective attention and stream separationOverview and example ↗Select the important sound stream among competing sources.12
Focus
- Follow one voice among several speakers.
- Extract a target sound from background noise.
- Follow one instrument within music.
- Hear a rare event in a long repeating stream.
Attention switching
- Switch channels, rooms or radio frequencies.
- Listen to reconnaissance while responding to nearby threats.
- Choose whose report to process first.
- Notice background changes while doing another task.
Comparing streams
- Compare two simultaneous sequences.
- Find inconsistency between speech and surrounding events.
- Identify a source masking a useful signal.
- Divide listening to multiple streams among participants.
11Auditory memory and sequence transformationOverview and example ↗Remember material and reproduce or transform it under a rule.12
Memory
- Repeat tones, words, noises or directions.
- Reproduce a growing sequence.
- Remember sound pairs and find matches.
- Retain instructions until they can be used.
Transformation
- Repeat a sequence in reverse.
- Sort heard elements by a property.
- Reproduce only elements of a selected category.
- Shift rhythm, transpose pitch or replace elements under a rule.
Changes and omissions
- Find a missing sound or word.
- Identify an element changed between listens.
- Continue a sequence using an inferred rule.
- Restore a sequence from fragments heard at different times.
Voice as physical action
12Loudness and sound intensityOverview and example ↗Control sound level to produce the intended action.12
Thresholds and switching
- Trigger an action with a brief loud impulse.
- Switch between whispering, normal speech and a loud voice.
- Cross several thresholds in the required order.
- Use sufficient loudness while limiting resource use or risk.
Feedback
- Adjust the voice to a moving sound target.
- Compensate for changing sensitivity within game rules.
- Separate quiet movement from a loud active action.
- Coordinate several participants' loudness for a shared result.
Continuous control
- Change action speed or strength through loudness.
- Keep loudness within a target range.
- Gradually increase or decrease sound intensity.
- Balance an object by maintaining a target sound level.
13Duration, tempo and pausesOverview and example ↗Control sound onset, duration and the gaps between sounds.12
Duration
- Sustain sound to charge or maintain an effect.
- Distinguish short and long impulses.
- Stop a sound at a precise moment.
- Accumulate a total duration across several sounds.
Rhythmic patterns
- Repeat a sequence of sounds and pauses.
- Speak syllables or produce impulses in a target rhythm.
- Speed up or slow down under a condition.
- Perform syncopation, polyrhythm or alternating strong and weak beats.
Speech timing
- Fit a phrase within a time window.
- Choose the right moment to speak a command.
- Wait for another line or sound cue to finish.
- Include a pause of a required length in a combination.
14Pitch and melodic contourOverview and example ↗Reach a target pitch or move the voice along a specified contour.12
Pitch control
- Select an action with a high or low tone.
- Move an object continuously through vocal pitch.
- Match a note or interval.
- Hold a steady tone for a specified duration.
Pitch changes
- Raise or lower pitch along a contour.
- Repeat a pitch sequence.
- Jump between several target tones.
- Repeat a melodic contour in a comfortable vocal range.
Pitch relationships
- Match a sounding reference.
- Find consonance or a required difference with another voice.
- Alternate pitches as code symbols.
- Control one parameter through pitch and another through loudness.
15Nonverbal sounds and microphone actionsOverview and example ↗Use the microphone to detect sound events.12
Mouth and breath sounds
- Blow into the microphone to create a brief impulse.
- Produce an audible exhalation or hiss.
- Hum without words or click the tongue.
- Whistle as a signal or combination element.
Body and object sounds
- Clap under a specified condition.
- Tap a surface in a specified rhythm.
- Use an instrument or object as a game sound source.
- Assemble a sequence of different noises.
Sound and silence
- Stay silent until a signal appears.
- Alternate audible sound and absence of sound.
- Keep total noise below a game threshold.
- Let the device hear a required real-world event.
16Timbre, articulation and imitationOverview and example ↗Reproduce a recognizable sound pattern.12
Phonetics
- Produce a required vowel, consonant or syllable.
- Distinguish close phonemes and select the corresponding action.
- Emphasize stress or an articulatory accent.
- Change vocal shape while keeping pitch steady.
Imitation
- Imitate an animal, machine or instrument.
- Imitate a fictional character's voice using specified properties.
- Reproduce laughter, growling, whistling or another recognizable signal.
- Make a sound another player must identify.
Performance style
- Read a line with a specified fictional mood.
- Alternate voiced, whispered and sung delivery.
- Maintain an acoustic disguise through range, rhythm and timbre.
- Choose delivery style as a separate game parameter.
17Singing and musical performanceOverview and example ↗Perform music with specified pitch and timing relationships.12
Repetition
- Sing notes or a melody from a model.
- Match pitch, rhythm and phrase endings.
- Continue a melody after the guide disappears.
- Repeat a musical phrase in call-and-response form.
Joint performance
- Sing in unison with a character or player.
- Add a second voice and maintain harmony.
- Enter a part at the right moment.
- Divide melody, bass and rhythmic foundation among participants.
Creating music
- Improvise within a musical rule.
- Compose a motif suited to the task.
- Build vocal loops and layer parts.
- Change performance in response to the game world.
Sound as information and material
18Recording, editing and playbackOverview and example ↗Collect or transform sound to serve a game function.12
Collecting material
- Record the required sound at the right moment.
- Collect voices, noises or musical phrases.
- Select a fragment from a long recording.
- Obtain a recording from a specified position or distance.
Editing
- Put fragments in the required order.
- Loop a sound or assemble loops.
- Layer tracks and synchronize them.
- Change a recording's pitch, speed, loudness or spectrum.
Using recordings
- Play a recording as a lure or distraction.
- Open a sound lock with a recording.
- Present a recording as evidence or a message.
- Create a sound scene a character or player must recognize.
19Stealth, lures and noise controlOverview and example ↗Manage audibility to gather information, evade detection or influence opponents.12
Player audibility
- Choose a quiet surface or movement method.
- Move while an environmental event masks one's own noise.
- Stay silent as a threat approaches.
- Trade speed for reduced audibility.
Opponent behavior
- Throw or activate a sounding lure.
- Draw an opponent out of an area with sound.
- Imitate a signal the opponent considers safe or familiar.
- Create several sources to confuse a search.
Information and risk
- Reveal oneself through sound to scout.
- Choose signal range according to detection risk.
- Conceal conversation from listening enemies.
- Recognize sound lures used by an opponent.
20Echolocation and world acousticsOverview and example ↗Produce or direct sound to obtain information or an effect through propagation.12
Active probing
- Send a sound pulse and study the response.
- Choose frequent weak or rare strong pulses.
- Estimate spatial shape from reflections.
- Detect an object responding only to a particular signal.
Propagation
- Open or close a passage to change source audibility.
- Position reflectors or absorbers to direct a signal.
- Bypass an acoustic shadow or find a transmission path.
- Choose a position with the required direct sound and reflections.
Effects
- Activate a resonator with a suitable frequency.
- Coordinate sources for amplification or designed cancellation.
- Trigger a mechanism chain through sound transmission.
- Change the environment and observe its altered response.
21Investigation and event reconstructionOverview and example ↗Compare audible evidence and reconstruct causal relationships.12
Observation
- Eavesdrop at the right place and time.
- Compare different speakers' lines.
- Identify a speaker, place or action through background acoustics.
- Distinguish testimony, retelling and a character's conjecture.
Reconstructing events
- Establish action order from sound traces.
- Connect simultaneously unfolding scenes.
- Match names, voices, roles and movements.
- Reconstruct causality between a conversation and a later event.
Testing hypotheses
- Find contradictions in testimony or alibis.
- Distinguish a recording, broadcast and live event.
- Check whether a character could hear a conversation.
- Choose the next listen that best distinguishes hypotheses.
22Codes, ciphers and hidden messagesOverview and example ↗Discover an encoding rule and extract a message.12
Symbolic codes
- Decode short and long impulses.
- Read a message encoded in pitches or rhythmic figures.
- Map sounds to letters, numbers, directions or actions.
- Infer an unfamiliar sound alphabet.
Hidden information
- Find a message in background noise.
- Isolate a part among layered tracks.
- Detect a message in repetitions, accents or pauses.
- Distinguish a real signal from a similar counterfeit.
Decoding transformations
- Change playback speed to understand a message.
- Play a fragment backward.
- Select a frequency, filter or listening channel.
- Combine message fragments from different sources.
23Music as world rulesOverview and example ↗Change musical relationships to change the game space.12
Musical locks
- Open a path with the right melody.
- Find a harmony that activates an object.
- Reproduce a mechanism's rhythm.
- Recognize a motif and use it in the right place.
World transformation
- Change the environment through a musical part.
- Add or mute instruments to enable different options.
- Switch world modes through tempo, mode or motif.
- Connect musical objects into a working system.
Actions in music
- Attack, move or build on a musical grid.
- Coordinate actions with a changing score.
- Improvise an action sequence that creates music.
- Manage musical tension as a game resource.
How games convey information through sound
These methods represent data and feedback. The same method can support different game actions.
Meaningful object sounds
Use footsteps, mechanisms, water or ringing objects. Give objects sound signatures and change their sound with state.
Spoken descriptions
Directly describe positions, events or states. Use in-world reports, dialogue or audio drama containing game information.
Designed audio symbols
Use brief event cues, sets identifying object or threat types, or a learned sound alphabet.
Spatial representation
Use stereo or spatial sources for direction. Change audibility for movement and barriers. Distribute sources to represent scenes or maps.
Continuous sonification
Map pitch to numbers or position; pulse rate to distance, speed or goal proximity; and timbre, loudness or density to parameters.
Contrast and silence
Missing expected cues indicate change. Pauses mark action windows or sequence boundaries. Inconsistency between speech and background events provides evidence.
Information on request
Listen to objects or request summaries. Switch listening position or channel. Probe actively and interpret the response.
Musical representation
Identify characters, places or objects with motifs. Use parts and harmony for system state and musical transitions for phase changes.
Parameters that create variations
Combine these parameters with any family. Selecting a parameter value alone does not constitute an independent mechanic.
Role of sound
Sole perception channel; primary channel with graphics; local mechanic within a visual game; human communication without computer recognition.
Input method
Speech meaning; acoustic voice or noise properties; buttons and gestures with audio feedback; combined voice, controller and spatial sensors.
Information availability
Everything audible immediately; information revealed on request or movement; hidden or outdated information; complementary information across participants.
Time
Turn-based actions; real time; bounded response windows; delayed execution or asynchronous messages.
Evaluation
Solution correctness or speech content; pitch, rhythm, loudness or sound-shape accuracy; timing, efficiency and resources; coordination, clarity or group decisions.
Action cost
Game resources; detection risk; channel or attention occupation; irreversible relationship or world changes.
Information reliability
Unambiguous signals; ambiguous or incomplete signals; mistaken sources; intentional deception within the game.
Skill progression
Longer and more complex sequences; new signals, words and rules; fewer hints and greater independence; combinations of mastered mechanics.
Participants
Solo player; player and system-controlled interlocutor; cooperative group; opponents or teams.
Task variation
Authored situations; procedural signals and objects; adaptation to measurable performance; generated dialogue bounded by state and rules.
Familiar game loops in audio form
These are conventional game loops adapted to voice or audio interfaces. They complement the core mechanics rather than define separate sound input methods.
Adventure and exploration
Explore locations, find items and open passages. Collect inventory and use items on objects. Revisit places after obtaining knowledge or abilities.
Quizzes and party games
Answer in turns or against time. Guess words, music, scenes and sound sources. Explain or perform tasks for others.
Card and board games
Receive private hands or roles through personal audio. Announce moves, wagers, exchanges or votes. Track shared state through short spoken updates.
Narrative and roleplaying campaigns
Make choices with delayed effects. Develop relationships and reputation. Play a story alone, with a facilitator or in a group.
Turn-based tactics and RPGs
Select targets and abilities through speech or audio menus. Assess position, initiative and state through reports and cues. Assemble squads, equipment and ability combinations.
Strategy and management
Allocate resources, production and actors. Receive event reports and prioritize. Plan development and respond to threats in several places.
Simulations and professions
Diagnose equipment faults by sound. Handle dispatcher, operator or rescue calls. Control transport, production or services through instrument cues.
Survival and development
Plan limited resources, routes and risks. Collect, craft and exchange items. Learn new sound cues, commands and navigation methods.
16 mechanic combinations
Design proposals. These titles name concepts rather than released games.
Scout in darkness
Localization + echolocation + stealth: pulses reveal a map but expose position to enemies.
Blind navigator
Audio landmarks + route memory + changing world: travel a route and return after beacons disappear.
Acoustic detective
Listening + voice recognition + chronology: reconstruct events from parallel conversations.
Duet with divided information
Musical performance + cooperation: each participant knows only their part and part of the rule.
Rescue dispatcher
Command + limited radio + incomplete reports: decide whom to send, answer and double-check.
Sound lockpicker
Recording + editing + sound locks: assemble a suitable signal from discovered fragments.
Magical language
Vocabulary discovery + spoken formulas + musical relationships: infer a language and apply it to mechanisms.
Hunting sound counterfeits
Recognition + lures + memory: detect inconsistencies in an opponent's familiar-sound imitations.
Archive of a vanished city
Recordings + place signatures + mental maps: reconstruct space from scattered audio fragments.
Unreliable radio partner
Dialogue + conflicting information + navigation: compare guidance with surrounding audible events.
Acoustic machine specialist
Diagnosis + filtering + mechanisms: identify faults and verify repairs by listening.
Time-pressured negotiations
Bargaining + hidden information + short response windows: agree before circumstances change.
Synchronized sound code
Rhythmic sequences + several performers: open a mechanism through coordinated sound.
Team sound scene
Imitation + group performance + guessing: create an event using voices and objects.
Radio strategy
Resources + reports + communication priorities: manage territories with limited audio awareness.
Escape during a concert
Rhythm + noise masking + constrained routes: move while the orchestra masks footsteps.
Classification limits
This is a design space. Examples support particular game mechanics rather than every variation in a family.
Voice control, audio-based play and communication between players can exist independently.
Visualized echolocation does not guarantee screen-free play. Stifled, Lurking and Perception are hybrid examples here.
Microphones measure sound. Silence does not prove breath-holding, and loudness does not reliably measure effort or speaker distance.
Intonation alone does not reliably establish emotion or truthfulness. Game judgments can use content, explicit acoustic rules or human decisions.
Spatial audio output and locating a real speaker require different technologies. A single ordinary microphone does not provide full spatial control.
Speech recognition, synthesis, binaural audio and noise suppression are technologies. Mechanics require actions, rules, feedback and meaningful outcomes.
Spoken menus, replay, tempo settings and text alternatives are interface features supporting any of these mechanics.
Sources and examples
Sources support particular techniques or methodology, not every family variant. Design examples and mechanic combinations are illustrative.
- There Came an Echo
Voice orders to a tactical squad, group commands and custom command aliases.
- Earplay / Codename Cygnus
Interactive audio stories use player speech as input.
- Phasmophobia
Use real voice to interact with ghosts through the Spirit Box and Ouija Board.
- In Verbis Virtus
Speak spells in a fictional language to solve puzzles and fight.
- Song Quiz / Volley
Recognize songs in a voice-based game format.
- Scream Go Hero
Soft voice controls walking; screaming controls jumping.
- One Hand Clapping
Musical puzzles use melody, rhythm, harmony and duets.
- Stifled
Sounds reveal space and expose the player to enemies.
- Lurking
Movement, objects and microphone pulses reveal surroundings and attract enemies.
- A Blind Legend
Exploration and combat through spatial audio.
- The Vale: Shadow of the Crown
Combat and exploration through spatial audio and haptic feedback.
- Blind Drive
Audio-driven arcade driving with two-button controls.
- AudioWizards
Identify enemy elements by sound and choose a corresponding countermeasure.
- Unheard
Listen to conversations, match names to voices and reconstruct event relationships.
- Perception
Sound visualizes space while noise attracts a pursuer.
- Keep Talking and Nobody Explodes
A bomb handler and manual-holding experts cooperate through divided information.
- SoundRTS
Real-time strategy through an audio interface.
CC BY 4.0 · gamemechanics.pro contributors
Communication between players
24Cooperation with divided informationOverview and example ↗Combine participants' knowledge to complete a shared task.12
Role division
Communicating descriptions
Joint solutions
25Restricted communication channelsOverview and example ↗Transmit enough information through a channel constrained by game rules.12
Capacity
Distortion
Radio rules
26Social deduction, roles and performanceOverview and example ↗Interpret people's statements and influence decisions within game roles.12
Social deduction
Roleplay speech
Performing for an audience
27Competition and collective synchronizationOverview and example ↗Compare participants' performances or coordinate voices and actions.12
Speed and accuracy
Interacting performances
Opposition