{"schemaVersion":1,"record":{"key":"mechanic/keyboard--family-hybrids","type":"mechanic","id":"keyboard--family-hybrids","lang":"en","title":"Hybrids and embedded controllers","summary":"Keys combine with another controller. In AudioSwift the keyboard triggers notes while the trackpad changes synthesizer parameters.","updatedAt":"2026-10-22","status":"active","url":"https://gamemechanics.pro/en/knowledge/mechanic/keyboard--family-hybrids/","jsonUrl":"https://gamemechanics.pro/api/v1/knowledge/en/mechanic/keyboard--family-hybrids.json","markdownUrl":"https://gamemechanics.pro/content/knowledge/en/mechanic/keyboard--family-hybrids.md","aliases":[],"tags":["Physical keyboard interactions","Channel combination"],"sourceIds":["source-fd215230c062deb7"],"sources":[{"id":"source-fd215230c062deb7","title":"AudioSwift","url":"https://audioswiftapp.com/","verifiedAt":null}],"sections":[{"id":"principle","title":"How it works","body":"Keys communicate with other input sources; the additional elements are not regular keys."},{"id":"variants","title":"Variants","body":"### Variants and applications\n\n\n\n- Keyboard and pointer. Action: Keys specify movement, mode or tool, mouse or trackpad selects a point. Application: Aiming, modified dragging, drawing and editing. Conditions: Need to determine the owner of the focus and joint interpretation of events. Equipment: Additional channel. \n- Keyboard and voice. Action: Text or buttons select a parameter, voice gives a command or vice versa. Application: Dispatcher, stage play, crew management, multimodal editor. Conditions: A microphone, resolution and clear processing of unrecognized speech are needed. Equipment: Additional channel. \n- Keyboard and touch screen. Action: Touch selects an object, keys control an action or modifier. Application: Drawing on a tablet with a keyboard, map control, musical instrument. Conditions: Consider the reachability of both devices and the state of the active window. Equipment: Additional channel. \n- Keyboard and look. Action: Gaze selects the target, the key confirms or changes it. Application: Quick selection of objects, accessible controls, aiming in an experimental game. Conditions: Requires an eye tracker or a suitable camera and calibration. Equipment: Additional channel. \n- Keyboard and body posture. Action: A camera or other sensor adds the position of the arms, head or body. Application: Check the crossing of hands, combine typing with movement, create stage acting. Conditions: Pose is not determined by the keyboard; The quality of external recognition needs to be checked. Equipment: Additional channel. \n- Keyboard and gamepad or pedal. Action: Different channels are responsible for different parts of the control. Application: Keys select commands, the pedal holds the mode, the gamepad sets a continuous axis. Conditions: Priority rules and support for mixed input are needed. Equipment: Additional channel. \n- Built-in encoder or wheel. Action: The additional rotary controller changes the value, the key confirms. Application: Frequency, scale, scrolling, step selection on the instrument panel. Conditions: Availability and accessibility of the encoder depends on the device and its interface. Hardware: Special device / SDK. \n- Built-in touchpad, strip or mini-joystick. Action: An additional surface or pointer gives continuous control next to the keys. Applications: Camera positioning, audio modulation, cursor, expressive creative tool. Conditions: This is a separate channel within the housing; it should not be assumed on any keyboard. Hardware: Special device / SDK. "},{"id":"context","title":"Context and limits","body":"Author's working classification for designing games and interactions. Options can overlap and combine; the list is not a generally accepted standard or proven exhaustive list. Application examples are conditional unless a specific verifiable observation is indicated nearby. Sources support individual techniques and technical limitations."}],"relations":[],"placements":[{"catalogId":"keyboard","id":"family-hybrids","title":"Physical keyboard interactions","url":"https://gamemechanics.pro/en/mechanics/keyboard/#family-hybrids","categoryIds":["section-11"]}],"supersededBy":[],"attributes":{"preview":{"updatedAt":"2026-10-22","title":"Hybrids and embedded controllers","description":"Keys combine with another controller. In AudioSwift the keyboard triggers notes while the trackpad changes synthesizer parameters.","image":{"src":"images/mechanics/control-audioswift-8.webp","width":1024,"height":576,"game":"AudioSwift","sourceUrl":"https://audioswiftapp.com/","originalUrl":"https://www.dropbox.com/scl/fi/yqt0o62p84omwo9zdcacb/09-Utilities-MIDI-Keys.mp4?rlkey=3pmy5octl15j8klsneydy1dvl&st=c3vxluvv&raw=1","sourceFrameSeconds":3,"credit":"Nigel Ríos; host apps and instruments retain their respective rights","rights":"Imagery © Nigel Ríos; host apps and instruments retain their respective rights. Developer-distributed screenshot or frame; all rights reserved. Excluded from MIT and CC BY 4.0.","caption":"AudioSwift: keyboard and trackpad jointly control a synthesizer","alt":"AudioSwift: keyboard and trackpad jointly control a synthesizer","markers":[{"x":46,"y":70,"label":"The trackpad changes Vibrato during keyboard performance"}]},"tips":["Separate input roles and retain control if one channel disconnects."],"examples":[{"title":"AudioSwift","url":"https://audioswiftapp.com/"}]}},"endsAt":null,"provenance":"Original editorial design catalog consolidated from project discussions on 2026-10-20. Complete discussion item lists and contextual limitations are preserved; linked primary sources support specific techniques, not the entire classification. English translation was prepared with machine assistance and editorial review.","license":"CC-BY-4.0","codeLicense":"MIT","attribution":"gamemechanics.pro contributors","catalogKey":"catalog/keyboard"}}