{"schemaVersion":1,"record":{"key":"mechanic/phone-camera--family-hybrid","type":"mechanic","id":"phone-camera--family-hybrid","lang":"en","title":"Hybrid and experimental methods","summary":"Camera input combines with other channels. RIDGID Level overlays a tilt indicator on the camera view.","updatedAt":"2026-10-22","status":"active","url":"https://gamemechanics.pro/en/knowledge/mechanic/phone-camera--family-hybrid/","jsonUrl":"https://gamemechanics.pro/api/v1/knowledge/en/mechanic/phone-camera--family-hybrid.json","markdownUrl":"https://gamemechanics.pro/content/knowledge/en/mechanic/phone-camera--family-hybrid.md","aliases":["Combining camera input"],"tags":["Phone camera interactions","Mechanics catalog"],"sourceIds":["source-c121374ae20b1406","source-0599b2ea6361e813","source-4e95de581d229547","source-d0b96e774048c628","source-bbdbf2272abeb5db"],"sources":[{"id":"source-c121374ae20b1406","title":"Apple AVFoundation: Camera Capture and Control","url":"https://developer.apple.com/documentation/avfoundation/capture-setup","verifiedAt":null},{"id":"source-0599b2ea6361e813","title":"ARCore: motion tracking, planes, anchors","url":"https://developers.google.com/ar/develop/fundamentals","verifiedAt":null},{"id":"source-4e95de581d229547","title":"ARCore Geospatial","url":"https://developers.google.com/ar/develop/geospatial","verifiedAt":null},{"id":"source-d0b96e774048c628","title":"W3C Media Capture and Streams","url":"https://www.w3.org/TR/mediacapture-streams/","verifiedAt":null},{"id":"source-bbdbf2272abeb5db","title":"RIDGID Level","url":"https://apps.apple.com/us/app/ridgid-level/id444491222?uo=4","verifiedAt":null}],"sections":[{"id":"principle","title":"How it works","body":"The camera participates in the system along with other inputs or a complex model. This is where it is especially important to test the prototype on target phones. These options are not universal capabilities of any camera."},{"id":"variants","title":"Variants","body":"### Variants and applications\n\n\n\n- Camera and microphone. Action: Coordinate visible action with sound: gesture with word, movement with clap. Application: Multimodal commands, rhythm game, stage performance. Technologies: Combination of channels; Sound. \n- Camera and IMU. Action: Match the video with the rotation and acceleration of the device. Application: Spatial controller, sustainable AR tracking, phone movement as a tool. Technologies: Combination of channels; AR spatial tracking. \n- Camera and location. Action: Combine a visual landmark with GPS and, if available, visual positioning. Application: Urban AR game, content at a landmark, route. Technologies: Combination of channels; Geolocation. \n- Camera and touch screen. Action: Select an area by touch, then associate it with a real object or effect. Application: Interactive cutting, tracking a selected target, drawing on top of the world. Technologies: Combination of channels; Image analysis. \n- Light exchange between devices. Action: The screen or flashlight of one device sends a code to the camera of another. Application: Local connection, game key, physical riddle channel. Technologies: Combination of channels; Own algorithm. \n- Visual management agent. Action: The model interprets the limited scene and suggests the next move or reaction. Application: Adaptive presenter, procedural learning, experimental NPC. Technologies: Recognition or machine learning model; Generative model; Experimental prototype. \n- Recognition of compound action. Action: To associate an object, gesture and scene change by time. Application: Analysis of a visual recipe, interactive story, complex combo. Technologies: Recognition or machine learning model; Own algorithm. \n- Performance style. Action: Compare the rhythm, smoothness or expressiveness of visible movement with a selected criterion. Application: Creative challenge, evaluation of an animated sketch, dance game. Technologies: Recognition or machine learning model; Own algorithm; Experimental prototype. "},{"id":"context","title":"Context and limits","body":"Games, learning, creativity and interactive applications. Author's systematization of game rules based on proven technical capabilities. Examples are application ideas and not statements of released products."}],"relations":[],"placements":[{"catalogId":"phone-camera","id":"family-hybrid","title":"Phone camera interactions","url":"https://gamemechanics.pro/en/mechanics/phone-camera/#family-hybrid","categoryIds":["section-1"]}],"supersededBy":[],"attributes":{"preview":{"updatedAt":"2026-10-22","title":"Combining camera input","description":"Camera input combines with other channels. RIDGID Level overlays a tilt indicator on the camera view.","image":{"src":"images/mechanics/motion-ridgid-level-2.webp","width":720,"height":405,"game":"RIDGID Level","sourceUrl":"https://apps.apple.com/us/app/ridgid-level/id444491222?uo=4","originalUrl":"https://is1-ssl.mzstatic.com/image/thumb/Purple113/v4/82/2f/ce/822fce6a-36c4-5489-77a4-a272709dfd3c/mzl.mepckujn.png/720x1560bb.jpg","credit":"RIDGID Software Solutions","rights":"© RIDGID Software Solutions. Publisher-distributed App Store screenshot; all rights reserved. Excluded from MIT and CC BY 4.0.","caption":"RIDGID Level: a virtual level over the camera image","alt":"RIDGID Level: a virtual level over the camera image","markers":[{"x":50,"y":50,"label":"The tilt indicator is compared with the visible surroundings"}]},"tips":["Test image and sensor synchronization on target devices."],"examples":[{"title":"RIDGID Level","url":"https://apps.apple.com/us/app/ridgid-level/id444491222?uo=4"}]}},"endsAt":null,"provenance":"Original editorial design catalog consolidated from project discussions on 2026-10-20. Complete discussion item lists and contextual limitations are preserved; linked primary sources support specific techniques, not the entire classification. English translation was prepared with machine assistance and editorial review.","license":"CC-BY-4.0","codeLicense":"MIT","attribution":"gamemechanics.pro contributors","catalogKey":"catalog/phone-camera"}}