ALLPCB
Core elements of an AR interactive system
1. A PC computer (the performance requirement of the game determines the PC configuration); tablets are rarely used.
2. Sensing devices, control devices, and supporting control software.
3. Interactive software (2D Flash has largely been phased out; 3D is now dominant and can be combined with peripherals to produce 4D or 5D effects. Any holographic video effect can be converted into an interactive experience).
4. Large-format display devices: projectors, LED screens, large displays, video walls, transparent displays, pixel lights, LED strips, etc.
5. Stage lighting equipment: moving-head lights, fans, haze machines, and similar devices.
Overview of mainstream interactive techniques
Below is a list of currently mature and commonly used interactive technology solutions. Understanding these applications can help when designing exhibition spaces and events.
1. Graphite projection / Magic wall
Technical approach: In the Chinese market, around 80% of installations use infrared or radar sensing combined with projection; some implementations use capacitive switches or graphene-based sensing.
Wall treatment: Two approaches are common: applying wallpaper or using a bare wall. Interactions are triggered by touch on the physical surface and produce corresponding animations. The wallpaper approach typically produces a stronger sense of realism.
Custom animation and software are usually required for conferences and events, which increases cost. Some vendors offer ready-made music-enabled magic wall products suitable for malls or family entertainment venues; resolution is often configurable.
2. Silhouette interaction
Technical approach: A Kinect sensor plus a display device is sufficient.
Use cases: This technique is applicable in many scenarios. Advertising or marketing elements can be incorporated into the participant silhouette. For example, virtual balls or corporate logos can be added to the silhouette and replaced by simple gestures. Functions such as QR-code sign-in, audience comments, and 3D prize draws can be integrated.
It is also possible to perform live chroma keying of participants, replacing traditional virtual photo booths with interactive experiences that merge people and interactive elements.
3. Large information display walls
Technical principle: Interaction is typically realized with radar or infrared touch frames; the display is often a video wall or blended projection.
Key challenge: The main technical difficulty lies in the presentation software and how to display information in an engaging way.
Typical implementations:
3.1 Digital stream wall: Displays large amounts of information in a flowing, scrollable format. Users can click an item to enlarge it and view related information.
3.2 Historical timeline wall: Content is arranged along a timeline or key events axis for users to browse. If multiple items exist at a single time point, pagination is provided.
4. Integration with external peripherals
Interaction that combines human sensing with peripherals usually requires a compact central control system. Using a unified control platform simplifies integration between different software and games and reduces coordination overhead.
Examples:
4.1 Integration with microphones for voice recognition or command control.
Use case: A virtual greeter triggered by infrared sensing can play a welcome message and then accept voice commands to control the virtual greeter's presentation.
4.2 Rotation-speed sensing integration
Example: When a physical windmill spins, a projected virtual windmill spins in sync. The backend system can track rotation counts. An SDK can be provided to developers to detect touch point positions and states, recognized voice strings, and sensor rotation counts.
4.3 Linkage with stage lighting and effects
Peripherals such as moving-head lights, downlights, LED strips, haze machines, fans, and bubble machines can be linked to the interactive system and central control for coordinated effects.
5. AR body-sensing large-screen interaction
Technical principle: These installations commonly use Kinect v2.0 for interaction, though IP cameras can also be used for scene capture. This category supports a wide range of creative applications.
Examples:
5.1 Cosplay-style experiences: In one flow, participants are photographed after being transformed into a character (for example, a superhero); photos can be downloaded via QR code. In another stage, participants are composited into a scene to interact with virtual creatures. These experiences can support multiple users simultaneously.
5.2 AR large-screen interaction: Real-scene capture from the sensor is combined with a set of built-in animations and interactive effects. Playback can be configured to include specific animations and effects. AR interactions can include games and atmospheric effects such as transforming a person into a tree creature, flying-disk shooting, fruit cutting, face swapping, mirror-mode interactions, and more.
5.3 Motion-control games and information browsing: Kinect enables contactless content browsing (for example, page flipping) and a variety of motion-controlled games such as jump-and-reach, endless runner, underwater bubble shooting, magic mirror, and a motion-controlled snake game.
5.4 AR wall: Static wall images can be scanned with a mobile phone or tablet to trigger dynamic AR content.
6. Simulated fire-extinguishing system
Technical principle: Uses a real fire extinguisher modified with infrared sensing and signal capture devices. The core is the game design and interaction content. A simulated extinguishing product may include multiple 3D fire locations and a set of extinguishing scenarios for training or engagement purposes.
