The interactive augmented reality displays would feature an information layer on live video.
In VH1’s popular show ‘Pop-Up Video,’ little blurbs of information pop-up during a music video. A recent patent from Apple shows a similar type of system in the real world that uses augmented reality.
The ‘Synchronized, interactive augmented reality displays for multifunction devices’ offer informational overlays on buildings and objects in live video. The abstract reads:
A device can receive live video of a real-world, physical environment on a touch sensitive surface. One or more objects can be identified in the live video. An information layer can be generated related to the objects. In some implementations, the information layer can include annotations made by a user through the touch sensitive surface. The information layer and live video can be combined in a display of the device.
TechCrunch notes that the AR system for iOS devices could be used to label elements of a live video feed, with users able to annotate and edit information and then share it with another person.
In the example, a real-world view of San Francisco is paired with a CG model. The user could interact with this to navigate through the streets and modify points of interest. If they were trying to reach a friend, a dual-view could be shared live to build a virtual map, highlight certain places, and help them find their way.