Mixed Reality – On a way to
a perfect illusion
 

It is the Mount Everest of digital visualizations, a Star Trek-induced childhood dream, the ultimate challenge: the hologram. Although a true hologram has not yet been realized, there are many workarounds and approximations. One impressive holographic installation has just recently been put into reality for the Moscow City Government. Inty team was able to design visually stunning content that emanated true plasticity on three image layers – the PG hologram, backdrop LED screen and the floor projection mapping.

We used the traditional Pepper’s Ghost concept which dates back to the early 19th century. PG is based on the reflection of an image onto glass or foil. Since the transparency of the glass/foil allows the viewer to still see everything behind the reflected image, it appears to be floating in mid-air.

This is especially true if one looks at the purpose of the projectors. On the one hand they gave the opportunity to extend animations from the backdrop wall via the floor onto the holographic foil, thereby transcending from display into holography. On the other hand, they added plasticity to the hologram by providing it with an animated shadow – a simple idea that made all the difference.

In terms of content, we were faced with the task to visualize rather abstract topics, focusing on the energy policies of the city of Moscow, such as price optimization and energy convergence. We divided the content into eight segments and used individual design approaches and animations for each. For some segments, facts and figures were shifted to the backdrop wall and the hologram showed 3D models. Other segments, spread the visuals across all three layers, creating spatial impressions and 3D animations like bar charts rising from the floor.

With three individual image sources, the content production in turned out to be quite intricate. Synchronization was a bit of a problem, not so much in terms of playout, but rather during the design process. We didn’t want to create three separate animation channels. Instead, we created one project with one animation timeline.
For that purpose we created user interface for a designers team which showed each individual layer plus the entire project in a fourth window. This allowed us to create the content as a whole. With different markers and parameters, we then distributed the content to its corresponding machines.

The booth was design from the origin of setup. The form of all inner structures of the mixed reality setup was the main reference for the outer shape of the booth. To mask the LED-screen on the ceiling we decided to make an inclined roof so it looks more natural. All the inside design was make dark to focus spectators attention on the installation itself.

To get some more visual inspiration we tried out different graphic sketches with particels, color patterns and shapes within the night when the exhibition was closed. We came up with the idea of holographic fighting game with realtime shadows and tried our betta version made in Unity.

To round off the experience, we added a custom sound design. Apart from the background music, each event inside of Ventuz fired an individual sound that was connected to an object or animation. This created an audio picture that accompanied the visuals and served for a striking atmosphere.