Connecting some ideas and prototypes…
Imagine, being able to capture a session in 3D (well, 4D), like this:
with maybe some 360˚ video, like this: (google chrome plays the video in immersive mode)
mix it with data from other sensors, audio, video, photos, media…
and play it back like this:
(3D playback was prototyped in Unity, using prototype primitives and stock models – but imagine that with fully modelled, lit, textured environments)