Case Study - Play and learning for the world of tomorrow

Youth today engage the world natively through the lens of the smartphone camera, from outdoor games to photo filters and augmented reality. A decade prior, I partnered with the Creative Learning Lab in Amsterdam to imagine new interactions for AR/VR, now used widely by museums worldwide.

Client
Waag FutureLab
Year
Service
Design Research & Strategy

Overview

By 1965 Ivan E Sutherland (the "father of computer graphics") had already published his landmark dreams of "The Ultimate Display", which he imagined as a room within which virtual objects came truly to life. He would go on to develop the first head-mounted display system three years later, setting a course that would ultimately lead to Microsoft HoloLens, Apple Vision Pro, and of course the cultural landmark of Pokémon Go.

How I helped

To design for the future, I need to first step into a vast world of imagined yet pragmatic possibilities. I need to understand market trends, patents, emerging technology, and above all the habits and relationships we have with our devices. Using all this, I then anticipate and empathize with the many cultures and cohorts of tomorrow.

Together with thought leaders in the space, I joined the Augmented City Lab and Frequency 1550 outdoor game in Amsterdam to do just this. My research was funded through an innovation award and grant from the MacArthur Foundation.

Co-located at the Waag FutureLab for art and society, I ran a deep dive across mobile and headset technologies, with a careful eye towards usability and potential for widespread market adoption. I then hit the whiteboards and prototypes to explore new interaction design concepts. I ran outdoor play-tests with youth and research pilots at museums. To bring it all together, I published our findings and interface concepts in a digital report for use by the larger AR/VR community, helping to drive future research and ideation sessions.

  • Concept Development
  • Tech Canvas
  • Interaction Design
  • App Prototyping

How it looked

Example interactions I conceptualized and tested:

  1. Guidelines: at your feet, find a virtual trail and moving arrows to guide your way turn-by-turn through a building or city
  1. Radial Reveal: when glancing at an object in augmented space, a radial menu appears around it to allow deep interaction
  1. Pop-up Data: while moving through a building or room, showcase charts and graphs to reveal energy usage, air quality or forces of gravity
  2. Hot & Cold: like a metal detector for game objects; a 3D scope and device vibration helps guide the user through the room to find a hidden item

Business Impact

For mainstream public, the future of spatial computing is just now coming to view. But through future design and prototyping, I helped explore these trends and design techniques over a decade early. Not only does this create competitive edge, it helps to inspire new and more human-centered visions of tomorrow and plan for greater inclusivity and access.

New Interface Patterns
11
Play Tests
9
Pilot Weeks
36

More case studies

The first multi-world expo

A brand new city was built from the sands of Dubai for Expo 2020. But when lockdowns hit, the plan shifted to embrace virtual visits. Across six months of daily events, 250 million visitors streamed content across social, game and web and mobile platforms. Our research helped keep it all together.

Read more

Kindling a love for audiobooks

Voracious readers are often reluctant to try listening to books, but those who do often take joy from immersive narrations and convenience on-the-go. I helped introduced millions of Kindle users to Audible, driving marked month-over-month sales and lifetime subscription value.

Read more

How can I help?

My offices

  • Brooklyn
    61 Greenpoint Avenue
    11222, NY, United States
  • Montreal
    4020 Rue St-Ambroise
    H4C 2E1, Quebec, Canada