It's Time for a New UI
Here at Oblong, we’ve long been demanding, and creating, a new human-machine interface built with collaboration in mind, and Futurism.com recently gave our very own John Underkoffler an opportunity to explain why it’s so important to do so. “It’s time,” he declares. John points to the fact that the original keyboard-mouse-GUI screen scenario invented more than 30 years ago is woefully inadequate compared to where we should be in by now in servicing the collaborative computing needs of humans in the workplace. “The world… and its problems… demand more sophisticated thinking, tools, and patterns of work,” he argued. “We humans have always been capable of infinitely more than that primordial Mac UI lets us express.”
Underkoffler points to the need for greater levels of collaboration between workers, and the desirability of expanding into “extended pixel spaces, in which screens and displays turn corners to fill several walls while also interoperating with personal device displays.” Underkoffler delivers a powerful call to arms. “New UI is a universal revolution,” he said. “The time is now.”
Working with Watson
The goal of each Watson Experience Center—located in New York, San Francisco, and Cambridge—is to demystify AI and challenge visitor’s expectations through more tangible demonstrations of Watson technology. Visitors are guided through a series of narratives and data interfaces, each grounded in IBM’s current capabilities in machine learning and AI. These sit alongside a host of Mezzanine rooms where participants further collaborate to build solutions together.
The process for creating each experience begins with dynamic, collaborative research. Subject matter experts take members of the design and engineering teams through real-world scenarios—disaster response, financial crimes investigation, oil and gas management, product research, world news analysis—where we identify and test applicable data sets. From there, we move our ideas quickly to scale.
Accessibility to the immersive pixel canvas for everyone involved is key to the process. Designers must be able to see their ideas outside of the confines of 15″ laptops and prescriptive software. Utilizing tools tuned for rapid iteration at scale, our capable team of designers, data artists, and engineers work side-by-side to envision and define each experience. The result is more than a polished marketing narrative; it's an active interface that allows the exploration of data with accurate demonstrations of Watson’s capabilities—one that customers can see themselves in.
Under the Hood
Underlying the digital canvas is a robust spatial operating environment, g‑speak, which allows our team to position real data in a true spatial context. Every data point within the system, and even the UI itself, is defined in real world coordinates (measured in millimeters, not pixels). Gestures, directional pointing, and proximity to screens help us create interfaces that more closely understand user intent and more effectively humanize the UI.
This award-nominated collaboration with IBM is prototyped and developed at scale at Oblong’s headquarters in Los Angeles as well as IBM’s Immersive AI Lab in Austin. While these spaces are typically invite-only, IBM is increasingly open to sharing the content and the unique design ideas that drive its success with the public. This November, during Austin Design Week, IBM will host a tour of their Watson Immersive AI Lab, including live demonstrations of the work and a Q&A session with leaders from the creative team.
Can't make it to Austin? Contact our Solutions team for a glimpse of our vision of the future at our headquarters in the Arts District in Los Angeles.