Education’s New Frontier

Bringing multiple reality into the classroom

There are oohs, ahhs and sometimes “unrepeatable” words.

There is spinning, crouching, and head tilting accompanied by hesitant voice commands and imperfect finger motions.

But the very first thing they say is invariably the same:

“Oh my god.”

From freshmen to deans, each person has had the same reaction as they slip on the mixed reality headset in Professor Walter Johnson’s physics lab for the first time – and step into the future of teaching at Suffolk University.

“Everyone is like a kid in a candy store” when they first try multiple reality technology, says physics student Allen Alfadhel. “They start thinking about the ways that they can implement this platform into their fields.”

“I’ve been in education my whole life,” says Johnson, who was named Massachusetts Professor of the Year by the Carnegie Foundation in 2005. “For me the most important question about any piece of technology is ‘how can I use it to do something better than I have before?‘“

Johnson has been teaching modern physics for decades. There are concepts — like waves moving through space and interacting with other elements — that are nearly impossible to draw on a board.

“If I just try to draw pictures, it’s hard for the students to grasp. But if I can make a hologram of it and let them see it from various angles, it’s a totally different learning process.”

Before & after: Holograms on campus

See Next

About a year ago, Suffolk’s Chief Information Officer Tom Lynch encouraged Johnson’s interest in exploring uses for augmented, mixed, and virtual reality in teaching physics. Lynch and the University’s Information Technology Services department helped Johnson purchase three Microsoft HoloLens mixed reality headsets, as well as the high-powered computer needed to run the Oculus Rift virtual reality platform.

Over the summer Johnson and a core group of dedicated students experimented with the new gear. What started as a fun side project quickly became a healthy obsession.

“I tried it out. I tried to put things into it, deploy holograms, create things, learn about the formats,” says Alfadhel.

He and fellow seniors Mario Rojas and Paul Johnson used the HoloLens to conjure armored knights and spinning planets into the center of their lab. They completed spacewalks on the International Space Station via Oculus Rift. And when they invited a recent interior architecture graduate to visit, she used the HoloLens to design her new apartment layout in an empty classroom space in less than an hour.

The students are also using the headset to advance their radiation shielding research experiments at Massachusetts General Hospital.

It soon became clear to Johnson, as well as College of Arts & Sciences Dean Maria Toyoda, that the applications were paradigm shifting and University-wide.

“Multiple reality is going to be part of all our lives in the near future,” says Toyoda. “The work we’re doing at Suffolk puts us ahead of the curve, helping students learn in more immersive ways right now.”

Building cross-departmental bridges (and holographic buildings)

Interior architecture program director Sean Solley’s work translated to the new medium almost instantly.

Johnson took a 3D rendering of a sculpture Solley designed and turned it into a hologram, allowing the piece to be placed into any room and viewed at any angle. The hologram helps to show scale, fit, and any design flaws that can be fixed before an item is actually produced—potentially saving time, money, and materials.

“What struck me about it was how immediately effective it was—how clearly it was going to transform the way we work,” says Solley. “It reminded me of the first opportunity to create a digital image. Nothing was quite the same again.”

Students and professor using the VR headsets together

00:00 (gentle music)

00:05 Mixed reality combines what you actually see,

00:09 the room you're in with other things like holograms.

00:13 When I saw what it could do the applications were clearly

00:17 university wide.

00:18 So what I did now is.

00:19 - Much of what we do with interior architecture

00:21 we call the experiential.

00:23 - And look at the desk, see the desk right there.

00:25 - We can take people through spaces

00:27 and that's something that we've never really

00:29 been able to do.

00:30 The project that we've been looking at today

00:32 was created by one of our thesis students.

00:34 The model is allowing us to go from floor to floor

00:37 and look at the relationships between floors.

00:40 What struck me about it was how immediately

00:43 effective it was and how it was clearly going to

00:47 transform the way that we work.

00:50 It reminded me a little bit of the first opportunity

00:52 to create a digital image.

00:54 Nothing was the quite the same again.

00:57 - The applications are in medicine, in law, in research,

01:00 in business, design, you name it.

01:03 And you're gonna see this everywhere.

01:05 - The nicest thing about working across campus

01:08 and working within different departments is that

01:10 we're questioning what the role of new technologies can be.

01:14 - So I go over to.

01:16 I've been in education my whole life.

01:17 And so the most important part for me of any piece of

01:20 technology is how can I use it to do something better

01:22 than I have been before.

01:24 Plus it's a lot of fun. (laughs)

01:27 (gentle music)

Now two of Solley’s graduate students are using Google SketchUp to design entire buildings that are accessible via the HoloLens. By donning the headset, the designers can take clients through the furnished building floor by floor.

“It’s a very inclusive technology,” says Solley. “It engages more people in how the end outcome or the output of design is created. It is experiential, and that’s an important aspect of what we do as designers.”

Graphic design junior Anh Nguyen has spent the semester mastering the multiple reality design tools with the physics students. As part of an independent study, Nguyen is using her artistic talents to create holograms that help illustrate complex physics concepts. Johnson then uses Nguyen’s holograms as teaching tools in his classroom. It’s a cycle of cross-disciplinary learning that benefits everyone.

“People think that art students just like drawing and painting,” says Nguyen. “Now I can imagine myself having a job working with science.”

Into the future

In the past few months, Johnson has worked with faculty in physics, biology, chemistry, art & design, and engineering. He has lost track of all the demos he has done for faculty and administrators across campus, but his enthusiasm for expanding the use of multiple reality tech has only grown.

“It’s like being at the start of computers,” says Johnson. “Mixed reality technology is developing rapidly, getting better and cheaper with each new innovation. We’re in on the ground floor.

“The applications are in medicine, in law, in research, in business, design, history, English, you name it. You’re gonna see this everywhere.”

Students and Prfoessor

With special thanks to Professors Walter Johnson and Sean Solley and students Allen Alfadhel, Telvin Benjamin, Erick Bergstrom, Paul Johnson, Anh Nguyen, Jackson Nolan, Mario Rojas, and Jack Thomas for their time and talent creating multiple reality images and video. 

Take the Next Step