Magic Leap previews its first AR/MR system

Magic Leap One. Credit: Magic Leap

Magic Leap has had its share of ups-and-downs over the past few years. Founded by tech wizard Romy Abovitz, the super-secret company has been at the centre of hype, speculation and doubt. Much of the hype has been spun by the company itself, much of the doubt has been driven by reports of friction in the company, issues with the technology, and so on.

Now, a year after scepticism around the company overtook the hype, Magic Leap has announced the availability of its first product: the Billed as the Magic Leap One Creator Edition augmented (or mixed) reality system, the unit comprises three parts:

  • Lightwear: a headset utilizing the company’s “Digital Lightfield” display technology with multiple integrated sensors to gather spatial information.
  • Lightpack: a  circular belt-worn hip pack that contains the computer powering the headset via a tether.
  • Control: a hand-held controller that can be tracked in space that helps users navigate menu selections, etc.

As an augmented / mixed reality system Magic Leap One is designed to blur the divide between the digital and the real, with the company promoting a series of potential use-cases for it, including:  web browsing and shopping, working on multiple virtual monitors, social telepresence, theme park “rides” and experiences, and gaming.

The system is somewhat removed from some of the hype built-up around Magic Leap’s initial designs – which tended to suggest something far more glasses-like.

There’s no doubt the headset is a lot bulkier than might have been imagined from past descriptions, and while nowhere near as bulky as a VR headset, it leaves a lot to be desired in the ergonomics department, particularly when compared to the likes of AR headsets like Google’s Glass Enterprise Edition or AR systems using  Qualcomm’s snapdragon processors. My own impression on seeing the Magic Leap One images is that the headset looks sci-fi bug-eyed  – almost sinister – and the size of the lenses has me wondering about effective field-of-view.

Lightwear, Lightpack and Control. Credits: Magic Leap

The Lightpack has also come in for critique, with some tech journos calling it “large” or “bulky”. been called “large” by some in the tech press, it’s actually about the same size as Walkman CD players people used to happily clip onto their belts and wear.

The Control has a trackpad and six degrees of freedom (6DOF) tracking, and some six option buttons.

Other than that – details are currently light right now. There are no technical specifications or pricing. However, and in fairness, Abovitz does refer to the announcement as “a small reveal“, rather than any kind of pre-release notification. Instead, interested parties (defined as developers, reporters and the curious) can register their wish to learn more by supplying their e-mail details via a form as the bottom of the Magic Leap home page.

So far, Magic Leap has demonstrated various iterations of their equipment to assorted people from the technology and entertainments industries. All seem to have been thoroughly impressed – although sworn to secrecy – which has been frustrating for those trying to figure out exactly what the company has got. This approach actually continues with this pre-announcement about Magic Leap One – Rolling Stone magazine has an extensive article about Magic Leap in Glixel – but the use of an NDA prevents much in the way of really solid facts around the technology from being revealed, while descriptions of environments are sans images.

Telepresence with Magic Leap One? Credit: Magic Leap

There are, however, some intriguing little pieces of information within the article – such as this ability to generate very life-like characters, which Brian Crecente, writing for Glixel, suggests could become a kind of virtual assistant for those using the Magic Leap:

She walked up to me, stopping a few feet away, to stand nearby. The level of detail was impressive, though I wouldn’t mistake her for a real person, there was something about her luminescence, her design, that gave her away. While she didn’t talk or react to what I was saying, she has the ability to [do so] … I noticed that when I moved or looked around, her eyes tracked mine. The cameras inside the Lightwear was feeding her data so she could maintain eye contact. It was a little unnerving and I found myself breaking eye contact eventually, to avoid being rude.

One day, this human construct will be your Apple Siri, Amazon Alexa, OK Google, but she won’t just be a disembodied voice, she will walk with you, look to you, deliver AI-powered, embodied assistance.

Which sounds very sci-fi-ish, raising the idea of virtual tour guides and suchlike – as well as the question of whether or not we’ll have to cross the uncanny valley with AR as well as (possibly) VR.

I’m somewhat of the belief that AR / MR has the potential to be far more ubiquitous that VR, and garner a much larger, multi-use audience. The likes of Glass Enterprise and several of snapdragon headsets demonstrate considerable interest within healthcare, engineering and retail. The very nature of the technology means it can be integrated far more easily into our everyday lives and work than VR allows. That said, where and if Magic Leap fits into all of this remains as murky as ever. Perhaps the upcoming “Creator Portal”, promised for “early 2018”, coupled with a lifting of the restrictions concerning direct reporting on the system will do more to answer questions.

Magic Leap: DOA, over-hyped or still possible?

Well, maybe it IS only a lens. Not too long ago, Magic Leap were proclaiming they had more than just a lens, but a Photonic Chip. The Infromation thinks it was just more hype
Well, maybe it IS only a lens. Not too long ago, Magic Leap were proclaiming they had more than just a lens, but a Photonic Chip. The Infromation thinks it was just more hype. Credit: Wired.

Magic Leap has been the most controversial company in the emerging market of new VR, AR and MR technologies. Super-secretive but boasting an influx of US $1.4 billion in capital from leading technical and entertainments companies  – including Google – it has drawn a lot of attention, despite almost nothing of its technology being generally revealed.

Magic Leap promises a headset system which will be as easy to wear and remove as a pair of glass – but crucially, and despite several years of development work , has not revealed anything of what this headset might look like beyond various patent filings. In the meantime, the company has continued to release astonishing videos of their product’s apparent capabilities. Some of these were undeniably special effects enhanced pieces – but it now appears that this might be the case with more of the videos than the company were actually willing to let on.

In particular, on December 8th, the paywalled site The Information published a report on Magic Leap indicating that at least one of the more recent videos – that of office workers playing a shoot-’em-up game which was stated as being filmed using Magic Leap’s own technology was actually enhanced by Magic Leap partner, Weta Workshop (Weta’s head, Sir Richard Taylor, was an early investor in the company, and his business partner, director Peter Jackson, is an advisor). This has led to questions being raised over just how genuine Magic Leap is, and how real their product might in fact be.

The Verge summarises the report from The Information, pointing to the less-than-honest video and making mention of Magic Leap’s massive test rig, called The Beast, and the fact that as yet, the company hasn’t moved beyond a tethered headset style device which is claimed to give an inferior result when compared to Microsoft’s HoloLens. This has prompted others to question whether Magic Leap is dead – or potentially could be DOA, given it appears to lag behind what might be somewhat comparable products such as the HoloLens.

Magic Leap haven't been entirely secretive about the size of some of their test rigs. Credit: Peter Yang / Wired
Magic Leap haven’t been entirely secretive about the size of some of their test rigs. Credit: Peter Yang / Wired

As it is, the report from The Information stands sharply at odds with those from the likes of Wired, where Peter Yang from Wired spent time with Magic Leap back in April 2016, using that experience to tell The Untold Story of Magic Leap. Then, shortly ahead of The Information’s piece, and at the end of November, Forbes’ David Ewalt sat down with Magic Leap’s founder, Romy Abovitz. Like The Information’s Reed Albergotti, both Yang and Ewalt reference the fact that Magic leap utilises a headset rather than “glasses”, but that’s about all their articles have in common with Albergotti’s view. So where does that leave us?

First off, scepticism is healthy. There are many promises being made around VR / AR and MR, many of which could well be a mix of hype, hope and wishful endeavour. WE also have little ide just what reporters are being shown – and there is no denying Abovitz enjoys his role as unconventional showman.

Even so, it’s hard to see Magic Leap as purely being smoke and mirrors and flimflam; Abovitz has a track record of innovation and product delivery – he sold his medical robotic company for US $1.7 billion in 2009. Magic Leap has also made no secret of being in things for a long haul, developing a new paradigm in computing, while Albergotti acknowledges the company is now working towards a pair of glasses type of headset, albeit with different technology for their earlier work. Thus, writing them off entirely could be a premature.

A final point is that the company has never gone beyond saying a consumer product will be appearing “soonish”. Ewalt, writing for Forbes, estimates Magic Leap has perhaps another 18 months to go before a consumer launch. That’s a long time, given the HoloLens and Meta’s offerings will be out will before then. but the latter two are liable to have price tags of US $1,000 or more. If this is the case, are they really liable to corner the market, particularly if Magic Leap comes up with a product as user-friendly (and potentially superior) as Peter Yang at Wired feels will be the case – and at a lower price point, even if it is based on technology other than the hyped “Digital Lightfield™”?

The only thing we perhaps can say as a result of this is the hype trains – positive and negative – on what VR / AR / MR might or might not deliver will likely continue to rumble forward for a while yet.

With thanks to Roblem VR

VR and AR catch-up

Oculus Touch: shipping December 6yh, price: US $199.00
Oculus Touch: shipping December 6th, price: US $199.00

It’s been a while since I’ve covered anything in the VR and AR markets, so here’s a very quick catch-up on the main products I have been following on-and-off in these pages, and about which I’d been meaning to write about during October / November.

Oculus Rift: Touch and AWS

In October 2016, Oculus Rift opened the doors to pre-orders of the Touch, their hand controller system, due to start shipping on December 6th, 2016. The Touch price point is US $199.00 (approx. £189 / 187 / AU $265), which includes of Toybox, the multiplayer sandbox application designed specifically to show-off the controllers, and five Touch-ready game tiles.

Alongside of the Touch, Oculus announced additional Rift sensors would also be shipping on December 6th, 2016, at a price of US $79 (approx. £62.55 / 74.18 / AU $106.47), offering similar room-sized scanning capability as the HTC Vive. A new earbud system, designed to replace the earphones on the headset for a more immersive sound experience, was also made available for pre-order (again shipping on December 6th, at a cost of $49 (approx. £38.81 / 46 / AU $66).

Oculus Rift
Oculus Rift

As a rough-and-ready price comparison. The HTC Vive, which includes a headset with front-mounted “see-through” camera, two controllers and two room sensors for tracking) is prices at about US $800. The Oculus Rift (which ships with one sensor) + touch + and additional sensor comes to roughly US $877, with some recommending two additional sensors offer optimal scanning bringing that total to US $956. Obviously, the latter package also includes a hefty amount of additional software, including Toybox.

On November 10th 2016, Oculus VR confirmed they were lowering the minimum specification for hardware needed to run an Oculus VR experience  comfortably, as a result of something called Asynchronous Spacewarp, or AWS.  The announcement came with a long and involved description of what AWS is, which the press announcement summarised down to a TL;DR summary:

Oculus is releasing a new technology aimed at reducing system hardware requirements while maintaining content quality across a wider array of hardware. Asynchronous Spacewarp (ASW) is a frame-rate smoothing technique that almost halves the CPU/GPU time required to produce nearly the same output from the same content. Like Asynchronous Timewarp (ATW), ASW is automatic and enabled without any additional effort from developers.

In other words, and to summarise the summary, AWS allows VR experiences remain fluid to the eye by “making up” the “in-between” animation frames, reducing the demand of continued, heavy processing on the part of the CPU / GPU.

On the left, a game with every frame directly rendered at 45fps by the GPU. On the right, the same game using software AWS to render some of the
On the left, a game with every frame directly rendered at 45fps by the GPU. On the right, the same game using software AWS to render some of the “in-between” animation frames, where the direction of the fox’s motion is “known”. Credit: TechRadar

This is turn means that “lower end” systems can now in theory run VR experiences which incorporate AWS. Although it has to be said that “lower end” must be approached with something of a caveat: it reduces the GPU requirement from a minimum of a NVIDIA GTX 970 / AMD Radeon R9 290 and  Intel i5-4590 equivalent or greater to a NVIDIA GTX 960 / AMD Radeon RX 470 or greater and Intel i3-6100 / AMD FX4350 or greater – which some might consider a small move of the needle.

Finally, Oculus VR is working on an untethered version of the Rift headset, currently called Santa Cruz. It appeared in prototype form in October 2016, and includes a built-in processing system mounted with the headset, removing the need for it to be connected to a PC. Initial reports from those able to try the prototype were mixed, with several reporters noting their evaluations were carefully controlled, and that Oculus engineers were evasive when asked about the actual processing power and performance of the headset.

HTC Vive

On November 11th, 2016, HTC announced pre-orders were open for a “tether-less” kit for the Vive headset, produced by TPCAST, a Vive X Accelerator invested company. The kit comprises a wireless relay unit and battery pack to power the headset, bot of which attach to the headset harness, removing the need to connect it to a PC via USB cables. In difference to claims that wireless is “unsuitable” for VR due to factors such as latency, TPCAST is said to have no “noticeable difference” when using it with a Vive headset when compared to using the headset tethered directly to a PC.

The TPCAST wireless kit mounted on an HTC Vive
The TPCAST wireless kit mounted on a HTC Vive. Credit: HTC / TPCast

Continue reading “VR and AR catch-up”

Magic Leap reveals a little more about their AR system

Romy Abovitz talks Magic Leap at WSJD Live (image courtesy of engagdet)
Romy Abovitz talks Magic Leap at WSJD Live (image courtesy of Engagdet)

Magic Leap, the augmented reality company established by enigmatic entrepreneur Rony Abovitz, and which gained over US $500 million from the likes of Google in 2014 (see my article from October 2014),  revealed a little more about its product during a WSJD Live interview recently.

As reported by Nicole Lee for Engadget, Abovitz and Chief Content Officer Rio Caraeff talked in general terms about the system which has caused no small amount of excitement among those who have actually seen it in action. People such as Google’s CEO Sundar Pichai, who sits on the Magic Leap board and was one of the driving forces behind Google’s lion’s share of the half-billion funding mentioned above, and who shares a place on the board with Qualcomm’s executive chairman, Paul Jacobs, another investor from that round of funding.

The technology has also wowed leading lights from the entertainment industry such as Weta Workshop’s co-founder Richard Taylor (one of the first to invest in Magic Leap), and Thomas Tull, CEO of Legendary Entertainment (aka Legendary Pictures). For those outside, however, Magic Leap has perhaps come over as a riddle bordering on smoke and mirrors.

Magic Lap's website splash screen (no pun intended)
The Magic Leap website splash screen (no pun intended)

Talking at the WSJD event, Abovitz indicated Magic Leap won’t be tied to a particular platform or OS, but will be entirely self-contained and with a dedicated OS. He also indicates that in difference to those dismissing AR on the grounds that “no-one likes to wear glasses for long”, the form factor for the unit will be something people won’t fight shy of wearing. He also states it will allow them to maintain a normal relationship with others when in use – a little dig, no doubt, at the first generation of cumbersome and isolating VR headsets about to hit the market.

Alongside of the interview, Magic Leap also released a new video which they state is filmed entirely through Magic Leap technology and with no special effects or compositing.

Quite how the system works, however, is still a mystery. No headsets are shown in any of the company’s promotional material, and much is made of the use of a “Dynamic Digitized Lightfield Signal” (which we can call “Digital Lightfield™”). In speaking at WSJD, Abovitz and  Caraeff both skirted specifics, with the former only saying, “We treat human biology as our centre point; everyone already has a head-mounted display. It’s your head!”

This suggests the company is perhaps pursuing direct retinal projection, possibly in some form of headset unit that is less intrusive than the kind of units suggestive in the patent filings the company has made in the past. And if this sounds like science-fiction, remember Abovitz made his money developing medical technology, and the company has apparently devoted considerable effort into researching the relationship between the photonic light field and the way the brain functions.

Patent filed for Magic Leap by , draws extensively on one of earlier patents for augmented reality headsets styled in both "regular glasses" and "wrap-around" form factors (US 20120162549 A1)
Patent WO 2014043196 A1, filed for Magic Leap by Chunyu Gao for augmented reality headsets styled in both “regular glasses” and “wrap-around” form factors, suggesting some form of headset will be a necessary part of the system – click for full size

So what is the purpose of all this? Caraeff indicated the ultimate am is for Magic Leap to provide broad-based platform for visual computing. “Anything that you can do on your smartphone, on your computer; you’ll be able to do on Magic Leap,” he said, then added, “Where the world is your screen.”

“We believe the future of computing should be natural,” Abovitz stated. “With Magic Leap, your brain doesn’t distinguish what’s real and what’s Magic Leap, because as far as your brain’s concerned, it is real.”

I admit to being far more persuaded that AR will generate a greater mass market presence than VR. Despite the negative memes about people not liking glasses and Google’s misplaced Glass product, AR would appear to be far more inclusive in its use than VR, and have the same potential reach into many of the markets being hailed as VR’s territory: business, medical, education, healthcare and entertainment.

Whether Magic Leap will actually pave the way in this regard as units start to roll off the company’s new production line in Florida at some point in the future, is open to debate. I do, however, admit to being more intrigued by the potential of AR systems like it and CastAR than I am with the first generation of VR headsets we’re about to see.

Additional material on the WSJD Live event via The Verge.

The man whose novel helped inspire Second Life takes a Magic Leap

It has been announced that science-fiction author Neal Stephenson has become the latest high-profile individual to join the ranks of Magic Leap, the still-mysterious company that seems to be doing something highly innovative with augmented reality – and perhaps virtual reality as well.

Stephenson, who wrote Snow Crash, the novel which first coined the term “metaverse” and is often referred to as one of the influences behind the development of Second Life, has accepted the position of “Chief Futurist” at Magic Leap, in news being broken by the likes of Wired and The Verge.

Neal Stephenson, Magic Leap's new
Neal Stephenson, Magic Leap’s new “Chief Futurist” (image: Bob Lee via Flickr)

Writing in a blog post for Magic Leap, Stephenson states he had been approached by the company months ago – and in a rather unique way:

A few months ago, two Irishmen, a Scot, and an American appeared on my doorstep with Orcrist, aka “Goblin-cleaver,” the ancient sword forged during the First Age of Middle Earth by the High Elves of Gondolin, later retrieved from a troll hoard by Thorin Oakenshield. It’s not every day that someone turns up at your house bearing a mythic sword, and so I did what anyone who has read a lot of fantasy novels would: I let them in and gave them beer. True to form, they invited me on a quest and asked me to sign a contract (well, an NDA actually).

The use of Orcrist in the offer is cleverly symbolic: one of the Board of Directors of Magic Leap is Sir Richard Taylor, founder and head of WETA Workshop, the company behind the models, costumes and special effects seen in the Lord of the Rings and Hobbit trilogies directed by Peter Jackson.

Precisely what Magic Leap is developing is something of a mystery, although as I’ve previously reported in these pages, what has been shown to the likes of Google, Legendary Pictures, Andreessen Horowitz and others led them to invest some $542 million into the company in October – and that on top of $50 million of investment at the start of the year.

What little is known about Magic Leap is that it is currently working on what it calls “cinematic reality”, which uses a headset which may eventually look something like a pair of sunglasses to overlay anything the wearer sees in the real world with 3D digital images that move and respond to the wearer’s own head an eye movements, and which appear to “interact” with the physical world around the wearer.

You'll believe a whale can fly - or that's perhaps Magic Leap's hope (among more practical things)
You’ll believe a whale can fly – or that’s perhaps Magic Leap’s hope (among more practical things)

Recently, Sean Hollister over at Gizmodo followed the lead set by Tom Simonite, a bureau chief at MIT Technology Review, in tracing down patents filed by Magic Leap in an attempt to find out more about what the company may actually be producing. As I again reported, their findings make fascinating reading for anyone interested in emerging AR and VR technologies – and in the history of Magic Leap, which up until the huge investment by Google et al, had been quietly flying under the radar for a number of years.

In that same report, I also covered the fact that what might be on of Magic Leap’s first major public demonstrations could be at the Manchester International Festival here in the UK in July 2015.

The Age of Starlight is a new film bringing together Oscar-winning director Kevin MacDonald, the visual effects team behind the 2013 George Clooney / Sandra Bullock blockbuster Gravity and science pundit and physicist Professor Brian Cox. The film will tell the story of the cosmos around us utilising Magic Leap technology, allowing audiences of up to 50 people at a time witness – and be immersed in – the unfolding majesty and mystery of the universe in what is billed as being a transformative, emotional experience.

The Age of Starlight: an immersive, transformative film using Magic Leap technology will be shown at the Manchester International Festival in the UK in 2015
The Age of Starlight: an immersive, transformative film using Magic Leap technology will be shown at the Manchester International Festival in the UK in 2015

It is apparently this transformative power within the Magic Leap technology that has attracted Neal Stephenson. Again, on the Magic Leap blog he states:

Here’s where you’re probably expecting the sales pitch about how mind-blowingly awesome the demo was. But it’s a little more interesting than that. Yes, I saw something on that optical table I had never seen before–something that only Magic Leap, as far as I know, is capable of doing. And it was pretty cool. But what fascinated me wasn’t what Magic Leap had done but rather what it was about to start doing.

Magic Leap is mustering an arsenal of techniques–some tried and true, others unbelievably advanced–to produce a synthesized light field that falls upon the retina in the same way as light reflected from real objects in your environment. Depth perception, in this system, isn’t just a trick played on the brain by showing it two slightly different images.

Magic Leap is not exclusively about games. It’s also going to be a great tool for readers, learners, scientists, and artists … What applies to games applies as well to other things of interest, such as making the world safe for books, doing new things with science and math visualization, and simply creating art for art’s sake.

We still don’t know precisely what Magic Leap will present or how it will work, and truth be told, there is an awful lot of hype and hyperbole surrounding the emerging new market for AR and VR it is hard at times to separate fact from fiction. But when the likes of Sir Richard Taylor and Thomas Tull (CEO of Legendary Pictures) pour their own money into a project, and it attracts names such as Brian Cox, Kevin MacDonald and now Neal Stephenson – you have to suspect something very special might well be sitting just over the horizon.

Related Links

Magic Leap: bringing augmented reality to film in 2015

The Age of Starlight Promotion picture
Magic Leap technology is to be “premiered” at a UK festival in 2015, in a special film / show entitled The Age of Starlight (image: Manchester International Festival)

Professor Brian Cox may not be a familiar name to everyone, but in the UK and for those with an eye for science on television, he has become something of England’s answer to Neil deGrasse Tyson.

Professor Brian Cox
Professor Brian Cox

Cox, who played keyboards in the pop group D:Ream whilst studying physics at the University of Manchester in the 1990s, started his television career in 2005, appearing on the BBC’s science and philosophy series, Horizon.

Since then, he has fronted a range of science programmes and series, as well as appearing on chats shows on both sides of the Atlantic. He’s even  had a guest starring role in the adventures of the very master of time and space itself, Doctor Who.

Now, the BBC reports, he will be presenting in a cutting edge show / film (which he is also scripting) entitled The Age of Starlight, telling the story of the universe, intended to be one of the focal events of the 2015 Manchester International Festival. The production will also feature visual effects by Framestore, the team that won an Oscar for their work on the 2013 George Clooney / Sandra Bullock sci-fi vehicle Gravity, and will be directed by Kevin MacDonald whose films include the Oscar-winning Last King of Scotland and One Day in September and the BAFTA-winning Touching the Void.

But what makes The Age of Starlight particularly interesting is that it will utilise augment reality technology being developed by Magic Leap, the company that hit the headlines in October 2014, when it received $542 million in funding from a broad range of investors.

For those of you who missed it, Magic Leap is the company behind a headset that uses augmented reality to combine realistic computer graphics with everything the wearer sees in real time, in what the company calls “cinematic reality”. The results can be startling, going on the available promotional material: tiny elephants in the palms of your hands, dragons flying among flocks of birds,  yellow submarines sailing through streets, humpback whales floating over crowded beaches, and more.

One of the Magic Leap promotional images: a yellow submarine apparently floats down a street the Magic Leap wearer is walking along
Magic Leap merges realistic computer graphics with everything the user sees in the real world, in what the company calls “cinematic reality”.

However, beyond the stunning promotional images and video, the company has publicly revealed very little about what it is up to. But what they have shown behind closed doors has been enough to get John Markoff from the New York times very excited, and has been sufficient to get Google to lead that US$542 million (£346 million) round of investment in October, which itself came on top of an initial $50 million of funding earlier in 2014.

Given all the apparent mystery surrounding Magic Leap, Sean Hollister over at Gizmodo, decided to spend a little time digging around trying to find out more on what Magic Leap is all about.

In his article, Hollister starts out by framing something of the company’s history, revealing that Magic Leap has been chipping away at things for quite a while. In a fascinating track through the company’s history, he references their 2011 collaboration with Weta Workshop on something called The Hour Blue, as reported by Dice (see the video, below). This still appears to be around today, although exactly what it is, isn’t clear. This collaboration may have been the reason why Weta’s co-founder, Richard Taylor, opted to make a personal investment in Magic Leap during the $50 million round of funding and now sits on the board of directors.

Making augmented reality of the kind Magic Leap is trying to achieve is a significant challenge, as Hollister explains:

If you’re looking at the real world, your eyes are focusing at a variety of different distances, not necessarily on a tiny piece of glass right in front of your face. The real world also reflects a lot of light into your eyes, which is why the images from heads-up displays like Google Glass appear transparent and ghostly. Because you need to see the real world, you obviously can’t have a projector covering the front of the glasses: that light has to be bounced in from the side, which generally results in a narrow field of view.

And of course, you need some way to track your head and your surroundings so that CG objects appear to occupy a real place in the world, instead of looking like a flat image— which, sadly, is how many existing augmented reality specs do it.

Given this, Hollister reasoned, the best way to understand what the company might actually be developing is to take a look at the patents they have filed and which address such challenges. In taking this line, he’s actually following the lead set by Tom Simonite, a bureau chief at MIT Technology Review.

Continue reading “Magic Leap: bringing augmented reality to film in 2015”