High Fidelity reveal currency and IP protection roadmaps

In a pair of blog posts, Philip Rosedale of High Fidelity revealed the company’s plans to use blockchain technology as both a virtual worlds currency and for content protection.

The blockchain is described as “an incorruptible digital ledger of economic transactions that can be programmed to record not just financial transactions but virtually everything of value” (Don Tapscott, Blockchain Revolution: How the Technology Behind Bitcoin Is Changing Money, Business, and the World). It allows transactions to be simultaneously anonymous and secure by maintaining a tamper-proof public ledger of value. While it is most recognised for its role in driving Bitcoin, the technology is seen by more than 40 of the world’s top financial institutions as a potential means to provide speedier and more secure currency transactions. However, the technology has the potential to have far wider application.

To understand the basics of the blockchain, think of a database duplicated across the Internet, allowing any part of it to be updated by anyone at any time, and the updates being immediately available across all the duplicates of the database. Information held on a blockchain exists as a shared — and continually reconciled — database existing across multiple nodes. The decentralised blockchain network automatically checks with itself every ten minutes, reconciling every transaction, with each group of transactions checked referred to as a”block”. Within the network, nodes all operate as “administrators” of the entire network, and are encouraged to join it through what is (mistakenly) referred to as “mining”  – competing to “win” currency exchanges, sometimes for financial reward to the node’s operators (High Fidelity indicate that node operators will not gain directly from “mining” activities, but will instead be paid in HFCs for their computing resources used by the network).

Centralised, distributed and de-centralised networks – blockchains utilised decentralised networks

The key points to all this is that the blockchain is both openly transparent – the data is embedded in the network as a whole, not in any single point, and is by definition “public”. The lack of any centralisation also means it cannot be easily hacked – doing so would require huge amounts of computing power; nor is there a single point of data which can be corrupted or reliant on a single point of management for its continued existence – as High Fidelity point out, this means that the service can continue, even if High Fidelity does not. Thus, blockchain networks are considered both highly robust and very secure.

An estimated 700 Bitcoin-like crypto-currencies are already thought to be in operation, although the potential use of blockchains goes far, far beyond this (identity management, data management, record-keeping, stock broking, etc., etc.).

High Fidelity plans, over the coming months, to deploy their own blockchain network which will support both a new crypto-currency, the HFC (presumably “High Fidelity Currency”), which will ultimately operate independently of High Fidelity’s control. In addition, the system will provide a mechanism to protect intellectual property by embedding object certification affirming item ownership into the blockchain. This means that creators of original digital content. As High Fidelity explain:

Digital certificates issued by the High Fidelity marketplace (and likely other marketplaces choosing to use HFC) will serve a similar function as patents or trademarks — creators will register their works to get the initial certificates, and these certificates will be given out only for work that is not infringing on other or earlier works…. Once granted, these durable certificates cannot be revoked and can then be attached to purchases on the blockchain to prove the origin of goods. The absence of an accompanying digital certificate and blockchain entry will make digital forgery more obvious and impactful than in the real world — for example, server operators may choose not to host content without certificates and end-users may choose not to ‘see’ content according to it’s certificate status.

This approach could provide an extremely durable and trusted means of sharing digital content, one which is more durable than other approaches to digital rights management, for the same reasons as the blockchain offers security, transparency and robustness to operating a crypto-currency.

That the HFC blockchain is designed to operate independently of High Fidelity means that it can become self-sustaining, providing a currency environment that can be traded with other crypto-currencies and which can be exchanged for fiat currency through multiple exchanges.

The two blog posts – Roadmap Currency and Content Protection and Roadmap: Protecting Intellectual Property in Virtual Worlds – are very much companion pieces to be read in the order given. The first provides an overview of the HFC blockchain system and currency management, including how High Fidelity hope to establish a stable exchange rate mechanism without running into the issues of speculative dabbling in the system, inflated ICOs, etc., and on the use of digital wallets and personal security. It also outlines the certification mechanism for content protection, which the second article takes a deeper dive into, explaining how the relative strengthen of a blockchain approach as very quickly sketched out above could be used in protecting creator’s IP and controlling how their products / creations are used.

The decentralised approach to currency and digital rights management is something that has been pointed to numerous times during High Fidelity’s development, but this is the first time the plans have been more fully fleshed out and defined in writing. It’s an ambitious approach, one likely to stir debate and discussion – particularly given the current situation regarding the Decentraland / Ethereum and the risk of speculation around ICOs (again, something High Fidelity hope to avoid).

it’s also one which again points to High Fidelity’s founders looking far more towards more of an “open metaverse” approach to virtual environments and goods than others might be considering.

Advertisements

High Fidelity moves to “open beta”

HF-logoTuesday, April 27th saw High Fidelity move to an “open beta” phase, with a simple Twitter announcement.Having spent just over a year in “open alpha” (see my update here), the company and the platform has been making steady progress over the course of the last 12 months, offering increasing levels of sophistication and capabilities  – some of which might actually surprise those who have not actually set foot inside High Fidelity but are nevertheless will to offer comments concerning it.

I’ve actually neglected updating on HiFi for a while, my last report having been at the start of March. However, even since then, things have moved on at quite a pace. The website has been completely overhauled and given a modern “tile” look (something which actually seems to be a little be derivative rather than leading edge – even Buckingham Palace has adopted the approach).

High Fidelity open beta requirements
High Fidelity open beta requirements

The company has also hired Caitlyn Meeks, former Editor in Chief of the Unity Asset Store, as their Director of Content, and she has been keeping people appraised of progress on the platform at a huge pace, with numerous blog posts, including technical overviews of new capabilities, as well as covering more social aspects of the platform, including pushing aside the myth that High Fidelity is rooted in “cartoony” avatars, but has a fairly free-form approach to avatars and to content.

High Fidelity may not be as sophisticated in terms of overall looks and content – or user numbers – as something like Second Life or OpenSim, but it is grabbing a lot of media attention (and investment) thanks to it have a very strong focus on the emerging ranging to VR hardware systems, and the beta announcement is timed to coincide with the anticipated increasing availability of the first generation HMDs from Oculus VR and HTC. Indeed, while the platform is described as “better with” such hardware and can be used without HMDs and their associated controllers, High Fidelity  describe it as being “better with” such hardware.

High Fidelity avatars
High Fidelity avatars

I still tend to be of the opinion that, over time, VR won’t be perhaps as disruptive in our lives as the likes of Mixed / Augmented Reality as these gradually mature; as such I remain sceptical that platforms such as High Fidelity and Project Sansar will become as mainstream and their creators believe, rather than simply vying for as much space as they can claim in similar (if larger) niches to that occupied by Second Life.

And even is VR does grow in a manner similar t that predicted by analysts, it still doesn’t necessarily mean that everyone will be leaping into immersive VR environments to conduct major aspects of their social interactions. As such, it will be interesting to see what kind of traction high Fidelity gains over the course of the next 12 months, now that it might be considered moving more towards maturity – allowing for things like media coverage, etc., of course.

Which is not to share the capabilities aren’t getting increasingly impressive, as the video below notes – and just look at the way Caitlyn’s avatar interact with the “camera” of our viewpoint!

 

 

.

High Fidelity: “VR commerce”, 200 avatars and scanning faces

HF-logoHigh Fidelity have a put out a couple of interesting blog posts on their more recent work, both of which make for interesting reading.

In Update from our Interns, the provide a report by Edgar Pironti and Alessandro, Signa two of High Fidelity’s interns who have been working as interns  on a number of projects within the company, including developing a single software controller for mapping inputs from a range of hand controllers, with the initial work involving the Razer Hydra, HTC Vive’s controllers and the Space Navigator. They also discuss working on recording and playback functionality, which is also expanded upon in the second blog post which caught my eye, the January newsletter, issued by Chris Collins.

This work has involved developing the ability to pre-record the data stream of an avatar – audio, facial expressions and body movement in a format which can later be played back on a server under the control of JavaScript. As Chris notes, this makes it very easy to quickly populate a VR experience with compelling pre-recorded avatar content, allowing life-like characters to a place or for use within a machinima film.

As their third reported project. Edgar and Alessandro discuss how they’ve been looking into creating a “VR commerce” environment. This combines elements of physical world shopping – sharing it with friends, actually grabbing and trying items, having discussions with sales staff, etc., with the convenience of e-shopping, such as quickly changing colours, seeing customer reviews and feedback, and so on. As well as explaining how they went about the task, Edgar and Alessandro have put together a video demonstration:

In the High Fidelity newsletter, Chris Collins covers a number of topics, including work on optimising avatar concurrency on a single High Fidelity server. While this work most likely used Edgar’s and Alessandro’s approach to pre-recording avatar  data streams mentioned above, the initial results are impressive: 200 avatars on a server, of which the 40 nearest the observer’s viewpoint are rendered at 75Hz when using the Oculus Rift, and with a very high level of detail, with full facial animations.

200 avatars on a High Fidelity server as the comes starts into optimising avatar concurrency (image: High Fidelity)
200 avatars on a High Fidelity server as the comes starts into optimising avatar concurrency (image: High Fidelity)

One of the things that High Fidelity has often be critiqued for by SL users is the cartoon like avatars which were first shown as the company gradually cracked open its doors. These are still in use, but there has also been a lot of work put into making the avatars more life-like should users so wish. However, there is a trade-off here, which has been discussed in the past: the so-called uncanny valley effect: the closer the facial features look and move almost, but not exactly, like natural beings, it causes a response of revulsion among some observers.

This has tended those investigating things like avatar usage to express caution in pushing too close to achieving any kind of genuine realism in their avatars, and Philip Rosedale has discussed High Fidelity’s own gentle pushing at the edge of the valley. Now it seems the company is stepping towards the edge of the valley once more, using 3D scans of people to create avatar faces, as Chris notes in the newsletter:

We scanned our whole team using two different 3D scanners (one for hair and one for the face), and then used some simple techniques to make the results not be (too) uncanny … Although there is still a lot of work to do, we achieved these results with less than 2 hours of work beyond the initial scans, and the effect of having our team meetings using our ‘real’ avatars is quite compelling.

High Fidelity's staff group photo using scans of their own hair and faces (image: High Fidelity)
High Fidelity’s staff group photo using scans of their own hair and faces (image: High Fidelity)

Not everyone is liable to want to use an avatar bearing a representation of their own face, and the idea of using such a technique does raise issues around identity, privacy, etc., which should be discussed, by High Fidelity’s work in this area is intriguing. Although that said, and looking at the staff group photo, I would perhaps agree there is still more work needed; I’m not so much concerned about the technique pushing towards the edge of the uncanny valley so much as I am about the avatars in the photo looking just that little bit odd.

Also in the update is a discussion on audio reverb, a look at how the use of particles can be transformed when you’re able to see your “hands” manipulating them, and a look at a purpose-built game in High Fidelity.  These are all discussed on the video accompanying the January video, which I’ll close with.

High Fidelity: Stephen Wolfram and more on tracking

HF-logoOn Tuesday, December 29th, High Fidelity announced that Stephen Wolfram has become their latest advisor.

British-born Stephen Wolfram is best known  for his work in theoretical physics, mathematics and computer science. He  began research in applied quantum field theory and particle physics and publish scientific papers when just 15 years old. By the age of 23, he was studying at the School of Natural Sciences of the Institute for Advanced Study in Princeton, New Jersey, USA, where he  conducted research into cellular automata using computer simulations.

Stephen Wolfram via Quantified Self
Stephen Wolfram via Quantified Self

When introducing Wolfram through the High Fidelity blog, Philip Rosedale notes this work had a profound impact on him, as did – later in life – Wolfram’s 2002 book, A New Kind of Science.

More recently, Wolfram has been responsible for WolframAlpha, an answer engine launched in 2009, and which is one of the systems used by both Microsoft’s Bing “decision engine” and also Apple’s Siri. In 2014, he launched the Wolfram Language as a new general multi-paradigm programming language.

In become an advisor to High Fidelity, Dr. Wolfram joins Peter Diamandis, the entrepreneur perhaps most well-known for the X-Prize Foundation, Dr. Adam Gazzaley, founder of the Gazzaley cognitive neuroscience research lab at the University of California, Tony Parisi, the co-creator of the VRML and X3D ISO standards for networked 3D graphics, and a 3D technology innovator, Professor Ken Perlin of the NYU Media Research Lab, and Professor Jeremy Bailenson, the director of Stanford University’s Virtual Human Interaction Lab.

In their October update published at the start of November, High Fidelity followed-up on the work they’ve been putting into various elements of tracking movement, including the use of BinaryVR for tracking facial movement and expressions. In particular, the company’s software allows users to create a their own virtual 3D face from 2D facial photos, allowing them to track their facial animations in real-time, transforming them onto the CG representation of their face.

Ryan balances one object atop another while Chris uses the gun he picked-up with a hand movement, then cocked it, to try and shoot the yellow object down
Ryan balances one object atop another while Chris uses the gun he picked-up with a hand movement, then cocked it, to try to shoot the yellow object down

Integration of the BinaryVR software allows High Fidelity to track users’ mouth movements through their HMDs, allowing their avatars to mimic these movements in-world, as Chris Collins demonstrates in the update video. The company has also been extending the work in full body tracking, as seen in my October coverage of their work, and this is also demonstrated in the video alongside of more in-world object manipulation by avatars, with Chris and Ryan building a tower of blocks and Chris then picking up a gun and shooting it down.

The hand manipulation isn’t precise at this point in time, as can be seen in the video, but this isn’t the point; it’s the fact that in-world objects can be so freely manipulated that is impressive. That said, it would be interesting to see how this translates to building: how do you accurately sized a basic voxel (a sort-of primitive for those of us in SL) shape to a precise length and width, for example, without recourse to the keyboard or potentially complicated overlays?

Maybe the answer to this last point is “stay tuned!”.