Project Bento arrives on the main grid in Second Life

Project Bento, the Lab-initiated, collaborative project involving Second Life content creators to bring greater capabilities to mesh avatars and – potentially – rigged attachments – is now available on Agni, the Second Life main grid.

The news – not entirely unexpected, as the Lab has been gearing-up to make the move for the last few weeks – came via an official blog post on Tuesday, May 31st.

Project Bento has been in development for over a year, the initial phases of the work being carried out by the Lab behind closed doors, before a period of closed development involving a number of expert creators and tool makes – notably the Avastar team who produce the avatar plug-in for Blender, and Cathy Foil, who produces Mayastar, a similar plug-in for Maya. I was also invited to observe this initial work – my sincere thanks to Oz Linden for the opportunity – so that I could follow the project and report on its development, which I was able to start doing in December 2015, once the project had been publicly announced, and the project opened to greater input from content creators and animators.

Project Bento has involved staff from Linden Lab, notably Troy Linden, Oz Linden and Vir Linden, together with assistance from Alexa Linden, Simon Linden, Rider Linden, Aura Linden and others. It has also involved SL content creators including the folk from Avastar, Cathy Foil, Toady Nakamura, Siddean Munro and Flea Bussy
An early Project Bento meeting. The project has involved staff from Linden Lab, notably Troy Linden, Oz Linden and Vir Linden, together with assistance from Alexa Linden, Simon Linden, Rider Linden, Aura Linden and others. It has also involved the folk from Avastar and Mayastar as well as many content creators and animators

At that time, Bento introduced over 90 additional bones to the avatar skeleton, with no fewer that 30 being added to avatars hands to allow for finger manipulation, and another 30 to the head for facial expressions. To further support the new additions, new attachment points were added to the skeleton and – most recently of all – a good number of the bones (particularly those in the face) were hooked-up the viewer appearance sliders, allowing them to adjust elements of suitably rigged mesh heads, etc.

Net result: the ability for mesh avatars to be far more expressive and customisable than before, and much, much better support for non-human avatars. There’s also the potential for a wide range of other uses – such as Aki Shichiroji’s wyvern pictured below, or  rigged attachable pets – even the potential for gowns and other clothing to move naturally with an avatar’s movement.

Aki Shichiroji demonstrates a wearable wyvern utilising Bento bones for animation. Inset: the model under development at a Bento meeting.
Aki Shichiroji demonstrates a wearable wyvern utilising Bento bones for animation. Inset: the model under development at a Bento meeting (main image courtesy of Linden Lab)

Many of the possibilities for Bento are highlighted in a special promotional video released by the Lab and embedded at the end of this article, made with the full support for the creators who have been actively engaged in the project for the last 6-12 months.

It is important yo note that – as the official blog post states, this still a testing release of Project Bento: making it available to a wider audience than is possible when it is constrained to Aditi, and thus allowing further testing of things like overall simulator / grid performance with larger numbers of Bento avatars operating, looking out for other issues, etc., which may not have come to light during the Aditi testing, and also further refining and improving the viewer so it might progress to a release status.

Which brings up a further important point, again as the official blog post notes:

Anyone wishing to view the new content must be running the latest Bento Project Viewer.

If you encounter Bento avatars and are not using the Bento Project Viewer, you may see some strangely behaving avatar animations and meshes. If you’re using a very old (i.e. no longer supported) viewer, encountering Bento content may even cause a crash.

Some TPVs have already starting integrating the Bento code into experimental versions of their viewers. However, if you are testing Bento, working with content which leverages Bento capabilities, you are best off using the official project viewer for the purposes of bug reporting, etc.

There is also a Project Bento User Group wiki page for  those wishing to get involved in the project. However, please note that the meeting venue will likely be changing from Aditi to Agni now the project is available on the main grid.

Note, as well, that Project Bento is intended for use with mesh avatars and models – the capabilities are not intended to work with the default avatar form, as it was felt that attempting to do so risked potential content breakage and / or other issues which could impact the project.

Nevertheless, the new capabilities could herald a new era for mesh avatars within Second Life, with more realistic non-human avatars, greater dexterity with human-style avatars and even the potential for expressive, customisable mesh heads! So, welcome to the start of a new era for mesh avatars in Second Life.

Useful Links

Project Bento User Group update 14 with audio

Project Bento – extending the SL avatar skeleton
Project Bento – extending the SL avatar skeleton

The following notes and audio were taken from the weekly Bento User Group meeting, held on Thursday, May 26th at 13:00 SLT on Aditi. For details on each meeting and the location, please refer to the Bento User Group wiki page.

Note that this update is not intended to offer a full transcript of the meeting, nor does it present the discussion points in chronological order. Rather, it represents the core points of discussion, grouped together by subject matter were relevant / possible, whilst maintaining the overall context of the meeting.

Bento on Agni

A Bento Imp celebrates the upcoming Bento move to Agni
A Bento Imp celebrates the upcoming Bento move to Agni

It had been hoped that back-end support for Bento would be enabled on Agni (the main grid) during week #21. However, things got held up while a fix was being pushed through QA (possibly the security fix which rolled to LeTigre and then to all channels this week?).

The Lab is now planning to enable Bento in week #22, most likely on Tuesday, May 31st.

A couple of points to remember with the move to Agni:

  • This isn’t in any way a “final” release of Bento, although the Skeleton and slider updates are now frozen (unless a really significant issue / bug is found. At this point, enabling Bento on Agni, which includes the ability to upload Bento items to the main grid, is to expose the capabilities to a wider audience of content creators and allow broader testing
  • Until the Bento code comes into wider circulation among TPVs, any mesh avatars, etc., rigged to the new bones will look deformed in non-Bento viewer, and may cause some viewer instability / crashes.

Details are still TBD, but one aspect of the move to Agni will be a further stress test to see how large numbers of Bento avatars impact performance, region crossings, etc. Details, including date and time will be made available in due course.

Date and Location of Next Meeting

With the deployment of Bento to the main grid, Bento User Group meetings will also swap over to Agni as well to encourage attendance. Details of where meetings will take place will be announced via the User Group wiki page and through the Bento forum thread.

With regards to the next meeting, due on Thursday, June 2nd, there is a Lab internal meeting taking place that day. It is therefore unclear if the Bento meeting will take place or will be cancelled (Vir would prefer for the latter not to happen, given the scheduled Bento deployment to the main grid). A decision on whether, when and where it will be held will again be made via the User Group wiki page, etc., once decided.

Project Viewer Update

The Bento Project viewer updated to version 5.0.0.315657 on Thursday, May 26th. This version includes the following significant updates:

reset skeletionA “Reset Skeleton” option, intended to fix cases where an avatar is distorted in your world view as a result of incorrectly applied joint updates. For example, a non-human avatar may show as “crunched up” because it is still in a human pose.

Right-clicking on the affected avatar (your own or another) and selecting Reset Skeleton from the avatar context menu should correct the avatar’s appearance in your view. As this is a viewer-side update, it will not affect how anyone else sees the affected avatar until they use Reset Skeleton. The Lab has requested feedback on the capability if it fails to work as intended.

The viewer also includes a few late-breaking changes to the slider support for mesh avatars, including jaw shape and head shape. Sliders that affect the scale of mPelvis now also alter mHindLimbsRoot, to better keep the front and hind legs synced up.

Updated Skeleton and Test Files

At the time of writing, the Bento test files have yet to be updated to reflect the most recent viewer changes. When this has happened, they will be linked via the Bento Testing page. Matrice Lavalle from Avastar and Cathy foil of MayaStar are working on getting the skeleton files updated for their respective plug-ins, and ensuring the are consistent with one another, something they hope have finished in the very near future.

Once this has been done, both Avastar and Mayastar will be updated, and will include collision volumes and some other weighting tweaks which should help improve slider behaviour when editing an avatar’s appearance.

Vir has started putting together a repository for supporting test models and animations which can be made available through the wiki Bento test page, so if there are other Bento creators / animators who have test models and files they would like to submit, he asks that they drop him a line.

There was also discussion on how to present the models to ensure those using different modelling tools (e.g 3D Max) can obtain a full set of bones with which to work.

Other Items

BVH File Interpreter

The Second Life BVH interpreter has apparently been updated so it will allow the upload of position data. However, if problems are found when doing so, the Lab requests a JIRA is filed to let them know,

Animation Exports and Mayastar / Maya

Mayastar is the skeleton plug-in Cathy Foil produces for Maya users (Avastar being the plug-in for Blender). Mayastar will current export  .BVH files with bone rotations for the entire skeleton, but translations for the mPelvis bone only. This works reasonably well with these restrictions, although it does have an issue with feet Cathy is currently looking to fix. As far as skinning, etc., is concerned, Maya works “pretty good”.

However, and in her own time, Aura Linden is working on an exporter for Maya which is intended to support export .ANIM files with both rotation and translation of all bones in the skeleton.

This should eliminate the need to sue two skeletons for Mayastar – one for rigging and one for animations. Subject to confirmation, the .BVH uploader may also have been updated to eliminate the need to use two skeletons.

Continue reading “Project Bento User Group update 14 with audio”

SL project updates 16 19/2: server, viewer, Bento Agni deployment

Rosemoor; Inara Pey, May 2016, on FlickrRosemoorblog post

Server Deployments Week #19 – Recap

The RC server maintenance package deployment planned for Wednesday, May 11th was postponed as a result of the 3-day Aditi outage delaying testing. The update, which comprises minor internal improvements which present no visible functional changes to Second Life, will now most likely go ahead until week #20 (week commencing Monday, May 16th.

Viewer Updates

The Quick Graphics RC viewer updated to version 4.0.5.315117 on Wednesday, May 11th, brining it to code parity with the current release viewer. Providing no major issues are uncovered, this might be the last RC update for this viewer prior to its promotion as the de facto release viewer.

Project Bento

As noted above, the Project Bento meeting was severely disrupted by continuing Aditi issues, which left people unable to reach the meeting either via direct log-in or via teleport.  As Vir Linden was also unavailable (due to an unrelated matter), Troy Linden steered the meeting, fighting against a slowly deteriorating region condition.

A pile-on test had been planned for immediately after the meeting with the intention of stress testing a region with a large number of animated Bento avatars all with active animations. The test was to have been an internal Lab test, but members of the Bento user group were invited to join-in as well if they wished. Unfortunately, the continuing poor Aditi performance force the test to be postponed.

Agni Test Release Deployment

Allowing for things like stress testing and unforeseen issues, the plan is for a test release of Bento on Agni (the Main grid) to be made during week #21 (week commencing Monday, May 23rd).

The release will be the current server-side support for Bento, plus the project viewer. It has not as yet been decided to make the deployment grid-wide, or restrict it to an RC channel  / dedicated channel.

The deployment is to gain a broader audience testing Bento assets and content and using the viewer. This does mean that if you wish to see or try Bento content, you will have to be using either the Bento project viewer, or a TPV which has the Bento updates.

Continuing voice issues rendered recording the meeting impractical, so hopefully normal reporting will resume  next week.

 

 

Lab Chat #3 in 10-ish minutes

Lab Chat #3: Troy, Oz and Ebbe
Lab Chat #3: Troy, Oz and Ebbe

Friday, May 6th saw the third in the Lab Chat series take place in-world, featuring guests Oz Linden, the Director of Second Life Engineering, Troy Linden, a Senior Producer of Second Life and of course, Linden Lab CEO, Ebbe Altberg, in his alter-ego of Ebbe Linden.

You can find the full transcript, with audio extracts, as previously published in these pages by following this link.

However, I’ve been asked by a number of people if I could summarise things, rather than them having to read the entire transcript or just having a list of up–front links. I’ve therefore produced this summary, complete with links to the full answers within the transcript. If this approach proves popular with readers, I’ll adopt it as the lead-in to future transcripts.

Work in progress: Aki Shichiroji demonstrates a wearable wyvern utilising Bento bones for animation.
Work in progress: Aki Shichiroji demonstrates a wearable wyvern utilising Bento bones for animation.

Project Bento

  • How will creators make poses and animations for the new bones (wings, fingers, facial expressions, etc)? Creators will be able to use existing plug-ins (MayaStar, Avastar) to create animation content for Project Bento as is currently the case. Full answer.
  • Will there be any in-world tools for Bento pose and animation creation? At this point, Second Life doesn’t have any in-world animation creation tools, and Bento does not attempt to add them. Instead it leverages existing out-world tools. Full answer.
  • Will Bento have the ability to animate (or pose) separately?  Yes. Second life does already support isolating animations to certain parts, and Bento is no different.  Full answer.
  • Will any of the work on the Bento facial bones be incorporated into the default/system avatar for expressions, etc? The default system avatar has not at this point been re-rigged to use the new Bento bones. However, custom mesh heads, when rigged to the bones, will be able to make use of them. Full answer.
  • Will there be, or are there any plans to introduce animated mesh into Second Life (e.g. animated pets, etc)? No comment on whether or not animated meshes will be supported in the future. However, Bento bones can be used to provide a level of animation of creatures, objects, attached to an avatar (e.g. bats flying around your head). Full answer.
  • Will any attempts be made to have the new bones be scriptable for the use in user-created animation rigs like Anypose?  There are no plans to add scripting capabilities that are specific to Bento at this time. Full answer.
  • Can some Bento UG meetings be held at an “Asia friendly” time? It will be looked into. Full answer.

Second Life

The new Experience Keys based Social Islands
The new Experience Keys based Social Islands – see below
  • Can we have tools inside inventory to help manage it?  The Lab is focused on improving inventory operation robustness, and will have a new viewer offering this soon. Better inventory management interfaces and tools are a terrific idea, and something TPVs could even contribute. Full answer.
  • Will we see similar edutainment-type experiences as the new social islands, but aimed at more advanced users? Yes, very probably in time. Full answer.
  • Why doesn’t Second Life have gift cards which can be purchased in stores like other games? Probably more interesting to think of ways to sort-of refer a friend, maybe, with an associated gift card to get them into the world. But something to examine. Full answer.
  • Any plans to provide more robust photography tools similar to Firestorm’s Phototools? Will existing tools be updated? Lab prefers not to comment on things until close to release; photography floater updates an excellent opportunity for TPV / open-source contributions. Full answer.
  • Can sound files be increased in length beyond the 10 second limit? Yes, and animation file sizes can be increased. By how much isn’t clear, and the work will be dependent on moving the assets to CDN delivery first. Full answer.
  • Will we be able to texture more than 8 faces when editing mesh in-world?  The change made in Sept 2015 refers to allowing more than 8 textureable faces as a part of the upload process, not to in-world editing. No further changes planned at present. Full answer.
  • Will any similar incentive to the private island buy-down offer be presented to Mainland owners? Not at present. Time is required to analyse the other impact of the buy-down offer and determine its overall benefit (or otherwise). So nothing planned for Mainland at the moment or immediate future. Full answer.
  • Will anything be done to address vehicle region crossing issues, particularly with large vehicles, which have become worse over the past year? Lab not aware of any changes that should have made things worse, but will look into matters. However, large vehicles have always been problematic on region crossings, so no promises. Full answer.
  • Will RLV functionality be added to the official viewer? Longer-term, Lab will add more capabilities to Experience Keys which will be similar to, but not compatible with, RLV. Full answer.
  • Will Experience Keys be opened to Basic members to create Experiences? Experience Keys will remain Premium-only do to potential griefing abuse. Premium helps ensure accountability.  Full answer.
  • Will Experience Search (and other search) be improved? The  current focus is the Marketplace search beta, using Elasticsearch. This will likely become the default MP search engine soon. The Lab may then use Elasticsearch on other search capabilities. Full answer.
  • Will the Marketplace Listing Enhancement issues & JIRAs be addressed? The Lab believes they have a fix for a major cause, which is in the process of being implemented and may clear up most issues. Full answer.
  • Can the number of Estate Managers be increased? Will be looked at. Full answer.
  • What’s the best way to report group spammers? Single or Multiple reports? Via the Abuse Report, Quality of report, not quantity is important. Many reports aren’t actionable as they are incomplete. Full answer.
  • Does LL give employees time to use SL? Yes & all staff are encouraged to spend time in SL when first starting. Oz Linden also looks to recruit from SL users where possible. Full answer.
  • Any thoughts on Vulkan graphics support for SL? For SL, no. Sansar, yes.
  • Can we have an update on Linden Realms and the grid hunt games available through the portal parks? New Linden content is coming, but no details given.

Continue reading “Lab Chat #3 in 10-ish minutes”

Reminder: Lab Chat #3, May 6th with Ebbe, Oz, Troy and Bento

Lab Chat LogoLab Chat is the name of the public Q&A series aimed at providing Second Life users with the opportunity to have their questions put to Lab management and personnel.

The first two sessions in the series took place in November 2015 and January 2016 respectively, with guest Ebbe Altberg, CEO of Linden Lab. Each event covered both Second Life and Project Sansar and saw Ebbe respond to questions selected from those put forward to a forum thread ahead of each event.

The third in the series will take place on Friday, May 6th, starting at 10:30 SLT at the Linden Endowment for the Arts Theatre. The guests for this session will be:

Ebbe Linden (Ebbe Altberg, the Lab’s CEO), who requires no introduction here. He’ll obviously be answering any questions on Project Sansar which are raised during the show.

Oz Linden, the Director of Second Life Engineering at Linden Lab, and is perhaps most noted for his involvement with viewer development, including contributions from the open-source community and TPVs. He oversees almost all aspects of the technical development of Second Life, both viewer and server, and works closely with his engineers and developers to ensure Second Life continues to be enhanced.

Troy Linden, a Senior Producer of Second Life at the Lab, and has been involved in bringing numerous high-profile projects within SL to fruition, and is currently engaged in Project Bento, the project to greatly extend the second Life avatar skeleton, which Oz’s team is currently working on together with members of the SL content creation community.

Because both Oz and Troy will be present at the show, the majority of the questions this time around will be focused on Second Life and Project Bento, so this is a great opportunity to find out what is being planned for Second Life, and what Project Bento is all about and what it might mean for you.

Among many other things, Bento offers the potential for animated facial expressions and animated fingers (shown in this video by Abramelin Wolfe) on mesh avatar models

The show will be recorded in audio, which will be made available some time after the show has wrapped. I hope to attend and produce a full transcript, and those wishing to catch-up on the first two Lab Chat sessions through this blog can do so by following the links below:

For those who prefer, videos of the first two sessions can be found on YouTube:

LEA Theatre SLurls

Project Bento User Group update 13 with audio

Project Bento – extending the SL avatar skeleton
Project Bento – extending the SL avatar skeleton

The following notes and audio were taken from the weekly Bento User Group meeting, held on Thursday, April 28th at 13:00 SLT on Aditi. For details on each meeting and the location, please refer to the Bento User Group wiki page.

Note that this update is not intended to offer a full transcript of the meeting, nor does it present the discussion points in chronological order. Rather, it represents the core points of discussion to Project Bento, grouped together by subject matter were relevant / possible.

Issue Fixes

Partial Joint Offsets

As noted in my last update, one issue facing Bento is in how best to handle defining partial joint offsets – a mesh that specifies the override positions for some of the joints but leaves  other joints alone, which would allow different meshes to be mixed and matched to create an avatar look. Currently, the viewer doesn’t handle  multiple root bones in a mesh with partial rigging correctly, and to help correct this, Vir Linden has published a proposal for moving forward. Essentially, this would filter out any joints which have a position unchanged from their expected default, even if the mesh claims to use an offset, with only a very small adjustment (0.1mm or greater) is required to have a joint treated as having its own offset.

Offset and Slider Conflicts

Another issue which has been discussed recently is that joints offsets (notably translation offsets) can conflict with adjustments made using the appearance sliders, resulting in adjustments made using the sliders “snapping back” to their original location on leaving edit shape or following a relog or after removing / rewearing the avatar mesh.

An adjustment has now been made so that where an offset has been set for a joint, adjustments made using the sliders which only affect the offset will be ignored, only changes to the scale of a joint (length, height) made using the sliders will work. It is thought that this fix will also address the likes of BUG-11854.

Work in progress: Aki Shichiroji demonstrates a wearable wyvern utilising Bento bones for animation.
Work in progress: Aki Shichiroji demonstrates a wearable wyvern utilising Bento bones for animation.

It has also been noted that BUG-10991, “[Bento] Mesh rigged to the new joints either partly disappears, collapses or melts when viewing that avatar as an imposter” has not been fixed with the latest version of the project viewer. It will hopefully be one of the issues addressed with the next update.

Next Viewer Update

The above fixes, coupled with other work which has been carried out are regarded as being sufficient to kick-off another update to the project viewer, although there is a further piece of work Vir hopes to include. If all goes according to plan, this should see a new version of the Bento project viewer appearing in week #18 (week commencing Monday, May 2nd).

Animation File Size Limit

Currently, there is a file size limit of 120 Kb on animation files enforced by the back-end servers. With the increased number of bone available for animation. As it is now possible to animate a far large number of joints, some creators have started to find this limit a problem, and a request has been put in for it to be increased (see BUG-11836).

While there is potential for this to be done, it is currently unclear how much the file size limit should be increased. There are also other considerations to take into account, such as the intention for animation assets to be moved to the CDN for better delivery.

If there are specific examples of animation with large file sizes which could be attached to the JIRA as examples, they would be welcomed by the Lab. It has also been suggested that the Lab establish a best practices guide for animations files on the wiki.

This lead to a brief discussion on interpolation and the differences between .BVH and .ANIM animations, with Vir providing background information on how each are respectively handled.

Sliders for Remaining Bento Bones

While many Bento bones  – notably those of the face / head – have been tied-into the existing appearance sliders, there are still those which do not have slider support because they would require the development of dedicated sliders. this has been considered outside the scope of the initial Bento work, and it is far from certain it will be taken up in the near-term future, if at all.

Part of this comes down to the added complexity further sliders would thrust into the viewer UI, and also – as Vir explains – because the use of many of the Bento bones is intended to be arbitrary, therefore providing sliders to adjust them may not suit all of the uses to which they might be put, and cause further confusion / unpredictable results when used.

Continue reading “Project Bento User Group update 13 with audio”