Tag: Server Updates

2019 SL User Groups 23/1: Simulator User Group

Posted on by Inara Pey

Whimberly; Inara Pey, April 2019, on FlickrWhimberly – blog post

Server Deployments

At the time of writing, a deployment thread had yet to be posted (in fact, it’s not entirely clear what is happening with the weekly release threads). However:

  • There was no SLS (Main) channel deployment on Tuesday, June 4th, leaving it on server maintenance package #19 19.05.17.527341.
  • On Wednesday, June 5th, the Magnum and LeTigre RC channels should be updated to server maintenance package #19 19.05.24.527547, bringing them to parity with BlueSteel.

SL Viewer

There have been no LL viewer updates at the start of the week, leaving the pipelines as follows:

  • Current Release version 6.2.2.527338, formerly the Teranino RC viewer, promoted May 22 – No Change.
  • Release channel cohorts (please see my notes on manually installing RC viewer versions if you wish to install any release candidate(s) yourself):
  • Project viewers:
  • Linux Spur viewer, version 5.0.9.329906, dated November 17, 2017 and promoted to release status 29 November – offered pending a Linux version of the Alex Ivy viewer code.
  • Obsolete platform viewer, version 3.7.28.300847, May 8, 2015 – provided for users on Windows XP and OS X versions below 10.7.

In Brief

Script Processing Issues

As I’ve recently reported, there have been numerous reports of script run time issues, with some reporting that problems only started occurring following the roll-back on April 18th, 2019. BUG-226851 (and more recently BUG-227099) outlines some of the problems. Some regions experiencing the issue have been cloned to Aditi (the beta grid) where they are running fine, and the Lab is currently looking at script scheduling on Agni (the Main grid).

There is a forum thread on the impact of idle scripts (i.e. scripts that are scheduled, but waiting on an event) on full regions (primarily Mainland). In particular, the finding suggest that limiting in-world scripts to 1 per 10LI (2250 script for a Full region) might help pending improvements – although this falls woefully short of shopping-related regions.

Commenting on the situation, Simon Linden states:

We’re actively looking at script scheduling now and these odd cases are on the list to sort out. There hasn’t been a big magic fix yet but it’s getting attention.

Rider Linden added:

And, yes. Idle scripts are not really idle… they can drag down sim performance even if they are not actually doing anything. Right now llListen() is a major culprit (but I’m hoping we can clean that up in the near future) … [and] all idling is not equal. Some events are more expensive than others to wait on.

EEP Issues

As per my May 30th CCUG update, it’s been noted that a recent deployment has resulted in rendering issues for the Environment Enhancement Project (EEP) – see BUG-227100 as an example.

The EEP RC viewer is due for an update, and it is hoped that these will include shader fixes that should correct the problems in that viewer. However, in terms of the simulator problems that are causing issues for those on non-EEP viewers, Rider Linden commented:

We have had some confusion on our end. When we were chasing the teleport bug a couple fixes were accidentally dropped from the simulator. We’ve been sorting those out as we find them.

Other Performance Impacts

  • It’s long been recognised that teleports – particularly teleports involving mesh-heavy avatars into a region can adverse affect performance (see BUG-8496).
    • Beq Janus has been looking at this, and can show – via a a comment posted to the above Jira, that the effect “ripples through” simulator stats, including hitting script stats.
    • She estimates that overall, the arrival of a mesh avatar in a region can take around 6 seconds to ripple through the region (and impacting users within the region).
    • It’s currently estimate by both Beq and Lou Netizen that female avatars carry on average 70 scripts, and mail avatars an average of 68 (see here for more).
  • Beq has also been investigate another performance impact – that of the viewer flooding the server with GroupProfileRequest at log-in due to persistent notifications see BUG-227094). She is currently working on a patch for contribution to LL to resolve this issue.

2019 SL User Groups 22/1: Simulator User Group

Posted on by Inara Pey

Season's Cove; Inara Pey, April 2019, on FlickrSeason’s Cove – blog post

Update, May 29th: the BlueSteel RC updated to server maintenance package #19 19.05.24.527547. Magnum and LeTigre appear to have remained on  #19 19.05.17.527341.

Server Deployments

At the time of writing, a deployment thread had yet to be posted however:

  • On Tuesday, May 28th, the SLS (Main) channel updated to server maintenance package #19 19.05.17.527341, previously deployed to all three RC channels.
  • It does not appear that the three main RC channels will be updated on Wednesday, May 29th. Commenting on releases, Simon Linden said:

For server news, we updated the main channel of regions this morning, so the grid is pretty much all on the same version, except for one small RC channel. That’ll get updated tomorrow, I believe.

This “small” update might include an initial deployment of the updated region crossing code that has been subject to testing in the last couple of weeks, as per my last couple of Simulator User Group updates.

SL Viewer

There have been no LL viewer updates at the start of the week, leaving the pipelines as follows:

  • Current Release version 6.2.2.527338, formerly the Teranino RC viewer, promoted May 22nd.
  • Release channel cohorts:
  • Project viewers:
  • Linux Spur viewer, version 5.0.9.329906, dated November 17th, 2017 and promoted to release status November 29th, 2017 – offered pending a Linux version of the Alex Ivy viewer code.
  • Obsolete platform viewer, version 3.7.28.300847, May 8th, 2015 – provided for users on Windows XP and OS X versions below 10.7.

In Brief

Script Processing Issues

As I’ve recently report, there have been numerous reports of script run time issues, with some reporting that problems only started occurring following the roll-back on April 18th, 2019. BUG-226851 outlines some of the problems. Some regions experiencing the issue have been cloned to Aditi (the beta grid) where they are running fine, and the Lab is currently looking at script scheduling on Agni (the Main grid).

It has been suggested that multi-thread LSL might offer advantages, prompting Simon Linden to comment:

Again it’s a tougher job retrofitting multiple threads since it wasn’t part of the original design … it would have to be an update queue … but that adds some problems too, as if you call one function and it changes something in-world, then one to get the info … we’d have to suspend until we apply the first. I’m not saying it’s a bad idea or anything … just that it would turn into a monster project.

Rider Linden added:

Threading is one of those things that really needs to be considered up front in the design. Trying to retrofit it into an existing project can lead to madness.

Voice Griefing

Voice griefing can be a problem on voice-enabled regions. It can take several forms (e.g. someone hacks voice system so they can connect to a region without being in it or even logged in). Detailing with these types of hacks  is exceptionally difficult. However, Oz commented in the SUG meeting that LL are working to address this problem – how wasn’t specified, but one possible way of doing so would be for Support to be able to remove an offending user from voice.

2019 SL User Groups 21/1: Simulator User Group

Posted on by Inara Pey

Amrum; Inara Pey, April 2019, on FlickrAmrum – blog post

Server Deployments

There have been no release notes for the week #21 deployments. however:

  • On Tuesday, May 21st, the SLS (Main) channel updated to server maintenance package 19.05.10.527185, containing internal fixes.
  • On Wednesday, May 22nd, the three RC channels updated with server maintenance package 19.05.17.527341.

SL Viewer

  • The Alternate viewer wiki page has now been retired and replaced by a new Alternate Viewers page.
  • The de facto release viewer was updated to version 6.2.2.527338, dated May 20th, formerly the updated Teranino Maintenance RC.

The rest of the current SL viewer channels remain as:

  • Release channel cohorts:
  • Project viewers:
  • Linux Spur viewer, version 5.0.9.329906, dated November 17, 2017 and promoted to release status 29 November – offered pending a Linux version of the Alex Ivy viewer code.
  • Obsolete platform viewer, version 3.7.28.300847, May 8, 2015 – provided for users on Windows XP and OS X versions below 10.7.

In Brief

  • Teleport Fail Issues: following the last Server User Group meeting on Tuesday May 14th, there was a test of a teleport fix Simon Linden had been working on, and a further test was carried out following this week’s meeting, with Simon Linden commenting:

Last week’s test was really helpful – it showed that one problem seemed to be fixed, but exposed another one that I hope is fixed this week. If it goes well, that new teleport code may go out onto RC channels next week.

  • Teleport Attachment Issues: this is a separate issue to that being investigated by Simon Linden, and which is more related to . there’s no current update on the work being put into fixing this, but as Simon observed in the meeting:

As far as I know, the problems with attachments tend to be with crossings and not teleports … while much of the code is the same, there’s usually a fundamental difference in crossings because you’re already connected to that region before you go there, whereas with teleports you are not … which was part of the big disconnect issue we had before.

  • Script Processing Issues: as reported in my week #18 SUG summary, there have been numerous reports of script run time issues, with some reporting that problems only started occurring following the roll-back on April 18th, 2019. BUG-226851 outlines some of the problems. The Lab are looking into this, but at present there are no updates on the problem.

 

2019 SL User Groups 20/1: Simulator User Group

Posted on by Inara Pey

La Virevolte; Inara Pey, March 2019, on FlickrLa Virevolte – blog post

Server Deployments

At the time of writing, a deployment thread had yet to be posted however:

  • There are no deployment to the SLS (Main) channel on Tuesday, May 14th, leaving regions on that channel on server maintenance package 19#19.04.25.526669, primarily intended to correct the simulator-side EEP regressions that resulted of the roll-back of Thursday, April 18th. This update also includes a number of other internal fixes.
  • On Wednesday, May 15th, the three RC channels should be updated with two new packages:
    • BlueSteel and LeTigre should be updated with server maintenance package 19.05.01.526856, but not details are available at the time of writing.
    • Magnum RC will also be updated, but again, no details are available at the time of writing.

SL Viewer

  • The de facto release viewer was rolled back from the Teranino Maintenance RC release viewer, to the EAM viewer, version 6.2.0.526190, originally promoted on April 17th, 2019.
  • The Teranino Maintenance RC was re-released as a Release Candidate cohort on Monday, May 13th as version 6.2.2.527198.
  • The Love Me Render viewer updated to version 6.2.2.527021 on Monday, May 13th, 2019.

The rest of the current SL viewer channels remain as:

  • Release channel cohorts:
    • EEP RC viewer version 6.2.0.526104, dated April 11th.
    • Bakes on Mesh RC viewer, version 6.1.1.525409, dated March 26th.
  • Project viewers:
  • Linux Spur viewer, version 5.0.9.329906, dated November 17th, 2017 and promoted to release status 29th November – offered pending a Linux version of the Alex Ivy viewer code.
  • Obsolete platform viewer, version 3.7.28.300847, dated May 8th, 2015 – provided for users on Windows XP and OS X versions below 10.7. This viewer will remain available for as long as reasonable, but will not be updated with new features or bug fixes.

Network Maintenance

The first tranch of network maintenance announced last week has, according to the Grid Status page on the web, now been completed. This work included a period of time over the night of May 13th / 14th (US / EU) when Second Life log-in were disabled.

Commenting on the work, Simon Linden said, “Last night’s work isn’t anything that will be repeated … hopefully ever.”

While the core of the work has apparently been completed, Oz Linden noted there could be some final testing overnight on May 14th/15th, stating, “They’ll be doing some more testing tonight, but we don’t expect it to be (very) long or disruptive.”

Teleport Fail Issues

I’ve identified 3 different ways TPs could fail and I _believe_ I fixed those on the beta grid. Your help is really appreciated because the last time “someone” tried to fix things didn’t go well.

Simon Linden, SUG Meeting, May14th.

While the recent server-side deployment may have seen teleport success rates have returned to the levels witnessed before the recent “troubles”, the Lab continues to dig into problems, as per Simon’s comment above. To this end, those attending the SUG meeting were invited to a further test session, this one on Aditi (the Beta grid), to see how well his fix works. Expect an update following the next SUG meeting.

2019 SL User Groups 19/1: Simulator User Group

Posted on by Inara Pey

A L T I T U D E; Inara Pey, March 2019, on FlickrA L T I T U D E – blog post

Server Deployments

As always, please refer to the server deployment thread for the latest news.

  • On Tuesday, May 7th, the SLS (Main) channel updated to server maintenance package 19#19.04.25.526669, primarily intended to correct the simulator-side EEP regressions that resulted of the roll-back of Thursday, April 18th. This update also includes a number of other internal fixes.
  • On Wednesday, May 8th, the three RC channels should be updated with server maintenance package #19.05.01.526856, comprising internal fixes.

SL Viewer

The Teranino Maintenance RC viewer updated on Friday May 3rd, to version 6.2.1.526845. This viewer was subsequently promoted to de facto release status on Tuesday, May 7th.

The remaining viewer pipelines remain unchanged:

  • Release channel cohorts:
    • EEP RC viewer version 6.2.0.526104, dated April 11th.
    • Bakes on Mesh RC viewer, version 6.1.1.525409, dated March 26th.
  • Project viewers:
  • Linux Spur viewer, version 5.0.9.329906, dated November 17th, 2017 and promoted to release status 29th November – offered pending a Linux version of the Alex Ivy viewer code.
  • Obsolete platform viewer, version 3.7.28.300847, dated May 8th, 2015 – provided for users on Windows XP and OS X versions below 10.7. This viewer will remain available for as long as reasonable, but will not be updated with new features or bug fixes.

Teleport Disconnects

Following the deployments of server maintenance package 19#19.04.25.526669, it appears that there has been a significant improvement in teleports, with Simon Linden noting that the “TP crash has been mitigated and success rates are back to what they were months ago.”

This doesn’t mean that the Lab is ceasing efforts on trying to improve teleports and region crossings; rather that the priority of the work over that last few weeks has been on easing the problems people have been experiencing the last month.

Script Processing Issues

As reported in my week #18 SUG summary, there have been numerous reports of script run time issues, with some reporting that problems only started occurring following the roll-back on April 18th, 2019. BUG-226851 outlines some of the problems.

There is no specific update on this, other than the Lab’s engineering team has been asked to put together ways for them to look at script run times and performance grid wide.

2019 SL User Groups 18/1: Simulator User Group

Posted on by Inara Pey

Toshi Farms; Inara Pey, March 2019, on FlickrToshi Farms – blog post

Server Deployments

As always, please refer to the server deployment thread for the latest news.

  • There was no deployment of the SLS (Main) channel on Tuesday, April 20th, leaving all regions on that channel on server update 19#19.04.22.526534 comprising performance improvements (possible fixes for teleport / region crossing issues) and additional internal logging.
  • On Wednesday, May 1st, all three main RC channels should be updated to server maintenance package 19#19.04.25.526669, primarily intended to correct the simulator-side EEP regressions that resulted of the roll-back of Thursday, April 18th. This update also includes a number of other internal fixes.

SL Viewer

There have been no viewer updates at the time of writing this update, leaving the viewer pipelines as follows:

  • Current Release version 6.2.0.526190, formerly the Estate Access Management RC viewer, dated April 12, promoted April 17 NEW. – see my EAM overview for more information
  • Release channel cohorts:
  • Project viewers:
  • Linux Spur viewer, version 5.0.9.329906, dated November 17, 2017 and promoted to release status 29 November – offered pending a Linux version of the Alex Ivy viewer code.
  • Obsolete platform viewer, version 3.7.28.300847, May 8, 2015 – provided for users on Windows XP and OS X versions below 10.7. This viewer will remain available for as long as reasonable, but will not be updated with new features or bug fixes.

My.secondlife.com

My second Life has been down since the weekend of April 27/28th, 2019. This has affected all access to the site, the upload of snapshots and in-world web-based profiles.

Linden Lab is aware of the issue, and working to resolve the outage.

Teleport Disconnects

The teleport disconnect issue is now being seen as a race condition,with Simon Linden commenting:

The TP issue looks like a race condition … we “fixed” 3 other bugs and made that worse.

To which Oz Linden added:

And we’ve already put in place a bunch of improvements to our RC monitors to help prevent a similar recurrence (with more coming soon) … Doubtless Murphy will find new ways to avoid our monitors from time to time, but one tries.

The Lab now feel they have investigated the issue and gathered sufficient data around it to be able to perform a post-mortem on the situation to (hopefully) reduce the likelihood of such an occurrence in the future.

Script Processing Issues

This was raised at the April 26th TPVD meeting as well. There have been numerous reports of script run time issues, with some reporting that problems only started occurring following the roll-back on April 18th, 2019. BUG-226851 outlines some of the problems.

As per the TPVD meeting, the Lab are not aware of anything that may have changed to impact script run time (particularly on Full regions); but the problem has been somewhat exacerbated by the issue being bounced between the JIRA and support (note how the above report has been closed, referencing the matter back to support).