Deploy Plan for the week of 2019-12-02

[Bugsly Linden]

Second Life Server:
Scheduled Tuesday 2019-12-03 03:00-09:00 PDT
https://releasenotes.secondlife.com/simulator/2019-11-19T22%3A26%3A38.532992.html

No Roll on Tuesday 2019-12-03

Second Life RCs:
Scheduled Thursday 2019-12-05 07:00-10:30 PDT

https://releasenotes.secondlife.com/simulator/2019-12-04T20%3A29%3A26.533447.html

On Region Restarts:
Regions will be restarted if they have been running for more than 10 days on Tuesday (Main Channel) and Wednesday (RCs) regardless of whether or not new code is being deployed, for the general health and well being of the Simulators. Nothing beats turning it off and then on again ... once in a while.

As always please plan events around these maintenance windows. However, if you are hosting an event on Tuesday or Wednesday when we're not deploying new code, you can restart your region ahead of time to avoid interruptions.

[Aishagain]

 who done broked it?

[Liffento Eldritch]

They must of caught something at the last minute and had to change plans.

[Ardy Lay]

Look around for the "Shrek ears".  Or is that just for breaking the build system?

Edited December 3, 2019 by Ardy Lay

[Aishagain]

Um...so what IS being rolled, 'cos the GSP says the Main Server regions are being rolled right now? 

Edited December 3, 2019 by Aishagain

[Jaylinbridges]

"Regions will be restarted if they have been running for more than 10 days on Tuesday (Main Channel) and Wednesday (RCs) regardless of whether or not new code is being deployed, for the general health and well being of the Simulators."

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Dec 3, 03:00 PST

A restart for regions running over 10 days is maintenance.  And it's happening now.  My region was restarted 6 days ago, so no restart for me.

[Aishagain]

Yes...well...

1) All Main Server regions were (or SHOULD have been) restarted last Tuesday Mine was. (I CAN read)

Why ANY Main Server restarts then?  If there is no new code being deployed the GSP does not issue any notice for any of the "maintenance" restarts.

2)The Restart sequence is 6 hours or more, recently MUCH more due to the operational changes LL made to the process.

Today:...

"Dec 3, 2019

Rolling Restarts for Second Life Main Channel

Completed - The scheduled maintenance has been completed.
Dec 3, 06:00 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Dec 3, 03:00 PST

Scheduled - We will be performing rolling restarts for regions on the main Second Life Server channel on Tuesday, December 3rd. Please refrain from rezzing no copy objects and remember to save all builds. Please check this blog for updates."

 

...just over three hours!  So no reason for a restart anywhere (unless they knew something we don't).  So whether this was an exercise in "i" dotting or a miscommunication, we don't really need to know, I guess. 

 

Not trying to find fault here, just curious!

 

PS @Jaylinbridges:  If your region was restarted 6 days ago (Wednesday) it is very likely on a RC channel not the Main one; it is not as apparent now since LL have stopped showing the channel ID in the viewer.

Edited December 3, 2019 by Aishagain
additional fluff

[Jaylinbridges]

I think the Status page is automated with canned messages, and is not updated when there are changes late  in the day.  It always runs behind real-time.  The techs that actually restart regions are not the same that post the Status reports.  They probably quit at 5pm and hit the local bars.

I am on the Main Channel.  When I posted above my sim monitor was still reading 6 days, because my last restart was at 06:37 SLT on Nov 26, Tuesday.

This free sim monitor is rather useful - Region Performance Monitor Version 1.04 - Search on MP.  It is a free service from Dream Seeker Estates but works for any land.

My outage log:

Last Seen                        Sim Start                        Duration
Date & Time                    Date & Time                  Min/Max
2019-11-26 06:16:34    2019-11-26 06:37:18    10 / 20
2019-11-22 09:51:56    2019-11-22 09:55:07    0 / 3
2019-11-12 07:53:32    2019-11-12 08:17:21    13 / 23
2019-11-05 11:15:45    2019-11-05 11:20:56    0 / 5
2019-11-05 11:11:01    2019-11-05 11:15:45    0 / 4
2019-11-05 10:47:15    2019-11-05 10:51:21    0 / 4
2019-11-05 10:38:31    2019-11-05 10:47:15    0 / 8
2019-11-05 08:37:39    2019-11-05 10:38:31    110 / 120
2019-11-04 07:44:22    2019-11-04 07:47:28    0 / 3
2019-11-04 07:41:29    2019-11-04 07:44:22    0 / 2    
2019-10-25 08:09:54    2019-10-25 08:17:43    0 / 7
2019-10-15 07:42:46    2019-10-15 08:06:18    13 / 23
2019-10-08 04:59:50    2019-10-08 05:00:00    0 / 0
2019-09-28 02:53:34    2019-09-28 03:13:53    10 / 20

 

 

 

 

Edited December 3, 2019 by Jaylinbridges

[Aishagain]

@Jaylinbridges:

Yes, I use the BMI monitor which has proven reliable in our low-lag homestead and also on a lagfest Adult Mainland region. But yours does give slightly more info; I'll have to check it out.  Not quite clear what the Min/Max refers to mind you!

[Grumpity Linden]

Apologies for not updating the gridstatus bot.  There was no SLS roll indeed, and we're going to cancel the RC rolls tomorrow.  The hamsters   poor underfed serfs QA are going as fast as they can to validate the latest build. 

Edited December 4, 2019 by Grumpity Linden
no roll tomorrow.

[Hatsya]

If there are no rolls today, why are there something like 26 mainland regions, between Nautilus and Corsica showing offline on the SL map and for some considerable time?

[Liffento Eldritch]

The hamsters needs more noms!

[Miller Thor]

That Rolling Restart isnt that i normaly know from a Rolling Restart and as usual the Livechat is not available. 

It took 1 1/2 Hours until our Region came back and that with a very low Scriptperformance so we had to Restart again to bring back a Scriptperformance witch we can see as "normal" . 

Edited December 5, 2019 by Miller Thor

[Qie Niangao]

I'm seeing an unusual number of Mainland sims down for an unusually long time, FWIW, and I think they're RC regions, so that makes sense. Perhaps the bug fix for stopped scripts slows down the installation or initial restart? 

[ETA for closure: Things started returning to normal quickly, soon after I posted this, so just a bit more patience would have been rewarded.]

Edited December 5, 2019 by Qie Niangao