Jump to content

Mazidox Linden

  • Posts

  • Joined

Everything posted by Mazidox Linden

  1. Second Life Server No roll is planned for Second Life Server hosts after our promotion of version 563375 to all hosts last week. Second Life RC We are planning a rolling restart this week. Due to technical constraints this rolling restart will show as version 564195, however there are no changes in code or configuration from the currently deployed version 563375. Wednesday 2021-09-29 07:00-10:30 PDT On Region Restarts Grid Poking Bot has been brought back online and should restart regions that reach 2 weeks up continuous uptime. We will continue to do mass restarts via version updates for the time being however, as this allows us to more fully refresh the environment the simulators are running in, not just the individual simulators themselves.
  2. If you're still having problems logging in please contact Support, they'll walk you through some initial troubleshooting steps and escalate it up to an engineer to look at if needed.
  3. That's odd, it's working fine for me on both my work machine and personal machine. You might want to try a force refresh in case it's being cached on your end. If that doesn't work, please do let me know. CO₂ levels are good, but we may need to adjust the template we use for SLS rolls. I'll check with the folks on the blog-side, thanks!
  4. Second Life Server We'll be rolling last week's RC roll, version 563375 to all remaining channels and simhosts this week. Second Life RC No new roll for RC this week, but keep your eyes on the Server Technology forum for some news about upcoming releases! Region Restarts After Grid Poking Bot nearly gained sentience earlier today our engineers will be handling region restarts manually until we've had a chance to check the bot's code and make sure it's set to "friendly helper" 🙂
  5. Badlist Bot came back to life and decided to restart everything, just to be safe. We caught it before it got more than about 5% of the grid restarted, and it's currently sitting in a small dark hole while we wait for an engineer to take another crack at not making it go berserk.
  6. I fixed it, sorry. Caffeine seems to never be enough on Mondays. Edit: No, I don't know why we have a dash in the staging URL but not the production URL. I've asked, it's just a thing 🤷‍♂️
  7. https://releasenotes.secondlife.io/simulator/2021-08-27.563375.html is now live. I had it just about done yesterday but there were merge conflicts that required input from colleagues during business hours. (n.b. 563385 is an older "restart only" version that had no changes, so you won't find the release notes for that version anywhere.)
  8. Second Life Server No roll for Second Life Server this week. Second Life RCs We're deploying version 2021-08-27.563375 to all RCs this week after a successful configuration change with version 2021-08-27.563385 last week. On Rolling Restarts We are not planning any rolling restarts for Second Life Server regions this week.
  9. Second Life Server We will be deploying version 2021-08-27.563385 to all Second Life Server main channel regions. This version is identical to existing Second Life Server version 2021-07-29.562252 with no code changes nor configuration changes being deployed to Second Life Server hosts. Scheduled for: 2021-08-31 06:00-11:00 PDT Please note, the Second Life Server deploy window has been permanently modified to be 06:00-11:00 Pacific Time. The Second Life Grid Status Blog will reflect this shortly. Second Life RC We will be deploying version 2021-08-27.563385 to all Second Life RC regions. As noted above there are no code changes in this version, however we will be changing all RC regions over to our new configuration as mentioned here. This will cause some incidental changes to how mesh land impact is calculated, but the primary change will be a small but noticeable bump in speed for most regions. Scheduled for: 2021-09-01 07:00-9:30 PDT As today's outage is ongoing further configuration changes are suspended until we have ensured the stability of Second Life and the in-world experience. On Rolling Restarts As mentioned above, all simulator hosts are being restarted this week. All Main Channel hosts have been restarted.
  10. We're restarting the main channel. It requires a new version to spin up new hosts, but there are no code or configuration changes being deployed to simulators on 2021-08-31. We will have some configuration changes during our standard RC roll window on Wednesday, look for my weekly forum post in a few minutes.
  11. I've passed this on to engineers examining the issue in-depth, but for posterity could you file a BUG at jira.secondlife.com so we can make sure we capture this failure mode as well?
  12. We have paused today's roll as we investigate an issue affecting less than 0.25% of regions preventing them from starting.
  13. Second Life Server There will be no roll for Second Life Server this week. Ideally we won't need to restart most regions before next week's planned deploy; we've seen a higher tolerance for simulators to go a long period without restarting, and will be keeping an eye out this week to see how it goes. Second Life RC This week we'll be deploying version 2021-08-19.563028 to all Second Life RC. In addition, this update will bring all of our RC simhosts onto the same configuration as mentioned in the deploy plan here . This release has fixes for BUG-231064 and ensures llChar() now properly returns the Unicode Replacement Character (�) for all out of range, even if the input value is negative. On Rolling Restarts As mentioned above, we won't be doing rolling restarts for Second Life Server this week.
  14. There are no rolls planned for the week of August 16th. We're looking at possibly rolling out our performance optimizing configuration changes to all RCs next week and putting a new maintenance release on RCs that are already optimized, but we need some more time to gather and parse the relevant data, plus testing the Maintenance release.
  15. Second Life Server This week we're deploying version 2021-07-29.562252 to the rest of the Second Life Server simulator fleet. As a reminder this version contains a partial fix for BUG-230960, with a fix for negative indicies coming in a future release, as well as a first pass of allowing experiences to unsit agents that have accepted the experience's permissions, plus some internal fixes and changes to make life easier for our engineers. Second Life RC This week we'll be deploying version 2021-07-29.562252 with the same updated machine configuration as mentioned here to approximately 15% of homesteads and openspaces. We do not anticipate any major changes in behavior for the simulator, but there is a chance of both better performance, and the already discovered mesh physics impact calculation issue. If you should encounter a situation where an object has a noticeably different mesh physics impact value, please file a BUG on jira.secondlife.com On Region Restarts With all regions on the grid restarting this week we're pausing our investigation of automated region restart issues for the week while we gather data on performance from the changes we're making to RC Homesteads and Openspaces.
  16. We've got some folks on vacation this week and I was up late finishing the last round of testing for this RC, deploy plan is up now and the release notes should have propagated through our CDN at this point.
  17. Second Life Server No roll for Second Life Server this week Second Life RCs As you may have noticed this week we put out version 2021-07-29.562252 which contains some changes to help our engineers better investigate crashes and clean up the crash afterward, as well as a fix for BUG-230960 *, and the implementation of BUG-228541. * llOrd() currently incorrectly returns 63 instead of 65533 for any (gibberish) character created with llChar() from -1 to -(2^32) On Region Restarts We didn't have any rolling restarts needed this week, we're still investigating what is going on with our Grid Poking Bot not always restarting regions.
  18. Second Life Server This week we will be restarting all regions that were not restarted last week to run version 2021-07-16.561609. This week's restarts will not include any changes to the behavior of simulators, nor to the configuration of the machines running those simulators as we are both still gathering data as to how effective last week's modifications were, as well as hunting down a particularly vexing issue. Second Life RC Updates We are still in the final stages of figuring out what (if anything) we can promote to Release Candidate stage for the simulator this week. At this point our contender is version 2021-07-20.561821, which contains some changes to help our engineers better investigate crashes and clean up the crash afterward, as well as a fix for BUG-230960, and the implementation of BUG-228541. No update tomorrow because of a combination of not enough time to finish testing and the bumpiness of today's roll meaning we want to investigate before we roll again. On Region Restarts As mentioned above, we're doing a "super-restart" of all remaining regions that weren't restarted last week so that we clean out any cobwebs that might get missed during a normal region level restart. We are aware that the grid poking bot has continued to derelict its duty, and have noted its permanent record; when we know more about the future of rolling restarts you'll hear it here, and at our Tuesday Server User Group meeting in-world.
  19. As part of the move to the cloud, we changed how we wall off grids from each other. To use a material science example, instead of using reinforced brick we're now using tungsten carbide, which is extremely hard to cut through even intentionally. This means getting data from one grid to another is almost impossible; we're spending the time making sure that: Data only goes from Agni to Aditi, never the other way around Only the specific data we want to go from Agni to Aditi is transferred, only when we want it, for the very specific reason of synchronizing active Beta accounts The synchronization mechanism will work both for accounts that already exist on Aditi, as well as accounts that have never been synchronized before The good news is we are getting there. We have a prototype working and anticipate tests with Linden owned accounts will start soon.
  20. Second Life Server There are no updates to Second Life Server this week. Second Life RC Updates This week we'll be restarting all RC regions to refresh the underlying cloud hosts which are running our simulators. Because of limitations in how we deploy our simulator code, this will show as an update to version 2021-07-16.561609. There are no changes in this version, however we will be making some additional changes to approximately 1/3 of the machines running RC servers which we believe may improve performance in some situations. On Region Restarts As mentioned in some of our recent deploy plans we've been investigating the effectiveness of region restarts at the ten day limit. We believe some of the issues Residents are encountering with regions that have long uptimes are due to issues at the machine level, not the simulator level. Our instance refresh for Second Life RC channels this week is an attempt to gather data as to whether this is correct or not.
  21. As mentioned on a recent Lab Gab, we have looked at changing the size of regions in Second Life, and even made a prototype, but it was extremely difficult to even get that far because the assumption that a region is exactly 256m by 256m is baked into many, many places in Second Life, both in the simulator and services that support it. You couldn't cross regions anymore, you couldn't manage parcel settings, you couldn't modify terrain properly, and many other issues. I'm not saying it could never happen, but it would be a very large initiative.
  22. Second Life Server: No Second Life Server rolls this week. Second Life RC: No RC roll this week. On Region Restarts: We believe the last round of restarts we did for Second Life Server and Release Candidate channels should have enabled our Grid Poking Bot to start poking regions that have more than 10 days of uptime again, but we'll be watching this coming week, and will continue to investigate if regions with 10+ days of uptime aren't restarted as planned.
  23. We were making some changes to ensure we get fresh data rather than cached data from internal services when we need it, and that code happens to be adjacent to the "send custom headers" code.
  24. Second Life Server: No roll for Second Life Server this week. Second Life RC: We'll be deploying a new version to all RCs this week, version 2021-06-23.560819, which will include several internal fixes as well as implementing BUG-202864 and a fix for BUG-230881 which caused last week's rollback. On Region Restarts: We've seen some reports that automatic restarts aren't happening as planned and are investigating.
  25. Second Life Server: No roll for Second Life Server this week. Second Life RC: We'll be deploying a new version to all RCs this week, tentatively version 2020-06-16.560618, which will include several internal fixes as well as implementing BUG-202864. Release notes link coming later. On Region Restarts: We'll be restarting regions that have more than 10 days uptime during the usual Second Life Server roll window of 03:00-11:00 PDT.
  • Create New...