Blake Sea is now up on Aditi!

[Henri Beauchamp]

21 hours ago, Simon Linden said:

We just did some updates this morning (Monday July 27th) that fixes a bunch of the region connectivity issues.    I just did a tour and didn't hit any invisible walls.

Yep, seems working just fine now.

Quote

Along those lines, I made a quick ”Blake Sea Challenge”   Go to secondlife://Aditi/secondlife/Morris/200/207/34  on the BETA aditi grid, and click on the red egg-shaped thing to try it out.   It will give you the ”Blake Sea Challenge”  ... wear it and touch, and it'll get you going.   Follow the instructions to sail / fly / motor around 46 regions without doubling back and see if you make it.   Have fun and keep letting us know how it goes!

Did it flying (avatar fly only) with a ”mildly heavy” avatar (25 attachments, around 80 scripts capped at around 3Mb of RAM):

Quote

Blake Sea Challenge: Yay all done!!   It took 11 minutes and  you never got lost!

But you should change the permissions of the gift it gives, because I also got:

Quote

Blake Sea Challenge: Cannot give no-copy objects from an attached object.

😜

Here are the region crossing times I got from the viewer log:

Personal test:
2020-07-28T15:13:18Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 435.148 ms 
2020-07-28T15:13:34Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 393.159 ms 
2020-07-28T15:13:59Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 439.247 ms 
2020-07-28T15:14:11Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 391.723 ms 
2020-07-28T15:14:28Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 450.473 ms 
2020-07-28T15:14:44Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 457.707 ms 
2020-07-28T15:15:01Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 438.855 ms 
2020-07-28T15:15:18Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 451.317 ms 
2020-07-28T15:15:35Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 394.944 ms 
2020-07-28T15:15:39Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 423.022 ms 
2020-07-28T15:16:02Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 394.764 ms 
2020-07-28T15:16:05Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 401.468 ms 
2020-07-28T15:16:06Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 403.55 ms 
2020-07-28T15:16:10Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 446.477 ms 
2020-07-28T15:16:14Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 368.816 ms 
2020-07-28T15:16:18Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 382.727 ms 
2020-07-28T15:16:22Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 446.515 ms 
2020-07-28T15:16:25Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 371.96 ms 
2020-07-28T15:16:27Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 448.023 ms 
2020-07-28T15:16:29Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 388.299 ms 
2020-07-28T15:16:32Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 445.138 ms 
2020-07-28T15:16:34Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 430.341 ms 
2020-07-28T15:16:36Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 442.932 ms 
2020-07-28T15:16:38Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 413.238 ms 
2020-07-28T15:16:40Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 447.037 ms 
2020-07-28T15:16:43Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 388.694 ms 
2020-07-28T15:16:46Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 425.852 ms 
2020-07-28T15:16:51Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 386.307 ms 
2020-07-28T15:16:55Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 395.2 ms 
2020-07-28T15:16:58Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 444.341 ms 
2020-07-28T15:17:16Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 445.237 ms 
2020-07-28T15:17:22Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 437.963 ms 
Back sea challenge:
2020-07-28T15:20:42Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 419.862 ms 
2020-07-28T15:20:58Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 356.679 ms 
2020-07-28T15:21:14Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 369.125 ms 
2020-07-28T15:21:30Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 419.841 ms 
2020-07-28T15:21:47Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 363.55 ms 
2020-07-28T15:22:03Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 422.33 ms 
2020-07-28T15:22:19Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 385.414 ms 
2020-07-28T15:22:35Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 411.964 ms 
2020-07-28T15:22:51Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 435.624 ms 
2020-07-28T15:23:07Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 448.512 ms 
2020-07-28T15:23:28Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 381.7 ms 
2020-07-28T15:23:44Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 390.958 ms 
2020-07-28T15:24:00Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 387.146 ms 
2020-07-28T15:24:10Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 427.114 ms 
2020-07-28T15:24:26Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 391.214 ms 
2020-07-28T15:24:42Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 371.007 ms 
2020-07-28T15:24:59Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 395.141 ms 
2020-07-28T15:25:16Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 445.889 ms 
2020-07-28T15:25:28Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 395.793 ms 
2020-07-28T15:25:42Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 401.7 ms 
2020-07-28T15:25:58Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 389.019 ms 
2020-07-28T15:26:14Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 398.36 ms 
2020-07-28T15:26:31Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 387.909 ms 
2020-07-28T15:26:44Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 395.128 ms 
2020-07-28T15:27:01Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 392.492 ms 
2020-07-28T15:27:17Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 442.12 ms 
2020-07-28T15:27:38Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 390.326 ms 
2020-07-28T15:27:52Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 385.123 ms 
2020-07-28T15:28:06Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 398.123 ms 
2020-07-28T15:28:22Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 390.206 ms 
2020-07-28T15:28:36Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 446.418 ms 
2020-07-28T15:28:52Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 398.019 ms 
2020-07-28T15:29:08Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 383.912 ms 
2020-07-28T15:29:23Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 386.911 ms 
2020-07-28T15:29:39Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 443.062 ms 
2020-07-28T15:29:55Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 396.678 ms 
2020-07-28T15:30:01Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 447.504 ms 
2020-07-28T15:30:18Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 391.238 ms 
2020-07-28T15:30:27Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 394.383 ms 
2020-07-28T15:30:36Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 385.006 ms 
2020-07-28T15:30:55Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 395.23 ms 
2020-07-28T15:31:06Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 441.859 ms 
2020-07-28T15:31:22Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 450.933 ms 
2020-07-28T15:31:40Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 442.411 ms 
2020-07-28T15:31:56Z INFO: LLVOAvatarSelf::updateRegion: Region crossing took 391.386 ms 

As you can see (or rather cat | cut | sort, 'cause I'm lazy), the minimum was 357ms and the maximum 458ms.

It should be noted that during my personal test, I tried hard to make crossings fail (for example by flying in circles at the frontier/corner of four regions, to enter and re-enter regions as fast as possible).

So I'd say it's a very good start for the new region crossing server code !

[Leonardis Ducatillon]

So, here's my comparison with my two posts from last Wednesday (22nd July). As a recap, I had a horrible experience then, crashed at every sim boundary pretty much and even when taking precautions and with a script-light avatar. I was looking forward today to seeing with the same avatar how the improvements would change things.

For reference: [12:17] Script info: 'Leonardis Ducatillon': [25/25] running scripts, 1460 KB allowed memory size limit, 0.049499 ms of CPU time consumed.

I initially sailed from the Windlass boathouse to the Newport East Jetty in "Japan" in my Nacra. Sooooo smooth! I can honestly say I did not feel a single sim boundary (what sim boundary? It was one giant sim, surely?!). All in all, a very pleasant - if gentle - experience.

I then decided to get naughty. First using my Sea BOSS jetski and then BOSS 225 motorboat, I did the boy racer thing of charging around. The mild blips at the sim boundaries were a bit more noticeable at 35-40 knots but barely interrupted things and far superior to a cautious sim crossing in Agni at present. Now, I wanted to break it since it was being so well-behaved. Even ramming the four-sim intersections at the top speeds of both these motor vessels did not result in an avatar detachment or crash. There was a more evident 'blip' at the crossing, but it was comparable to a normal two-sim transition in Agni. 

I then took to the skies in my DHC-2 Turbobeaver seaplane. In  this, I could reach 80 knots and I attacked the sim boundaries again at top speed with abandon, and other than a few slight jars (but none that spun me right round, baby right round) I was fine doing all sorts of crazy aeronautics that I wouldn't normally dare do in SL. I did manage to achieve an avatar detachment on four occasions, but these were each at the four-sim intersections going at 80 knots. Crossing these at a more moderate speed appeared to be safe.

Finally, I sailed back to base in an Ushuaia, first at a normal speed, then with a highly unrealistic 200kt windspeed with full spinnaker and motor, going at nearly 40 knots. Again, no problems with any sim boundaries at all. 

The whole test this time lasted about an hour, and I could not cause an avatar detachment error or full SL crash in a boat, as hard as I tried. Only in the plane, and only then when flying with a deathwish, was I able to cause any significant issues.

Colour me impressed! (with the usual caveats as to whether this will translate to a full version of SL, yada yada). If this is where SL is going vis-a-vis sim crossings in the sea, it will be so much more fun.

Edited July 28, 2020 by Leonardis Ducatillon

[JoyofRLC Acker]

Leonardis - thats great news.  A more aggressive test than my sailing Simon's easter egg course in a Trudeau 12m.

Im sorry if Ive missed it but do we know if there are any code differnces between these servers and Agni - and if so what.  If there are also code improvements as well as cloud servers Id be cautiously optimistic.  If the code is the same Im sceptical.

However fwiw, Blake Sea has been very good last two days for our races (from Arabian line yesterday and Baltic today) - so yes before and after todays maintenance.

Maybe Agni is trying not be shown up by Aditi!!  😄

[JoyofRLC Acker]

Another question - is there any sort of timetable for Blake on Agni going to cloud servers?  Im sorry Im really not up to speed on the whole cloud project.  Are any production sims in the cloud at this poiint, or only on Aditi?

[animats]

I just finished Simon's challenge with no problems. Time 9 minutes. "Belleza" speedboat, unmodified.

When I finished, a friend was at the end, so I asked her to go for a boat ride with me. So we went blasting around at 65 knots through about 30 sims. No major problems. One minor problem - at one sim corner, there was an extra delay, my avi disappeared for about two seconds, and when it came back, its sit animation didn't trigger, so I was stuck standing. Controls still worked, the boat still worked, and we made it to Sirens Isle and finished there. That kind of thing happens all the time on mainland, and can be compensated for in scripts. (My bikes do that, but this boat does not.)

This is all looking very good so far.

For further testing, how about an airstrip on this part of the beta grid connected to the Blake Sea? Perhaps copy over Coral Waters, the little Linden island west of Bellessaria, which has an short airstrip and a rez zone. Then we can try more aircraft.

[animats]

First failed region crossing.

22:06 SLT crossing from Crow's Nest to Cattewater on the beta grid in a Kiwi EZ-Fly helicopter. First the rotor anmation stopped, then the avatar was ejected. Avatar could move normally after the unsit, but had to reset animations. No sign of the helicopter.

Only happened once. Unable to repeat.

 

[Wulfie Reanimator]

18 hours ago, Henri Beauchamp said:

It should be noted that during my personal test, I tried hard to make crossings fail (for example by flying in circles at the frontier/corner of four regions, to enter and re-enter regions as fast as possible).

Now add 100-200 Mono scripts to yourself.

[M Peccable]

Is HTTP going to be turned on for scripts at some point in the near future? The biggest part of my needed testing with the cloud needs HTTP enabled.

[Oz Linden]

1 hour ago, M Peccable said:

Is HTTP going to be turned on for scripts at some point in the near future? The biggest part of my needed testing with the cloud needs HTTP enabled.

It will be enabled when it's ready; no predictions.

We'll post a note to the scripting forum for that and any other script feature changes we need to make when they're available to test.

[Lucia Nightfire]

4 hours ago, Oz Linden said:

and any other script feature changes we need to make when they're available to test.

So no more announcing new script features Mondays, two days before they get released on RC's on agni and discovering issues that might negatively impact residents with little time to change/correct? cough...llTargetedEmail(), chat ranges...cough

Wouldn't that hurt Linden "creative control"? 😉

[Lucia Nightfire]

I ran into a bug last night when using my custom NPV to cross a region.

Once I crossed, controls were stuck and my inputs did nothing.

I was stuck going on the same direction.

After standing up, I couldn't move with controls even after dctp'ing into another region.

I had to relog to fix it.

I couldn't repro on a bare bones test script, so I'll have to see why my custom NPV repro's it every time.

[animats]

1 hour ago, Lucia Nightfire said:

I ran into a bug last night when using my custom NPV to cross a region.

 

1 hour ago, Lucia Nightfire said:

I couldn't repro on a bare bones test script, so I'll have to see why my custom NPV repro's it every time.

Repeatable is good. I look forward to hearing more from Lucia on this.

 

Edited July 29, 2020 by animats

[Artair Glendullen]

On 7/28/2020 at 2:25 AM, JoyofRLC Acker said:

I will see what I can do about a fleet race or cruise (the latter would likely get larger numbers) may take a few days.

If you need more people, lemme know. I'm always willing to be an extra body to throw at some tests. : D

[Lucia Nightfire]

Another thing I notice is that IM2Email is not observed with objects in cloud regions IMing you and you relog on a non-cloud region.

If you log into a cloud region that has objects that have been IMing you while offline you will get your IM's but after over a minute of being online.

[Lucia Nightfire]

Here is some good/interesting news, though.

Mauve is back up on aditi and running in the cloud.

I have a bunch of various speed/integrity tests I've made over the years.

Here are two speed tests that involve llParseStringKeepNulls() vs llSubStringIndex():

https://gyazo.com/c3c98a5e72a9e7c77978fc534de348ce

I'll spare the technical details of what work these actually do repeatedly.

On the left we have the tests running in Animesh Adult on agni in a full sandbox region with few running scripts, low script eps and low active objects in the region.

On the right we have the tests running in Mauve on aditi in the cloud in a full sandbox region with many more active objects, more running scripts and more script eps.

Ignore the viewer FPS on the left as I had both instances running at once and the one on the right was in focus.

Notice that the performance of the same scripts in the cloud region is 2.5 - 3x faster despite it being a somewhat more busy region.

Edited July 30, 2020 by Lucia Nightfire

[JoyofRLC Acker]

6 hours ago, Lucia Nightfire said:

Here is some good/interesting news, though.

Mauve is back up on aditi and running in the cloud.

I have a bunch of various speed/integrity tests I've made over the years.

Here are two speed tests that involve llParseStringKeepNulls() vs llSubStringIndex():

https://gyazo.com/c3c98a5e72a9e7c77978fc534de348ce

I'll spare the technical details of what work these actually do repeatedly.

On the left we have the tests running in Animesh Adult on agni in a full sandbox region with few running scripts, low script eps and low active objects in the region.

On the right we have the tests running in Mauve on aditi in the cloud in a full sandbox region with many more active objects, more running scripts and more script eps.

Ignore the viewer FPS on the left as I had both instances running at once and the one on the right was in focus.

Notice that the performance of the same scripts in the cloud region is 2.5 - 3x faster despite it being a somewhat more busy region.

Good work, and interesting.

Is there a hypothesis as to the reason?  Has this been repeated yet, or is it just a one off?

[Henri Beauchamp]

On 7/29/2020 at 11:48 AM, Wulfie Reanimator said:

Now add 100-200 Mono scripts to yourself.

My avatar was already wearing 80+ scripts... Adding more scripts of mine won't change things much, for my scripts are well optimized (especially in the memory usage (most important for sim crossing) and events processing departments) ! 😜

I'd need to add badly scripted stuff to my Aditi inventory... But feel free to use by yourself the same method as the one I described. 💭

[Henri Beauchamp]

1 hour ago, JoyofRLC Acker said:

Good work, and interesting.

Is there a hypothesis as to the reason?  Has this been repeated yet, or is it just a one off?

I'm afraid such benchmarks are not very significant, unless you know for sure the sims are running on the same hardware (especially with the same CPU power) sharing the same load (number of sims per server, RAM usage to avoid swapping, etc), and (if applicable) using the same virtualization software/hypervisor... Too many unknown variables for us: only LL devels/admins can perform such benchmarks in a proper/deterministic way.

[Lucia Nightfire]

2 hours ago, Henri Beauchamp said:

I'm afraid such benchmarks are not very significant, unless you know for sure the sims are running on the same hardware (especially with the same CPU power) sharing the same load (number of sims per server, RAM usage to avoid swapping, etc), and (if applicable) using the same virtualization software/hypervisor... Too many unknown variables for us: only LL devels/admins can perform such benchmarks in a proper/deterministic way.

OF course. They are not running the same hardware. We've been told in the last server UG that they are using better hardware than the best of what they've been using with their own servers.

They've already said they are not maximizing number of regions per rack too.

And yes, they could have all the usual telemetry disabled that would normally be running/bogging down things as it does on agni.

It is still "interesting" nonetheless.

[JoyofRLC Acker]

Speaking of 'telemetry' ... Ive always wondered how much resource goes into making those huge log files.

...

Seems to me the priority right now is identifying actual bugs, and lets leave the performance evaluation until this goes to production.  (Unless they want to create a non-cloud Aditi ...)

[Lucia Nightfire]

2 hours ago, JoyofRLC Acker said:

lets leave the performance evaluation until this goes to production

Then let's also not praise how fast region handoffs are until this goes into production too?

[Lucia Nightfire]

One area of concern I notice is mesh caching seems to take longer.

I rezzed an animesh character server that had 115 characters that wear complex heads, bodies, hair and accessories and it took 1250 seconds for them all to rez with its caching protocol. The same protocol runs on agni after a region start and usually takes 720 seconds with 128 characters.

Edited July 31, 2020 by Lucia Nightfire

[bigmoe Whitfield]

So I have access now,  went across the blake sea,  just to see how border crossings were and I had zero delay crossing from one to the other, not even a hiccup like normal.   @Linden Lab very nice job!  if this is what is to come of it,  I can't wait!

[bigmoe Whitfield]

wow, okay wow,  just did the 1024 draw and everything instantly popped in,  like no loading popped in.  yep.  yep.   I needs this.

[Rachel1206]

Flawless flight, smooth region crossings, even at 4 intersecting borders. No problems at all, two others flew around and sometimes we crossed regions in parallel.

Wonder how it would be with many people around.

Edited July 31, 2020 by Rachel1206