Waymarking.com disappeared?

[bootron]

We are still trying to figure out what is wrong. We have so far been attempting to make some code optimizations, but now we are looking to add some hardware resources to see if that can bring some relief. Hoping to get things under control soon. Thanks for your continued patience.

 

Bootron

[+prussel]

Since about an hour there seems to be a problem again (and no, it's not our ISP )

[+PISA-caching]

No problems on Firefox, Chrome or IE over here.

[+Master Mariner]

Same problem here...

 

[+elyob]

No problems here.

[+Master Mariner]

Wow... what a difference a few hours' make! Before, the site was dead and now I have just created a WM in a speed that I have not seen for weeks! Whatever you did bootron... keep doing it. Thanks.

[+ToRo61]

I am also satisfied for this time, HW has changed?

Edited January 30, 2020 by ToRo61

[bootron]

So I believe we have figured out what the issue was. When we updated the website to use ssl on all pages in October, that move was the equivalent of changing every single page on the website to be a different url than before, and Google's search bots went into a frenzy working to reindex our site over the past several months. The activity of Googlebot increased slowly at first but became pretty relentless in the past month. Because it was repeatedly hitting our search page with all kinds of random combinations, it put heavy CPU pressure on our servers in waves that happened every couple minutes.

 

The two things that seem to have solved this problem are A) Adding some more CPU to the servers, and B ) putting noindex meta tags on pages that shouldn't be indexed like the /wm/search.aspx page. These actions have resulted in Googlebots hitting the site far less frequently and the page durations for the past several days have been MUCH lower, averaging around 500ms per request for the entire day yesterday. CPU is now down to 1% utilization, down from 90+% during the peak of each wave. We've also added much better telemetry to the site so we can do a better job of monitoring it, which is a nice side benefit. We're continuing to pay close attention to it, but I am hopeful that site performance will continue to remain this stable state going forward.

 

Thanks again for your patience,

Bootron

[+Alfouine]

Thank you very much, we will also pay attention just playing Waymarking....

[+Max and 99]

4 hours ago, bootron said:

So I believe we have figured out what the issue was. When we updated the website to use ssl on all pages in October, that move was the equivalent of changing every single page on the website to be a different url than before, and Google's search bots went into a frenzy working to reindex our site over the past several months. The activity of Googlebot increased slowly at first but became pretty relentless in the past month. Because it was repeatedly hitting our search page with all kinds of random combinations, it put heavy CPU pressure on our servers in waves that happened every couple minutes.

 

The two things that seem to have solved this problem are A) Adding some more CPU to the servers, and B ) putting noindex meta tags on pages that shouldn't be indexed like the /wm/search.aspx page. These actions have resulted in Googlebots hitting the site far less frequently and the page durations for the past several days have been MUCH lower, averaging around 500ms per request for the entire day yesterday. CPU is now down to 1% utilization, down from 90+% during the peak of each wave. We've also added much better telemetry to the site so we can do a better job of monitoring it, which is a nice side benefit. We're continuing to pay close attention to it, but I am hopeful that site performance will continue to remain this stable state going forward.

 

Thanks again for your patience,

Bootron

Fascinating! I actually understood a fair portion of that explanation.

Thank you!!

[+ToRo61]

It is very good that you have come to the cause of the overload.

Even today, the server response is very fast.

Thank you Bootron.

[+ToRo61]

Sunday 16:39 or 21:10 Central European Time (CET)

Eforia is gone :-(

again, there are delays during browsing Waymarking.com 

Edited February 2, 2020 by ToRo61

[+Max and 99]

I upgraded my internet package about the same time bootron posted that the site had been fixed.  So I'm not sure which did the trick for me, but it sure is fantastic to be able to use the Waymarking site when I want to!