Elias

Maybe my post wasn't clear. I made the database change about an hour ago and I made my post right after I made the change. So what I'm asking for is feedback since that time. I believe I've addressed the major issue but its too soon to say for sure, so feedback will be helpful to let me know if there's been any improvement (or not). Elias

I temporarily disabled that feature while I was attempting to track down some of the performance issues. I've added it back as it doesn't appear to have any impact on the database. Elias

I discovered a query that the forums use over and over again which didn't have a good index so I created one. The forums feel much better, but I'm not convinced that the one query was causing all the issues. Please let me know if you continue to experience forum issues. Thanks, Elias

This is a known Bellsouth issue. They've been heavily throttling our mail for almost a year. Because we have a lot of Bellsouth customers, I had the server force requeue all the Bellsouth email every day rather than delete it after a few days. So this is good news, Bellsouth must have removed the throttling which is why you received all your old email. Elias

It looks like we sent you two today and one yesterday. Did you not receive them? Elias

These are very strange observations and the first I've heard of them. While we certainly do have server issues from time to time, there is no way this should be occurring 20-25% of the time. I'd also be surprised that this is a Firefox issue as most of our developers use Firefox as their primary browser. Can anyone come up with something reproducible? Based on the comments here, I've tried: 1. Doing a nearest cache search and clicking "next" over and over. 2. Going to the latest photos page and and clicking "next" over and over. Neither of these reproduced the results indicated here. We also use a fair amount of 3rd party javascript, so perhaps the hanging is due to one of these script blocks? Since I'm fairly certain this is not something we've seen internally, anything you can point us to as potential causes would be helpful. Elias

Give it a try now, those bad queries shouldn't count against your total for today. Elias

This is a good suggestion and I've added it to our potential new feature list. Elias

For some reason, those queries are being flagged as "problem queries". I can't tell why, but I'll have the dev team look into it. My guess would be that there's something strange with the route you've created that might be causing this. Try recreating your route to see if that resolves the issue. Elias

One of the PQ Generator instances failed and had to be restarted. All outstanding PQs are being generated now. Elias

One of the PQ Generator instances failed and had to be restarted. All outstanding PQs are being generated now. Elias

As part of our release, we unintentionally introduced an inefficient database query which was impacting the whole site. We've disabled the query and will post a fix shortly. However, the site should be running normally now. Elias

The network move has been completed and all Groundspeak servers should be operating normally. If you do notice anything strange, please let us know. Thanks! Elias

As I mentioned in yesterday's maintenance notice, tonight we'll be moving the remaining network infrastructure to our new location in the datacenter. During this move, all Groundspeak servers and services will be offline. This work has to be coordinated with datacenter network engineers and the latest I am able to schedule this work is for 6 PM Pacific Time (GMT -7). All services should be restored in under an hour. Thanks, Elias

All Groundspeak servers have been moved and all services have been restored. If you notice anything strange with the sites, please let us know. Thanks for your patience during this maintenance window. Elias

Geocaching.com will be going down in just a few minutes. We moved the forums server earlier today, so the forums will be online during the move. Elias

Geocaching.com and many other Groundspeak services will go offline starting at 7:00 PM PDT (GMT -7) while we move our servers to a new location in our datacenter. This move is anticipated to take much of the evening and could extend into the early morning hours. We'll move the forums early on in the evening so we can keep you updated on our progress. After the completion of this move, we'll be posting another shorter downtime period for tomorrow afternoon to move our core networking equipment. If you have any questions, please contact us at contact(at)geocaching.com Elias

The image server is back online. We don't anticipate any further issues at this time. Elias

We have to take the server down for another 15 minutes. I'll post again here when its back up. Elias

This maintenance has been completed althought it may take several hours for the server's performance to return to normal. Elias

We're currently performing some unscheduled maintenance on our image server. Images on Geocaching and Waymarking will be broken for the next 15 minutes. I'll post an update here when the maintenance is complete. Elias

Bellsouth is a constant problem for us. We send more email to Bellsouth than they're willing to receive, so some of that mail ends up getting deleted from our servers after a few days. Attempts to get them to stop heavily throttling us have been unsuccessful. Elias

You'll have to contact FairPoint to ask them what's happening. They are rejecting email from us. Elias

You mail provider is rejecting our email to you. I'll send you a PM with the log entries so you can follow up with them. Elias

All outbound email from Groundspeak is sent through a central mail server. It was this server that was having issues, so all outbound email was affected. Elias