PDA

View Full Version : Server Migration



ConfusedCartman
12-25-2009, 06:33 PM
Hey guys! We're back up and running on our brandy new server. We have a lot more wiggle room now, so we've re-enabled all of those cool features that we had to disable while we worked on optimizing the site. Enjoy it, and don't forget to post any issues you may find - we may very likely have problems that still need to be ironed out. You know, growing pains, that sort of thing. :)

Yarbone
12-25-2009, 06:46 PM
yay! took way to long for me! o.o I was like totally bored... :cry:

Mopthefloo
12-25-2009, 06:48 PM
does this mean expirience is back?

CCubbage
12-25-2009, 06:49 PM
Wow... didn't know what to do with myself.... :D

All good now!

ConfusedCartman
12-25-2009, 06:49 PM
does this mean expirience is back?
Yes it does! I'm doing a quick recount to account for all of the posts you guys made while it was down, but yes, it's back. :)

jwwphotos
12-25-2009, 06:54 PM
Cool!! Thanks CC!! Santa was really good to us all today! :)

v0rtex
12-25-2009, 07:00 PM
Nice work! Merry Christmas CC - now get some rest! ;)

applepod124
12-25-2009, 07:05 PM
Yay! we're back! the one day without LBPc was torture.

Morgana25
12-25-2009, 07:38 PM
It's a Christmas miracle! I needed some sanity after last night and this morning. Glad to have ya back LBPC :)

Thanks CC!

iGotFancyPants
12-25-2009, 07:50 PM
Ah I nearly exploded without this site. Excellent.

Thanks CC! :)

jeffcu28
12-25-2009, 08:23 PM
Long live LBP Central! Part of LittleBigPlanet's success and longevity is because of communities like this, and I'm glad we can make it thrive even more.

Thanks CC and everyone for making such a supportive community.

rseah
12-25-2009, 09:35 PM
lol yay its back

mrsvista
12-25-2009, 09:40 PM
Glad it's back up and running. mrv and I were lost without it!

ConfusedCartman
12-26-2009, 12:40 AM
Ok, small update on the recent problems:

First time, the site went down and nobody could access it. That was due to a setting that was not optimized for the current traffic that we get. It was set too low, and when that limit was reached, the server had to be restarted and that setting reconfigured so that it could handle extra requests.

Second time, the database error: that was due to that setting I mentioned being set too high. This time, the server couldn't keep up with the high setting I had configured, so it crashed. Once again, I lowered the setting to a happy middle and reset everything, and it's working again.

I will be keeping an eye on the site's CPU usage and adjusting this setting accordingly until I get it to a limit that works. Sorry for the issues - like I said, growing pains!

jwwphotos
12-26-2009, 01:11 AM
Awesome! Thanks so much for all your hard work!

..one question, email notifications are not working for me after the restart. Is that turned off now?

Thanks again!

ConfusedCartman
12-26-2009, 01:16 AM
Awesome! Thanks so much for all your hard work!

..one question, email notifications are not working for me after the restart. Is that turned off now?

Thanks again!
It has something to do with the new servers we're using. I just changed a setting that might fix it - let me know how it goes.

comphermc
12-26-2009, 01:39 AM
Thanks, CC. I hope everyone is understanding with all the downtime we've been having. Myself, I was going crazy without LBPC! Hehe. Thanks again.

jwwphotos
12-26-2009, 01:44 AM
It has something to do with the new servers we're using. I just changed a setting that might fix it - let me know how it goes.


Cool!! working now! Thanks!

ConfusedCartman
12-26-2009, 02:05 AM
Cool!! working now! Thanks!
Good to hear it.

I also just finished making a load of changes to the most server-heavy processes, which should (in theory) keep things more stable from now on. More tweaking will probably be required in the future.

Doopz
12-27-2009, 09:23 PM
Wow that one day the site broke happend to be the one day i didn't come here. So i didn't really notice anything...

Matt 82
12-27-2009, 10:00 PM
I've found the site slow since the migration and at times seems to stop working altogether ie if I go into 2 or 3 threads in one section, by the time I've browsed a few pages I'll click on a hyperlink and nothing happens. I end up needing to close the browser and start again.

I also cannot access the add/subtract reputation at all.

Any of these related or is it my PC?

CCubbage
12-27-2009, 10:27 PM
I've found the site slow since the migration and at times seems to stop working altogether ie if I go into 2 or 3 threads in one section, by the time I've browsed a few pages I'll click on a hyperlink and nothing happens. I end up needing to close the browser and start again.

I also cannot access the add/subtract reputation at all.

Any of these related or is it my PC?
I think it happens when you get your kilt stuck in the hard drive.....


I profusely apologize for my last comment (give me some credit - I haven't made a kilt joke in months)

Matt 82
12-27-2009, 10:40 PM
It wasn't my kilt. Turned out a haggis got into the house and nibbled though the cables.

ConfusedCartman
12-27-2009, 11:36 PM
I've found the site slow since the migration and at times seems to stop working altogether ie if I go into 2 or 3 threads in one section, by the time I've browsed a few pages I'll click on a hyperlink and nothing happens. I end up needing to close the browser and start again.

I also cannot access the add/subtract reputation at all.

Any of these related or is it my PC?
Sounds like a browser issue, to be honest. It's the browser's responsibility to ensure that clicked links result in that link loading, so if you open a few tabs (thus making the browser more resource-heavy) and features stop working, it's because the browser is having trouble finding the resources to handle your request. As to the second issue, it sounds related to the first. As far as I can tell, the site has been faster since the migration, so it seems to be browser-related.

ARD
12-29-2009, 05:32 PM
I just got a database error D:

Only lasted like 10 seconds though.

jwwphotos
12-29-2009, 05:38 PM
I just got a database error D:

Only lasted like 10 seconds though.

I have gotten a few today. :(

ConfusedCartman
12-29-2009, 07:06 PM
I have gotten a few today. :(
When the server load gets too high it can cause MySQL to go down, which causes that error. I'm still looking into ways to lighten the load on MySQL, and I have already made changes today in an attempt to combat the issue.

Also, I just restarted MySQL, so you probably encountered a database error for a short period of time (less than 10 seconds). Just so you know, that was intentional - I had to restart MySQL so the changes I made would take effect.

Syroc
12-30-2009, 05:39 PM
I'm getting plenty of internal server error messages since the migration.

ConfusedCartman
12-30-2009, 07:54 PM
I'm getting plenty of internal server error messages since the migration.
It's been going down regularly once a day at a specific time, so something is causing it. There wasn't much I could do yesterday because the error log was too large to be helpful, but I flushed that and I got some good info out of it today.

Basically, what I'm saying is: the problems aren't the host's fault, and they can all be fixed (by me) given enough time to analyze when the site goes down and why. I hope you guys will bear with us as we sort this out. :)

Snrm
01-01-2010, 08:00 AM
sweet all the features are back! :D