Thursday, May 9, 2013

Reworking some Database data / Site Performance may be slow


Site performance, it's possible you may see slow downs or it might take a minute for your comments to post for the next couple days.

I'm rebuilding/denormalizing the table that tracks each gamertag for each day(which has more rows that blog since we don't write blogs for people that don't play for 30+ days). This table is up to 334 million rows and it takes up 60GB.

I hope to get the size down to under 20GB and better than that, it will be organized/indexed better. Mostly, this will improve results when you look at your gamerscore chart. I'm planning a secondary update to work on all of our charts, there's a lot of new stuff out now that will make these charts run a lot smoother. 

This may go on for 3 or 4 days, I'll keep you posted. It's taking 3 minutes a day and I'm scared to run this overnight. Good news is 500 days down(24 million rows), only 2100 days and 310 million rows to go. 

No comments:

Post a Comment