TSS42 wrote:Is it time for a new forum?
No.
lichtrausch wrote:TSS42 wrote:Is it time for a new forum?
No.
TSS42 wrote:So what's so holy about this one?
rdearman wrote:So what are we doing about this? Well the issue is that both EMK and I need to work on this together, we both work full time, and he is in the USA, and I'm in the UK. So we're trying to coordinate a time when both of us are available. (I am on-call and working this weekend so couldn't meet up, and he is on holiday with his family so isn't near his computer and the AWS account details)
But the plan is: We're going to schedule a few hours together, we need to do some account maintenance and change some AWS permissions and possibly swap the account. We then need to migrate to the latest load balancer configuration and update and upgrade all the server instances. We need to upgrade the proxy server software to the latest version. Then we need to put in the latest PhpBB software and upgrade it. Then we need to apply all the patches / mods and plugins required for the LLORG site, like language packs, virtual keyboard, love hearts for posts, etc, etc.
Then, assuming we haven't messed anything up, the site should be back up and running.
rdearman wrote:We're investigating the issue.
rdearman wrote:We're investigating the issue. The error seem to be related to the Load Balancer which we use. This system is hosted on the Amazon Web Services and because of the amount of people using the services we have had to split the load across multiple virtual services.
How did we get here?
I used to host the system on a shared service, but it kept getting database errors (anyone remember those?) (oh and we got hacked too) so EMK and I migrated it over to Amazon web services and used the AWS database backend, which wasn't shared. So, problem solved for a little while.
Next we had even more users, and we started getting loading errors where people were waiting forever for the page to load, if it ever did. So we needed to add more virtual machines and then start using the AWS load balancer to spread the load across different virtual machines. Which seemed ok, but then we had issues with cookies across various servers not being carried. So we installed a proxy server as well.
Then the proxy server lead to all users getting deleted when an admin removed a banned user, and if you were in Bratislava with me, you will remember me trying to fix this on my mobile phone in a restaurant late at night. But we restored the DB and got it fixed and removed the glitch that deleted all users.
We've been running very successfully without a hitch for a while now, except the occasional problem with people getting logged out. (Which we still haven't figured out, but suspect it is the version of PhpBB we are on).
Now it seems that AWS have updated the load balancer system and we are on the "Classic Load Balancer" and it doesn't seem to be playing nicely with the rest of the Amazon services.
Return to “LLORG & HTLAL discussion area”
Users browsing this forum: No registered users and 2 guests