We're back online!

Discuss technical problems and features here
User avatar
emk
Brown Belt
Posts: 1380
Joined: Sat Jul 18, 2015 12:07 pm
Location: Vermont, USA
Languages: English (N), French (B2+)
Badly neglected "just for fun" languages: Middle Egyptian, Spanish.
Language Log: viewtopic.php?f=15&t=723
x 4622
Contact:

We're back online!

Postby emk » Sun Oct 28, 2018 3:15 am

Yay! We're back online. And my apologies for the outage.

What went wrong: This site uses HTTPS, which means that your friendly neighborhood script kiddie (or intelligence agency) can't read your password, private messages, etc., by snooping on network traffic. Well, probably the NSA can, but they won't admit it. But in order to secure your connection, this site needs to have a "certificate", which says that we're who we say we are.

Previously, we were getting our certificates from Let's Encrypt, a wonderful non-profit which has done more than anybody else to secure web traffic. They provide free certificates which renew automatically. We used a piece of software called docker-letsencrypt-nginx-proxy-companion to get our certificates from Let's Encrypt. Usually, this worked well—once or twice a year, either rdearman or I needed to reboot the server, but that was all.

But sometime early yesterday (US time), the certificate software fell over hard. I rebooted the server, and it didn't come back up. So I rebuilt the server from scratch (which takes like 10 minutes). But this meant that we upgraded to new versions of the OS and docker-letsencrypt-nginx-proxy-companion, and everything broke. I fixed three serious problems, but it still wasn't working, and I couldn't see why not. So I dumped docker-letsencrypt-nginx-proxy-companion and installed caddy-docker-proxy, which has like 2,000 fewer moving parts. Unfortunately, this also failed in several different mysterious ways, with no errors.

So I said "Arggghh! No more stupid Docker proxies that talk to Let's Encrypt! I'm going to cough up another $21/month (in addition to the $40/month it costs me) and pay for an Amazon Application Load Balancer with a certificate from AWS Certificate Manager!" Now, the downside of this is that it has like a dozen moving parts and it takes hours to set up correctly. The upside is that it's likely to keep working from now until the heat death of the universe, because once Amazon builds something like this, it just keeps running (and gets very slowly cheaper).

So, that finally worked.

The site is mostly back online. However, for now, you must connect using "https:" and not "http:". I'll work on setting up a redirect. I'll talk more about this soon, but for now I need sleep! Once again, my apologies for the unplanned outage.

(Also, while this was going on, I had to get rid of about a zillion leaves before an ice storm hit, and deal with a minor pluming leak.)

Anyway, I'll talk more about this later. But I just wanted to let people know what had been happening.
50 x

User avatar
emk
Brown Belt
Posts: 1380
Joined: Sat Jul 18, 2015 12:07 pm
Location: Vermont, USA
Languages: English (N), French (B2+)
Badly neglected "just for fun" languages: Middle Egyptian, Spanish.
Language Log: viewtopic.php?f=15&t=723
x 4622
Contact:

Re: We're back online!

Postby emk » Sun Oct 28, 2018 3:26 am

For the geeks in the audience, you can find all the configuration changes on GitHub. It's a giant pile of devops carnage, basically. I promise to add some more comments on the certificate stuff. But at least it's done, and certs should give us no more problems.

Oh, and the admins & moderators are working on longer-term plans to keep the forum online in the future, and to accept donations. But it's a long process with paperwork. We'll let everybody know when there's something to talk about!
15 x

User avatar
Ani
Brown Belt
Posts: 1342
Joined: Mon Mar 14, 2016 8:58 am
Location: Alaska
Languages: English (N), speaks French, Russian & Icelandic (beginner)
x 3358
Contact:

Re: We're back online!

Postby Ani » Sun Oct 28, 2018 3:33 am

Thank you, thank you, thank you!!!

I'm so glad we're back. I missed you all!
4 x
But there's no sense crying over every mistake. You just keep on trying till you run out of cake.

dgc1970
White Belt
Posts: 42
Joined: Mon Oct 03, 2016 3:16 am
Languages: English (N), Spanish (beginner)
x 65

Re: We're back online!

Postby dgc1970 » Sun Oct 28, 2018 3:52 am

Thanks for all your hard work!
2 x

User avatar
arthaey
Brown Belt
Posts: 1082
Joined: Sat Jul 18, 2015 9:11 pm
Location: Seattle, WA, USA
Languages: :
EN (native);
ES (adv receptive, int productive);
FR (false beginner);
DE (lapsed beg);
ASL (lapsed beg);
HU (tourist)
Language Log: viewtopic.php?f=15&t=3864&view=unread#unread
x 1628
Contact:

Re: We're back online!

Postby arthaey » Sun Oct 28, 2018 4:49 am

emk wrote:the admins & moderators are working on longer-term plans to…accept donations.

Thank you for volunteering both your time and money to the forum! I eagerly await a way to donate. :)
7 x
Posts in: FrenchGermanHungarianSpanish
NaNoWriMo: 10,000 words
Corrections welcome in any language; I prefer an informal register.

User avatar
PeterMollenburg
Black Belt - 2nd Dan
Posts: 2067
Joined: Wed Jul 22, 2015 11:54 am
Location: Australia
Languages: English (N), French (B2-certified), Dutch (High A2?), Spanish (~A1), German (long-forgotten 99%)
Language Log: viewtopic.php?f=15&t=784
x 4009

Re: We're back online!

Postby PeterMollenburg » Sun Oct 28, 2018 4:51 am

Thank you emk.... for the dishonarable mention of the NSA. It's okay, they're protecting national interests, so it's all very honest work they are doing, trust me ;) I sincerely do appreciate your hard work in keeping this forum working, seriously. Now, let me get back to my drug addition, porn addiction, sugar addiction, carb addiction, screen addiction, prescription drug addiction, alcohol addiction...NO NO NO, let me get back to MY LANGUAGE ADDICTION, dammit (this also includes collecting far too many language learning materials and renaming of files to get ready for more language learning) ! This is all in good humour :) (do I need to write a disclaimer to ensure I don't offend anyone? :? ) Many thanks emk, love your work! 8-) and the work of the mods and admins too!
3 x

User avatar
Teango
Green Belt
Posts: 470
Joined: Mon Jul 06, 2015 4:55 am
Location: Honolulu, Hawaiʻi
Languages: (* current focus)
n: en
c: de
b: es, fr, haw, nzs, ru*
a: egy, ga, ja
–: fa, zu
Language Log: https://teango.wordpress.com/
x 1376
Contact:

Re: We're back online!

Postby Teango » Sun Oct 28, 2018 5:45 am

Thanks for all the time and effort you invest into this forum, emk, not only on this particular occasion, but on so many other occasions in the past. Merci mille fois! :)
1 x
365 Day Challenge: 15 / 365

Skynet
Orange Belt
Posts: 224
Joined: Wed Jul 18, 2018 6:37 pm
Location: Cyprus
Languages: BILINGUAL: Shona & English
PURSUING: French (B2?), German (A0)
ILLITERATE: Farsi Persian (listening, speaking)
Language Log: https://forum.language-learners.org/vie ... =15&t=8686
x 616

Re: We're back online!

Postby Skynet » Sun Oct 28, 2018 6:58 am

EMK, thanks for the time, effort and money that you spend to ensure that we have somewhere FREE to congregate. I would be delighted to donate towards the continued existence of this noble cause.
2 x

User avatar
rdearman
Site Admin
Posts: 4130
Joined: Thu May 14, 2015 4:18 pm
Location: United Kingdom
Languages: English (N)
Language Log: viewtopic.php?f=15&t=1836
x 9244
Contact:

Re: We're back online!

Postby rdearman » Sun Oct 28, 2018 11:06 am

On a side note, if you tried to post to the Super Challenge bot while the server was inoperative it didn't get it. The last message it got before the server came back online was at 10:21 GMT. So if you did try to post to the bot, check the website to see if it went through, and if it didn't you'll need to tweet it again for it to get picked up.
1 x
: 4 / 100 100 Italian paperbacks:
: 161 / 75000 Output Challenge 2019 (普通话写作):

Lollygagging Podcast available on iTunes

User avatar
rfnsoares
Yellow Belt
Posts: 97
Joined: Mon Sep 14, 2015 12:39 am
Location: Rio de Janeiro, Brazil
Languages: Native: Portuguese
B2/C1: English, French, Italian and Spanish
A2/B1: Romanian, Russian, German
A2: Polish, Greek
Dabbling: Croatian, Czech Swedish, Norwegian, Lithuanian, Finnish, Turkish, Hebrew...
x 207

Re: We're back online!

Postby rfnsoares » Sun Oct 28, 2018 11:32 am

Thank you for the explanation, but you are speaking Greek to me :lol:
0 x


Return to “Technical Support and Feature Requests”

Who is online

Users browsing this forum: No registered users and 2 guests