We've been struggling to handle the forum load all day, and I'm not sure why. Has anybody linked to us from a really high-traffic site? I saw 1086 HTTP requests in just over 2.5 minutes, which is a lot for this form. There's no obvious pattern to the traffic: It's going to different pages, using different browsers, and there are no HTTP referrer fields telling me where it's coming from.
I've temporarily upgraded the server and started running multiple copies of the forum. We can keep doing this for a while, but it can get expensive.
Let me know if you have any guesses. My apologies for the downtime, and thank you for your patience!
Struggling to handle load. Are we getting heavy traffic from somewhere?
- emk
- Black Belt - 1st Dan
- Posts: 1708
- Joined: Sat Jul 18, 2015 12:07 pm
- Location: Vermont, USA
- Languages: English (N), French (B2+)
Badly neglected "just for fun" languages: Middle Egyptian, Spanish. - Language Log: viewtopic.php?f=15&t=723
- x 6737
- Contact:
- Serpent
- Black Belt - 3rd Dan
- Posts: 3657
- Joined: Sat Jul 18, 2015 10:54 am
- Location: Moskova
- Languages: heritage
Russian (native); Belarusian, Polish
fluent or close: Finnish (certified C1), English; Portuguese, Spanish, German, Italian
learning: Croatian+, Ukrainian; Romanian, Galician; Danish, Swedish; Estonian
exploring: Latin, Karelian, Catalan, Dutch, Czech, Latvian - x 5181
- Contact:
Re: Struggling to handle load
the increased interest may have to do with the polyglot conference?
0 x
- Xenops
- Brown Belt
- Posts: 1451
- Joined: Mon Nov 30, 2015 10:33 pm
- Location: Boston
- Languages: English (N), Danish (A2), Japanese (rusty), Nansha (constructing)
On break: Japanese (approx. N4), Norwegian (A2) - Language Log: https://forum.language-learners.org/vie ... 15&t=16797
- x 3583
- Contact:
Re: ANNOUNCEMENT: Struggling to handle load. Are we getting heavy traffic from somewhere?
I’m pleased to say that I now work full-time, and I can make contributions.
3 x
Check out my comic at: https://atannan.com/
- fresh_air
- Yellow Belt
- Posts: 76
- Joined: Wed Mar 15, 2017 5:12 pm
- Location: EUA
- Languages: English*, Portuguese
Learning: Russian - x 223
Re: ANNOUNCEMENT: Struggling to handle load. Are we getting heavy traffic from somewhere?
emk wrote:We've been struggling to handle the forum load all day, and I'm not sure why. Has anybody linked to us from a really high-traffic site? I saw 1086 HTTP requests in just over 2.5 minutes, which is a lot for this form. There's no obvious pattern to the traffic: It's going to different pages, using different browsers, and there are no HTTP referrer fields telling me where it's coming from.
I've temporarily upgraded the server and started running multiple copies of the forum. We can keep doing this for a while, but it can get expensive.
Let me know if you have any guesses. My apologies for the downtime, and thank you for your patience!
Can you make a donation tab, or provide a link to a paypal? I would love to help, even in a small way.
1 x
-
- Green Belt
- Posts: 310
- Joined: Wed Jul 18, 2018 6:37 pm
- Location: San Francisco
- Languages: English (N)
Shona (N)
French (DELF B2)
German (Goethe-Zertifikat B2)
Spanish (DELE B2) - Language Log: https://forum.language-learners.org/vie ... =15&t=8686
- x 950
Re: ANNOUNCEMENT: Struggling to handle load. Are we getting heavy traffic from somewhere?
A DDoS attack or perhaps increased interest in new languages (and countries) after this week's election results?
Please can you ensure that international VISA/MasterCard/JCB cards are accepted (yes, that's a thing!) too for those who cannot open PayPal accounts because of their countries of origin?
CONGRATULATIONS! I am so happy for you!
Please can you ensure that international VISA/MasterCard/JCB cards are accepted (yes, that's a thing!) too for those who cannot open PayPal accounts because of their countries of origin?
Xenops wrote:I’m pleased to say that I now work full-time, and I can make contributions.
CONGRATULATIONS! I am so happy for you!
2 x
- Iversen
- Black Belt - 4th Dan
- Posts: 4787
- Joined: Sun Jul 19, 2015 7:36 pm
- Location: Denmark
- Languages: Monolingual travels in Danish, English, German, Dutch, Swedish, French, Portuguese, Spanish, Catalan, Italian, Romanian and (part time) Esperanto
Ahem, not yet: Norwegian, Afrikaans, Platt, Scots, Russian, Serbian, Bulgarian, Albanian, Greek, Latin, Irish, Indonesian and a few more... - Language Log: viewtopic.php?f=15&t=1027
- x 15050
Re: ANNOUNCEMENT: Struggling to handle load. Are we getting heavy traffic from somewhere?
Even if most of the money we as users might contribute might be confiscated by somebody's tax authorities there ought to be something left to cover the forum costs.
As for the heavy load I had intermittent problems accessing the site from around 16 to 20 CET, but right now I got on without problems. If the traffic really goes to many different specified pages it is hard to see why it should be a normal denial-of-service attack, where it is the sheer of bulk of traffic that is the important thing. To ask for specific pages somebody must have made a list of pages and set up a system to access them.
AS for the conference it is over several days ago, and I doubt that it can be the cause.
As for the heavy load I had intermittent problems accessing the site from around 16 to 20 CET, but right now I got on without problems. If the traffic really goes to many different specified pages it is hard to see why it should be a normal denial-of-service attack, where it is the sheer of bulk of traffic that is the important thing. To ask for specific pages somebody must have made a list of pages and set up a system to access them.
AS for the conference it is over several days ago, and I doubt that it can be the cause.
0 x
- lavengro
- Blue Belt
- Posts: 729
- Joined: Wed May 24, 2017 1:39 am
- Location: Hiding in Vancouver. Tell no one.
- Languages: Taking a siesta from this site for the rest of 2024.
- x 2008
Re: ANNOUNCEMENT: Struggling to handle load. Are we getting heavy traffic from somewhere?
Skynet wrote:A DDoS attack or perhaps increased interest in new languages (and countries) after this week's election results?
...
If by your reference to "this week's election results" you meant (without letting this thread become political) the mid-term elections in any of the countries located, say, between Canada and Mexico, the common flight path is to Canada, which will require remarkably little in the way of language adjustment. Just get used to calling your "couch" a "chesterfield" and for goodness sake learn what a "double-double" is, and one should be fine. Eh.
2 x
This signature space now dedicated to Vancouver's best - but least known - two person female power rock band:
https://www.youtube.com/watch?v=FnbymC_M1AY, ,https://www.youtube.com/watch?v=7Av4S6u83a0, , https://www.youtube.com/watch?v=4ARPYVYE6Vc
https://www.youtube.com/watch?v=FnbymC_M1AY, ,https://www.youtube.com/watch?v=7Av4S6u83a0, , https://www.youtube.com/watch?v=4ARPYVYE6Vc
- rdearman
- Site Admin
- Posts: 7260
- Joined: Thu May 14, 2015 4:18 pm
- Location: United Kingdom
- Languages: English (N)
- Language Log: viewtopic.php?f=15&t=1836
- x 23317
- Contact:
Re: ANNOUNCEMENT: Struggling to handle load. Are we getting heavy traffic from somewhere?
Morgana wrote:Is that weird? No referrer field (I assume that means link)? Especially when it's going to different pages and not just the main page or a particular thread/post?emk wrote:It's going to different pages, using different browsers, and there are no HTTP referrer fields telling me where it's coming from.
The HTTP referer (originally a misspelling of referrer) is an HTTP header field that identifies the address of the webpage (i.e. the URI or IRI) that linked to the resource being requested. By checking the referrer, the new webpage can see where the request originated.
In the most common situation this means that when a user clicks a hyperlink in a web browser, the browser sends a request to the server holding the destination webpage. The request includes the referer field, which indicates the last page the user was on (the one where they clicked the link).
Referer logging is used to allow websites and web servers to identify where people are visiting them from, for promotional or statistical purposes.
Basically the lack of a referrer field means that our server cannot tell where the traffic originated. For example, if I make a link to the BBC here, and our server does give out a referrer field then the BBC can track statistics which say this page was linked to LLORG and X people clicked it.
This raises a number of privacy concerns, and as a result, a number of systems to prevent web servers being sent the real referring URL have been developed. These systems work either by blanking the referrer field or by replacing it with inaccurate data. Generally, Internet-security suites blank the referrer data, while web-based servers replace it with a false URL, usually their own.
It could be whoever has linked to us has blanked the field before sending. It might be that we are simply falling victim to "The slashdot effect".
Slashdot effect
The Slashdot effect, also known as slashdotting, occurs when a popular website links to a smaller website, causing a massive increase in traffic. This overloads the smaller site, causing it to slow down or even temporarily become unavailable. The name stems from the huge influx of web traffic which would result from the technology news site Slashdot linking to websites. The name, however, is somewhat dated, as flash crowds from Slashdot were reported to be diminishing as of 2005 due to competition from similar sites. The effect has been associated with other websites or metablogs such as Fark, Digg, Drudge Report, Imgur, Reddit, and Twitter, leading to terms such as being "farked" or "drudged", being under the "Reddit effect"—or receiving a "hug of death" from the site in question. Google Doodles, which link to search results on the doodle topic, also result in high increases of traffic from the search results page
1 x
: Read 150 books in 2024
My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter
I post on this forum with mobile devices, so excuse short msgs and typos.
My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter
I post on this forum with mobile devices, so excuse short msgs and typos.
- zjones
- Green Belt
- Posts: 483
- Joined: Mon Apr 16, 2018 6:22 pm
- Location: USA
- Languages: English (N), French (B1-certified), Spanish and Greek (abandoned)
- Language Log: https://forum.language-learners.org/vie ... =15&t=9860
- x 1405
Re: ANNOUNCEMENT: Struggling to handle load. Are we getting heavy traffic from somewhere?
Is there also an increase in new sign-ups, or just in the traffic alone?
Edit: Not that I know anything about how websites work, but I'm curious.
Edit: Not that I know anything about how websites work, but I'm curious.
1 x
- rdearman
- Site Admin
- Posts: 7260
- Joined: Thu May 14, 2015 4:18 pm
- Location: United Kingdom
- Languages: English (N)
- Language Log: viewtopic.php?f=15&t=1836
- x 23317
- Contact:
Re: ANNOUNCEMENT: Struggling to handle load. Are we getting heavy traffic from somewhere?
zjones wrote:Is there also an increase in new sign-ups, or just in the traffic alone?
Edit: Not that I know anything about how websites work, but I'm curious.
Actually that is a very penetrating and relevant question. But no, there doesn't seem to have been any sharp increase in membership.
1 x
: Read 150 books in 2024
My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter
I post on this forum with mobile devices, so excuse short msgs and typos.
My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter
I post on this forum with mobile devices, so excuse short msgs and typos.
Return to “Technical Support and Feature Requests”
Who is online
Users browsing this forum: No registered users and 2 guests