Modern open source alternative to LWT, lingq etc

General discussion about learning languages
t123
White Belt
Posts: 49
Joined: Sat Jul 18, 2015 1:48 pm
x 67

Re: Modern open source alternative to LWT, lingq etc

Postby t123 » Wed Dec 01, 2021 4:42 pm

Maybe something like https://snowballstem.org/ could help.
1 x

Cainntear
Black Belt - 3rd Dan
Posts: 3469
Joined: Thu Jul 30, 2015 11:04 am
Location: Scotland
Languages: English(N)
Advanced: French,Spanish, Scottish Gaelic
Intermediate: Italian, Catalan, Corsican
Basic: Welsh
Dabbling: Polish, Russian etc
x 8664
Contact:

Re: Modern open source alternative to LWT, lingq etc

Postby Cainntear » Wed Dec 01, 2021 8:01 pm

languagedev wrote:
Henkkles wrote:Wiktionary lookup with etymology and declension table, if those are available/relevant. Easy way to see all sentences where you've seen the same word before!


I like the idea of seeing all sentences where you've seen the same word, I wonder if I can do this without bloating the database... If anyone here knows how to design SQL databases feel free to get in touch.

If you go down that route, I don't think you're going to want to do it hosted, and instead to it with a local install, cos as far as I can see, the only alternative to database bloat is scanning the entire database on each access, and either would make the server quite expensive to maintain at scale.
1 x

t123
White Belt
Posts: 49
Joined: Sat Jul 18, 2015 1:48 pm
x 67

Re: Modern open source alternative to LWT, lingq etc

Postby t123 » Wed Dec 01, 2021 9:28 pm

I've written one of these for myself, you can see some pictures here.

By far the most useful feature is parallel texts. The next most useful is copy to clipboard when you click on a word, that's because most desktop software (like dictionaries) can react to clipboard events.

You can choose between a full modal or just an inline translation. The Forvo, (G)oogle and (M)icrosoft Bing are there by default if you have the API keys, you can define as many custom sites as you want if they accept a URL (like Word Reference would be https://www.wordreference.com/enfr/because), those just open in a new browser window. The base word is just a way to group words in different forms together if you want, like the infinitive or the nominative form. Sentences can either be one word to one sentence or one word to many sentences.

On that reading type view most of the colours, fonts, spacing etc is customisable as well as what state a word is in be default, whether to translate by default, show the statistics and so forth.

The words are exportable as CSV but also can be exposed via a REST API. Each word has a UUID so in theory a 2-way Anki sync would be possible with an Anki plugin.

The last picture is of an older version which I wrote in Python + QT. That had some features that I never used. One was something like subs2srs, if you have parallel texts then doing a video with parallel subtitles is easy enough. The other thing is it had plugins. Essentially there was a defined interface and you could dump Javascript files in the plugins folder and enable them on a per language basis. So when a text was loaded or button clicked or any event really, plugins could hook on to the event and do there own thing.

There's not much more to it than that except for listing all the texts there's a free form field to search on type. It accepts certain keywords like language or read, so something like: language:polish read:no
would give me everything in Polish that hasn't been read. I find that more convenient than LWT.

Edit: The repo is https://github.com/t123/yar2. I've no idea what state it's in, I just maintain it enough for it to work for me, which is pretty much not at all. Also just be aware the license is AGPL.
7 x

User avatar
zenmonkey
Black Belt - 2nd Dan
Posts: 2528
Joined: Sun Jul 26, 2015 7:21 pm
Location: California, Germany and France
Languages: Spanish, English, French trilingual - German (B2/C1) on/off study: Persian, Hebrew, Tibetan, Setswana.
Some knowledge of Italian, Portuguese, Ladino, Yiddish ...
Want to tackle Tzotzil, Nahuatl
Language Log: viewtopic.php?f=15&t=859
x 7030
Contact:

Re: Modern open source alternative to LWT, lingq etc

Postby zenmonkey » Mon Jan 17, 2022 9:33 pm

MorkTheFiddle wrote:
rdearman wrote:Rather than a cloud installation, I think you should go for a docker instance.

I second this suggestion as well. Why cuff yourself to the internet? For the same reason, let users use locally installed dictionaries if they choose.


Look what I found...

https://hub.docker.com/r/adamlukens/lwt-docker
1 x
I am a leaf on the wind, watch how I soar

User avatar
rdearman
Site Admin
Posts: 7231
Joined: Thu May 14, 2015 4:18 pm
Location: United Kingdom
Languages: English (N)
Language Log: viewtopic.php?f=15&t=1836
x 23127
Contact:

Re: Modern open source alternative to LWT, lingq etc

Postby rdearman » Mon Jan 17, 2022 9:44 pm

zenmonkey wrote:
MorkTheFiddle wrote:
rdearman wrote:Rather than a cloud installation, I think you should go for a docker instance.

I second this suggestion as well. Why cuff yourself to the internet? For the same reason, let users use locally installed dictionaries if they choose.


Look what I found...

https://hub.docker.com/r/adamlukens/lwt-docker

Guess I can remove mine.

https://github.com/rdearman/LWT_Docker
1 x
: 0 / 150 Read 150 books in 2024

My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter

I post on this forum with mobile devices, so excuse short msgs and typos.

User avatar
zenmonkey
Black Belt - 2nd Dan
Posts: 2528
Joined: Sun Jul 26, 2015 7:21 pm
Location: California, Germany and France
Languages: Spanish, English, French trilingual - German (B2/C1) on/off study: Persian, Hebrew, Tibetan, Setswana.
Some knowledge of Italian, Portuguese, Ladino, Yiddish ...
Want to tackle Tzotzil, Nahuatl
Language Log: viewtopic.php?f=15&t=859
x 7030
Contact:

Re: Modern open source alternative to LWT, lingq etc

Postby zenmonkey » Mon Jan 17, 2022 9:45 pm

rdearman wrote:
zenmonkey wrote:
MorkTheFiddle wrote:
rdearman wrote:Rather than a cloud installation, I think you should go for a docker instance.

I second this suggestion as well. Why cuff yourself to the internet? For the same reason, let users use locally installed dictionaries if they choose.


Look what I found...

https://hub.docker.com/r/adamlukens/lwt-docker

Guess I can remove mine.

https://github.com/rdearman/LWT_Docker


which one is more up-to-date?
Your readme is perfectly clear! Don't delete.
2 x
I am a leaf on the wind, watch how I soar

User avatar
rdearman
Site Admin
Posts: 7231
Joined: Thu May 14, 2015 4:18 pm
Location: United Kingdom
Languages: English (N)
Language Log: viewtopic.php?f=15&t=1836
x 23127
Contact:

Re: Modern open source alternative to LWT, lingq etc

Postby rdearman » Mon Jan 17, 2022 9:48 pm

zenmonkey wrote:
rdearman wrote:
zenmonkey wrote:
MorkTheFiddle wrote:
rdearman wrote:Rather than a cloud installation, I think you should go for a docker instance.

I second this suggestion as well. Why cuff yourself to the internet? For the same reason, let users use locally installed dictionaries if they choose.


Look what I found...

https://hub.docker.com/r/adamlukens/lwt-docker

Guess I can remove mine.

https://github.com/rdearman/LWT_Docker


which one is more up-to-date?

Mine was probably done later, but I don't think it matters since both are pulling the code from the latest repository.
3 x
: 0 / 150 Read 150 books in 2024

My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter

I post on this forum with mobile devices, so excuse short msgs and typos.

Cainntear
Black Belt - 3rd Dan
Posts: 3469
Joined: Thu Jul 30, 2015 11:04 am
Location: Scotland
Languages: English(N)
Advanced: French,Spanish, Scottish Gaelic
Intermediate: Italian, Catalan, Corsican
Basic: Welsh
Dabbling: Polish, Russian etc
x 8664
Contact:

Re: Modern open source alternative to LWT, lingq etc

Postby Cainntear » Tue Jan 18, 2022 5:11 am

zenmonkey wrote:Your readme is perfectly clear!

Doesn't that break some kind of open source law...?
5 x

User avatar
rdearman
Site Admin
Posts: 7231
Joined: Thu May 14, 2015 4:18 pm
Location: United Kingdom
Languages: English (N)
Language Log: viewtopic.php?f=15&t=1836
x 23127
Contact:

Re: Modern open source alternative to LWT, lingq etc

Postby rdearman » Tue Jan 18, 2022 7:58 am

Cainntear wrote:
zenmonkey wrote:Your readme is perfectly clear!

Doesn't that break some kind of open source law...?

Shhhhhhh don't tell anyone, :D

I suppose mine is clearer because I had 2 or 3 people try it and it was apparent that the first couple of readme messages weren't good enough for non IT people (aka normal people)
3 x
: 0 / 150 Read 150 books in 2024

My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter

I post on this forum with mobile devices, so excuse short msgs and typos.

User avatar
luke
Brown Belt
Posts: 1243
Joined: Fri Aug 07, 2015 9:09 pm
Languages: English (N). Spanish (intermediate), Esperanto (B1), French (intermediate but rusting)
Language Log: https://forum.language-learners.org/vie ... 15&t=16948
x 3631

Re: Modern open source alternative to LWT, lingq etc

Postby luke » Tue Jan 18, 2022 4:46 pm

rdearman wrote:
Cainntear wrote:
zenmonkey wrote:Your readme is perfectly clear!

Doesn't that break some kind of open source law...?

I suppose mine is clearer because I had 2 or 3 people try it and it was apparent that the first couple of readme messages weren't good enough for non IT people (aka normal people)

LWT's web site says it's in the Public Domain. If rdearman wanted to contribute it to the original project, that would be cool, right?
1 x
: 124 / 124 Cien años de soledad 20x
: 5479 / 5500 5500 pages - Reading
: 51 / 55 FSI Basic Spanish 3x
: 309 / 506 Camino a Macondo


Return to “General Language Discussion”

Who is online

Users browsing this forum: No registered users and 2 guests