Modern open source alternative to LWT, lingq etc
-
- White Belt
- Posts: 49
- Joined: Sat Jul 18, 2015 1:48 pm
- x 67
Re: Modern open source alternative to LWT, lingq etc
Maybe something like https://snowballstem.org/ could help.
1 x
-
Online
- Black Belt - 3rd Dan
- Posts: 3527
- Joined: Thu Jul 30, 2015 11:04 am
- Location: Scotland
- Languages: English(N)
Advanced: French,Spanish, Scottish Gaelic
Intermediate: Italian, Catalan, Corsican
Basic: Welsh
Dabbling: Polish, Russian etc - x 8794
- Contact:
Re: Modern open source alternative to LWT, lingq etc
languagedev wrote:Henkkles wrote:Wiktionary lookup with etymology and declension table, if those are available/relevant. Easy way to see all sentences where you've seen the same word before!
I like the idea of seeing all sentences where you've seen the same word, I wonder if I can do this without bloating the database... If anyone here knows how to design SQL databases feel free to get in touch.
If you go down that route, I don't think you're going to want to do it hosted, and instead to it with a local install, cos as far as I can see, the only alternative to database bloat is scanning the entire database on each access, and either would make the server quite expensive to maintain at scale.
1 x
-
- White Belt
- Posts: 49
- Joined: Sat Jul 18, 2015 1:48 pm
- x 67
Re: Modern open source alternative to LWT, lingq etc
I've written one of these for myself, you can see some pictures here.
By far the most useful feature is parallel texts. The next most useful is copy to clipboard when you click on a word, that's because most desktop software (like dictionaries) can react to clipboard events.
You can choose between a full modal or just an inline translation. The Forvo, (G)oogle and (M)icrosoft Bing are there by default if you have the API keys, you can define as many custom sites as you want if they accept a URL (like Word Reference would be https://www.wordreference.com/enfr/because), those just open in a new browser window. The base word is just a way to group words in different forms together if you want, like the infinitive or the nominative form. Sentences can either be one word to one sentence or one word to many sentences.
On that reading type view most of the colours, fonts, spacing etc is customisable as well as what state a word is in be default, whether to translate by default, show the statistics and so forth.
The words are exportable as CSV but also can be exposed via a REST API. Each word has a UUID so in theory a 2-way Anki sync would be possible with an Anki plugin.
The last picture is of an older version which I wrote in Python + QT. That had some features that I never used. One was something like subs2srs, if you have parallel texts then doing a video with parallel subtitles is easy enough. The other thing is it had plugins. Essentially there was a defined interface and you could dump Javascript files in the plugins folder and enable them on a per language basis. So when a text was loaded or button clicked or any event really, plugins could hook on to the event and do there own thing.
There's not much more to it than that except for listing all the texts there's a free form field to search on type. It accepts certain keywords like language or read, so something like: language:polish read:no
would give me everything in Polish that hasn't been read. I find that more convenient than LWT.
Edit: The repo is https://github.com/t123/yar2. I've no idea what state it's in, I just maintain it enough for it to work for me, which is pretty much not at all. Also just be aware the license is AGPL.
By far the most useful feature is parallel texts. The next most useful is copy to clipboard when you click on a word, that's because most desktop software (like dictionaries) can react to clipboard events.
You can choose between a full modal or just an inline translation. The Forvo, (G)oogle and (M)icrosoft Bing are there by default if you have the API keys, you can define as many custom sites as you want if they accept a URL (like Word Reference would be https://www.wordreference.com/enfr/because), those just open in a new browser window. The base word is just a way to group words in different forms together if you want, like the infinitive or the nominative form. Sentences can either be one word to one sentence or one word to many sentences.
On that reading type view most of the colours, fonts, spacing etc is customisable as well as what state a word is in be default, whether to translate by default, show the statistics and so forth.
The words are exportable as CSV but also can be exposed via a REST API. Each word has a UUID so in theory a 2-way Anki sync would be possible with an Anki plugin.
The last picture is of an older version which I wrote in Python + QT. That had some features that I never used. One was something like subs2srs, if you have parallel texts then doing a video with parallel subtitles is easy enough. The other thing is it had plugins. Essentially there was a defined interface and you could dump Javascript files in the plugins folder and enable them on a per language basis. So when a text was loaded or button clicked or any event really, plugins could hook on to the event and do there own thing.
There's not much more to it than that except for listing all the texts there's a free form field to search on type. It accepts certain keywords like language or read, so something like: language:polish read:no
would give me everything in Polish that hasn't been read. I find that more convenient than LWT.
Edit: The repo is https://github.com/t123/yar2. I've no idea what state it's in, I just maintain it enough for it to work for me, which is pretty much not at all. Also just be aware the license is AGPL.
7 x
- zenmonkey
- Black Belt - 2nd Dan
- Posts: 2528
- Joined: Sun Jul 26, 2015 7:21 pm
- Location: California, Germany and France
- Languages: Spanish, English, French trilingual - German (B2/C1) on/off study: Persian, Hebrew, Tibetan, Setswana.
Some knowledge of Italian, Portuguese, Ladino, Yiddish ...
Want to tackle Tzotzil, Nahuatl - Language Log: viewtopic.php?f=15&t=859
- x 7032
- Contact:
Re: Modern open source alternative to LWT, lingq etc
MorkTheFiddle wrote:rdearman wrote:Rather than a cloud installation, I think you should go for a docker instance.
I second this suggestion as well. Why cuff yourself to the internet? For the same reason, let users use locally installed dictionaries if they choose.
Look what I found...
https://hub.docker.com/r/adamlukens/lwt-docker
1 x
I am a leaf on the wind, watch how I soar
- rdearman
- Site Admin
- Posts: 7255
- Joined: Thu May 14, 2015 4:18 pm
- Location: United Kingdom
- Languages: English (N)
- Language Log: viewtopic.php?f=15&t=1836
- x 23259
- Contact:
Re: Modern open source alternative to LWT, lingq etc
zenmonkey wrote:MorkTheFiddle wrote:rdearman wrote:Rather than a cloud installation, I think you should go for a docker instance.
I second this suggestion as well. Why cuff yourself to the internet? For the same reason, let users use locally installed dictionaries if they choose.
Look what I found...
https://hub.docker.com/r/adamlukens/lwt-docker
Guess I can remove mine.
https://github.com/rdearman/LWT_Docker
1 x
: Read 150 books in 2024
My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter
I post on this forum with mobile devices, so excuse short msgs and typos.
My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter
I post on this forum with mobile devices, so excuse short msgs and typos.
- zenmonkey
- Black Belt - 2nd Dan
- Posts: 2528
- Joined: Sun Jul 26, 2015 7:21 pm
- Location: California, Germany and France
- Languages: Spanish, English, French trilingual - German (B2/C1) on/off study: Persian, Hebrew, Tibetan, Setswana.
Some knowledge of Italian, Portuguese, Ladino, Yiddish ...
Want to tackle Tzotzil, Nahuatl - Language Log: viewtopic.php?f=15&t=859
- x 7032
- Contact:
Re: Modern open source alternative to LWT, lingq etc
rdearman wrote:zenmonkey wrote:MorkTheFiddle wrote:rdearman wrote:Rather than a cloud installation, I think you should go for a docker instance.
I second this suggestion as well. Why cuff yourself to the internet? For the same reason, let users use locally installed dictionaries if they choose.
Look what I found...
https://hub.docker.com/r/adamlukens/lwt-docker
Guess I can remove mine.
https://github.com/rdearman/LWT_Docker
which one is more up-to-date?
Your readme is perfectly clear! Don't delete.
2 x
I am a leaf on the wind, watch how I soar
- rdearman
- Site Admin
- Posts: 7255
- Joined: Thu May 14, 2015 4:18 pm
- Location: United Kingdom
- Languages: English (N)
- Language Log: viewtopic.php?f=15&t=1836
- x 23259
- Contact:
Re: Modern open source alternative to LWT, lingq etc
zenmonkey wrote:rdearman wrote:zenmonkey wrote:MorkTheFiddle wrote:rdearman wrote:Rather than a cloud installation, I think you should go for a docker instance.
I second this suggestion as well. Why cuff yourself to the internet? For the same reason, let users use locally installed dictionaries if they choose.
Look what I found...
https://hub.docker.com/r/adamlukens/lwt-docker
Guess I can remove mine.
https://github.com/rdearman/LWT_Docker
which one is more up-to-date?
Mine was probably done later, but I don't think it matters since both are pulling the code from the latest repository.
3 x
: Read 150 books in 2024
My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter
I post on this forum with mobile devices, so excuse short msgs and typos.
My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter
I post on this forum with mobile devices, so excuse short msgs and typos.
-
Online
- Black Belt - 3rd Dan
- Posts: 3527
- Joined: Thu Jul 30, 2015 11:04 am
- Location: Scotland
- Languages: English(N)
Advanced: French,Spanish, Scottish Gaelic
Intermediate: Italian, Catalan, Corsican
Basic: Welsh
Dabbling: Polish, Russian etc - x 8794
- Contact:
Re: Modern open source alternative to LWT, lingq etc
zenmonkey wrote:Your readme is perfectly clear!
Doesn't that break some kind of open source law...?
5 x
- rdearman
- Site Admin
- Posts: 7255
- Joined: Thu May 14, 2015 4:18 pm
- Location: United Kingdom
- Languages: English (N)
- Language Log: viewtopic.php?f=15&t=1836
- x 23259
- Contact:
Re: Modern open source alternative to LWT, lingq etc
Cainntear wrote:zenmonkey wrote:Your readme is perfectly clear!
Doesn't that break some kind of open source law...?
Shhhhhhh don't tell anyone,
I suppose mine is clearer because I had 2 or 3 people try it and it was apparent that the first couple of readme messages weren't good enough for non IT people (aka normal people)
3 x
: Read 150 books in 2024
My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter
I post on this forum with mobile devices, so excuse short msgs and typos.
My YouTube Channel
The Autodidactic Podcast
My Author's Newsletter
I post on this forum with mobile devices, so excuse short msgs and typos.
- luke
- Brown Belt
- Posts: 1243
- Joined: Fri Aug 07, 2015 9:09 pm
- Languages: English (N). Spanish (intermediate), Esperanto (B1), French (intermediate but rusting)
- Language Log: https://forum.language-learners.org/vie ... 15&t=16948
- x 3632
Re: Modern open source alternative to LWT, lingq etc
rdearman wrote:Cainntear wrote:zenmonkey wrote:Your readme is perfectly clear!
Doesn't that break some kind of open source law...?
I suppose mine is clearer because I had 2 or 3 people try it and it was apparent that the first couple of readme messages weren't good enough for non IT people (aka normal people)
LWT's web site says it's in the Public Domain. If rdearman wanted to contribute it to the original project, that would be cool, right?
1 x
: Cien años de soledad 20x
: 5500 pages - Reading
: FSI Basic Spanish 3x
: Camino a Macondo
: 5500 pages - Reading
: FSI Basic Spanish 3x
: Camino a Macondo
Return to “General Language Discussion”
Who is online
Users browsing this forum: No registered users and 2 guests