ChatGPT Is A Big Fat Failure That Can't Be Trusted For TranslationAs previously mentioned, after reading each chapter of Akiramenai, I've been asking ChatGPT to translate each chapter so that I could actually understand the story. I assumed that ChatGPT was advanced enough that it would do a reasonable job of translation and not be subject to the frequent hallucinations and omissions that I ran into in the past with DeepL. And up until now, I hadn't noticed any major problems.
However, with
ch49, something strange happened. There was one particular line from the story that I remembered and I got confused when I couldn't find it in ChatGPT's translation. After carefully comparing the two, I discovered that ChatGPT just straight out skipped over 11 lines. (For the sake of posterity, I've copied ChatGPT's entire response at the end of this post, along with the section of the chapter that it omitted.)
As far as I can tell, it didn't hallucinate anything, it just omitted an entire section of the story, with the translation skipping straight from the line before to the line after. In particular, this chapter features Sakuraba confronting Yuunagi after seeing her with a guy the previous day, and she explains that it was just her brother. However,
ChatGPT skipped over the entire part where she explains this making it a bit strange.
It's pretty frustrating to discover that ChatGPT still can't be trusted to do translation. (I mean I knew prompt injection is an issue, but that's not applicable when translating regular stories). I guess I'll just have to go back to Google Translate instead. I mean, ChatGPT's translations clearly weren't
perfect in the past, as it occasionally obviously messed up pronouns the way that Japanese->English translations tend to do, but I never imagined that it would just leave out entire sections of the input like this.
This was a longer than normal chapter, which makes me wonder if it was a context window limitation. However, it's still mysterious because in that case, you would expect it to leave out either the beginning or end, not some random part in the middle. In any case, the takeaway is that ChatGPT still can't be trusted for translation, even in non-adversarial contexts.
Edit: Man, I'd forgotten just how rough Google Translate still is. I like how it translated "「え」" as "picture". On the other hand, at least it didn't skip the section that ChatGPT did. With Google Translate, the translation is obviously garbage, but at least you can still figure out what it's probably supposed to say based on the translation. Whereas with LLMs, the output is usually natural English and it's usually accurate, but you can never know if/when it does make a mistake.
---
In other news, ch49 also contained the word "yakimochi" (jealousy). I found that word especially interesting because it also means "roasted rice cakes" (i.e. yaki+mochi), and it seems kind of weird and random that it would have the secondary meaning of "jealousy".
It also contained the word 品位, notable as it was a word I previously encountered on the practice JLPT (more on that later) and looked up. Funny how new words you see sometimes pop right back up like that.
---
4989 American LifeEver since the early days of learning Japanese, I've been listening to Japanese podcasts in the background when doing other things. I almost never pay conscious attention to any of it, but occasionally one bit will stick out at me.
Recently, I noticed Utaco say that American vending machines are an "undameshi". I remembered the word "kimodameshi" (test of courage) with "kimo" meaning "liver", and that "un" can mean "luck", and suddenly realized that it was probably "test of luck". I was really proud that I managed to rapidly recognize an unknown word with no context like that.
Incidentally, this afternoon, I heard a bit where she mentioned fireworks setting off car alarms in her neighborhood, something that sometimes happens in my neighborhood too.
---
FrierenIn ep14, their carriage is suddenly carried off by a flying monster. What I couldn't get over is how the horse just sticks straight out to the side like the carriage is a
rigid plastic toy. I'm not an expert in carriage physics, but it just seems to me like there's no way those little wooden beams could possibly support the weight of a horse. And also the roc is probably not holding the carriage at its center of mass either, given the weight of the horse.
And then it gets
worse if anything after they crash, as the horse somehow ends up
sticking straight up, which also implies that the magic stick somehow holding it to the cart wasn't rigid after all.
![Image](https://i.postimg.cc/CKMh4w8f/Screenshot-from-2024-05-22-21-47-36.png)
![Image](https://i.postimg.cc/QxLjyQ5D/Screenshot-from-2024-05-22-21-48-11.png)
---
そう言った桜庭くんは、なんだか悲しんでいるような、恥ずかしがっているような、怒っているような、とにかく、ものすごくかわいい顔をしていた。
桜庭くん……もしかして……?
「いや、さっきも言ったけど、べつにいいんだよ僕は。ただ、そういう行為自体は君の品位を下げてしまうというか、そうならそうと言ってくれれば、僕との関係はあっさり切れるわけだし、なにもそんな隠れる必要は」
「桜庭くん!」
「……」
「違う! 違うの! それね、この人!」
桜庭くんに、スマホの画面を見せた。
メッセージアプリに登録されている連絡先、その『家族』フォルダの中のひとり。
顔写真と、名前。
「遊薙奏汰! 私のお兄ちゃん!」
「……は?」
On the Tuesday following the date with Sakuraba-kun,
I messaged him again and we chatted in the classroom after school.
"Ahh, I wish we had taken more photos on our date."
"...But it was fun, so we should go somewhere else again, right? Right?"
"Yeah, you're right."
...
In our previous date, various things happened.
Somehow, things felt a bit awkward towards the end on the Ferris wheel.
But it was a wonderful date because I held hands with Sakuraba-kun for the first time, and he protected me. It made me realize that Sakuraba-kun is really kind. There's no doubt about that.
...But there's no doubt, right...?
...
For some reason, Sakuraba-kun seems gloomy today...!
Or rather, a little scary!
Huh, why?
Did I do something...?
But we didn't meet at all yesterday, and today is the first time we're seeing each other...?
Why...?
"Hey, Sakuraba-kun? Is something wrong?"
"N-no."
...No good.
Sakuraba-kun was sitting at his seat by the window, staring blankly at the outside scenery. The evening sun was casting a surreal color on his fair skin.
Hmm, Sakuraba-kun even with a frown looks cool...
No, that's not it!
"Hey, what's wrong? You're usually quiet, but not like this, right?"
"...Maybe."
That's right!
Sakuraba-kun is cool and calm, but he would usually smirk or look amazed!
And his face is so wonderful, I love it.
Especially recently, we've been getting along better and Sakuraba-kun has been treating me more kindly... So, what happened today?
"Um, Sakuraba-kun... I give up. What's wrong? Tell me..."
I gathered my courage and moved in front of Sakuraba-kun.
Resting my elbows on the desk, I looked up at Sakuraba-kun from below.
It's unpleasant to become awkward over something unclear like this. Of course, it might not be my fault, but if there's something bothering Sakuraba-kun, I want to hear about it. And if I can, I'd like to help.
"Are you hiding something from me, Yunagi-san?"
"Huh?"
H-hiding something...?
There are plenty of things I'm hiding!!
But, which one?
Did he find out I peeked at the message from Mikura-san?
Or that I secretly smelled Sakuraba-kun's pillow?
Or that I got a picture of Sakuraba-kun in a yukata from Aina-chan?
Which one is it?!
Ugh... I have too many suspects...
But, probably just one... right?
Ugh, what should I do?!
If I confess and it turns out to be something completely different!
I'll be digging my own grave for no reason!
...
But Sakuraba-kun seems upset...!
What? W-what if he's hiding something, and he ends up hating me...?
But if I confess, he might hate me for that too... What should I do...?
"Um... um..."
"..."
In the end, I couldn't say anything, and Sakuraba-kun looked down at me with a pained expression.
I'm sorry, Sakuraba-kun... I don't have the courage to confess...
But Sakuraba-kun, after staring at me for a while, softened his expression and said,
"No, it's nothing... I mean, if you just openly tell me instead of hiding it, I'll understand... It's just..."
"Huh..."
...W-what?
W-what does that mean?!
No, this way, I'll never know what Sakuraba-kun wants to say...
I have to brace myself and say it!
"Um, Sakuraba-kun..."
"...What?"
"I-I'll be honest... I have several suspicions... or rather, I have many secrets... but... except for what Sakuraba-kun noticed, I'd prefer to keep them hidden... C-could you tell me what happened...?"
After saying that, I put my face on my arms on the desk and silently prayed to God.
I didn't know what to ask for, but I was filled with embarrassment and anxiety.
"Yesterday..."
Y-yesterday?
"...You were at the shopping mall near the station."
Huh...?
"Uh, y-yeah, I was! W-why do you know?"
Certainly, I went shopping near the station yesterday.
But why does Sakuraba-kun know about it...?
"...And you were with a guy, right?"
Sakuraba-kun said that with a somewhat deflated voice.
His mouth was opening and closing, and he blinked several times, remaining silent for a while.
I didn't tell Sakuraba-kun, but I have a brother.
He's handsome, born from the same parents as me, not very social, but he gets along very well with his little sister.
And yesterday, I bumped into my brother on his way back from college at the station, and we ended up shopping together. Sakuraba-kun must have seen that...!
"...Forget about what happened today."
"N-no!"
"Forget it! This is just... Ugh..."
Sakuraba-kun buried his head in his arms and slumped onto the desk.
Sakuraba-kun, who is usually composed, is so flustered.
The reason is probably...
"Could it be that Sakuraba-kun... is jealous?"
"N-no..."
"Liar!"
"N-no! I just... If you found someone else you liked, I thought we should break up quickly... I didn't cheat!"
"I don't like anyone else! I won't break up! Hey, is it really not jealousy? Really?"
"Ugh, enough! I said let's drop it!"
"Sakuraba-kun!"
"Stop it!"
After that, we shouted at each other like children for a while, getting angry and laughing.
Sakuraba-kun got jealous.
I was truly, helplessly happy about that.
If someone does that to you, you can't help but hope.
Sakuraba-kun will probably say "stop," but it's no use.
I love you, Sakuraba-kun.
I love you so much.
I can do my best again from tomorrow.
And from now on, I have to be careful not to cause any misunderstandings.
"I'm going home!"
"Aww. Oh! Then, today, I'll go shopping with Sakuraba-kun!"
"Don't need to."
"Oh, you don't need to be shy!"
"I'm not shy. I'm going home."
"Aww, Sakuraba-kun!"
But sometimes, it's nice to make him jealous.
...Just kidding.