Japanese or Chinese in subject line

User Help for Mozilla Thunderbird
Post Reply
NIRC
Posts: 9
Joined: March 1st, 2018, 7:29 pm

Japanese or Chinese in subject line

Post by NIRC »

When I use Japanese or Chinese in a subject line (and sometime also in an email address), the program freezes as soon as I try to do move the mail in question to another folder or drag it to the desktop.
This is getting annoying... but perhaps there is some setting I missed.
User avatar
DanRaisch
Moderator
Posts: 127186
Joined: September 23rd, 2004, 8:57 pm
Location: Somewhere on the right coast

Re: Japanese or Chinese in subject line

Post by DanRaisch »

Moving to Thunderbird Support.

Does the same thing occur if you launch the application in Mozilla Safe Mode? http://kb.mozillazine.org/Safe_mode
NIRC
Posts: 9
Joined: March 1st, 2018, 7:29 pm

Re: Japanese or Chinese in subject line

Post by NIRC »

Yes, it does.
User avatar
tanstaafl
Moderator
Posts: 49647
Joined: July 30th, 2003, 5:06 pm

Re: Japanese or Chinese in subject line

Post by tanstaafl »

I can't duplicate that problem using TB 52.6.0 under Windows 10 x64. Using Control-U to look at the raw message source I see UTF-8 (Unicode) was used as the character encoding. Are using it too or something more specific like Big5 or GB?

Subject: =?UTF-8?B?44CM5YWI55Sf77yB5Y+v5oCc5ZKn77yM5rGC5L2g5ZCR5b+X6IiN6K6y?=
=?UTF-8?B?5LiA5aOw77yM5a6e5Zyo5piv55yf56m36Ium77yM6L+Z5piv5YWI55Sf5omA57Sg?=
=?UTF-8?B?55+l55qE77yb5LiALOWFt+iWhOadv+S7lO+8jOS6suaImumXtOW3sue7j+aYrw==?=
=?UTF-8?B?6Imw6Ium6LSf5ouF77yM5pWj5Lq644CU5pWj6LWk5Lq677yM56m36Ium5Lq644CV?=
=?UTF-8?B?5pys5peg5a+M5oi355qE5Lqy5oia77yM5b+XLOiIjei/meagt+Wutuenge+8jA==?=
=?UTF-8?B?5bCR5pS25LqU6ZKx6ZO25piv5LiN5YWz6L276YeN77yM5rGC5L2g5YGa5aW95b+D?=
=?UTF-8?B?77yM5pu/5oiR6K6y5LiA5aOw44CC44CN?=
Message-ID: <cc1381dd-2a4b-7d62-a90c-9c67ba45b4a3@fastmail.fm>
Date: Fri, 2 Mar 2018 00:58:58 -0500
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101
Thunderbird/52.6.0
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
Content-Language: en-US

test of chinese text in subject. copied excerpt from
http://www-personal.umich.edu/~dporter/ ... mpler.html
NIRC
Posts: 9
Joined: March 1st, 2018, 7:29 pm

Re: Japanese or Chinese in subject line

Post by NIRC »

I'd be happy to send you a sample file to try out.
NIRC
Posts: 9
Joined: March 1st, 2018, 7:29 pm

Re: Japanese or Chinese in subject line

Post by NIRC »

Here is the "log" for one of the problem mails;
From - Wed Feb 28 13:16:39 2018
X-Mozilla-Status: 0011
X-Mozilla-Status2: 00000000
X-Mozilla-Keys:
X-Account-Key: account2
Return-Path: <liang@nanzan-u.ac.jp>
Delivered-To: heisig@nanzan.jp
Received: from imsva-internal-00.nanzan-u.ac.jp (unknown [10.10.112.192])
by smtp00.nanzan.jp (Postfix) with ESMTP id DCB5EC23EC
for <heisig@nanzan-u.ac.jp>; Mon, 26 Feb 2018 14:39:35 +0900 (JST)
Received: from imsva-internal-00.nanzan-u.ac.jp (unknown [127.0.0.1])
by IMSVA (Postfix) with ESMTP id 93ED41003D
for <heisig@nanzan-u.ac.jp>; Mon, 26 Feb 2018 14:39:34 +0900 (JST)
Received: from nanzan.jp (unknown [10.10.112.204])
by imsva-internal-00.nanzan-u.ac.jp (Postfix) with SMTP id 7D8E510036
for <heisig@nanzan-u.ac.jp>; Mon, 26 Feb 2018 14:39:34 +0900 (JST)
MIME-Version: 1.0
Message-ID: <20180226053934.00004448.0036@nanzan.jp>
Date: Mon, 26 Feb 2018 14:39:34 +0900
From: =?ISO-2022-JP?B?TElBTkcgWGlhb2hvbmcvGyRCTkIbKEIgGyRCNkdGehsoQg==?= <liang@nanzan-u.ac.jp>
To: "Jim Heisig" <heisig@nanzan-u.ac.jp>
Subject: Re: =?ISO-2022-JP?B?GyRCJCo0aiQkGyhC?=
In-Reply-To: <1A19BAA752974F08B281D6A0EE459619@LAPTOPBTQ9UNR8>
References: <1A19BAA752974F08B281D6A0EE459619@LAPTOPBTQ9UNR8>
Content-Type: text/plain; charset=ISO-2022-JP
Content-Transfer-Encoding: 7bit
X-Priority: 3
X-MAILER: Active! mail
X-TM-AS-GCONF: 00
X-TM-AS-Product-Ver: IMSVA-9.0.0.1549-8.2.0.1013-23686.004
X-TM-AS-User-Approved-Sender: Yes
X-TMASE-Version: IMSVA-9.0.0.1549-8.2.1013-23686.004
X-TMASE-Result: 10--3.677400-10.000000
X-TMASE-MatchedRID: ZkuSgFxpyLxCXIGdsOwlUh5+URxv1WlBpHrN5q7P5u/runkxzmhgzLFx
Rc2XN3bQkSfO80kXYjJREYmSiLpzZT/pyYKOcKnKrVQEzzTyhuwAYhCQJWWryLFQWKlAfzmEMTP
YCK4/Q6QiArttpevNpEj/pO9kUrFOPfX10q5FAMOi3tEVgjGSzQ2uWtgGEQSRWUNnKbNXkhLyoC
rQy2TPjYl6/ygcnx3K5TkSwOrsup8yjQJEBHucR54CIKY/Hg3AtOt1ofVlaoIHA64fRbkFm3nhQ
EB6FTWSbxc8rwAf4o5q8/xv2Um1avoLR4+zsDTtz6Z2NvWLo/BBlgQ4NkIt9Dy+AGBd3yatLz1b
NxJpkez9cETI3enhEDfkmJrxbS0MzJhdYiDoeCcaC3AGC8Nkt3colQqiHQ0Kkxyv4HgD4HE=
X-TMASE-SNAP-Result: 1.821001.0001-0-1-12:0,22:0,33:0,34:0-0

$B%O%$%8%C%/@h@8!'(B

$BNB$G$9!#>5CN$7$^$7$?!#?eMKF|$N8a8eG!2?$G$7$g$&$+!)(B


----- Original Message -----
> $BNB$5$s!"(B
>
> $B$A$g$C$H$7$?AjCL$,$"$j$^$9$N$G!"$=$A$i$NET9g$G%-%c%s%Q%9$KMh$k$H$-(B
30$BJ,$0$i$$$NBG$A9g$o$;$r$*4j$$$7$^$9!#(B
>
> $B%O%$%8%C%/(B
>
User avatar
tanstaafl
Moderator
Posts: 49647
Joined: July 30th, 2003, 5:06 pm

Re: Japanese or Chinese in subject line

Post by tanstaafl »

I noticed the Content-Type: text/plain; charset=ISO-2022-JP header.

"ISO-2022-JP. A widely used encoding for Japanese. Starts in ASCII and includes the following escape sequences
ESC ( B to switch to ASCII (1 byte per character)
ESC ( J to switch to JIS X 0201-1976 (ISO/IEC 646:JP) Roman set (1 byte per character)
ESC $ @ to switch to JIS X 0208-1978 (2 bytes per character)
ESC $ B to switch to JIS X 0208-1983 (2 bytes per character)"

I assume you have no problem displaying that message, it's only a problem when you move it. Do you have the same problem with other messages that are non-ASCII and have 8 or 16 bit characters?

All that I can think of is that your inbox folder is corrupted and Thunderbird gets caught in a endless loop when trying to move a message. I suggest you move most of the messages that you want to keep from the inbox to other folders and then empty the trash and compact it. Try to make the folder as empty as possible. There is a obvious catch-22 in moving messages to avoid a problem that occurs when moving messages. Are you using a POP or IMAP account? If its a IMAP account I'd suggest moving them via webmail (browser).
NIRC
Posts: 9
Joined: March 1st, 2018, 7:29 pm

Re: Japanese or Chinese in subject line

Post by NIRC »

Thanks for looking at this. I do not have the problem with I use characters outside Ascii (diacritical marks, etc). I use POP3. And the same thing happens on both my computers and in ALL folder I try to move the messages to from outside.
User avatar
tanstaafl
Moderator
Posts: 49647
Joined: July 30th, 2003, 5:06 pm

Re: Japanese or Chinese in subject line

Post by tanstaafl »

See if you're comfortable using Cut MboxD or exporting the messages as *.eml files using ImportExportTools as described in http://kb.mozillazine.org/Recover_messa ... upt_folder
NIRC
Posts: 9
Joined: March 1st, 2018, 7:29 pm

Re: Japanese or Chinese in subject line

Post by NIRC »

Actually, my intention was to report a bug: When you try to drag-and-drop a file INSIDE of Thunderbird, if that mail's subject line or adressee has Japanese characters in it, it will often crash the program (it goes into "not responding" mode and has to be shut down.
When you drag such a message OUTSIDE of Thunderbird, or drag from some OUTSIDE into Thunderbird, the same thing happens. All other mails, even with advanced European diacritical marks , transfer fine always.
Perhaps it has something to do with 2-bit characters. I would change the default menu language to Japanese, but there is no option.
Clearly, this is something the programmers have to look into... if I could only get the attention.
User avatar
tanstaafl
Moderator
Posts: 49647
Joined: July 30th, 2003, 5:06 pm

Re: Japanese or Chinese in subject line

Post by tanstaafl »

You can file a bug report at https://bugzilla.mozilla.org/ . When you file it I suggest you also mention some cases where the subject used 8 bit characters (such as Unicode or BigRed) and it did not cause a problem. This will reduce the chance that somebody will close the bug report by claiming its a problem that should be handled in the support forums.

Please post a link to the bug report afterwards.
Post Reply