MozillaZine

Thunderbird crashing when viewing folder with 90K+ emails

User Help for Mozilla Thunderbird
Danielx64
 
Posts: 5
Joined: August 6th, 2017, 5:45 pm

Post Posted August 6th, 2017, 5:52 pm

Thunderbird version: 52.2.1 (32-bit)
OS: Windows 10 pro x64

So I used to use Mailstore to store all my emails and I decided to use Thunderbird so that I could do everything in one place.

I been able to get everything imported just fine however this is one folder that has 90K+ emails in it. When I try to view that folder Thunderbird will crash internally and offer to send a error report in.

I'm aware that mbox format is not all that great because everything is stored in one big file so when I went to switch over I picked maildir knowing that every email is stored in it own file.

I believe that Thunderbird may be having issues with creating the .msf file for the folder.

Can someone please advise me what I need to do?

Thank you :)

tanstaafl
Moderator

User avatar
 
Posts: 43112
Joined: July 30th, 2003, 5:06 pm

Post Posted August 6th, 2017, 11:03 pm

I don't think you are running into a limit in the number of messages that can be stored in a mbox file. It supposedly supports up to 4 billion messages. The *.msf file is basically just a cache of the folder listing. It doesn't have any messages. There have been a couple of threads where people had several hundred thousand messages in a mail folder for a POP account with no problems.

My first thought is that you have a corrupt mail folder. See http://kb.mozillazine.org/Recover_messa ... upt_folder . As a sanity check you might want to use a utility such as the MboxViewer to view the contents of a mbox file without using Thunderbird, to see if it has any problems with it. See http://kb.mozillazine.org/Mail_Utilities#MboxViewer

Another possible solution would be to lie to MailStore and export the folder as .eml files (by saying you are using Outlook Express or some other client that uses that format). The ImportExportTools add-on supports importing all of the *.eml files in a directory as a mail folder. You could also try importing the mail folder (using whatever file format is appropiate) into some other email client and then copying the messages to a IMAP account. If you add the same IMAP account to Thunderbird it can access those messages without having to do any importing since IMAP accounts store messages in remote folders on the IMAP server. However, if you're not used to IMAP I'd stick with the *.eml file approach.

tanstaafl
Moderator

User avatar
 
Posts: 43112
Joined: July 30th, 2003, 5:06 pm

Post Posted August 6th, 2017, 11:32 pm

"I'm aware that mbox format is not all that great because everything is stored in one big file so when I went to switch over I picked maildir knowing that every email is stored in it own file."

The basic problem with mbox files really isn't that it uses one big file, its that Thunderbird has to parse the contents of the file to find a message. That can be error prone, and it is vulnerable to corruption. AFAIK the *.msf file doesn't specify the actual location of a message in the mbox file despite it sometimes being called a index file. Its a shame they didn't add support for using SQLite when they implemented the pluggable mail store API.

Thunderbird's implementation of maildir is good enough to be usable, but it hasn't matured yet. There are some actions that can be risky. See https://wiki.mozilla.org/Thunderbird/Maildir .

Danielx64
 
Posts: 5
Joined: August 6th, 2017, 5:45 pm

Post Posted August 7th, 2017, 12:16 am

In a nutshell I went Mailstore -> export to eml file -> import to thunderbird.

I just have Thunderbird crash on me and here the screenshot that I got at the time:

Image

Edit here my report id: bp-dde08a73-9b79-46f6-9762-a76d90170807

tanstaafl
Moderator

User avatar
 
Posts: 43112
Joined: July 30th, 2003, 5:06 pm

Post Posted August 7th, 2017, 10:06 am

See http://kb.mozillazine.org/Go_back_to_an ... hunderbird if you want to try a older version of Thunderbird (using your existing profile).

Random crash or due to trying to import that folder?

The IMAPSize utility at http://www.broobles.com/imapsize/ has a built-in eml to mbox convertor available from the tools menu. If you use it you could try copying the mbox file into a subdirectory in "Local Folders" in your profile. Thunderbird should discover it and create a corresponding .msf file so that it can be opened as a mail folder. The reason why I suggest IMAPSize is eml2mbox etc. all seem to require a obsolete version of Ruby to be installed.

Danielx64
 
Posts: 5
Joined: August 6th, 2017, 5:45 pm

Post Posted August 7th, 2017, 4:05 pm

Random crash or due to trying to import that folder?

No the import went fine (did crash there) but while trying to view that folder is where it crash.

I also got more crash reports as well:

Report ID Date Submitted
bp-9e58fb63-e673-4dc6-be24-c9bef0170807
8/8/17 9:00 AM
bp-4aa77c65-328e-4130-89ba-ddd3e0170807
8/8/17 8:50 AM
bp-bbaa40dc-8af2-4674-aafa-e8fdf0170807
8/8/17 8:48 AM
bp-c7c04419-4cab-4feb-be13-0f16b0170807
8/8/17 8:44 AM
bp-dde08a73-9b79-46f6-9762-a76d90170807
8/7/17 9:54 PM
bp-20fc3147-ee13-49c1-8f2a-84d8d0170807
8/7/17 9:52 PM
bp-49dcefcd-b9c9-4efa-be04-519800170807
8/7/17 9:51 PM
bp-017a1e09-51b5-4047-b648-1c38a0170807
8/7/17 9:48 PM
bp-7871c107-3afd-44b3-a0a3-8ce780170807
8/7/17 9:45 PM
bp-b9481673-60aa-43af-8b2e-cd6720170807
8/7/17 7:31 PM
bp-ae0485ee-2363-4741-9391-9bb490170807
8/7/17 6:25 PM
bp-3a2d7210-406a-4aed-9dfc-b9dd90170807
8/7/17 6:00 PM
bp-6d8549f7-f046-4d2d-baca-84db40170807
8/7/17 5:37 PM
bp-aa4551d3-eeb1-497f-a1b4-0572b0170807
8/7/17 5:29 PM
bp-8526f604-93d6-403b-96ff-61ad80170807
8/7/17 5:28 PM
bp-69b20395-a0ae-4717-b77b-575e90170807
8/7/17 5:27 PM
bp-911bb258-8751-4827-908f-7bb8e0170807
8/7/17 5:19 PM
bp-d8abca1f-8be4-41bc-ba84-0b7410170807
8/7/17 5:18 PM
bp-d69c95a0-73d3-4739-b68b-acea40170807
8/7/17 5:18 PM
bp-73bef450-aa37-4d0e-9475-2b8470170807
8/7/17 1:13 PM
bp-b1a17088-5aa6-4ac8-8442-05bce0170807
8/7/17 10:35 AM
bp-bfcc77d3-d106-41cd-b259-6f5940170806
8/7/17 9:59 AM
bp-bc05873f-7d42-4eab-9cca-6a9ef0170806
8/6/17 8:41 PM
bp-c52cbe83-67cf-4f02-84e4-521290170806
8/6/17 7:46 PM
bp-25f1fddb-0fbd-4b16-afcd-2fea50170806
8/6/17 7:44 PM
bp-eff83a08-5b62-4ee2-bb3d-476cd0170806
8/6/17 7:23 PM
bp-5d8481fa-ec21-427e-895a-071750170806
8/6/17 7:13 PM

Looking at some of then shows that I am running into different issues each time.

So should I try the nbox format instead or is that more dangerous?

Edit: I know what I need, something like Turgs Maildir Wizard but it will also let me delete emails as well.

tanstaafl
Moderator

User avatar
 
Posts: 43112
Joined: July 30th, 2003, 5:06 pm

Post Posted August 8th, 2017, 10:39 pm

I'm not sure what to suggest as I haven't been tracking the progress of the current efforts to deal with crashes. I normally wouldn't recommend the daily build (its meant for testers, so its always a calculated risk) as it isn't tested but it has the latest fixes. Try it. I'm running a copy and it seems very usable. I suggest you also stick with mbox files for now as despite their limitations they are less likely to contribute to crashes. If you do that I suggest you temporarily disable automated updates in tools -> options -> advanced -> update

https://ftp.mozilla.org/pub/thunderbird ... n32/en-US/

Danielx64
 
Posts: 5
Joined: August 6th, 2017, 5:45 pm

Post Posted August 9th, 2017, 12:22 am

Well I decided to get the latest beta build and so far everything is looking good.

I also decided to look in the bug tracker a bit more and I happen to find this: https://bugzilla.mozilla.org/show_bug.cgi?id=1333342

If that is my issue or not is another story but it could be a memory leak waiting to happen.

I'll keep you guys posted on the beta build.

Thank you guys :)

Return to Thunderbird Support


Who is online

Users browsing this forum: No registered users and 10 guests