oAuth2 and Gmail

[pftavares]

usually means either a problem with the mail server name, port number, or the SSL/TLS setting.

It connected to Google and fetched the configuration. All port numbers, server names and other settings are correct...

"C:\Program Files\Betterbird\betterbird.exe" --allow-downgrade

I'm on Linux!

Anyway, Evolution run fine at first attempt!
So there's nothing wrong in my Gmail account configuration, firewall or any other detail in the computer.
All settings in Evolution -- server names, port numbers, etc -- are the same that I use in Thunderbird.
Then why Thunderbird family refuses to connect?
It has been my faithful mail program for so many years...

[BuddhaNature]

See the last post in this bug report (comment number 3): https://bugzilla.mozilla.org/show_bug.cgi?id=1766071#c3 You seem to be in territory where anything is worth a try now.

Might also be worth while raising a bug report yourself at Bugzilla.

[tanstaafl]

Thunderbrid doesn't fetch configuration data from Google, its fetched from the "Mozilla ISP database". Email providers such as Gmail, Outlook.com, Yahoo etc. submit their data to the project, which stores it there.

Try creating a IMAP log file. A lot of it might look like gibberish to you but you should be able to figure out if it got far enough to try to log in using a token. If you sanitize the log file using a text editor to replace your username with "username" , post it on something like dropbox and post a link to it I'll take a look at it.

See https://www.lifewire.com/pop-imap-smtp- ... rd-1173156 and http://kb.mozillazine.org/Session_logging_for_mail/news

You need to create a shell script (Linux equivalent of a batch file) that contains the equivalent for Linux of:

set MOZ_LOG=IMAP:5,timestamp
set MOZ_LOG_FILE=%APPDATA%\Thunderbird\Profiles\imap.log
set NSPR_LOG_MODULES=IMAP:5,timestamp
set NSPR_LOG_FILE=%APPDATA%\Thunderbird\Profiles\imap.log
"%ProgramFiles(x86)%\Mozilla Thunderbird\thunderbird.exe"

You use export instead of set to set a environmental variable under Linux.

When you run that it in a terminal window it will launch Thunderbird with IMAP logging enabled, storing the log data in imap.log. The advantage of using the built-in logging method over Wireshark, tcpdump etc. is more people in this forum understand it. Its also something that could be submitted as part of a bug report.

https://www.theserverside.com/blog/Coff ... sion-steps

[pftavares]

Done that.
Only get an empty file with 0kb...

Meanwhile in the linux console (while Thunderbird is running) I get:

paulo@Mint203:~$ thunderbird
JavaScript error: resource://gre/modules/XULStore.jsm, line 66: Error: Can't find profile directory.
JavaScript error: resource://gre/modules/XULStore.jsm, line 66: Error: Can't find profile directory.
JavaScript error: resource://gre/modules/XULStore.jsm, line 66: Error: Can't find profile directory.
JavaScript error: resource://gre/modules/XULStore.jsm, line 66: Error: Can't find profile directory.
JavaScript error: resource://gre/modules/XULStore.jsm, line 66: Error: Can't find profile directory.
JavaScript error: resource://gre/modules/XULStore.jsm, line 66: Error: Can't find profile directory.
JavaScript error: resource://gre/modules/XULStore.jsm, line 66: Error: Can't find profile directory.
[calBackendLoader] Using Thunderbird's libical backend
[LDAPModuleLoader] Using LDAPDirectory.jsm
[MsgSendModuleLoader] Using MessageSend.jsm
[SmtpModuleLoader] Using SmtpService.jsm
console.warn: Calendar: Warning: Using guessed timezone
Europe/Lisbon (UTC+0000/+0100).
This ZoneInfo timezone seems to match the operating system timezone this year.
This ZoneInfo timezone was chosen based on the operating system timezone
identifier "/etc/localtime -> /usr/share/zoneinfo/Europe/Lisbon".
console.debug: "Successfully loaded OpenPGP library librnp.so version 0.16+git20220124.f06439f7.MZLA from /usr/lib/thunderbird/librnp.so"
console.warn: SearchSettings: "get: No settings file exists, new profile?" (new NotFoundError("Could not open the file at /home/paulo/.thunderbird/i6u4t31w.default-release/search.json.mozlz4", (void 0)))
console.debug: "Found 0 public keys and 0 secret keys (0 protected, 0 unprotected)"
console.debug: "Successfully loaded optional OpenPGP library libgpgme.so.11 from system's standard library locations"
console.debug: "gpgme version: 1.13.1-unknown"
console.debug: "Trying to load /usr/lib/thunderbird/libotr.so"
console.debug: "Trying to load libotr.so from system's standard library locations"
console.debug: "Trying to load libotr.so.5 from system's standard library locations"
console.debug: "Trying to load libotr.so from system's standard library locations"
console.log: (new Error("Cannot load required OTR library", "resource:///modules/OTRLib.jsm", 109))
console.warn: services.settings: thunderbird/url-classifier-skip-urls has signature disabled
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource://gre/modules/LoginManagerPrompter.jsm, line 776: TypeError: PopupNotifications is undefined
JavaScript error: resource://gre/modules/LoginManagerParent.jsm, line 1018: NS_ERROR_XPC_JAVASCRIPT_ERROR_WITH_DETAILS: [JavaScript Error: "PopupNotifications is undefined" {file: "resource://gre/modules/LoginManagerPrompter.jsm" line: 776}]'[JavaScript Error: "PopupNotifications is undefined" {file: "resource://gre/modules/LoginManagerPrompter.jsm" line: 776}]' when calling method: [nsILoginManagerPrompter::promptToSavePassword]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource://gre/modules/LoginManagerPrompter.jsm, line 776: TypeError: PopupNotifications is undefined
JavaScript error: resource://gre/modules/LoginManagerParent.jsm, line 1018: NS_ERROR_XPC_JAVASCRIPT_ERROR_WITH_DETAILS: [JavaScript Error: "PopupNotifications is undefined" {file: "resource://gre/modules/LoginManagerPrompter.jsm" line: 776}]'[JavaScript Error: "PopupNotifications is undefined" {file: "resource://gre/modules/LoginManagerPrompter.jsm" line: 776}]' when calling method: [nsILoginManagerPrompter::promptToSavePassword]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: resource:///modules/OAuth2.jsm, line 171: NS_ERROR_NOT_IMPLEMENTED: Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIRequest.name]
JavaScript error: chrome://calendar/content/today-pane.js, line 60: NS_ERROR_ILLEGAL_VALUE: Component returned failure code: 0x80070057 (NS_ERROR_ILLEGAL_VALUE) [nsIObserverService.removeObserver]
JavaScript error: chrome://messenger/content/msgHdrView.js, line 399: NS_ERROR_ILLEGAL_VALUE: Component returned failure code: 0x80070057 (NS_ERROR_ILLEGAL_VALUE) [nsIObserverService.removeObserver]

###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost

[tanstaafl]

What shell script did you use?

search.json.mozlz4 is the file in your profile used to store search engine options. It can't be opened for some reason. Does that file exist? The reason I ask is you seem to have lots of unrelated problems, especially for a brand new profile with one account.

[pftavares]

Typed directly in the console:

set NSPR_LOG_MODULES=IMAP:4
export NSPR_LOG_MODULES=IMAP:4
export NSPR_LOG_FILE=~/tbird.log.txt
thunderbird

The file search.json.mozlz4 exists in my profile dir.

Any more ideas?

[tanstaafl]

You're missing a line. That might be why you got a empty file. Try again.

In the interim I'll investigate what Linux distro to use with WSL (Windows subsystem for Linux). That will let me run Linux applications from a terminal window under Windows. I'll install a Linux version of Thunderbird, create a new profile, and enable logging. Might take me a couple of days.

Ubuntu would be a good choice but "Pengwin is the first Linux distribution created specifically for WSL." It has some useful utilities for WSL. I need to see what else is available.

https://github.com/WhitewaterFoundry/Pengwin
https://github.com/wslutilities/wslu
https://www.windowscentral.com/how-inst ... -10-and-11
https://docs.microsoft.com/en-us/windows/wsl/install
https://docs.microsoft.com/en-us/window ... s/gui-apps

[pftavares]

You're missing a line

What line? I followed exactly the instructions for linux in the link you sent -- https://www.lifewire.com/pop-imap-smtp- ... rd-1173156

[tanstaafl]

The Lifewire article is much more readable but its out of date. I didn't realize that at the time. What is in http://kb.mozillazine.org/Session_logging_for_mail/news works (under Windows, and plenty of people have modified it for Linux and OSX).

NSPR_LOG_MODULES and NSPR_LOG_FILE were used before Thunderbird 55.0a1 . MOZ_LOG and MOZ_LOG_FILE are what current versions use, according to the note at the end of https://wiki.mozilla.org/MailNews:Logging . We document using both in the KB article because that covers all cases. I didn't remember that at the time but I did give you a copy of what would work under Windows, saying you need to adapt it for Linux.

# For bash shell (the default shell on most GNU/Linux systems):
export MOZ_LOG=IMAP:5,timestamp
export MOZ_LOG_FILE=/tmp/imap.log

# For tcsh / csh (which is not as common):
setenv MOZ_LOG IMAP:5
setenv MOZ_LOG_FILE /tmp/imap.log

If your log file is empty or missing, review this document again, and check for these common problems:

Do you have write access to the directory specified in MOZ_LOG_FILE?
Did you shut down the mailnews application? (the log file is buffered in memory)
Did you restart your mailnews application, and wipe out the log of the session you wanted to debug? (every restart wipes out the previous log)
If you used a batch file on Windows, is the batch file set to run with administrator privileges?
Do your log variables contain quotation marks or other invalid characters?
Are your log module names correctly CASE SENSITIVE? (i.e. camel case which is not all upper case, nor all lower case)

[pftavares]

Dis it all right this time substituting NSPR for MOZ and putting a 5 instead of a 4 after IMAP.
Empty log file and console errors equal to the last try...

[tanstaafl]

I'll install WSL/Ubuntu tomorrow and see if I can get session logging working for a Gmail IMAP account .

[tanstaafl]

I installed the Ubuntu distro under WSL2, and then installed thunderbird and gedit.

I started Thunderbird and it created a profile and launched the new account wizard. I added a Gmail IMAP account using default settings. I saw

* One account all of google popup that had my email address
* Then it wanted the password
* Then it wanted to confirm that TB can access the google account. Pressed Allow button
* Popup went away
* Saw blue Finish button in Thunderbird pane. Pressed it.
* Saw System integration popup. Enabled TB being default email client

No problem using the account. I confirmed the Gmail IMAP account is set to use OAuth authentication, and installed the Compact Headers add-on and the soft drawing paper theme. I exited Thunderbird and created a imap_log.sh script file in .thunderbird that contained

export MOZ_LOG=IMAP:5,timestamp
export MOZ_LOG_FILE=imap.log
thunderbird

I ran the script file from the .thunderbird directory using bash imap_log.sh
It stored the data in imap.log.moz_log .


2022-05-23 14:19:22.700955 UTC - [Parent 10457: IMAP]: D/IMAP Try to log in
2022-05-23 14:19:22.700956 UTC - [Parent 10457: IMAP]: D/IMAP IMAP auth: server caps 0xc080c1625, pref 0x800000000, failed 0x0, avail caps 0x800000000
2022-05-23 14:19:22.700958 UTC - [Parent 10457: IMAP]: D/IMAP (GSSAPI = 0x1000000, CRAM = 0x20000, NTLM = 0x100000, MSN = 0x200000, PLAIN = 0x1000, LOGIN = 0x2, old-style IMAP login = 0x4, auth external IMAP login = 0x20000000, OAUTH2 = 0x800000000)
2022-05-23 14:19:22.700958 UTC - [Parent 10457: IMAP]: D/IMAP Trying auth method 0x800000000
2022-05-23 14:19:22.701768 UTC - [Parent 10457: IMAP]: D/IMAP IMAP: trying auth method 0x800000000
2022-05-23 14:19:22.701773 UTC - [Parent 10457: IMAP]: D/IMAP XOAUTH2 auth
2022-05-23 14:19:22.845467 UTC - [Parent 10457: IMAP]: I/IMAP 7f93f6d13000:imap.gmail.com:NA:SendData: Logging suppressed for this command (it probably contained authentication information)
2022-05-23 14:19:22.896512 UTC - [Parent 10457: IMAP]: I/IMAP 7f93f6e29800:imap.gmail.com:NA:SendData: Logging suppressed for this command (it probably contained authentication information)
2022-05-23 14:19:23.623104 UTC - [Parent 10457: IMAP]: D/IMAP ReadNextLine [rv=0x0 stream=7f93fb4118b0 nb=218 needmore=0]
2022-05-23 14:19:23.623113 UTC - [Parent 10457: IMAP]: I/IMAP 7f93f6d13000:imap.gmail.com:NA:CreateNewLineFromSocket: * CAPABILITY IMAP4rev1 UNSELECT IDLE NAMESPACE QUOTA ID XLIST CHILDREN X-GM-EXT-1 UIDPLUS COMPRESS=DEFLATE ENABLE MOVE CONDSTORE ESEARCH UTF8=ACCEPT LIST-EXTENDED LIST-STATUS LITERAL- SPECIAL-USE APPENDLIMIT=35651584
2022-05-23 14:19:23.623115 UTC - [Parent 10457: IMAP]: D/IMAP SetConnectionStatus(0x0)
2022-05-23 14:19:23.623190 UTC - [Parent 10457: IMAP]: D/IMAP ReadNextLine [rv=0x0 stream=7f93fb4118b0 nb=48 needmore=0]
2022-05-23 14:19:23.623194 UTC - [Parent 10457: IMAP]: I/IMAP 7f93f6d13000:imap.gmail.com:NA:CreateNewLineFromSocket: 27 OK USERNAME@gmail.com authenticated (Success)
2022-05-23 14:19:23.623195 UTC - [Parent 10457: IMAP]: D/IMAP SetConnectionStatus(0x0)
2022-05-23 14:19:23.623202 UTC - [Parent 10457: IMAP]: D/IMAP login succeeded

I edited the above excerpt to replace my username with USERNAME. I got the following chatter in the terminal window when starting Thunderbird:

eric@DESKTOP-K8K60RO:~/.thunderbird$ thunderbird
[calBackendLoader] Using Thunderbird's libical backend
[LDAPModuleLoader] Using LDAPDirectory.jsm
[MsgSendModuleLoader] Using MessageSend.jsm
[SmtpModuleLoader] Using SmtpService.jsm
console.debug: WebExtensions:
Compact Headers loaded
console.debug: "Trying to load /usr/lib/thunderbird/libotr.so"
console.debug: "Trying to load libotr.so from system's standard library locations"
console.debug: "Trying to load libotr.so.5 from system's standard library locations"
console.debug: "Trying to load libotr.so from system's standard library locations"
console.log: (new Error("Cannot load required OTR library", "resource:///modules/OTRLib.jsm", 109))
console.debug: "Successfully loaded OpenPGP library librnp.so version 0.16+git20220124.f06439f7.MZLA from /usr/lib/thunderbird/librnp.so"
console.debug: "Found 0 public keys and 0 secret keys (0 protected, 0 unprotected)"
console.debug: "Successfully loaded optional OpenPGP library libgpgme.so.11 from system's standard library locations"
console.debug: "gpgme version: 1.13.1-unknown"
console.warn: services.settings: thunderbird/hijack-blocklists has signature disabled

I didn't use setenv MOZ_LOG_FILE /tmp/imap.log since I'm still learning how to use WSL. I noticed four empty child log files such as /home/eric/.thunderbird/imap.log.child-1.moz_log , no idea why they were created. imap.log.moz_log has the data.

eric@DESKTOP-K8K60RO:~/.thunderbird$ cat /etc/os-release
NAME="Ubuntu"
VERSION="20.04 LTS (Focal Fossa)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 20.04 LTS"
VERSION_ID="20.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and- ... acy-policy"
VERSION_CODENAME=focal
UBUNTU_CODENAME=focal

[pftavares]

No problem using the account.

You succeeded in your environment.
I wonder what is wrong in mine and mostly how can I correct it?

[tanstaafl]

Dis it all right this time substituting NSPR for MOZ and putting a 5 instead of a 4 after IMAP.
Empty log file and console errors equal to the last try...

Try using

export MOZ_LOG=IMAP:5,timestamp
export MOZ_LOG_FILE=imap.log
thunderbird

If you can get a non-zero log file that might provide the information needed to understand what is wrong with your configuration.

After the installation I updated it using sudo apt update && sudo apt upgrade and it fetched a good bit of code. cat /etc/os-release now says its Ubuntu 20.04.4 LTS . Using apt list | grep thunderbird I found: thunderbird-locale-en-us/focal-updates,focal-security 1:91.9.1+build1-0ubuntu0.20.04.1 all

The latest Ubuntu LTS according to https://ubuntu.com/download/desktop is Version 22.04

help -> more troubleshooting information in Thunderbird says the user agent is Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.9.1 and the OS is Linux 5.10.16.3-microsoft-standard-WSL2 #1 SMP Fri Apr 2 22:23:49 UTC 2021 . What distro are you using and what is the user agent and OS in help -> more troubleshooting information?

[pftavares]

~$ cat /etc/os-release
NAME="Linux Mint"
VERSION="20.3 (Una)"
ID=linuxmint
ID_LIKE=ubuntu
PRETTY_NAME="Linux Mint 20.3"
VERSION_ID="20.3"
HOME_URL="https://www.linuxmint.com/"
SUPPORT_URL="https://forums.linuxmint.com/"
BUG_REPORT_URL="http://linuxmint-troubleshooting-guide. ... en/latest/"
PRIVACY_POLICY_URL="https://www.linuxmint.com/"
VERSION_CODENAME=una
UBUNTU_CODENAME=focal

$ apt list | grep thunderbird
thunderbird-locale-en-us/focal-updates,focal-updates,focal-security,focal-security,now 1:91.9.1+build1-0ubuntu0.20.04.1 all [installed]

User Agent Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.9.1
OS Linux 5.14.0-1038-oem #42-Ubuntu SMP Thu May 19 05:03:08 UTC 2022