A place where the Joyent community can gather, help each other out, and stay informed.
You are not logged in.
We've run across an undocumented configuration change in the new version of Dovecot. On the server, in your "Maildir" directory, is a file called ".subscriptions". The new version of Dovecot changed the default subscriptions file to "subscriptions", without the dot.
If you can't see your mail, don't worry, it's still there. You either need to change the filename, or re-subscribe to your e-mail folders. Apple's Mail.app seems to be largely unaffected by the change in filenames, but other applications are. If someone with access to Microsoft Outlook can post instructions on re-subscribing, that would be immensely appreciated.
We don't have many reports of problems with e-mail, and the vast majority of customers are retrieving e-mail successfully. If you are still having additional e-mail problems, please submit a ticket and please be patient. Those problems we are seeing appear to be fairly unique so far and will take some time to work through. We will get things working correctly again soon, and so far the new Dovecot appears to have improved the stability of the servers it's been installed on.
Offline
"Mail was unable to open this mailbox on the server "gilford.textdrive.com".
The server error encountered was: Internal error occurred. Refer to server log for more information."
That's what I currently get with Mail.app. I've downloaded and tried Thunderbird, same problem. Ditto with Squirrel, Iloha is pretty much silent but gives me an empty inbox.
Any help would be greatly appreciated, I can't even check my tickets status, I don't have access to my email, eh! ;)
Offline
Now I'm being told that one.textdrive.com "is not a valid IMAP4 server." I've also gotten two "stack fault" errors.
UPDATE: Well, that's gone away, but only after I removed my old user account and created a new one. This has been a real pain in the ass.
Last edited by me3dia (2005-09-22 20:50:04)
Offline
More info. It looks like the problem is only occuring for INBOX. Squirrel now allows me to log in, but displays an error when it tries to display INBOX: "ERROR : Could not complete request. Query: SELECT "INBOX" Reason Given: Internal error occurred. Refer to server log for more information. [2005-09-22 22:41:52]"
INBOX subfolders seem to display just fine.
Last edited by lucsky (2005-09-22 22:46:10)
Offline
Offline
Sorry I vanished for so long today! A thunderstorm in my area brought power down for awhile, and network down for even longer.
Okay, you three. The problem you're running into has to do with corrupted index files. The old version of Dovecot was a bit more lenient about what it allowed. This newer version has better error checking, and was choking on your indexes.
The solution is to remove your index files and let Dovecot re-create them. In your Maildir, there are a handful of "dovecot.index*" files that need to be deleted. This should solve the problem in most cases. If not, the next step is to go into each of your individual mailboxes (such as .INBOX) and delete the .imap.index* files that are in there.
Once you're able to log back in, your mail client will start recreating those indexes for you again.
Offline
I'm having the same problem. Only there are no index files at the top level of MailDir. And there are no files at all in .INBOX either, which is somewhat disturbing. There are index files in other mailboxes, but I'm a little reluctant to delete them, not knowing what's going on at the top level.
Offline
cnladd wrote:
The solution is to remove your index files and let Dovecot re-create them. In your Maildir, there are a handful of "dovecot.index*" files that need to be deleted. This should solve the problem in most cases. If not, the next step is to go into each of your individual mailboxes (such as .INBOX) and delete the .imap.index* files that are in there.
Having never messed with the guts of my mail app before, I'm not sure where I'm to do this. On the server? In Webmin somewhere? In my mail app (Thunderbird)?
Offline
Hi me3dia.
I did this to get my mail upa and running again. (Secure Shell access though)
cd Maildir
mv dovecot.index* ..
mv'd instead of rm since then I could revert if everything crashed ;)
Reopened Firebird and I got my Sent and Draft folders back.
If you lack SSH access you can run the a single command from WEBMIN (Running Processes/Command to run)
mv ~/Maildir/dovecot.index* ~
Will do the trick.
Last edited by JoNtE (2005-09-23 06:16:16)
Offline
me3dia wrote:
Having never messed with the guts of my mail app before, I'm not sure where I'm to do this. On the server? In Webmin somewhere? In my mail app (Thunderbird)?
Are you still having problems with your e-mail? I've already done this for you (as well as the ".subscription" change I talked about, up above.)
Offline
Offline
cnladd: deleting the index files fixed the problem for a while but when I relaunched Mail.app after a few hours the files seemed to have got somehow corrupted again. The new messages appear on the screen only for a second and then they disappear. I deleted the index files again but I wouldn't like to do that every time I launch the mail client :-/
Offline
cnladd wrote:
Are you still having problems with your e-mail? I've already done this for you (as well as the ".subscription" change I talked about, up above.)
For awhile yesterday morning, all was nearly fine. I could receive mail with no problems, but Thunderbird hung up when trying to save the email to the "sent" folder. Then mid-afternoon I started getting the "Internal server error" message.
Offline
JoNtE wrote:
If you lack SSH access you can run the a single command from WEBMIN (Running Processes/Command to run)
Code:
mv ~/Maildir/dovecot.index* ~
Will do the trick.
Followed this advice and got this notice:
Output from mv ~/Maildir/dovecot.index* ~ ..
mv: rename /root/Maildir/dovecot.index* to /root/dovecot.index*: Permission denied
Offline
jarkko wrote:
cnladd: deleting the index files fixed the problem for a while but when I relaunched Mail.app after a few hours the files seemed to have got somehow corrupted again. The new messages appear on the screen only for a second and then they disappear. I deleted the index files again but I wouldn't like to do that every time I launch the mail client :-/
Please try it now. If deleting the first level of indexes (dovecot.index*) does not work, then all indexes need to be deleted at once (including those in each mailbox, both dovecot.index* and .imap.index*). You should be set, now.
Offline
Gee, it's broken again. And this time deleting index files doesn't fix it. Different error, though. Mail just silently fails. SquirrelMail reports:
ERROR : Connection dropped by imap-server.
Query: STATUS "INBOX" (MESSAGES UNSEEN RECENT)
And after I deleted indexes it changes to "Query: EXPUNGE". Any ideas? How do I fix it and more importantly, how do I stop it from happening again?
Offline
My most important email account account is inaccessible via IMAP or POP3. Can only see the inbox via Webmin. Tried everything suggested here. Filed a ticket. Nothing's happening.
If this were a client's account I'd be taking a serious black-eye.
I'm not gonna escalate my ticket to where it rings somebody's pager. But I want to.
What's pissing me off is the lack of definitive instructions for repairing this myself. I'd be glad to look after whatever clean-up the Dovecot upgrade makes necessary, but I need clear information.
Nate, I'll write-up and publicize instructions for every mail client I can get my hands on, screenshots and everything, but I need the facts. Yes, client-server interaction makes IMAP a special case
Thanks.
LQ
Offline
Okay, so the word is to get rid of (or rename) all files under one's home directory matching these masks:
dovecot* // (not `dovecot.index*`)
.imap.index*
[Thanks, Ryan.]
LQ
Last edited by Lou Quillio (2005-09-25 12:22:51)
Offline
Just had the same problem on Barclay. Solved it by renaming everything named 'dovecot' via FTP.
Offline
FWIW, I'm on barclay and haven't had any problems at all with email.
Offline
jdueck wrote:
FWIW, I'm on barclay and haven't had any problems at all with email.
Seems to be very much about individual IMAP folders. For example, I can SELECT each of my IMAP folders across sixteen domains, including the folders of the account I use for most everything -- except I can't get to the .inbox folder of my main account. As a practical matter, I'm down. Haven't heard from any (human) clients, but only two use IMAP that I know of.
The messages are in my .inbox; I can read them via Webmin. Any other IMAP client gets 'internal error' on SELECT, including sqmail. Can't POP, either.
This began with the Dovecot upgrade or seemed to, and deleting Dovecot's indexes and whatnot seemed to work over the weekend. It isn't working any more.
So it seems like this isn't getting much attention because it affects specific folders of specific accounts of specific users on specific servers. Sure wish I could think of something else to try. Even more, I like to know the cause. IMAP's a little touchy anyhow, so it'd be good to make sure my email clients are making clean requests and aren't somehow fouling things.
LQ
Offline
Unfortunately, my IMAP problems are back here too (I'm on gilford) :(
I have manually removed all Dovecot index files this morning because Mail.app was getting zombie deleted messages again, it has worked during the day and it now starts to behave weirdly again.
Let's see, what could be wrong here...
- upgrading Dovecot was not such a good idea. Seriously, an alpha version on a production server ?
- Mail.app is a crappy IMAP client, which is possible but I did not have any problem before the Dovecot upgrade so...
- Mail.app and Dovecot now have some kind of incompatibilities which corrupt the index files after a certain time or because of the way Mail.app does IMAP interaction.
- ??
Any idea ?
Offline
lucsky wrote:
Any idea ?
Probably you're fixed by now, Luc-ster. I am.
But after being effectively without email access for two days, I still want to know what happened.
LQ
Offline
We're not entirely sure what the exact cause is, but it appears to be client-related.
The new version of Dovecot was accessing the same index files that the old version had been accessing. These index files can become corrupted. According to the notes about upgrading from the old version of Dovecot to the new version of Dovecot, the new version has much better error checking and will not tolerate some of the index errors that the old version tolerated.
The problems were fairly limited, and only a handful of people were affected. There's no rhyme or reason (that we can tell) to who was affected: some people had a huge number of IMAP folders and e-mail, some people hardly had anything (if anything at all.) Clients affected were across the board, but seemed to mainly be Mail.app users. My own personal account is on One, one of the upgraded servers, and I use Mail.app and didn't see the error.
lucsky wrote:
- upgrading Dovecot was not such a good idea. Seriously, an alpha version on a production server ?
The version we've upgraded to is the recommended version. The previous version is a few years old, is no longer actively being updated, and has had several problems that were fixed in this version (problems whose resolution is "upgrade to the recommended version, it's more stable.")
Offline
Thanks, Nate. IMAP really is odd. POP3 you point at any mailserver, it retrieves, can ask for messages to be deleted, and gets out. IMAP can make things (folders), but there's more than one way to make an IMAP folder. Clients offer IMAP to users like it's monolithic, like POP3. But it ain't. There's ... variance.
For the record, mine went bad using primarily T-Bird on Linux (current T-Bird, and over SSL) and TxD's sqmail install, natch over SSL. Hit it with Mail.app at one point just to see, but that didn't 'cause' anything. There's about 35mb in the folder and its children. Should clean that.
Anyhow, if there are optimal settings for popular IMAP clients, let me know what they are and I'll research and write-up some TxD documentation. We need to be using tight IMAP at TxD. Separates us from the animals.
Working ...
sudo apt-get install dovecot
Setting up dovecot-common (0.99.13-3) ...
man dovecot
LQ
Offline
Okay, I created a new email account and everything works just dandy. So I decided to do as complete a reset as possible on my old email account (I use Mac OS X Mail).
First I took the mail account offline and deleted it from the preferences panel.
Then I ssh'ed in and from Maildir ran the following:
rm subscriptions
rm .subscriptions
rm dovecot*
rm .imap.index*
rm .*/dovecot*
rm .*/.imap.index*
Then I added the account back to mail and am letting it completely update before touching anything. Right now it's still synchronizing Deleted Messages (should of deleted those first), but I'm not gonna touch anything til its done.
BTW, any thoughts on maybe the corruption happening due to mixing IMAP clients at the same time? My dialup is so slow I often log into webmail with Mail open and synchronizing...
Offline
Looked like everything was going great, then I got the dreaded Internal Error message
The server error encountered was: Internal error occurred. Refer to server log for more information. [2005-09-28 04:40:05]
That's on gilford if you want to investigate the particular entry.
Offline
My IMAP access was completely fubar again this morning: new messages were not showing up and messages which I had deleted yesterday were constantly reappearing. So I did exactly what dasil003 did: deleted my IMAP email account from Mail.app, removed all Dovecot subscriptions and index files from my Maildir folder, then recreated the account, yadda yadda yadda.
So far so good, but in order to really try to track this one down I have also changed some of the account settings in Mail.app:
Now waiting for shit to happen again... ;)
Offline
There seem to be similar difficulties on One.
Mail.app is throwing up an IMAP error:
IMAP command
Offline