Reply by email issue
Hi, I'm using reply by mail with exchange (i have installed a custom transport agent for supporting plus addressing). Mail are sent using the correct address but when i reply i receive
Unfortunately, your email message to GitLab could not be processed.
It appears that the email is blank. Make sure your reply is at the top of the email, we can't process inline replies.
Why?
PS. I'm using an antispam which adds a custom footer to all the mail received and sent. It will create problems?
Activity
If you turn off HTML when replying (using outlook) it works
Edited by username-removed-82025Yep
User-Agent: Microsoft-MacOutlook/0.0.0.150923 Date: Wed, 7 Oct 2015 18:17:53 +0200 Subject: Re: Test | Issue (#2) From: Andrea Ruggiero <xxxx@xxxxx.xx> To: Andrea Ruggiero / Test <gitlab+2197e6f3fd715f165421979610b8e4a6@xxxxx.xx> Message-ID: <0D90654D-69B7-4D29-AC79-0069DAB91F15@xxxxx.xx> Thread-Topic: Test | Issue (#2) References: <issue_3@git.xxxxx.xx> In-Reply-To: <issue_3@git.xxxxx.xx> MIME-Version: 1.0 Content-type: multipart/alternative; boundary="B_3527156800_719895807" > This message is in MIME format. Since your mail reader does not understand this format, some or all of this message may not be legible. --B_3527156800_719895807 Content-type: text/plain; charset="UTF-8" Content-transfer-encoding: quoted-printable test Da: Chris54721 Risposta: Andrea Ruggiero / Test Data: marted=C3=AC 29 settembre 2015 18:58 A: Andrea Ruggiero Oggetto: Test | Issue (#2) GitLab=20 @pupax 6 6 6 =E2=80=94=20 Reply to this email directly or view it on GitLab. {"@context":"http://sche= ma.org","@type":"EmailMessage","action":{"@type":"ViewAction","name":"View I= ssue","url":"http://git.xxxxx.xx/pupax/Test/issues/2"}} You're receiving th= is notification because you are a member of the Andrea Ruggiero / Test proje= ct team.=20 --=20 Questo messaggio e' stato analizzato con Libra ESVA ed e' risultato non inf= etto.=20 Clicca qui per segnalarlo come spam. Clicca qui per metterlo in blacklist --B_3527156800_719895807 Content-type: text/html; charset="UTF-8" Content-transfer-encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dutf-8"> </head> <body style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-= break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family:= Calibri, sans-serif;"> <div> <div> <div>test</div> <div> <div id=3D"MAC_OUTLOOK_SIGNATURE"></div> </div> </div> </div> <div><br> </div> <span id=3D"OLK_SRC_BODY_SECTION"> <div style=3D"font-family:Calibri; font-size:12pt; text-align:left; color:bla= ck; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0i= n; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BOR= DER-RIGHT: medium none; PADDING-TOP: 3pt"> <span style=3D"font-weight:bold">Da: </span>Chris54721<br> <span style=3D"font-weight:bold">Risposta: </span>Andrea Ruggiero / Test<br> <span style=3D"font-weight:bold">Data: </span>marted=C3=AC 29 settembre 2015 18:5= 8<br> <span style=3D"font-weight:bold">A: </span>Andrea Ruggiero<br> <span style=3D"font-weight:bold">Oggetto: </span>Test | Issue (#2)<br> </div> <div><br> </div> <div lang=3D"en"> <title>GitLab</title> <!-- </meta> --><style> img { max-width: 100%; height: auto; } p.details { font-style:italic; color:#777 } .footer p { font-size:small; color:#777 } pre.commit-message { white-space: pre-wrap; } .file-stats a { text-decoration: none; } .file-stats .new-file { color: #090; } .file-stats .deleted-file { color: #B00; } </style> <div> <div class=3D"content"> <p><a href=3D"http://git.xxxxx.xx/u/pupax" data-user-id=3D"2" class=3D"gfm gfm-pr= oject_member">@pupax</a> 6 6 6</p> </div> <div class=3D"footer" style=3D"margin-top: 10px;"> <p>=E2=80=94 <br> Reply to this email directly or <a href=3D"http://git.xxxxx.xx/pupax/Test/iss= ues/2"> view it on GitLab</a>. <mailscannerscript22984 script=3D"" type=3D"application/= ld+json"> {"@context":"<a href=3D"http://schema.org","@type&qu= ot;:"EmailMessage","action":{"@type":"Vie= wAction","name":"View">http://schema.org","@ty= pe":"EmailMessage","action":{"@type":&quo= t;ViewAction","name":"View</a> Issue","url&quo= t;:"<a href=3D"http://git.xxxxx.xx/pupax/Test/issues/2"}">http://git= .xxxxx.xx/pupax/Test/issues/2"}</a>}</mailscannerscript22984> You're receiving this notification because you are a member of the Andrea = Ruggiero / Test project team. </p> </div> <br> -- <br> <font color=3D"#999999" face=3D"Arial,Helvetica,sans-serif" size=3D"1">Questo mes= saggio e' stato analizzato con Libra ESVA ed e' risultato non infetto. <br> <a href=3D"http://antispam.xxxxx.xx/cgi-bin/learn-msg.cgi?id=3DCA96A405DC.A814A">Cl= icca qui per segnalarlo come spam.</a></font><font color=3D"#999999" face=3D"Ari= al,Helvetica,sans-serif" size=3D"1"><br> <a href=3D"http://antispam.xxxxx.xx/cgi-bin/learn-msg.cgi?blacklist=3D1&id=3DCA96= A405DC.A814A">Clicca qui per metterlo in blacklist</a></font></div> </div> </span> </body> </html> --B_3527156800_719895807--Added reply by email label
@pupaxxo Hmm, I just tried it out with the same message locally, and it's working fine here.
Could you try again, and see if you see
Email can not be processed:in the Rails logs?@pupaxxo No email body after that? In that case, it sounds like mail_room is somehow failing to read the messages from the IMAP inbox. Can you log into it manually and see if every incoming email looks like it should?
@DouweM It's not an IMAP problem, because if I disable HTML it works
Edited by username-removed-82025@pupaxxo Hmm. You weren't seeing any email body logged?
@DouweM I just noticed this.. The mail is encoded !?
Edited by username-removed-82025@pupaxxo Hmm, that looks OK actually, happens often with HTML mail. Could you send that to me as text?
@DouweM Here you are
Received: from SRV3.pupax.local (10.0.0.52) by SRV3.pupax.local (10.0.0.52) with Microsoft SMTP Server (TLS) id 15.1.225.42 via Mailbox Transport; Thu, 8 Oct 2015 15:46:10 +0200 Received: from SRV3.pupax.local (10.0.0.52) by SRV3.pupax.local (10.0.0.52) with Microsoft SMTP Server (TLS) id 15.1.225.42; Thu, 8 Oct 2015 15:46:10 +0200 Received: from SRV3.pupax.local ([fe80::a8d3:9e3:b9e1:29a2]) by SRV3.pupax.local ([fe80::a8d3:9e3:b9e1:29a2%15]) with mapi id 15.01.0225.041; Thu, 8 Oct 2015 15:46:10 +0200 From: Andrea Ruggiero <andrea@xxxxx.xx> To: Andrea Ruggiero / Test <gitlab+051583ebfebd57cd6e7971e384d410d2@xxxxx.xx> Subject: Re: Test | Issue (#3) Thread-Topic: Test | Issue (#3) Thread-Index: AQHRAcz3amCvAbDnGUKyTwNS6sYqa55hm9+A Date: Thu, 8 Oct 2015 15:46:10 +0200 Message-ID: <EC0DDE46-CC91-4E5B-AB7B-5952E22AC028@xxxxx.xx> References: <issue_7@git.xxxxx.xx> In-Reply-To: <issue_7@git.xxxxx.xx> Accept-Language: it-IT, en-US Content-Language: it-IT X-MS-Exchange-Organization-AuthAs: Internal X-MS-Exchange-Organization-AuthMechanism: 04 X-MS-Exchange-Organization-AuthSource: SRV3.pupax.local X-MS-Has-Attach: X-MS-Exchange-Organization-Network-Message-Id: 9da257df-6a72-4f33-3361-08d2cfe6d35b X-MS-Exchange-Organization-SCL: -1 X-MS-TNEF-Correlator: Content-Type: text/html; charset="utf-8" Content-ID: <49F18F3FB3FED247A8D0AAF1D681F859@xxxxx.xx> Content-Transfer-Encoding: base64 MIME-Version: 1.0 PGh0bWw+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0i dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjwvaGVhZD4NCjxib2R5IHN0eWxlPSJ3b3JkLXdy YXA6IGJyZWFrLXdvcmQ7IC13ZWJraXQtbmJzcC1tb2RlOiBzcGFjZTsgLXdlYmtpdC1saW5lLWJy ZWFrOiBhZnRlci13aGl0ZS1zcGFjZTsgY29sb3I6IHJnYigwLCAwLCAwKTsgZm9udC1zaXplOiAx NHB4OyBmb250LWZhbWlseTogQ2FsaWJyaSwgc2Fucy1zZXJpZjsiPg0KPGRpdj4NCjxkaXY+DQo8 ZGl2PnRlc3Q8L2Rpdj4NCjxkaXY+DQo8ZGl2IGlkPSJNQUNfT1VUTE9PS19TSUdOQVRVUkUiPjwv ZGl2Pg0KPC9kaXY+DQo8L2Rpdj4NCjwvZGl2Pg0KPGRpdj48YnI+DQo8L2Rpdj4NCjxzcGFuIGlk PSJPTEtfU1JDX0JPRFlfU0VDVElPTiI+DQo8ZGl2IHN0eWxlPSJmb250LWZhbWlseTpDYWxpYnJp OyBmb250LXNpemU6MTJwdDsgdGV4dC1hbGlnbjpsZWZ0OyBjb2xvcjpibGFjazsgQk9SREVSLUJP VFRPTTogbWVkaXVtIG5vbmU7IEJPUkRFUi1MRUZUOiBtZWRpdW0gbm9uZTsgUEFERElORy1CT1RU T006IDBpbjsgUEFERElORy1MRUZUOiAwaW47IFBBRERJTkctUklHSFQ6IDBpbjsgQk9SREVSLVRP UDogI2I1YzRkZiAxcHQgc29saWQ7IEJPUkRFUi1SSUdIVDogbWVkaXVtIG5vbmU7IFBBRERJTkct VE9QOiAzcHQiPg0KPHNwYW4gc3R5bGU9ImZvbnQtd2VpZ2h0OmJvbGQiPkRhOiA8L3NwYW4+Q2hy aXM1NDcyMTxicj4NCjxzcGFuIHN0eWxlPSJmb250LXdlaWdodDpib2xkIj5SaXNwb3N0YTogPC9z cGFuPkFuZHJlYSBSdWdnaWVybyAvIFRlc3Q8YnI+DQo8c3BhbiBzdHlsZT0iZm9udC13ZWlnaHQ6 Ym9sZCI+RGF0YTogPC9zcGFuPmdpb3ZlZMOsIDggb3R0b2JyZSAyMDE1IDE1OjI2PGJyPg0KPHNw YW4gc3R5bGU9ImZvbnQtd2VpZ2h0OmJvbGQiPkE6IDwvc3Bhbj5BbmRyZWEgUnVnZ2llcm88YnI+ DQo8c3BhbiBzdHlsZT0iZm9udC13ZWlnaHQ6Ym9sZCI+T2dnZXR0bzogPC9zcGFuPlRlc3QgfCBJ c3N1ZSAoIzMpPGJyPg0KPC9kaXY+DQo8ZGl2Pjxicj4NCjwvZGl2Pg0KPGRpdiBsYW5nPSJlbiI+ DQo8dGl0bGU+R2l0TGFiPC90aXRsZT4NCjwhLS0gPC9tZXRhPiAtLT48c3R5bGU+DQogIGltZyB7 DQogICAgbWF4LXdpZHRoOiAxMDAlOw0KICAgIGhlaWdodDogYXV0bzsNCiAgfQ0KICBwLmRldGFp bHMgew0KICAgIGZvbnQtc3R5bGU6aXRhbGljOw0KICAgIGNvbG9yOiM3NzcNCiAgfQ0KICAuZm9v dGVyIHAgew0KICAgIGZvbnQtc2l6ZTpzbWFsbDsNCiAgICBjb2xvcjojNzc3DQogIH0NCiAgcHJl LmNvbW1pdC1tZXNzYWdlIHsNCiAgICB3aGl0ZS1zcGFjZTogcHJlLXdyYXA7DQogIH0NCiAgLmZp bGUtc3RhdHMgYSB7DQogICAgdGV4dC1kZWNvcmF0aW9uOiBub25lOw0KICB9DQogIC5maWxlLXN0 YXRzIC5uZXctZmlsZSB7DQogICAgY29sb3I6ICMwOTA7DQogIH0NCiAgLmZpbGUtc3RhdHMgLmRl bGV0ZWQtZmlsZSB7DQogICAgY29sb3I6ICNCMDA7DQogIH0NCjwvc3R5bGU+DQo8ZGl2Pg0KPGRp diBjbGFzcz0iY29udGVudCI+DQo8cD48YSBocmVmPSJodHRwOi8vZ2l0LnB1cGF4Lm1lL3UvcHVw YXgiIGRhdGEtdXNlci1pZD0iMiIgY2xhc3M9ImdmbSBnZm0tcHJvamVjdF9tZW1iZXIiPkBwdXBh eDwvYT48L3A+DQo8L2Rpdj4NCjxkaXYgY2xhc3M9ImZvb3RlciIgc3R5bGU9Im1hcmdpbi10b3A6 IDEwcHg7Ij4NCjxwPuKAlCA8YnI+DQpSZXBseSB0byB0aGlzIGVtYWlsIGRpcmVjdGx5IG9yIDxh IGhyZWY9Imh0dHA6Ly9naXQucHVwYXgubWUvcHVwYXgvVGVzdC9pc3N1ZXMvMyI+DQp2aWV3IGl0 IG9uIEdpdExhYjwvYT4uIDxtYWlsc2Nhbm5lcnNjcmlwdDc1MzIgc2NyaXB0PSIiIHR5cGU9ImFw cGxpY2F0aW9uL2xkJiM0Mztqc29uIj4NCnsmcXVvdDtAY29udGV4dCZxdW90OzomcXVvdDs8YSBo cmVmPSJodHRwOi8vc2NoZW1hLm9yZyZxdW90OywmcXVvdDtAdHlwZSZxdW90OzomcXVvdDtFbWFp bE1lc3NhZ2UmcXVvdDssJnF1b3Q7YWN0aW9uJnF1b3Q7OnsmcXVvdDtAdHlwZSZxdW90OzomcXVv dDtWaWV3QWN0aW9uJnF1b3Q7LCZxdW90O25hbWUmcXVvdDs6JnF1b3Q7VmlldyI+aHR0cDovL3Nj aGVtYS5vcmcmcXVvdDssJnF1b3Q7QHR5cGUmcXVvdDs6JnF1b3Q7RW1haWxNZXNzYWdlJnF1b3Q7 LCZxdW90O2FjdGlvbiZxdW90Ozp7JnF1b3Q7QHR5cGUmcXVvdDs6JnF1b3Q7Vmlld0FjdGlvbiZx dW90OywmcXVvdDtuYW1lJnF1b3Q7OiZxdW90O1ZpZXc8L2E+IElzc3VlJnF1b3Q7LCZxdW90O3Vy bCZxdW90OzomcXVvdDs8YSBocmVmPSJodHRwOi8vZ2l0LnB1cGF4Lm1lL3B1cGF4L1Rlc3QvaXNz dWVzLzMmcXVvdDt9Ij5odHRwOi8vZ2l0LnB1cGF4Lm1lL3B1cGF4L1Rlc3QvaXNzdWVzLzMmcXVv dDt9PC9hPn08L21haWxzY2FubmVyc2NyaXB0NzUzMj4NCiBZb3UncmUgcmVjZWl2aW5nIHRoaXMg bm90aWZpY2F0aW9uIGJlY2F1c2UgeW91IGFyZSBhIG1lbWJlciBvZiB0aGUgQW5kcmVhIFJ1Z2dp ZXJvIC8gVGVzdCBwcm9qZWN0IHRlYW0uDQo8L3A+DQo8L2Rpdj4NCjxicj4NCi0tIDxicj4NCjxm b250IGNvbG9yPSIjOTk5OTk5IiBmYWNlPSJBcmlhbCxIZWx2ZXRpY2Esc2Fucy1zZXJpZiIgc2l6 ZT0iMSI+UXVlc3RvIG1lc3NhZ2dpbyBlJyBzdGF0byBhbmFsaXp6YXRvIGNvbiBMaWJyYSBFU1ZB IGVkIGUnIHJpc3VsdGF0byBub24gaW5mZXR0by4NCjxicj4NCjxhIGhyZWY9Imh0dHA6Ly9lc3Zh LnB1cGF4Lm1lL2NnaS1iaW4vbGVhcm4tbXNnLmNnaT9pZD0wRDYwODQwODkzLkE2RkRDIj5DbGlj Y2EgcXVpIHBlciBzZWduYWxhcmxvIGNvbWUgc3BhbS48L2E+PC9mb250Pjxmb250IGNvbG9yPSIj OTk5OTk5IiBmYWNlPSJBcmlhbCxIZWx2ZXRpY2Esc2Fucy1zZXJpZiIgc2l6ZT0iMSI+PGJyPg0K PGEgaHJlZj0iaHR0cDovL2VzdmEucHVwYXgubWUvY2dpLWJpbi9sZWFybi1tc2cuY2dpP2JsYWNr bGlzdD0xJmFtcDtpZD0wRDYwODQwODkzLkE2RkRDIj5DbGljY2EgcXVpIHBlciBtZXR0ZXJsbyBp biBibGFja2xpc3Q8L2E+PC9mb250PjwvZGl2Pg0KPC9kaXY+DQo8L3NwYW4+DQo8L2JvZHk+DQo8 L2h0bWw+DQo=@pupaxxo The encoding isn't an issue, but the message does not seem to contain a plain text part, just a HTML part (encoded as base64). We currently only use the text part, because it's easier to parse the message out of, and since we assumed all email clients that send a HTML part also send a text part. But it appears that we were wrong on that.
cc @rspeicher I think we've reached the point where we should bring back your good old pal
HtmlCleaner.@pupaxxo By the way, could you share how you set up your Exchange server to support plus addressing? I think this is something that a lot of other people are interested in, and that deserves to be in the GitLab documentation.
@DouweM Yep, no problem! I could have done a merge request with the doc, but I'm not very good in english.
Btw first of all you need to install a custom agent for handling plus subaddressing. Writing one it's not very difficult but on Github i found this: RegExCatchAllAgent. Before installing it you need to compile it, using the dlls of the version (of exchange) you have (I successfully compiled it with 2013 cu10 and 2016 dlls). After that you can install it using this guide http://durdle.com/regexcatchall/installation/ . Then you can add the gitlab-{key} address to the configuration. Now you'll need to enable imap service and start it (this is very easy just open the services.msc and put imap server and imap backend to "Automatic", then start them). And that's all!
When installing agent you could have some problems like this:
If you download the agent dll from a website be sure to right click them, properties and remove download lock or else, when you install them, windows will give you a strange error.
The install command has an error (a word is missing) here is the fixed command:
Install-TransportAgent -Name "RegExCatchAll Agent" -TransportAgentFactory:RegExCatchAllAgent.CatchAllFactory -AssemblyPath:"<path>"Edited by username-removed-82025@pupaxxo Thank you! I'll have a few more people try this, and hopefully we can turn this into a detailed guide :)
@pupaxxo Any chance you would able to fork the GitHub repo and add the compiled versions for 2013 and 2016? :)
https://github.com/pupaxxo/RegExCatchAllAgent/releases Here you are!
@pupaxxo Awesome :) Aside from the typo you mentioned, where the steps in http://durdle.com/regexcatchall/installation/ accurate for 2013/2016?
@DouweM Yes, they are accurate except for the install command, it should have been
Install-TransportAgent -Name "RegExCatchAll Agent" -TransportAgentFactory:RegExCatchAllAgent.CatchAllFactory -AssemblyPath:"<path>"@pupaxxo Awesome. I will add this to the documentation.
@DouweM Awesome news!! I just found a configuration option in exchange imap server settings that could fix this for now. You can change the MIME format type, and if you select HTML and text, imap clients receive also the text part. Just tried with gitlab 8.1.0rc1 and it works!
@pupaxxo awesome! since you now seem to be the expert on GitLab + reply by email + exchange, do you think you could make a start on the documentation for this? I'm happy to edit the English, but it would be nice to get a general outline from someone who actually knows what needs to happen :)
@DouweM !1624 (closed) Here is it the merge request!
I seem an expert? I'm just 16 ahahahahha
@pupaxxo Why would age have anything to do with that? I'm only a few years older ;) I will check out your merge request, thanks!
@DouweM It has nothing to do with it, it just seems a bit strange to call a young guy an expert, or better, not strange but unusual!
mentioned in issue #18388 (closed)
I'm running into that issue as well with the Exchange server. Unfortunately I can not change the configuration of the Exchange server.
@pupaxxo what was the change you applied to the Exchange server?
It would make more sense to me if the GitLab handled the HTML-only emails transparently and did the conversion itself. Would that be hard to implement with the above mentioned HtmlCleaner?
@michal-galet
I changed that settings!Mentioned in issue #18388 (closed)
Mentioned in issue #24151 (moved)
mentioned in issue gitlab#6875
mentioned in merge request !14785
