Actions

Email bounce tracking system/nl: Difference between revisions

From LimeSurvey Manual

No edit summary
(Updating to match new version of source page)
Line 4: Line 4:
=Inleiding=
=Inleiding=


Het systeem voor het controleren van niet verzonden e-mail (beschikbaar vanaf versie v1.91) ziet welke e-mails niet goed verzonden zijn. Dit gaat via de "mail delivery notification failure report" en daarbij wordt het e-mailadres van de beheerder, dat gebruikt wordt om e-mails te verzenden, gebruikt of het speciale account dat alleen voor deze bounces gebruikt wordt. Ook de credentials en de connectie-details van dit account worden gebruikt.
The email bounce tracking system (available in v1.91 or later) is capable of tracking down and marking the emails that were not delivered to the recipients (survey participants). The system relies on the "email delivery notification failure report". Therefore, it needs an email address where the emails can be sent to in order to track the bounces. Along with the address of the account, the credentials of the account are also required as well as the connection details.
 
{{Box|Most email and hosting providers offer SMTP to send emails. The only thing for you to find out are the SMTP details that allow you to use that email address as a bounce email address.}}


=Vereisten=
=Vereisten=


De php5-imap module moet op de server zijn geïnstalleerd. Dit kun je controleren, door te kijken in PHPInfo, dat je via LimeSurvey kunt bekijken op de [[Global settings/nl|Instellingen]].
The <u>php5-imap</u> module must be installed on your server. You can check if this is the case by looking at the '''Show PHPinfo''' button, found on the [[Global settings|global settings]] page of your LimeSurvey installation, under the [[Global settings#Overview|Overview]] tab:


Zoek naar de imap sectie, het ziet er ongeveer als volgt uit:


[[File:phpinfo_imap.png]]
<center>[[File:Show php info general settings.png]]</center>


Als er geen php5-imap geïnstalleerd is, en je mag ook niet naar de root van de server, dan kun je via de voor jouw geldende procedures proberen te installeren. In geval van: http://www.electrictoolbox.com/install-php-imap-debian/ . Je moet dan wel je webserver opnieuw starten, bijvoorbeeld met "apache/usr/sbin/apache2ctl restart"
 
Next, look for an imap section (use control+F for a quick search). If an imap section is shown, you are good to go:
 
 
<center>[[File:phpinfo_imap.png]]</center>
 
 
If you don't have php5-imap installed and you have root access to the server, you can install it following the proceudure specific to your distribution. For example, check [http://www.electrictoolbox.com/install-php-imap-debian/ this link] if you use Debian. Just remember to restart your web server once it is installed (e.g. run "apache/usr/sbin/apache2ctl restart" in terminal).


=Werking=
=Werking=


De redenen voor het ontwikkelen van dit bounce-systeem is het verminderen van het werk met de handleiding in de hand en het verminderen van menselijke fouten.
The basic idea behind the development of the system was to reduce the manual work and reduce the possible human errors that might arise from manually editing every field.
 
The basic idea behind this system is that when sending the email, the email bounce tracking system automatically adds a survey-id and token-id to the email header without the notice of the administrator.
 


Als er een e-mail verzonden wordt, dan wordt er door dit systeem automatisch een survey-id en token-id aan de e-mailheader toegevoegd.
<center>[[File:Header.png]]</center>


[[File:Header.png]]


Deze headers, ook wel "custom headers", worden toegevoegd aan elke uitnodiging die naar deelnemers wordt verzonden.
These headers (also known as custom headers) are added to each invitation email sent via LimeSurvey to the survey participants.


Wanneer de e-mail bounced, dus niet verzonden kon worden, dan wordt de originele header ontvangen met de header van de "Delivery notification". Het systeem kijkt in de e-mails die ontvangen worden of er een aangepaste header in staat en legt de bounce van die e-mail dan vast in de tabel token.
When the email is bounced back, the original header along with the ''delivery notification header'' is received. The system then checks for new emails and parses the emails that have these custom headers. It changes the font color of the wrong email addresses from the [[Survey_participants|survey participants table]] in red.


=Installatie=
=Installatie=


Het systeem kan op algemeen niveau of op enquête niveau werken. Op algemeen niveau kunnen de instellingen worden ingesteld bij Instellingen -> Bounce instellingen.
The system is capable of working globally (for all the surveys) or locally (only for a specific survey), thus the settings can be saved accordingly. The bounce global settings can be saved under '''Global Settings''' -> '''Bounce Settings'''. The following options will be displayed:
 
 
<center>[[File:limesurvey_index_php_admin_globalsettings_bouncesettings.png]]</center>
 
 
*'''Default site bounce email:''' This is the email address where bounced emails will be sent to. For a faster processing of the bounced emails, we recommend the usage of an email address that is used only for the LimeSurvey email bounce tracking system.
 
*'''Server type:''' If set to "Off", no bounce processing functions will be available. Choose either "POP" or "IMAP" to make use of LimeSurvey email bounce tracking system.
 
*'''Server name & port:''' Name of the server and (if needed) the port separated by a colon. The port number isn't typically needed unless the email host uses a non-standard port.
 
{{Box|If your host name is 'smtp.server.net' and the port is 143, then write 'smtp.server.net:143' as host name. For security reasons we currently only allow the following ports numbers: 110, 143, 587, 993 and 995.}}
 
*'''User name:''' The user name for the POP/IMAP account.
*'''Password:''' The password for the POP/IMAP account.
*'''Encryption type:''' If encryption is used, please set the right one here (SSL or TLS).
 
 
<hr width="50%" style="margin:auto">


[[File:limesurvey_index_php_admin_globalsettings_bouncesettings.png]]


Het instellen voor een specifieke enquête kan bij het toegangscode beheer van die enquête.
If you want to apply bounce settings only to a single survey, access the desired survey -> go to the survey menu and click on the [[Survey participants|Survey participants]] tab -> check the main toolbar of the page and click on [[Survey participants#Invitations & reminders|Invitations & reminders]] option -> click on '''Bounce settings'''. The following page will be loaded:


[[File:limesurvey_admin_tokens_bouncesettings.png]]


Zoals je in de afbeelding hierboven ziet, moet de te gebruiken instelling worden vastgelegd. De opties zijn:  
<center>[[File:limesurvey_admin_tokens_bouncesettings.png]]</center>
* Geen
 
* Gebruik onderstaande instellingen
 
* Gebruik algemene instellingen
The additional option is represented by the '''Used bounce settings'''. Here, you can choose whether you use:
*no bounce settings;
*the local bounce settings. If picked up, you will have to fill out the rest of the local bounce settings fields; 
*the global bounce settings. In this case, the bounce settings of your LimeSurvey installation will be used.
 
<div class="simplebox">[[File:help.png]] '''Note:''' LimeSurvey will initialize the SMTP connection from the IP address of your LimeSurvey installation. Just ping the URL of the LimeSurvey installation to find out which one it is. In case you have your SMTP server locked down you will need to add this IP address as an exception to your SMTP configuration/firewall.</div>
 
 
===On using LimeSurvey PRO email server===
 
If you are using the LimeSurvey Professional email server, all your emails will have the sender address "noreply@limesurvey.org". However, these emails will have a Reply-to header with your email address. So, in case someone tries to reply, they can write you directly.
 
Even though this system can be easily set up (by leaving the bounce settings fields empty), it has one downside: if an email cannot be transmitted to the email receiver and bounces back, then you won't get any notifications whatsoever.
 
{{Alert|Attention|text=Please don't abuse LimeSurvey for spam or we will have to lock your account. Make sure that you have the general consent of people you want to send invitations to.}}
 
==Starting Bounce Processing in v3.0==
 
Before starting the bounce processing, do not forget to first send the email invitations to your survey participants.
 
In version 3.0+, once the email bounce tracking system has been set up, you can start '''bounce processing''' by accessing the survey home page -> click on the '''Survey participants''' tab from the survey menu -> click on '''Invitations & reminders''' (located on the toolbar) -> '''Start bounce processing'''.
 
 
<center>[[File:Survey Startbounceprocessing.png]]</center>
 
 
After selecting this option, a progress indicator will be displayed during the process, followed by a final processing status summary.
 
<!--100-->
The sent email invitations will start to be examined. The scan results will be shown on the [[Survey participants#Display participants|Survey participants table]] (you may have to manually refresh the page to actualize it). All the entries whose invitations were bounced will have their email addresses marked in red font. Also, their '''Email status''' is changed from "OK" to "bounced".
 
 
<center>[[File:Red bounced email addresses.png]]</center>
 


== Starten bounce-verwerking in v2.5 ==
== Starten bounce-verwerking in v2.5 ==


Indien bounce-verwerking ingeschakeld is kun je deze verwerking van geweigerde e-mails starten met de bijbehorende menu-keuze op "Uitnodigingen en herinneringen" van het menu "Deelnemers aan de enquête".
In version 2.50+, once the bounce processing system has been set up, you can start '''bounce processing'''. from the survey home page: '''Invitations & reminders''' -> '''Start bounce processing'''.
 
 
<center>[[File:WikiBounceProcessing2.5.png]]</center>
 
 
After selecting this option, a progress indicator will be displayed during the process, followed by a final processing status summary.
 
<!--100-->
The sent email invitations will start to be examined. The scan results will be shown on the [[Survey participants#Display participants|Survey participants table]] (you may have to manually refresh the page to actualize it). All the entries whose invitations were bounced will have their email addresses marked in red font. Also, their '''Email status''' is changed from "OK" to "bounced".
 
''{{Alert|title=Attention|text=Some releases of v2.50+ do not correctly display this menu choice and the issue was fixed in build 160714 released on July 14, 2016.}}''
 
 
=Example=
 
 
To better understand how the LimeSurvey email bounce tracking system is working, check the below example:
 
{{Box|The following example is based on LimeSurvey 2.06+. Most of the steps and screenshots coincide with the steps you have to follow in LimeSurvey 3.0+ in order to make use of the email bounce tracking system.}}
 
1. Introduce your respondents to the survey participants table. Make sure that each of them has an assigned token and email address.
 
 
2. Select the respondents to whom you wish to send the survey invitation:
 
 
<center>[[File:Send survey invitations - example.png]]</center>
 
 
Click on the '''Selected participant(s)...''' button, and choose the '''send email invitations''' option.
 
 
3. Wait for some moments in order to make sure that the emails were sent to the survey respondents.
 
 
4. Now, you can make use of LimeSurvey email bounce tracking system. Click on '''Invitations & reminders''' and fill in the bounce email settings fields with the connection and account details of your personal email account:
 
 
<center>[[File:Bounce email settings local survey - example.png]]</center>
 
 
You could also leave the fields empty. The bounce processing will still work, only that you will not get any bounce-processing-related email. However, the email status of the entries from the [[Survey participants|survey participants]] table will get updated.
 
''As you may observe below, we use the email bounce tracking system with the help of a free Gmail account. To find out about the Gmail-related connection settings, access the following [https://support.google.com/mail/answer/7126229?hl=en link]. Also, do not forget to enable IMAP/POP from the settings of your Gmail account.''
 
 
<center>[[File:Complete local survey bounce settings - example.png]]</center>
 


Om op het menu "Deelnemers aan de enquête" te komen klik je op de gelijknamige knop in het linkermenu of de gelijknamige knop in het hoofdmenu.
{{Alert|Attention|text=Gmail might treat the connection to your LimeSurvey account as an insecure one. To let LimeSurvey connect to your Gmail account, you [https://support.google.com/accounts/answer/6010255?hl=en will then need to allow less secure apps use your account].}}


Fill in the fields. Select the desired server and encryption settings. Once done, click on the '''Save''' button located on the upper-right part of the screen.


[[File:WikiBounceProcessing2.5.png]]


Na het selecteren van deze optie wordt er een voortgangsbalk weergegeven met na het afronden een verslag van de verwerking.
5. Now, you can click on '''start bounce processing''' button:


"NB.: in enkele versies is de menu-keuze niet goed getoond. Dit is aangepast in build 160714 van 14-07-2016"


== Starten bounce-verwerking in oudere versies ==
<center>[[File:Start bounce processing - example.png]]</center>


Om de bounce verwerking te starten, moet je nog wel klikken op het icoon in de toolbar (zie onderstaand plaatje).


[[File:limesurvey_admin_tokens_browse_bounceicon.png]]
The email bounce tracking system will start to look for the survey-id, token-id, and delivery notification that are attached to the email header of each bounced email. If these custom headers exist, the system will change the font color of the wrong email addresses from the survey participants table in red. Also, the email status of the respective entries will be switched from ''OK'' to ''bounced''.


Na het klikken op het icoon krijg je een popup met een voortgangsmeter.


[[File:Running.png]]
<center>[[File:Results bounce processing - example.png]]</center>


Wacht totdat het proces klaar is. Er wordt dan een resultaat getoond op een ververste respons-pagina (mogelijk moet je het verversen van je pagina zelf doen). De deelnemers van wie de uitnodiging terug is ontvangen (bounce) omdat het e-mailadres niet klopt zijn  gemarkeerd met een rood e-mailadres en een e-mailstatus bounced in plaats van OK.


[[File:table.png]]
{{Note|If further questions arise, join us on [https://www.limesurvey.org/forum our forums] or [irc://irc.freenode.net/limesurvey  IRC channel].}}

Revision as of 18:45, 29 January 2018

Inleiding

The email bounce tracking system (available in v1.91 or later) is capable of tracking down and marking the emails that were not delivered to the recipients (survey participants). The system relies on the "email delivery notification failure report". Therefore, it needs an email address where the emails can be sent to in order to track the bounces. Along with the address of the account, the credentials of the account are also required as well as the connection details.

Most email and hosting providers offer SMTP to send emails. The only thing for you to find out are the SMTP details that allow you to use that email address as a bounce email address.


Vereisten

The php5-imap module must be installed on your server. You can check if this is the case by looking at the Show PHPinfo button, found on the global settings page of your LimeSurvey installation, under the Overview tab:



Next, look for an imap section (use control+F for a quick search). If an imap section is shown, you are good to go:



If you don't have php5-imap installed and you have root access to the server, you can install it following the proceudure specific to your distribution. For example, check this link if you use Debian. Just remember to restart your web server once it is installed (e.g. run "apache/usr/sbin/apache2ctl restart" in terminal).

Werking

The basic idea behind the development of the system was to reduce the manual work and reduce the possible human errors that might arise from manually editing every field.

The basic idea behind this system is that when sending the email, the email bounce tracking system automatically adds a survey-id and token-id to the email header without the notice of the administrator.



These headers (also known as custom headers) are added to each invitation email sent via LimeSurvey to the survey participants.

When the email is bounced back, the original header along with the delivery notification header is received. The system then checks for new emails and parses the emails that have these custom headers. It changes the font color of the wrong email addresses from the survey participants table in red.

Installatie

The system is capable of working globally (for all the surveys) or locally (only for a specific survey), thus the settings can be saved accordingly. The bounce global settings can be saved under Global Settings -> Bounce Settings. The following options will be displayed:



  • Default site bounce email: This is the email address where bounced emails will be sent to. For a faster processing of the bounced emails, we recommend the usage of an email address that is used only for the LimeSurvey email bounce tracking system.
  • Server type: If set to "Off", no bounce processing functions will be available. Choose either "POP" or "IMAP" to make use of LimeSurvey email bounce tracking system.
  • Server name & port: Name of the server and (if needed) the port separated by a colon. The port number isn't typically needed unless the email host uses a non-standard port.
If your host name is 'smtp.server.net' and the port is 143, then write 'smtp.server.net:143' as host name. For security reasons we currently only allow the following ports numbers: 110, 143, 587, 993 and 995.


  • User name: The user name for the POP/IMAP account.
  • Password: The password for the POP/IMAP account.
  • Encryption type: If encryption is used, please set the right one here (SSL or TLS).




If you want to apply bounce settings only to a single survey, access the desired survey -> go to the survey menu and click on the Survey participants tab -> check the main toolbar of the page and click on Invitations & reminders option -> click on Bounce settings. The following page will be loaded:



The additional option is represented by the Used bounce settings. Here, you can choose whether you use:

  • no bounce settings;
  • the local bounce settings. If picked up, you will have to fill out the rest of the local bounce settings fields;
  • the global bounce settings. In this case, the bounce settings of your LimeSurvey installation will be used.
Note: LimeSurvey will initialize the SMTP connection from the IP address of your LimeSurvey installation. Just ping the URL of the LimeSurvey installation to find out which one it is. In case you have your SMTP server locked down you will need to add this IP address as an exception to your SMTP configuration/firewall.


On using LimeSurvey PRO email server

If you are using the LimeSurvey Professional email server, all your emails will have the sender address "noreply@limesurvey.org". However, these emails will have a Reply-to header with your email address. So, in case someone tries to reply, they can write you directly.

Even though this system can be easily set up (by leaving the bounce settings fields empty), it has one downside: if an email cannot be transmitted to the email receiver and bounces back, then you won't get any notifications whatsoever.

  Please don't abuse LimeSurvey for spam or we will have to lock your account. Make sure that you have the general consent of people you want to send invitations to.


Starting Bounce Processing in v3.0

Before starting the bounce processing, do not forget to first send the email invitations to your survey participants.

In version 3.0+, once the email bounce tracking system has been set up, you can start bounce processing by accessing the survey home page -> click on the Survey participants tab from the survey menu -> click on Invitations & reminders (located on the toolbar) -> Start bounce processing.



After selecting this option, a progress indicator will be displayed during the process, followed by a final processing status summary.

The sent email invitations will start to be examined. The scan results will be shown on the Survey participants table (you may have to manually refresh the page to actualize it). All the entries whose invitations were bounced will have their email addresses marked in red font. Also, their Email status is changed from "OK" to "bounced".



Starten bounce-verwerking in v2.5

In version 2.50+, once the bounce processing system has been set up, you can start bounce processing. from the survey home page: Invitations & reminders -> Start bounce processing.



After selecting this option, a progress indicator will be displayed during the process, followed by a final processing status summary.

The sent email invitations will start to be examined. The scan results will be shown on the Survey participants table (you may have to manually refresh the page to actualize it). All the entries whose invitations were bounced will have their email addresses marked in red font. Also, their Email status is changed from "OK" to "bounced".

  Attention : Some releases of v2.50+ do not correctly display this menu choice and the issue was fixed in build 160714 released on July 14, 2016.


Example

To better understand how the LimeSurvey email bounce tracking system is working, check the below example:

The following example is based on LimeSurvey 2.06+. Most of the steps and screenshots coincide with the steps you have to follow in LimeSurvey 3.0+ in order to make use of the email bounce tracking system.


1. Introduce your respondents to the survey participants table. Make sure that each of them has an assigned token and email address.


2. Select the respondents to whom you wish to send the survey invitation:



Click on the Selected participant(s)... button, and choose the send email invitations option.


3. Wait for some moments in order to make sure that the emails were sent to the survey respondents.


4. Now, you can make use of LimeSurvey email bounce tracking system. Click on Invitations & reminders and fill in the bounce email settings fields with the connection and account details of your personal email account:



You could also leave the fields empty. The bounce processing will still work, only that you will not get any bounce-processing-related email. However, the email status of the entries from the survey participants table will get updated.

As you may observe below, we use the email bounce tracking system with the help of a free Gmail account. To find out about the Gmail-related connection settings, access the following link. Also, do not forget to enable IMAP/POP from the settings of your Gmail account.



  Gmail might treat the connection to your LimeSurvey account as an insecure one. To let LimeSurvey connect to your Gmail account, you will then need to allow less secure apps use your account.


Fill in the fields. Select the desired server and encryption settings. Once done, click on the Save button located on the upper-right part of the screen.


5. Now, you can click on start bounce processing button:



The email bounce tracking system will start to look for the survey-id, token-id, and delivery notification that are attached to the email header of each bounced email. If these custom headers exist, the system will change the font color of the wrong email addresses from the survey participants table in red. Also, the email status of the respective entries will be switched from OK to bounced.



If further questions arise, join us on our forums or IRC channel.