Actions

Expression Manager to be updated: Difference between revisions

From LimeSurvey Manual

mNo edit summary
m (Text replacement - "Expression Manager" to "ExpressionScript")
 
(32 intermediate revisions by 3 users not shown)
Line 5: Line 5:




=Quick start tutorial=<!--T:4-->
[[ExpressionScript - Quick Tutorial]]




<!--T:5-->
=Introduction= <!--T:52-->
Within [https://www.limesurvey.org LimeSurvey], you can further customize your surveys via the usage of the Expression Manager (EM). It can be used to specify the following:
# '''Navigation/Branching''' - allows a respondent's answers to change the order in which the questions are displayed;
# '''Tailoring/Piping''' - helps you phrase the question (such as referring to prior answers, or conjugating sentences based upon the age or gender of your subjects) or how to generate custom reports (like assessment scores or tailored advice);
# '''Validation''' - ensures that answers pass certain criteria, like min and max values or a certain input pattern.


<!--T:6-->
EM provides an intuitive way to specifying the logic for each of those features. Nearly anything that you can write as a standard mathematical equation is a valid expression.


EM currently provides access to 70 functions and it can be easily extended to support more. It also lets you access your
<!--T:53-->
variables using human-readable variable names (rather than [[SGQA_identifier|SGQA names]]).
LimeSurvey uses the new ExpressionScript (EM) module which lets LimeSurvey support more complex branching, assessments, validation, and tailoring. It replaces how LimeSurvey manages Replacements, [[Setting conditions|Conditions]], and [[Assessments]] on the back-end. It also speeds up processing considerably since it eliminates most run-time database reads. EM was developed by Dr. Thomas White (TMSWhite).
 
<!--T:7-->
The upcoming sections show the main places where the EM is used.
 
 
==Relevance (Controlling Navigation/Branching)== <!--T:8-->
 
 
<!--T:9-->
Some surveys use "Goto Logic", such that if you answer Question1 with option C, you are redirected to Question5. This approach is very limited since it is hard to validate it. Moreover, it easily breaks when you have to reorder questions. On the other hand, EM uses [https://en.wikipedia.org/wiki/Boolean_algebra Boolean relevance equations] to specify all the conditions under which a question might be valid. If the question is relevant, then the question is shown, otherwise it is not applicable, and the value "NULL" is stored in the database.  


<div class='simplebox'> '''Note:''' This is similar to what can be done via the [[Setting conditions|Conditions editor]], but EM lets you easily specify much more complex and powerful criteria (and lets you use the variable name rather than SGQA identifiers).</div>


==Key Definitions==


<hr width="50%" style="margin:auto">


 
<!--T:55-->
To better understand the relevance concept, let's focus on the following survey which computes the Body Mass Index (BMI) of survey respondents. To download it, click on the following link: [[Media:EM_survey_-_Cohabs.zip|Body Mass Index survey example]].
#'''Expression''': Anything surrounded by curly braces:
 
#*As long as there is no white space immediately after the opening brace or before the closing curly brace.
<!--T:10-->
#*The expression content is evaluated by EM, so it can contain mathematical formulas, functions, and complex string and date processing.
The relevance equation is shown below in the '''Relevance''' column after the variable name. The relevance values of weight, weight_units, height, and height_units are all 1 (default value), meaning that those questions are always displayed. However, the relevance for BMI is {!is_empty(height) and !is_empty(weight)}, which means that BMI will only be computed if the subject enters a value for both height and weight (thereby avoiding the risk of getting a zero error). Also, question "Report" is only shown if the respondent answers all four main questions (height, heightunits, weight, weightunits).
#'''Tailoring''': Sometimes called "piping". It is the process of conditionally modifying text:
 
 
<!--T:11-->
<center>[[File:tutorial1.jpg]]</center>
 
 
<div class="simplebox"> [[File:help.png]] '''Note:''' The above image comes from the [[Show logic file|survey logic file]] which allows you to look for syntax errors before activating the survey.</div>
 
 
<!--T:12-->
Relevance is shown and editable when:
*you wish to view/edit question-level relevance
*you wish to view/edit group-level relevance
 
 
===Viewing / Editing Question-Level Relevance=== <!--T:13-->
 
 
<!--T:14-->
This equation computes the Body Mass Index (BMI). It is only asked if the person enters their height and weight.
 
 
<!--T:15-->
<center>[[File:tutorial2.jpg]]</center>
 
 
<!--T:16-->
This is the edit screen for the "BMI" question.
 
 
<!--T:17-->
<center>[[File:tutorial3.jpg]]</center>
 
 
<!--T:18-->
Note that you do not use the curly braces when you enter a relevance equation.
 
 
===Viewing / Editing Group-Level Relevance=== <!--T:19-->
 
 
Let's focus now on another example - simple census survey. To download it, click on the following link:[[Media:EM survey - Cohabs.zip|Census survey example]].
 
<!--T:20-->
The first page asks how many people live with you and stores that in the "cohabs" variable. This page is only shown if you have more than one cohabitant (it is shown for the second person cohabitating with you). Also, p2name, p2age. p2sum are displayed only if the question before each of them contains a a response.
 
 
<!--T:21-->
<center>[[File:tutorial4.jpg]]</center>
 
 
<!--T:22-->
So, the group also has question-level relevance criteria, such that some questions only appear if you answered certain questions before them (e.g., p2age is displayed if p2name has been answered). EM combines the Group and Question-level relevance for you. '''Questions in a group are only asked if the group as a whole is relevant'''. Then, only the subset of questions within the group that are relevant are asked.
 
 
<!--T:23-->
Here is the screenshot for editing the group-level relevance for that question:
 
 
<!--T:24-->
<center>[[File:tutorial5.jpg]]</center>
 
 
<!--T:25-->
Note that you do not use the curly braces when you enter a relevance equation.
 
==Tailoring/Piping== <!--T:26-->
 
<!--T:27-->
EM lets you easily do simple and complex conditional tailoring of your questions. Sometimes you just need simple substitution, like saying, "You said you purchased <nowiki>[</nowiki>Product]. What did you like best about it?".  Sometimes you need conditional substitution like "<nowiki>[</nowiki>Mr./Mrs.] <nowiki>[</nowiki>LastName], would you be willing to complete our survey?". In this case, you want to use "Mr. or Mrs." based upon the person's gender. Other times you need even more complex substitution (such as based upon a mathematical computation). EM supports each of these types of tailoring/piping.
 
 
===Conditional Equations=== <!--T:28-->
 
 
<!--T:29-->
The Body Mass Index example shows the ability to compute a person's BMI, even while letting them enter their height and weight in two different units (cms vs inches and kgs vs lbs):
 
 
<!--T:30-->
<center>[[File:tutorial1.jpg]]</center>
 
 
<!--T:31-->
Here weightkg is {if(weightunits == "kg", weight, weight * 0.453592)}.  This "if()" function means that if the subject entered the weight using kilograms, use that value, otherwise multiply the entered value (pounds is the alternative) by 0.453592 to convert it to kilograms. The heightm variable uses a similar approach to compute the person's height in meters (height in cms/100), even if he entered his height in inches (1 meter=3.28084 inches).
 
<!--T:32-->
BMI is computed as: {weightkg / (heightm * heightm)}.
 
<!--T:33-->
Lastly, the report conditionally tailors the message for the subject, telling him what he entered. (e.g., "You said you are 2 meters tall and weight 70 kg.")
 
<!--T:34-->
In the above image, weightstatus uses nested "if()" statements to categorize the person as underweight to severely obese. You can see its equation in the Show Logic View
 
 
<!--T:35-->
<center>[[File:tailoring8.jpg]]</center>
 
 
<!--T:36-->
From the edit window for this question, you can see two things:
#Tailoring must surround expressions with Curly Braces
#Expressions can span multiple lines if, as in this case, you want to make it easier to read the nested conditional logic.
 
 
<!--T:37-->
<center>[[File:tailoring9.jpg]]</center>
 
===Tailored Questions, Answers, and Reports=== <!--T:38-->
 
 
<!--T:39-->
<div class="simplebox">[[File:help.png]] '''Note:''' Dynamic tailoring may not work if answer options are made available in select boxes on the same question page. This results from the fact that tailoring inserts a <nowiki><span></nowiki> tag which is not valid inside select options.</div>
 
<!--T:40-->
The BMI report looks like this:
 
 
<!--T:41-->
<center>[[File:tailoring10.jpg]]</center>
 
 
<!--T:42-->
Here is the edit window for the same question.
 
 
<!--T:43-->
<center>[[File:tailoring11.jpg]]</center>
 
 
<!--T:44-->
Anything within curly braces is treated as an expression, being syntax-highlighted (color coded) in the prior image. If you have any typos (such as misspelled or undefined variable names or functions), EM would show an error. In our below example:
* heightunit.shown is an undefined variable name (it is actually heightunits.shown) and
* "rnd()" is an undefined function (the proper function name is "round()").
 
In both cases, the errors are surrounded by a red box to make it easier to spot and fix them.
 
 
<!--T:45-->
<center>[[File:tailoring12.jpg]]</center>
 
 
<!--T:46-->
You can also see that you can quickly create complex reports, such as a table of entered values or tailored advice.
 
<!--T:47-->
Please remember that all tailoring must surround expressions with curly braces, so that LimeSurvey knows which parts of the question are free text and which should be parsed through Expression Manager.
 
 
==Validation== <!--T:48-->
 
 
<!--T:49-->
EM controls how most of the advanced question options work.  These control aspects like min/max numbers of answers; min/max individual values; min/max sum values; and checking that entered values match specified string patterns.  You continue to enter those advanced question options as usual.  However, now any value in one of those fields is considered an expression, so you can have min/max criteria with complex conditional relationships to other questions.
 
<!--T:50-->
In all of these cases, since the advanced question option is always considered an expression, you do not use curly braces when specifying it.
 
<!--T:51-->
The [[Expression Manager Sample Surveys|Sample Surveys]] pages shows many working examples of using expressions for validations.
 
 
=Introduction= <!--T:52-->
 
 
<!--T:53-->
LimeSurvey uses the new Expression Manager (EM) module which lets LimeSurvey support more complex branching, assessments, validation, and tailoring. It replaces how LimeSurvey manages Replacements, Conditions, and Assessments on the back-end. It will also speed up processing considerably since it eliminates most run-time database reads. EM was developed by Dr. Thomas White (TMSWhite).
 
<!--T:54-->
This wiki page is the definitive reference for Expression Manager syntax and functionality.
 
==Key Definitions== <!--T:55-->
#'''Expression''':  Anything surrounded by curly braces
#*As long as there is no white space immediately after the opening brace or before the closing curly brace
#*The contents of Expressions are evaluted by EM, so they can contain mathematical formulas, functions, and complex string and date processing.
#'''Tailoring''': Sometimes called "piping", this is the process of conditionally modifying text
#*You have access to all 'replacement fields', participant data, and response data.
#*You have access to all 'replacement fields', participant data, and response data.
#*You also have easier access to questions, answers, and their properties.
#*You also have easier access to questions, answers, and their properties.
#'''Relevance''' Equation: A new question attribute controlling question visibility
#'''Relevance''' Equation: A new question attribute controlling question visibility:
#*If there is a relevance equation, then the question is only shown if the relevance evaluates to true.
#*If there is a relevance equation, then the question is only shown if the relevance evaluates to true.
#*Internally, all [[QS:Array_filter|array_filter]] and [[QS:Array_filter_exclude|array_filter_exclude]] commands become sub-question-level relevance
#*Internally, all [[QS:Array_filter|array_filter]] and [[QS:Array_filter_exclude|array_filter_exclude]] commands become subquestion-level relevance.
#'''Equation''' Question Type:  [[Question type - Equation|A new question type]] that saves calculations or reports to the database
#'''Equation''' Question Type: [[Question type - Equation|A new question type]] that saves calculations or reports to the database:
#*It is like a Boilerplate question, but its contents are saved to the database even if you set "Always Hide this Question"
#*It is like a Boilerplate question, but its contents are saved to the database even if you set "Always Hide this Question".
#'''Question Code''': This is the preferred variable name for EM
#'''Question Code''': This is the preferred variable name for EM:
#*This can be a descriptive name indicating the purpose of the question, making it easier to read complex logic
#*This can be a descriptive name indicating the purpose of the question, making it easier to read complex logic.
#*Valid question codes should NOT start with a number, so when using the question code to number your questions, simply use "q1", or "q1a" or "g1q2".
#*Valid question codes should NOT start with a number, so when using the question code to number your questions, simply use "q1", or "q1a" or "g1q2".
#*This is what becomes the variable name if you export data to SPSS or R, so if you do statistical analysis, you need to create only unique question codes.
#*This is what becomes the variable name if you export data to SPSS or R. So, if you do statistical analysis, you need to create only unique question codes.




Line 234: Line 40:


<!--T:57-->
<!--T:57-->
The short answer is " perhaps not". However, this heavily depends on the complexity of the survey you want to create.  
The short answer is "no". However, this heavily depends on the complexity of the survey you want to create.  


For example, the [[Setting conditions|Conditions editor]] covers some basic expressions that can be applied to the questions of your survey. However, the Conditions editor is limited. That is why the EM is used - it expands the realm of possibilities on how you can [[Expression_Manager_to_be_updated#Quick_start_tutorial|customize]] your survey.
For example, the [[Setting conditions|Conditions editor]] covers some basic expressions that can be applied to the questions of your survey. However, the Conditions editor is limited. That is why the EM is used - it expands the realm of [[Expression_Manager_to_be_updated#Quick_start_tutorial|customization possibilities]].




==Can I mix use of Conditions and Relevance?== <!--T:61-->
==Can I mix Conditions and Relevance equations?== <!--T:61-->




<!--T:62-->
<!--T:62-->
Yes. You can use the [[Setting conditions|Conditions editor]] for some questions and [[QS:Relevance|relevance equations]] for others.  
Yes. You can use the [[Setting conditions|Conditions editor]] for some questions and [[QS:Relevance|Relevance equations]] for others.  


'''You cannot have both conditions and expressions set up in the same question!'''. Once a condition is set up, it replaces whatever expression is written in the relevance equation field.
'''You cannot have both conditions and expressions set up in the same question!''' Once a condition is set up, it replaces whatever expression is written in the relevance equation field. Moreover, the [[QS:Relevance|Relevance equation]] field cannot any longer be manually edited.


<!--T:63-->
<!--T:63-->
Yet, there is a way to use both expressions and conditions within a question. As mentioned above, a condition replaces the relevance equation field. Once done, check what is the newly created equation and copy it in a text editor. Delete the newly created condition from the [[Setting conditions|Conditions editor]] and then edit the question, and add the desired expressions together with the conditions-based expression from your text editor file.  
Yet, there is a way to use both expressions and conditions within a question. As mentioned above, a condition replaces the relevance equation field. Once done, check what is the newly created equation and copy it in a text editor. Delete the newly created condition from the [[Setting conditions|Conditions editor]] and then edit the question by adding the condition-based expressions from your text editor file alongside the rest of expressions you wish to use.  




Line 255: Line 61:


<!--T:65-->
<!--T:65-->
Here is a list of pros and cons of each style:
Here is a list of the pros and cons of each style:


<!--T:66-->
<!--T:66-->
Line 261: Line 67:
!Style!!Pros!!Cons
!Style!!Pros!!Cons
|-
|-
|Conditions||1. Nice GUI for creating simple conditions <br/>2. GUI well documented and understood by support team||1. Only supports simple comparisons and does not "AND" and "OR" conditions well <br/>2. Cascading conditions work erratically <br/>3. Slow - database intensive -it can slow down long surveys <br/>4. Some reported problems with reloading conditions <br/>5. GUI doesn't scale well when there are dozens, hundreds, or thousands of questions <br/>6. May be slow to convert paper-based surveys since it must use [[SGQA identifier|SGQA]] names <br/>7. Often need a programmer to custom-code logic needed for complex branching
|Conditions||1. Nice [[Setting conditions|GUI]] for creating simple conditions. <br/>2. GUI well documented and understood by support team||1. Only supports simple comparisons and does not "AND" and "OR" conditions well. <br/>2. Cascading conditions work erratically <br/>3. Slow - database intensive -it can slow down long surveys. <br/>4. Some reported problems with reloading conditions.<br/>5. GUI doesn't scale well when there are dozens, hundreds, or thousands of questions. <br/>6. It could be slow to convert paper-based surveys since it must use [[SGQA identifier|SGQA]] names. <br/>7. Often need a programmer to custom-code logic needed for complex branching.
|-
|-
|Relevance||1. Supports very complex logic, including 80+ functions and math/string operators <br/>2. Perfect support for cascading logic <br/>3. Fast - no extra database calls, supporting 1000+ question surveys <br/>4. No problems with reloading logic since it does not require [[SGQA identifier|SGQA]] codes <br/>5. Syntax-highlighting scales to 1000+ question surveys <br/>6. Easy and fast to use for groups wanting to computerize existing paper-based suveys.  <br/>7. It easily supports semi-structured interviews and epidemiological surveys without the need of programmer||1. No GUI for simple conditions - it makes use pf syntax-highlighting instead.
|Relevance||1. Supports very complex logic, including 80+ functions and math/string operators. <br/>2. Perfect support for [[Expression_Manager_to_be_updated#Relevance_and_Cascading_Relevance|cascading logic]]. <br/>3. Fast - no extra database calls, supporting 1000+ question surveys. <br/>4. No problems with reloading logic since it does not require [[SGQA identifier|SGQA]] codes. <br/>5. Syntax-highlighting scales to 1000+ question surveys. <br/>6. Easy and fast to use for groups wanting to computerize existing paper-based surveys. <br/>7. It easily supports semi-structured interviews and epidemiological surveys without needing a programmer||1. No GUI for simple conditions - it makes use of [[Expression_Manager_to_be_updated#Syntax_Highlighting|syntax-highlighting]] instead.
|}
|}




{{Note|We recommend you to use whatever fits better your needs.}}
{{Note| '''Note:'''
*We recommend you to use whatever fits better your needs.
*For a more detailed explanation of the EM features, click on the following [[EM and its features|link]].}}




<div class='simplebox'>For a more detailed explanation of the EM features, click on the following [[EM and its features|link]].</div>
=Getting Started= <!--T:75-->


=Getting Started= <!--T:75-->


<!--T:76-->
<!--T:76-->
The best way to get started with EM is to:
The best way to get started with the EM is to:
*Install the latest stable version from http://www.limesurvey.org/en/download  
*Install the latest stable version from http://www.limesurvey.org/en/download.
*Import and explore the [[Expression Manager Sample Surveys|sample surveys]].
*Import and explore some [[ExpressionScript sample surveys|sample surveys]].
*Explore the [[Expression Manager HowTos|use cases and HowTos]] and [[Expression Manager Examples|step-by-step examples]].
*Explore the [[ExpressionScript how-tos|use cases and HowTos]], and the [[ExpressionScript examples|step-by-step examples]].
*Explore the EM documentation (this page)
*Explore the EM documentation (this page)
*Examine the built-in EM test suite
**Unit Tests of Isolated Expressions (advanced)
**From any survey, under tools, select the EM option
***shows examples of using all EM functions and operators, and the PHP and JavaScript results;
**Available Functions lists the 70+ functions and syntax
**Unit Tests of Isolated Expressions
***shows examples of using all EM functions and operators, and the PHP and JavaScript results
***note there are few functions that generate different results in the PHP and JavaScript versions, so this page lets you plan your EM logic accordingly.
***note there are few functions that generate different results in the PHP and JavaScript versions, so this page lets you plan your EM logic accordingly.


=What Functionality does Expression Manager Extend/Replace? (LimeSurvey <= 1.91+)= <!--T:77-->
=Terminology= <!--T:90-->


==Conditions => Relevance== <!--T:78-->


<!--T:79-->
These words are commonly used to describe the capabilities of the EM:
Conditions controlled which  questions are visible.  The general syntax was ''SGQA operator Value'', like ''111X2X3 == "Y"''.  Conditions could be ANDed or ORed together, but mixing ANDs and ORs was difficult.  The conditions themselves were stored in a separate table, and large portion of LimeSurvey's code was devoted to managing Conditions.  Because of extensive database access, processing large numbers of conditions could cause noticable performance problems.  Furthermore, once you had conditions assigned to questions or groups, you were often not allowed to re-order or delete them.


==Assessments => Equations and  Micro-Tailoring== <!--T:80-->
<!--T:93-->
 
EM "thinks" of its functionality in the following terms:
<!--T:81-->
*'''Relevance-based Branching''' - if a question is relevant, then ask it, otherwise don't (e.g., make it invisible and mark it as NULL in the database). You may find the [[QS:Relevance|Relevance fields]] in the question editor panel as well as in the question group editor panel. The later is used to apply a set of conditions to an entire group without having to copy the same condition to each question, and/or combine group and question-level conditional logic).
Assessments let users create scale scores from a collection of questions.  However, they could not dynamically change on the current page, and their values were not stored to the database.
*'''Tailoring''' - Once you know which questions should be asked, tailoring (sometimes called ''piping'') specifies how the question should be asked. This lets you support not only simple substitution (like {TOKEN:FIRSTNAME}), but also conjugation of verbs and declination of nouns based upon the gender or number of your subjects. It also lets you change the message you deliver to a survey respondent based upon whether they answered (or how they answered) other questions.
 
*'''Equations''' - EM adds a new question type called [[Question type - Equation|Equation]] which stores the result of an Expression. The equation results are computed and written to the database, even if you hide them on the page. Thus, they are used for hidden scoring calculations, navigation based upon complex equations, assessments, and reports that will be generated and stored within the database.
==Replacements => Micro-Tailoring== <!--T:82-->
 
<!--T:83-->
Users could tailor some messages and questions based  upon prior responses.  For example, a question might be, ''{TOKEN:FIRSTNAME}, you said {INSERTANS:111X3X4} was your favorite sport''.  However, it was not possible to do conditional tailoring (like say "Mr." or "Mrs." depending upon the person's gender), or conjugate verbs or decline nouns without fancy JavaScript.  Authors could implement surveys that seemed to tailor questions, but it required separate questions for each permutation, and complex conditions to decide which questions to display.
 
==Validation== <!--T:84-->
 
<!--T:85-->
Question could be validated with Regular expressions, or minimum/maximum values, or let an SGQA response serve as the minimum or maximum value.  However, validations could not be based upon calculations of other variables without fancy JavaScript.
 
==Equations== <!--T:86-->
 
<!--T:87-->
Equations were not supported without fancy JavaScript.
 
==Equation Question Type== <!--T:88-->
 
<!--T:89-->
Equations could not be saved to the database (e.g. the final score for an assessment) without fancy JavaScript.
 
=How Will Expression Manager Replace/Extend That Functionality?= <!--T:90-->
 
<!--T:91-->
The Expression Manager is a new core module within LimeSurvey that makes it much easier to support the type of complex functionality that used to require custom JavaScript.  It is also replacing the way LimeSurvey currently manages Conditions and Assessments.


==New Terminology When Referring to Expression Manager (EM)== <!--T:92-->


<!--T:93-->
==Relevance and Cascading Relevance== <!--T:94-->
EM "thinks" of its functionality in the following terms:
*'''Relevance-based Branching''' - if a question is relevant, then ask it, otherwise don't (e.g. make it invisible, and mark it as NULL in the database).  There is a new Relevance field for all Question types, and also for each Group (so you can apply a set of conditions to an entire group without having to copy the same condition to each question, and/or combine group and question-level conditional logic).
*'''Tailoring''' - Once you know which questions should be asked, tailoring (sometimes called ''piping'') specifies how the question should be asked. This lets you support not only simple subsitution (like {TOKEN:FIRSTNAME}), but also conjugation of verbs and declination of nouns based upon the gender or number of your subjects.  It also lets you change the message you deliver to a subject based upon whether they answered (or how they answered) other questions.
*'''Equations''' - EM adds a new question type called Equation which stores the result of an Expression.  These equations results are computed and written to the database, even if you hide them on the page.  Thus, they are useful for hidden scoring calculations, navigation based upon complex equations, assessments, and reports that should be generated and easily available within the database.


===Relevance and Cascading Relevance=== <!--T:94-->


<!--T:95-->
<!--T:95-->
Every question type now has a Relevance option which controls whether the question is displayed.  EM processes each of the Relevance Equations in the order they should appear in the survey.  If the expression is true (or missing - to support legacy surveys), the question will be displayed. If it is not relevant, then the question will be hidden, and the value will be NULLed in the database.  If there are no relevant questions in a group, the entire group will be skipped.
Every question type now has a [[QS:Relevance|Relevance option]] which controls whether the question is displayed or not. The EM processes each Relevance Equation in the order they appear in the survey. If the expression is true (or missing - to support legacy surveys), the question will be displayed. If it is not relevant, then the question will be hidden, and the value will be NULLed in the database. If there are no relevant questions in a group, the entire group will be skipped.


<!--T:96-->
<!--T:96-->
Moreover, if any of the variables within an expression is irrelevant, then the expression always evaluates to false.  This enables Cascading Relevance so that you do not have to write very long Relevance equations for each question.
Moreover, if any of the variables within an expression is irrelevant, then the expression always evaluates to false. This enables '''Cascading Relevance''' so that you do not have to write very long Relevance equations for each question.


<!--T:97-->
<!--T:97-->
Say you have 5 questions Q1-Q5, and you only want to show Q2 if Q1 was answered, and Q3 if Q2 was answered, etc.  The relevance equations might be:
Say you have five questions Q1-Q5, and you only want to show Q2 if Q1 was answered, and Q3 if Q2 was answered, etc.  The relevance equations might be:


<!--T:98-->
<!--T:98-->
Line 358: Line 130:
|}
|}


<!--T:99-->
The relevance calculations also work in JavaScript - so you could put all the above questions on one page and it would still work as expected.  In fact, EM totally replaces how EM processes Survey vs. Group vs. Question-at-a-time survey formats.  They now all use the exactly same navigation engine so they work identically regardless of survey style.


<!--T:100-->
==Group-Level Relevance== <!--T:101-->
As long as you are on the same page, any data you entered will still be there, just hidden.  So, if you enter some information, then choose an option that makes them irrelevant, then make them relevant again, your answers will still be available.  However, as soon as you move to a different page, all irrelevant responses will be lost to integrity of the dataset.


===Group-Level Relevance=== <!--T:101-->


<!--T:102-->
<!--T:102-->
Expression Manager also supports group-level relevance.  This makes it easier to implement looping.   Say you want to collect information about up to 10 entities (such a products or people in a household), where you first determine how many entities need follow-up (such as by asking how many people live in a household, or having people check which products they like from a long list).  After knowning how many entities need follow-up, you can use Group-level relevance like {count >= 1}, {count >=2}, ... {count >= 10} for each of the 10 groups of follow-up questions.  Within each group, you can have question-level conditional logic (e.g. gender or age-specific follow-up questions for each subject).  The question and group-level relevance equations are ANDed together to determine which should be shown.
ExpressionScript also supports group-level relevance. This makes it easier to implement looping. Say you want to collect information from up to 10 entities (such as products or people from a household), where you first determine how many entities need follow-up (such as by asking how many people live in a household or having people check which products they like from a long list). After knowing how many entities need follow-up, you can use Group-level relevance like {count >= 1}, {count >=2}, ... {count >= 10} for each of the 10 groups of follow-up questions.  Within each group, you can have question-level conditional logic (e.g. gender or age-specific follow-up questions for each subject). The question and group-level relevance equations are ANDed together to determine which should be shown.
 
To check such an example, import the following survey: [[Media:EM survey - Cohabs.zip|Census survey example]].
 
 
==Tailoring / Piping== <!--T:103-->


===Tailoring / Piping=== <!--T:103-->


<!--T:104-->
<!--T:104-->
Anything within curly braces is now treated as an Expression (with one exception described below).  Expressions have acccess to all of the LimeReplacementFields, all of the variables (via several aliases), all typical equation operators (mathematical, logical, and comparison), and dozens of functions (that even work dynamically on the client-side).
Anything within curly braces is now treated as an Expression (with one exception described below). Expressions have access to all the LimeReplacementFields and variables (via several aliases), all typical equation operators (mathematical, logical, and comparison), and to dozens of functions (that even work dynamically on the client-side).


<!--T:105-->
<!--T:105-->
Using these equations, you can do things such as:
By Using these equations, you can do things such as:
#Conditionally show tailored messages to the respondants based upon prior responses
#Conditionally show tailored messages to the respondents based on prior responses;
#Create Assessments and show Assessment results (or conditionally branch or show messages) based upon those results, all without using the Assessments module itself
#Create Assessments and show Assessment results (or conditionally branch or show messages) based upon those results, all without using the Assessments module itself;
#Conjugate verbs and decline nouns within questions, answers, and reports.
#Conjugate verbs and decline nouns within questions, answers, and reports;
#Show summaries of responses before the "Show your answers" page at the end of the survey
#Show summaries of responses before the "Show your answers" page at the end of the survey.
 
 
==Equations== <!--T:106-->


===Equations=== <!--T:106-->


<!--T:107-->
<!--T:107-->
There is a new question type called  Equation.  It is like a Boilerplate questions, except that it stores the value of what is displayed in the database.  So, if the Equation Question text contains an Assessment computation, that value would be stored in the database in a variable that can be displayed within public or private statistics.
There is a new question type called [[Question type - Equation|Equation]]. Think of it as a [[Question type - Text display|Text display question type]], except that it stores the value of what is displayed in the database. So, if the Equation Question text contains an Assessment computation, that value would be stored in the database in a variable that can be displayed in public or private statistics.
 


<!--T:108-->
=Syntax= <!--T:109-->
This solves a common request for storing Assessment scores within the database


==Syntax== <!--T:109-->


<!--T:110-->
<!--T:110-->
Anything contained within curly braces is now considered an Expression (with one exception:  there must be no leading or trailing whitespace - this is needed to ensure the Expression Manager does not try to process embedded JavaScript).
Anything contained within curly braces is now considered an Expression (with one exception: '''there must be no leading or trailing whitespace''' - this is needed to ensure the ExpressionScript does not try to process embedded JavaScript).


<!--T:111-->
<!--T:111-->
Note, it is OK for expressions to span multiple lines, as long as there is no whitespace after the opening  curly brace or before the closing curly brace.  This is especially helpful for nested if() statements like this:
Note that it is OK for expressions to span multiple lines, as long as there is no whitespace after the opening curly brace or before the closing curly brace. This is especially helpful for nested "if()" statements like this:


<!--T:112-->
<!--T:112-->
Line 426: Line 199:


<!--T:138-->
<!--T:138-->
<div id="EMsyntax">Expression Manager supports the following syntax:</div>
The ExpressionScript supports the following syntax:
*All standard mathematical operators (e.g. +,-,*,/,!)
*All standard mathematical operators (e.g. +,-,*,/,!);
*All standard comparison operators (e.g. <,<=,==,!=,>,>=, plus these equivalents:  lt,le,eq,ne,gt,ge)
*All standard comparison operators (e.g. <,<=,==,!=,>,>=, plus their equivalents: lt, le, eq, ne, gt, ge);
*Parentheses (so you can group sub-expressions)
*Parentheses (so you can group sub-expressions);
*Conditional operators (e.g. &&,| | and these equivalents: and,or)
*Conditional operators (e.g. &&,| | and their equivalents: and, or);
*Single and double-quoted strings (which can each embed strings with the other quote type)
*Single and double-quoted strings (which can each embed strings with the other quote type);
*Comma operator (so can have a list of expressions and just return the final result)
*Comma operator (so can have a list of expressions and just return the final result);
*Assignment operator (=)
*Assignment operator (=);
*Pre-defined variables (to refer to questions, question attributes, and responses) - e.g. all of the SGQA codes
*Pre-defined variables (to refer to questions, question attributes, and responses) - e.g., the [[SGQA identifier|SGQA codes]];
*Pre-defined functions (there are already 70+, and it is easy to add more)
*Pre-defined functions (there are already 80+, and it is easy to add more).
 
 
== Operators == <!--T:211-->


=== Operators === <!--T:211-->


<!--T:139-->
<!--T:139-->
Line 468: Line 243:


<!--T:141-->
<!--T:141-->
Note, for consistency between JavaScript and PHP, the plus operator (+) does addition if both operands are numeric, but does concatenation if both parts are non-numeric strings.  However, we recommend using the join() function for concatenation, as that makes your intent more clear, and avoids unexpected results if you were expecting strings but got numbers instead (or vice versa).
{{Note| For consistency between JavaScript and PHP, the plus operator (+) does addition if both operands are numeric, but does concatenation if both parts are non-numeric strings. However, we recommend using the "join()" function for concatenation, as that makes your intent more clear. It also avoids unexpected results if you were expecting strings but got numbers instead (or vice versa).}}




===Caution about using Assignment Operator (=)=== <!--T:142-->
==Caution about using Assignment Operator (=)== <!--T:142-->




<!--T:143-->
<!--T:143-->
Note, you should avoid using the assignment operators unless absolutely necessary, since they may cause unexpected side-effects.  For example, if you change the value of a previous response, the cascading relevance and validation logic between that question and the current question is not re-computed, so you could end up with internally inconsistent data (e.g. questions that stay answered but should have been NULLed, or questions that are skipped but should have been answered).  In general, if you want to assign a value to a variable, you should create an Equation question type, and use an expression to set its value.  However, there are some rare times that people really need this operator, so we made it available.
You should avoid using the assignment operators unless absolutely necessary, since they may cause unexpected side-effects. For example, if you change the value of a previous response, the cascading relevance and validation logic between that question and the current question is not re-computed, so you could end up with internally inconsistent data (e.g., questions that stay answered but should have been NULLed, or questions that are skipped but should have been answered). In general, if you want to assign a value to a variable, you should create an Equation question type, and use an expression to set its value. However, there are some rare times that people really need this operator, so we made it available.


<!--T:144-->
<!--T:144-->
To help caution you about this operator, it is shown in red font within the syntax equations (so that you don't confuse it with "==")
To help caution you about this operator, it is shown in red font within the syntax equations (so that you don't confuse it with "==").
 
 
<center>[[FIle:Example assignment operator.png]]</center>




Line 485: Line 263:


<!--T:145-->
<!--T:145-->
The main reasons you may want to use assignment are:
The main reasons you may want to use the assignment operator are:
*You need to set the default value for a question that does not accept defaults via equation (such as list radio, where the user interface lets you pick one of the answer options, but does not let you enter an equation).  However, be careful, as LimeSurvey will not be able to validate that your equation generates one of the allowable answers for that question.
*You need to set the default value via equation for a question that does not accept default values (such as list radio, where the user interface lets you pick one of the answer options, but does not let you enter an equation). However, be careful, as LimeSurvey will not be able to validate that your equation generates one of the allowable answers for that question;
*You need to forcibly change the response to a previous question based upon a later response
*You need to forcibly change the response to a previous question based upon a later response;
* etc...
* etc...




<!--T:212-->
<!--T:212-->
You can use all expression manager system for this purpose. It's better to use an [[Question_type_-_Equation|Equation question]] type to this purpose.
You can use all the expression manager system for this purpose. It's better to use an [[Question_type_-_Equation|Equation]] for this purpose.




<!--T:213-->
<!--T:213-->
Some example:
Some examples:
* Set answer to a short text question in lowercase : <code>{QCODE=strtolower(QCODE.NAOK)}</code>
* Set answer to a short text question in lowercase : <code>{QCODE=strtolower(QCODE.NAOK)}</code>;
* Set a default answer to an array question type at start of a survey : <code>{Q1_SQ1=(is_empty(Q1_SQ1.NAOK),"A99",Q1_SQ1.NAOK)}</code>
* Set a default answer to an array question type at start of a survey : <code>{Q1_SQ1=(is_empty(Q1_SQ1.NAOK),"A99",Q1_SQ1.NAOK)}</code>;
* Set a default answer to an array texts question type at start of a survey : <code>{Q1_SQY1_SQX1 = (is_empty(Q1_SQY1_SQX1.NAOK),"Inserted answer", Q1_SQY1_SQX1.NAOK)}</code>
* Set a default answer to an array texts question type at start of a survey : <code>{Q1_SQY1_SQX1 = (is_empty(Q1_SQY1_SQX1.NAOK),"Inserted answer", Q1_SQY1_SQX1.NAOK)}</code>;
* Set an answer with condition : <code>{QCODE=if(YesNo="Y","A1","")}</code>
* Set an answer with condition : <code>{QCODE=if(YesNo="Y","A1","")}</code>.




== XSS security == <!--T:214-->
= XSS security = <!--T:214-->




<!--T:215-->
<!--T:215-->
With XSS enable, some expression manager system can not be used :  
With [[Global_settings#Security|XSS enabled]], some parts of the expression manager system cannot be used:  
* starting a HTML tag in expression but ending in another expression
* starting a HTML tag in expression but ending in another expression;
* use a complex expression in URL.  
* using a complex expression within a URL.
 
 
{{Note| Please note that XSS is enabled by default in any LimeSurvey installation.}}
 


<!--T:216-->
<!--T:216-->
Example and workaround
Examples and workarounds:
* <code>{if( 1 ,"&lt;strong&gt;","")}information{if( 1 ,"&lt;/strong&gt;","")}</code> is broken with XSS security, here you can use <code>{if(1,"<strong&gt;information&lt;/strong&gt;","information")}</code>
* <code>{if( 1 ,"&lt;strong&gt;","")}information{if( 1 ,"&lt;/strong&gt;","")}</code> is broken with XSS security, here you can use <code>{if(1,"<strong&gt;information&lt;/strong&gt;","information")}</code>;
* <code>&lt;a href="/script.php?value={if(QCODE == "Y","yes","no")}"&gt;next&lt;/a&gt;</code>, here you can use an equation question because using a complete question code is OK : <code>&lt;a href="/script.php?value={EQUATION.NAOK}"&gt;next&lt;/a&gt;</code>
* <code>&lt;a href="/script.php?value={if(QCODE == "Y","yes","no")}"&gt;next&lt;/a&gt;</code>, here you can use an equation question because using a complete question code is OK : <code>&lt;a href="/script.php?value={EQUATION.NAOK}"&gt;next&lt;/a&gt;</code>.




==Access to Variables== <!--T:146-->
=Access to Variables= <!--T:146-->




<!--T:147-->
<!--T:147-->
Expression Manager provides read-only access to whichever variables we might need.  For backwards compatibility, it provides access to the following:
ExpressionScript provides read-only access to whichever variables you might need. For backwards compatibility, it provides access to the following:
*TOKEN:xxx - the value of a TOKEN (e.g. TOKEN:FIRSTNAME, TOKEN:ATTRIBUTE_5) (Only for NOT anonymous survey).
*[[Survey_participants|TOKEN:xxx]] - the value of a TOKEN (e.g., TOKEN:FIRSTNAME, TOKEN:ATTRIBUTE_5) (only for '''not''' [[Participant_settings|anonymous survey]]).
*[[Adding a question#Information_from_previous_answers|INSERTANS:SGQA]] - the display value of an answer (e.g. "Yes"). For Expression Manager it's the same that using {QCODE.shown}.
*[[Adding a question#Information_from_previous_answers|INSERTANS:SGQA]] - the display value of an answer (e.g., "Yes") - similar to using {QCODE.shown}.
*All [[The_template_editor#Keywords|{XXX} values used by templates]].
*All [[The_template_editor#Keywords|{XXX} values used by templates]].
*In question text, you can use {QID} replaced by the question id and {SGQ} replaced by the SGQA of the question
*In question text, you can use {QID} replaced by the question id and {SGQ} replaced by the SGQA of the question.


<!--T:148-->
<!--T:148-->
In addition, Expression Manager lets you refer to variables by the Question Code (the 'title' column in the questions table within the database).  This is also the variable label used when you export your data to SPSS, R, or SAS.  For example, if you have questions about name, age, and gender, you could call those variables ''name'', ''age'', and ''gender'' instead of ''12345X13X22'', ''12345X13X23'', and  ''12345X13X24''.  This makes equations easier for everyone to read and validate the logic, plus makes it possible to shuffle questions around without having to keep track of group or question numbers.
In addition, ExpressionScript lets you refer to variables by the Question Code (the 'title' column in the questions table within the database). This is also the variable label used when you export your data to SPSS, R, or SAS. For example, if you have questions about name, age, and gender, you could call those variables ''name'', ''age'', and ''gender'' instead of ''12345X13X22'', ''12345X13X23'', and  ''12345X13X24''. This makes equations easier for everyone to read and validate the logic, plus making it possible to shuffle questions around without having to keep track of group or question numbers.


<!--T:210-->
<!--T:210-->
<div class='simplebox'>
<div class='simplebox'>
'''Important:''' It is only safe to refer to variables that occur in preceding pages or questions.
'''Important:''' It is safer to refer to variables that occur in the preceding pages or questions.
</div>
</div>


<!--T:149-->
<!--T:149-->
Furthermore, Expression Manager lets you access many properties of the Question:
Furthermore, ExpressionScript lets you access many properties of the question:




Line 581: Line 363:




=== HTML editor issue=== <!--T:151-->
== HTML editor issue== <!--T:151-->
 


<!--T:217-->
{{Alert|This issue is fixed after 2.05 build 140803}}


<!--T:152-->
<!--T:152-->
If you use HTML editor, some characters are replaced by HTML entities.
If you use the HTML editor, some characters are replaced by HTML entities.
* & by &amp;amp;
* & by &amp;amp;
* < by &amp;lt;
* < by &amp;lt;
Line 602: Line 381:




==Qcode Variable Naming== <!--T:153-->
It is recommended to clear your expression of HTML that appears within your expression. If you use the LimeSurvey HTML editor, click on the "Source" button (located in the upper left part of the editor) and delete all the characters that are not related to your expression (e.g., <p>,</br>, and so on).
 
 
=Qcode Variable Naming= <!--T:153-->




<!--T:154-->
<!--T:154-->
Here are the details of how to construct a Qcode (and access some properties) by question type.  In general, Qcodes are constructed as:
Here are the details of how to construct a Qcode (and access some properties) by question type. In general, Qcodes are constructed as:


<!--T:155-->
<!--T:155-->
Line 612: Line 394:


<!--T:208-->
<!--T:208-->
For '''comment''' and '''other''', question code are QuestionCode_comment and QuestionCode_other
For '''comment''' and '''other''', the corresponding question codes are QuestionCode_comment and QuestionCode_other, respectively.


<!--T:156-->
<!--T:156-->
Line 678: Line 460:




==The reserved 'this', 'self', and 'that' variables== <!--T:157-->
=Usage of NAOK= <!--T:218-->
 
 
<!--T:219-->
NAOK --> "Not Applicable" (NA) is alright (OK)
 
<!--T:224-->
Using NAOK, means that all or some of the variables are irrelevant (e.g. "Not Applicable" (NA) is alright (OK)).
 
<!--T:220-->
For example: count(Q1_SQ1,Q1_SQ2,Q1_SQ3,Q1_SQ4) give always an empty string if one subquestion of Q1 is filtered.
To count the number of checked subquestion in such question can be count(Q1_SQ1.NAOK,Q1_SQ2.NAOK,Q1_SQ3.NAOK,Q1_SQ4.NAOK). If the subquestion is hidden, the EM returns an empty string.
 
<!--T:221-->
Without NAOK, if one question or one subquestion is hidden, the EM returns always an empty string (same to returning false).
 
<!--T:222-->
The .shown always use the NAOK system (empty string if hidden) but if you need the code of the answer: it's always a good idea to add .NAOK after the question code (except if you need it and know what you do).
 
<!--T:223-->
More information is provided in the [[#Overriding_Cascading_Conditions|Overriding Cascading Conditions subsection]].
 
 
=The reserved "this", "self", and "that" variables= <!--T:157-->




<!--T:158-->
<!--T:158-->
Quite often, you want to evalute all parts of a question, such as counting how many sub-questions have been answered, or summing the scores.  Other times, you want to process just certain rows or columns of a question (such as getting the row or column sums and storing them in the database).  These reserved variables make that process relatively painless.
Quite often you want to evaluate all the parts of a question, such as counting how many subquestions have been answered or summing up the scores. Other times you want to process just certain rows or columns of a question (such as getting the row or column sums and storing them in the database). These reserved variables make that process relatively painless.
 
 
=="This" variable==
 


<!--T:159-->
<!--T:159-->
The 'this' variable is used exclusively within the "Whole question validation equation" and "Sub-question validation equation" advanced question options.  It expands to the variable names of each of the cells within those questions.  So, if you want to make sure that each entry is greater than three, you would set the "Sub-question validation equation" to (this > 3).
The '''"this"''' variable is used exclusively within the "[[QS:Relevance|Whole question validation equation]]" and "[[QS:Em_validation_sq|Subquestion validation equation]]" options (the later is not possible from GUI). It expands to the variable names of each of the cells within those questions. So, if you want to make sure that each entry is greater than three, you would set the "Sub-question validation equation" to (this > 3).
 
 
=="Self" variable==
 


<!--T:160-->
<!--T:160-->
The 'self' and 'that' variable are more powerful, and serve as macros which are expanded prior to processing equations.  The syntax choices are:
The '''"self"''' and '''"that"''' variable are more powerful, and serve as macros which are expanded prior to processing equations. The syntax choices for the "self" variable are:
*self
*self
*self.''suffix''
*self.''suffix''
Line 695: Line 508:


<!--T:161-->
<!--T:161-->
''suffix'' is any of the normal qcode suffixes (e.g. NAOK, value, shown)
#''suffix'' is any of the normal qcode suffixes (e.g., NAOK, value, shown)


<!--T:162-->
<!--T:162-->
''sub-selector'' is one of:
#''sub-selector'' can be one of the following:
*comments - only subquestions that are comments (e.g. from multiple choice with comment and list with comment)
*comments - only subquestions that are comments (e.g., [[Question type - Multiple choice with comments|multiple choice with comment]] and [[Question type - List with comment|list with comment]]);
*nocomments - only subquestions that are not comments
*nocomments - only subquestions that are not comments;
*sq_X - where X is a row or column identifier.  Only sub-questions matching pattern X are selected. Note that search is done on complete code identifier, then sq_X match and include subquestions nX, X, Xn (e.g. if you use sq_1, subquestions a1, 1a, 1, 11 or 001 was included). Put attention at dual scale question type where subquestions code are QCODE_SQCODE_1 and QCODE_SQCODE_1 and to ranking question type where subquestions code are QCODE_1,QCODE_2 ....
*sq_X - where X is a row or column identifier.  Only subquestions matching pattern X are selected. Note that search is done on complete code identifier, then sq_X match and include subquestions nX, X, Xn (e.g. if you use sq_1, subquestions a1, 1a, 1, 11 or 001 was included). Put attention at dual scale question type where subquestions code are QCODE_SQCODE_1 and QCODE_SQCODE_1 and to ranking question type where subquestions code are QCODE_1,QCODE_2 ....


<!--T:163-->
<!--T:163-->
Examples:
'''Examples:'''
*Has any part of a question been answered?  {count(self.NAOK)>0}
*Has any part of a question been answered? -> {count(self.NAOK)>0}
*What is the assessment score for this question?  {sum(self.value)}
*What is the assessment score for this question? -> {sum(self.value)}


<!--T:164-->
<!--T:164-->
You can also use these to get row and column totals.  Say you have a array of numbers with rows A-E and columns 1-5.
You can also use these to get row and column totals.  Say you have an array of numbers with rows A-E and columns 1-5.
*What is the grand total?  {sum(self.NAOK)}
*What is the grand total? -> {sum(self.NAOK)}
*What is the total of row B?  {sum(self.sq_B.NAOK)}
*What is the total of row B? -> {sum(self.sq_B.NAOK)}
*What is the total of column 3? {sum(self.sq_3.NAOK)}
*What is the total of column 3? -> {sum(self.sq_3.NAOK)}
 
 
=="That" variable==
 


<!--T:165-->
<!--T:165-->
The 'that' variable is like the 'self' variable, but lets you refer to other questions.  Its syntax is:
The '''"that"''' variable is like the "self" variable, but it allows you to refer to other questions. Its syntax is:
*that.''qname''
*that.''qname''
*that.''qname''.''suffix''
*that.''qname''.''suffix''
Line 722: Line 539:


<!--T:166-->
<!--T:166-->
''qname'' is the question name without any sub-question extensions.  So, say you create a question 'q1', that is its ''qname''
''qname'' is the question name without any subquestion extensions. So, let's create a question 'q1', 'q' representing also its ''qname''.


<!--T:167-->
<!--T:167-->
Examples:
Examples:
*Has any part of question q1 been answered?  {count(that.q1.NAOK)>0}
*Has any part of question q1 been answered? -> {count(that.q1.NAOK)>0}
*What is the assessment score for q2?  {sum(that.q2.NAOK)}
*What is the assessment score for q2? -> {sum(that.q2.NAOK)}
*What is the grand total of q3? {sum(that.q3.NAOK)}
*What is the grand total of q3? -> {sum(that.q3.NAOK)}
*What is the total of row C in q4?  {sum(that.q4.sq_C.NAOK)}
*What is the total of row C in q4? -> {sum(that.q4.sq_C.NAOK)}
*What is the total of column 2 in q4? {sum(that.q4.sq_2.NAOK)}
*What is the total of column 2 in q4? -> {sum(that.q4.sq_2.NAOK)}


<!--T:168-->
<!--T:168-->
The 'self' and 'that' variables can be used in any relevance,  validation, or tailoring.
The "self" and "that" variables can be used in any relevance, validation, or tailoring.


<!--T:169-->
<!--T:169-->
The one caveat is that when you use the [[Show Logic File|Show Logic File]] feature, it will show you the expanded value of 'self' and 'that'.  This lets you see the actual equation that will be generated so that you (and Expression Manager) can validate that the variables exist.  This may seem confusing since you may see quite lenghty equations.  However, if you edit the question, you will see the original equation using 'self' and/or 'that'
The one caveat is that when you use the [[Show Logic File|Show Logic File]] feature, it will show you the expanded value of "self" and "that". This lets you see the actual equation that will be generated so that you (and the EM) can validate whether the variables exist or not. This may seem confusing since you may see quite lengthy equations. However, if you edit the question, you will see the original equation using "self" and/or "that".


<!--T:170-->
<!--T:170-->
Also note that you should not use these variables if (a) you want to explicitly name each variable used in an equation, or (b) use variables that do not have sub-questions (e.g. single response questions).  In those cases, prefixing a variable with 'that' is overkill, and you run the risk of getting unexpected results.
{{Note| You should not use these variables if  
 
*you want to explicitly name each variable used in an equation, or  
 
* use variables that do not have subquestions (e.g., single response questions). In those cases, prefixing a variable with "that" is overkill, and you run the risk of getting unexpected results.}}
==Usage of NAOK== <!--T:218-->
 
 
<!--T:219-->
NAOK --> "Not Applicable" (NA) is alright (OK)
 
<!--T:224-->
Using NAOK, means that all or some of the variables are irrelevant (e.g. "Not Applicable" (NA) is alright (OK)).
 
<!--T:225-->
When you put some variable from question in any equation : if this question (or subquestion) is hidden by condition : this disable all equation.


<!--T:220-->
For example : count(Q1_SQ1,Q1_SQ2,Q1_SQ3,Q1_SQ4) give always an empty string if one subquestion of Q1 is filtered.
To count the number of checked subquestion in such question can be count(Q1_SQ1.NAOK,Q1_SQ2.NAOK,Q1_SQ3.NAOK,Q1_SQ4.NAOK). If the sub question is hidden :Expression manager return an empty string.


<!--T:221-->
=Access to Functions= <!--T:171-->
Without NAOK : if one question or one subquestion is hidden : Expression Manager return always an empty string, same to return false.
 
<!--T:222-->
The .shown always use the NAOK system (empty string if hidden) but if you need the code of the answer : it's always a good idea to add .NAOK after the question code. Except if you need it and know what you do.
 
<!--T:223-->
Another example and information is provided at [[#Overriding_Cascading_Conditions|Overriding Cascading Conditions]]
 
 
==Access to Functions== <!--T:171-->




<!--T:172-->
<!--T:172-->
Expression Manager provides access to mathematical, string, and user-defined functions, as shown below.  It has PHP and JavaScript equivalents for these functions so that they work identically on server-side (PHP) and client-side (JavaScript).  It is easy to add new functions.
The ExpressionScript provides access to mathematical, string, and user-defined functions, as shown below. It has PHP and JavaScript equivalents for these functions so that they work identically on server-side (PHP) and client-side (JavaScript).  It is easy to add new functions.




===Implemented Functions=== <!--T:173-->
==Implemented Functions== <!--T:173-->




Line 881: Line 674:
|[http://www.php.net/manual/en/function.quotemeta.php quotemeta]||Quote meta characters||string quotemeta(string)
|[http://www.php.net/manual/en/function.quotemeta.php quotemeta]||Quote meta characters||string quotemeta(string)
|-
|-
|[http://www.php.net/manual/en/function.rand.php rand]||Generate a random integer, see [[Expression Manager Sample Surveys#Randomly Ask One Question Per Group|this example]]||int rand() OR int rand(min, max)
|[http://www.php.net/manual/en/function.rand.php rand]||Generate a random integer, see [[ExpressionScript sample surveys#Randomly Ask One Question Per Group|this example]]||int rand() OR int rand(min, max)
|-
|-
|regexMatch||compare a string to a [[Using regular expressions|regular expression]]||bool regexMatch(pattern,input)
|regexMatch||compare a string to a [[Using regular expressions|regular expression]]||bool regexMatch(pattern,input)
Line 947: Line 740:




===Functions that are Planned or Being Considered=== <!--T:176-->
{{Note| Click [[Functions that are Planned or Being Considered|here]] if you wish to find out more about planned (or being constrained) functions.}}
 
 
<!--T:177-->
Other functions that are planned (or being considered) but which are not implemented yet include the following.  Some of these are for backwards compatability with another survey tool.
 
<!--T:178-->
{| class="wikitable"
!Syntax!!Meaning!!Comments
|-
|e()||returns the value of e||
|-
|formatDate(X,PAT)||return the string value of date X formatted according to Java data format pattern PAT||
|-
|formatNumber(X,PAT)||return the string value of number X formatted according to Java number format pattern PAT||
|-
|getAnsOption(X)||returns the text corresponding to the selected option for answer X||this is the same as X.shown
|-
|getAnsOption(X,Y)||returns the text corresponding to the option at index Y of node X||
|-
|getRelevance(X)||returns the relevance equation for question X||
|-
|getStartTime()||returns the date corresponding to the system time when the interview was started||
|-
|getType(X)||returns the string name of the datatype - e.g. *NA* if isNA()||
|-
|gotoFirst()||jumps to the first relevant set of questions - this violates the normal flow of the system||
|-
|gotoNext()||jumps to the next set of relevant questions - this violates the normal flow of the system||
|-
|gotoPrevious()||jumps to the previous set of relevant questions - this violates the normal flow of the system||
|-
|isAsked(X)||returns true if the answer is neither *NA*, *INVALID*, nor *UNASKED*||
|-
|isInvalid(X)||returns true if the answer is of type *INVALID*||
|-
|isNA(X)||returns true if the answer is of type *NA*||
|-
|isNotUnderstood(X)||returns true if the answer if of type *HUH*||
|-
|isRefused(X)||returns true if the answer is of type *REFUSED*||
|-
|isSpecial(X)||returns true if the answer is of type *UNASKED*, *NA*, *REFUSED*, *INVALID*, *UNKNOWN*, or *HUH*||
|-
|isUnknown(X)||returns true if the answer is of type *UNKNOWN*||
|-
|jumpTo(X)||jump to the group containing the named question -- this violates the normal flow of the system||
|-
|jumpToFirstUnasked()||jump to the first unasked question <strike> thus bypassing previous answered questions </strike> this violates the normal flow of the system||
|-
|lastIndexOf(X,Y)||returns the last index (base 0) of string Y in string X. Returns -1 if Y is not contained within X||
|-
|list(X,...)||a string containing a comma separated list of the positive values with "and" separating the last two||
|-
|mean(X,...)||returns the mean of a list of values||
|-
|numAnsOptions(X)||returns the number of answer options that question X has||
|-
|orlist(X,...)||a string containing a comma separated list of the positive values, with "or" separting the last two||
|-
|parseDate(X,PAT)||returns the date value of string X parsed with Java date format pattern PAT||
|-
|parseNumber(X,PAT)||returns the numerical value of string X parsed with Java number format pattern PAT||
|-
|showAllResponsesExcept( questionList,attributeList,attributeTitleList)||questionList = pipe-delimited list of question identifiers; attributeList = pipe-delimited list of attributes (like question#, title, text, type - so you can decide what to show); attributeTitleList = pipe-delimited list of table headers, so can internationalize the report.||
|-
|showTheseResponses( questionList,attributeList,attributeTitleList)||questionList = pipe-delimited list of question identifiers; attributeList = pipe-delimited list of attributes (like question#, title, text, type - so you can decide what to show); attributeTitleList = pipe-delimited list of table headers, so can internationalize the report.||
|}




==Expression Manager Knows Which Variables are Local== <!--T:179-->
=ExpressionScript Knows Which Variables are Local= <!--T:179-->




<!--T:180-->
<!--T:180-->
In order to properly build the JavaScript for page, Expression Manager needs to know which variables are set on the page, and what their JavaScript ID is (e.g. for document.getElementById(x)).  It also must know which variables are set on other pages (so that it can ensure that the needed <input type='hidden' value='x'> fields are present and populated).
In order to properly build the JavaScript for a page, the ExpressionScript needs to know which variables are set on the page, and what their JavaScript ID is (e.g., for document.getElementById(x)). It must also know which variables are set on other pages (so that it can ensure that the needed <input type='hidden' value='x'> fields are present and populated).




Line 1,028: Line 754:


<!--T:182-->
<!--T:182-->
If any of the variables are irrelevant, the whole equation will be irrelevant (false).  For example, in the following table, N/A means that one of the variables was not relevant
If any of the variables are irrelevant, the whole equation will be irrelevant (false). For example, in the following table, N/A means that one of the variables was not relevant




Line 1,101: Line 827:




===Overriding Cascading Conditions=== <!--T:184-->
==Overriding Cascading Conditions== <!--T:184-->




<!--T:185-->
<!--T:185-->
Say you want to show a running total of all relevant answers.  You might try to use the equation {sum(q1,q2,q3,...,qN)}.  However, this gets translated internally to LEMif(LEManyNA('q1','q2','q3',...,'qN'),'',sum(LEMval('q1'),LEMval('q2'),LEMval('q3'),...,LEMval('qN'))).  So, if any of the values q1-qN are irrelevant, the equation will always return false.  In this case, the sum() will show 0 until all questions are answered.
Say you want to show a running total of all relevant answers. You might try to use the equation {sum(q1,q2,q3,...,qN)}. However, this gets translated internally to LEMif(LEManyNA("q1","q2","q3",...,"qN"),"",sum(LEMval("q1"),LEMval("q2"),LEMval("q3"),...,LEMval("qN"))). So, if any of the values q1-qN are irrelevant, the equation will always return false. In this case, the sum() will show "0" until all questions are answered.
 


<!--T:186-->
<!--T:186-->
To get around this, each variable can have a ".NAOK" suffix (meaning that Not Applicable is OK) added to it.  In such cases, the following behavior occurs.  Say you have a variable q1.NAOK
To get around this, each variable can have a ".NAOK" suffix (meaning that Not Applicable is OK) added to it. In such cases, the following behavior occurs. Say you have a variable q1.NAOK:
#q1 is not added to the LEManyNA() clause
#q1 is not added to the LEManyNA() clause
#LEMval('q1') will  continue to check whether the response is relevant, and will return <nowiki>''</nowiki> if it is not (so individual irrelevant responses will be ignored, but they will not void the entire expression).
#LEMval('q1') will continue to check whether the response is relevant and will return <nowiki>""</nowiki> if it is not (so individual irrelevant responses will be ignored, but they will not void the entire expression).
 


<!--T:187-->
<!--T:187-->
So, the solution to the running total problem is to use the equation sum(q1.NAOK,q2.NAOK,q3.NAOK,...,qN.NAOK).
So, the solution to the running total problem is to use the equation '''sum(q1.NAOK,q2.NAOK,q3.NAOK,...,qN.NAOK)'''.
 


<!--T:188-->
<!--T:188-->
The use of the .NAOK suffix also lets authors design surveys that have several possible paths but then converge on common paths later.  For example, say subjects answer a survey in a way that is outside the normal range of responses.  The author could alert the subjects that they may not get valid results, and ask them whether they really want to  continue with the survey.  If they say Yes, then the rest of the questions will be shown.  The condition for the "rest of the questions" would check whether the initial responses were answered within the normal range OR whether the subject said Yes to the question that is only relevant if they answered outside the normal range.
The use of the .NAOK suffix also lets authors design surveys that have several possible paths but then converge on common paths later. For example, say subjects answer a survey in a way that is outside the normal range of responses. The author could alert the subjects that they may not get valid results, and ask them whether they really want to continue with the survey. If they say "Yes", then the rest of the questions will be shown. The condition for the "rest of the questions" would check whether the initial responses were answered within the normal range OR whether the subject said "Yes" to the question that is only relevant if they answered outside the normal range.


 
=How does ExpressionScript Support Conditional Micro-Tailoring?= <!--T:189-->
==How does Expression Manager Support Conditional Micro-Tailoring?== <!--T:189-->




Line 1,159: Line 881:
|sumage||1||expr||{sum(kid1.NAOK,kid2.NAOK,kid3.NAOK,kid4.NAOK,kid5.NAOK)}
|sumage||1||expr||{sum(kid1.NAOK,kid2.NAOK,kid3.NAOK,kid4.NAOK,kid5.NAOK)}
|-
|-
|report||parents||yesno||{name}, you said you are {age} and that you have {numKids}.  The sum of ages of your first {min(numKids,5)} kids is {sumage}
|report||parents||text||{name}, you said you are {age} and that you have {numKids}.  The sum of ages of your first {min(numKids,5)} kids is {sumage}
|}
|}


To download the above survey example, click on the following link: [[Media:No_of_kids_-_Micro_Tailoring.zip|Number of kids survey example]].


<!--T:192-->
<!--T:192-->
Line 1,168: Line 892:


<!--T:193-->
<!--T:193-->
Expression Manager provides this functionality by surrounding each expression with a named <nowiki><span></nowiki> element.  Every time a value changes, it recomputes the expression that should appear in that <nowiki><span></nowiki> element and regenerates the display.  You can have dozens, or even hundreds, of such tailored expressions on the same page, and the page will re-display all of them in a single screen refresh.
ExpressionScript provides this functionality by surrounding each expression with a named <nowiki><span></nowiki> element.  Every time a value changes, it recomputes the expression that should appear in that <nowiki><span></nowiki> element and regenerates the display.  You can have dozens, or even hundreds, of such tailored expressions on the same page, and the page will re-display all of them in a single screen refresh.
 
 
==Mapping of LimeSurvey 1.91+ to Expression Manager Functionality== <!--T:194-->
 
 
<!--T:195-->
{| class="wikitable"
!Old Feature!!New Feature!!Comments
|-
|Conditions||Relevance||You can use very complex conditional equations, and access a broader range of variables
|-
|Assessments||Equation||Any assessment scores can be re-structured into an Equation. This both ensures that the score is written to the database, and also lets you see dynamic changes to the score value on the current page
|-
|Replacements||Expression Manager||The core engine takes the input string and treats everything within curly braces as an Expression - so it handles all historical replacements types.  To avoid messing up embedded JavaScript, Expression Manager only processes content between curly braces as long as (a)  there is no leading or trailing whitespace within the curly braces - e.g. {expr} is an expression, but { expr}, {expr }, and { expr } are not expressions.  Furthermore, Expression Manager does not process content within its own strings (e.g. {list('hi','there {braces}')} generates "hi there {braces}").  It also ignores escaped curly braces (e.g. \{this is not an expression\})
|-
|Validation||Expression Manager||The plan is to take the current min/max Question Attributes and have Expression Manager process them.  That way the min/max values can be expressions themselves
|}
 


=Syntax Highlighting= <!--T:196-->
=Syntax Highlighting= <!--T:196-->
Line 1,192: Line 898:


<!--T:197-->
<!--T:197-->
To help with entering and validating expressions, EM provides syntax highlighting with the following features:
To help with entering and validating expressions, the EM provides syntax highlighting with the following features:
 


==Types and Meanings of Syntax Highlighting== <!--T:198-->
==Types and Meanings of Syntax Highlighting== <!--T:198-->
Line 1,202: Line 907:
!Color!!Sample!!Meaning!!Tooltip!!Comments
!Color!!Sample!!Meaning!!Tooltip!!Comments
|-
|-
|tan background||style='background-color: #eee8aa'|Sample||the whole equation||none||Anything within curly braces that is recognized as an equation (e.g. there is no leading or trailing whitepace) will be color-coded with a tan background to help distinguish it from surrounding text
|tan background||style='background-color: #eee8aa'|Sample||the whole equation||none||Anything within curly braces that is recognized as an equation (e.g., there is no leading or trailing whitepace) will be color-coded with a tan background to help distinguish it from surrounding text
|-
|-
|bold red text||style='color:#ff0000; background-color:#eee8aa'|'''Sample'''||An error||Some explanation on error||Can be an unknow variable or an error in function, .... Survey can be totally broken, this don't show to public user.
|bold red text||style='color:#ff0000; background-color:#eee8aa'|'''Sample'''||An error||Some explanation on error||Can be an unknow variable or an error in function. Survey is broken and the questions that rely on the respective expression will not be shown to the respondents.
|-
|-
|blue text||style='color:#0000ff; background-color:#eee8aa'|Sample||function name||meaning and allowable syntax||function names, or things that should be functions since they are followed by an opening parenthesis, are presented in bold blue text. Tooltips show the meaning and allowable syntax for the function.
|blue text||style='color:#0000ff; background-color:#eee8aa'|Sample||function name||meaning and allowable syntax||It refers to function names or things that should be functions since they are followed by an open parenthesis. They are displayed in bold blue text. Tooltips show the meaning and allowable syntax for the function.
|-
|-
|grey text||style='color:#808080; background-color:#eee8aa'|Sample||string||none||single and double-quoted strings are shown in grey text
|grey text||style='color:#808080; background-color:#eee8aa'|Sample||string||none||Single and double-quoted strings are shown in grey text.
|-
|-
|cyan text||style='color:#4169e1; background-color:#eee8aa'|Sample||variable set on the same page,||<nowiki>[</nowiki>name or SGQA code]: question; value; answerList showing codes for each value||Any variable that is set on the same page to the current question is shown in cyan text, showning it can be updated in javascript. The tooltip shows its name (if you used INSERTANS:xxx) or SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set). If the question type expects responses from an enumerated value set, the mapping of the codes to display values is show.
|cyan text||style='color:#4169e1; background-color:#eee8aa'|Sample||variable set on the same page,||<nowiki>[</nowiki>name or SGQA code]: question; value; answerList showing codes for each value||Any variable that is set on the same page as the question you are currently editing is shown in cyan text (it can be updated in javascript). The tooltip shows its name (if you used INSERTANS:xxx) or its SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set). If the question type expects responses from an enumerated value set, the mapping of the codes to display values is shown.
|-
|-
|green text||style='color:#008000; background-color:#eee8aa'|Sample||variable set on a prior page||<nowiki>[</nowiki>name or SGQA code]: question; value; answerList showing codes for each value||Any variable that is set on a prior page is shown in bold green text. The tooltip shows its name (if you used INSERTANS:xxx) or SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set).  If the question type expects responses from an enumerated value set, the mapping of the codes to display values is show.
|green text||style='color:#008000; background-color:#eee8aa'|Sample||variable set on a prior page||<nowiki>[</nowiki>name or SGQA code]: question; value; answerList showing codes for each value||Any variable that is set on a prior page is shown in bold green text. The tooltip shows its name (if you used INSERTANS:xxx) or SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set).  If the question type expects responses from an enumerated value set, the mapping of the codes to display values is shown.
|-
|-
|bold pink text||style='color:#9370db; background-color:#eee8aa'|Sample||variable set on a later page <sup>in general : empty at survey start, but can be filled with index or move previous</sup>||<nowiki>[</nowiki>name or SGQA code]: question; value; answerList showing codes for each value||Any variable that is set on a prior page is shown in bold pink text. The tooltip shows its name (if you used INSERTANS:xxx) or SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set). If the question type expects responses from an enumerated value set, the mapping of the codes to display values is show.
|bold pink text||style='color:#9370db; background-color:#eee8aa'|Sample||variable set on a later page <sup>in general : empty at survey start, but can be filled with index or move previous</sup>||<nowiki>[</nowiki>name or SGQA code]: question; value; answerList showing codes for each value||Any variable that is set on a prior page is shown in bold pink text. The tooltip shows its name (if you used INSERTANS:xxx) or SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set). If the question type expects responses from an enumerated value set, the mapping of the codes to display values is show.
|-
|-
|bold tan text||style='color:#a0522d; background-color:#eee8aa'|Sample||a lime replacement value||the value||Lime Replacement Strings (like {TOKEN:xxx}, {PRIVACY_MESSAGE}) are shown in bold tan text.   
|bold tan text||style='color:#a0522d; background-color:#eee8aa'|Sample||a lime replacement value||the value||Lime Replacement Strings (like {TOKEN:xxx}, {PRIVACY_MESSAGE}) are shown in bold tan text.   
|-
|-
|red text||style='color:#ff4500; background-color:#eee8aa'|Sample||assignment operator (=) ||warning message||If you use one of the assignment operator (=) that operator will be displayed in red text. This is meant to help prevent accidental re-assignment of values when you really meant to check whether a == b instead of  setting the value of a = b.
|red text||style='color:#ff4500; background-color:#eee8aa'|Sample||assignment operator (=) ||warning message||If you use one of the assignment operator (=), that operator will be displayed in red text. This is meant to help prevent accidental re-assignment of values when you really meant to check whether a == b instead of  setting the value of a = b.
|-
|-
|normal black text||style='color:black; background-color:#eee8aa'|Sample||punctuation||none||All other punctuation within the expression is shown as normal black text.
|normal black text||style='color:black; background-color:#eee8aa'|Sample||punctuation||none||All other punctuation signs within the expression are shown as normal black text.
|-
|-
|red-boxed text||a bold red line surrounds the error||syntax error||description of the error||Any detected syntax errors are shown by surrounding the error with a red box. The tooltip shows the error. Examples include unmatched parentheses, use of undefined functions, passing the wrong number of arguments to functions, poorly structured expressions (e.g. missing operators between variables), trying to assign a new value to a read-only variable, trying to assign values to non-variables, or using unsupported syntax. Note that the syntax error dectection system may only report one error in an expression even if there are multiple errors; however, if any errors are detected, at least one error will be shown.
|red-boxed text||a bold red line surrounds the error||syntax error||description of the error||Any detected syntax errors are shown within red boxes. The tooltip shows the error. Examples include unmatched parentheses, use of undefined functions, passing the wrong number of arguments to functions, poorly structured expressions (e.g., missing operators between variables), trying to assign a new value to a read-only variable, trying to assign values to non-variables, or using unsupported syntax. Note that the syntax error dectection system may only report one error in an expression even if there are multiple errors; however, if any errors are detected, at least one error will be shown.
|}
|}


{{Note| By tooltips, we refer to the popup message that is displayed when you hover over certain functions and variables.}}


=Additional Reading= <!--T:202-->
=Additional Reading= <!--T:202-->




==[[Expression Manager Sample Surveys|Expression Manager Sample Surveys]]== <!--T:203-->
==[[ExpressionScript sample surveys|ExpressionScript sample surveys]]== <!--T:203-->
 
 
==[[Expression Manager HowTos|Use Cases and HowTos]]== <!--T:204-->
 


==[[Expression Manager Examples|Step-by-Step Examples]].== <!--T:205-->
==[[ExpressionScript how-tos|Use Cases and HowTos]]== <!--T:204-->


==[[ExpressionScript examples|Step-by-Step Examples]]== <!--T:205-->


==[[Expression Manager for developers|Reference for Developers]]== <!--T:206-->
==[[ExpressionScript for developers|Reference for Developers]]== <!--T:206-->




==[[Expression Manager Roadmap|RoadMap/Status/ToDo List]]== <!--T:207-->
==[[ExpressionScript roadmap|RoadMap/Status/ToDo List]]== <!--T:207-->




</translate>
</translate>

Latest revision as of 15:45, 11 February 2020


  Under construction - the following wiki section is a draft.



ExpressionScript - Quick Tutorial


Introduction

LimeSurvey uses the new ExpressionScript (EM) module which lets LimeSurvey support more complex branching, assessments, validation, and tailoring. It replaces how LimeSurvey manages Replacements, Conditions, and Assessments on the back-end. It also speeds up processing considerably since it eliminates most run-time database reads. EM was developed by Dr. Thomas White (TMSWhite).


Key Definitions

  1. Expression: Anything surrounded by curly braces:
    • As long as there is no white space immediately after the opening brace or before the closing curly brace.
    • The expression content is evaluated by EM, so it can contain mathematical formulas, functions, and complex string and date processing.
  2. Tailoring: Sometimes called "piping". It is the process of conditionally modifying text:
    • You have access to all 'replacement fields', participant data, and response data.
    • You also have easier access to questions, answers, and their properties.
  3. Relevance Equation: A new question attribute controlling question visibility:
    • If there is a relevance equation, then the question is only shown if the relevance evaluates to true.
    • Internally, all array_filter and array_filter_exclude commands become subquestion-level relevance.
  4. Equation Question Type: A new question type that saves calculations or reports to the database:
    • It is like a Boilerplate question, but its contents are saved to the database even if you set "Always Hide this Question".
  5. Question Code: This is the preferred variable name for EM:
    • This can be a descriptive name indicating the purpose of the question, making it easier to read complex logic.
    • Valid question codes should NOT start with a number, so when using the question code to number your questions, simply use "q1", or "q1a" or "g1q2".
    • This is what becomes the variable name if you export data to SPSS or R. So, if you do statistical analysis, you need to create only unique question codes.


Do I have to use EM?

The short answer is "no". However, this heavily depends on the complexity of the survey you want to create.

For example, the Conditions editor covers some basic expressions that can be applied to the questions of your survey. However, the Conditions editor is limited. That is why the EM is used - it expands the realm of customization possibilities.


Can I mix Conditions and Relevance equations?

Yes. You can use the Conditions editor for some questions and Relevance equations for others.

You cannot have both conditions and expressions set up in the same question! Once a condition is set up, it replaces whatever expression is written in the relevance equation field. Moreover, the Relevance equation field cannot any longer be manually edited.

Yet, there is a way to use both expressions and conditions within a question. As mentioned above, a condition replaces the relevance equation field. Once done, check what is the newly created equation and copy it in a text editor. Delete the newly created condition from the Conditions editor and then edit the question by adding the condition-based expressions from your text editor file alongside the rest of expressions you wish to use.


How should I choose between Conditions and Relevance?

Here is a list of the pros and cons of each style:

Style Pros Cons
Conditions 1. Nice GUI for creating simple conditions.
2. GUI well documented and understood by support team
1. Only supports simple comparisons and does not "AND" and "OR" conditions well.
2. Cascading conditions work erratically
3. Slow - database intensive -it can slow down long surveys.
4. Some reported problems with reloading conditions.
5. GUI doesn't scale well when there are dozens, hundreds, or thousands of questions.
6. It could be slow to convert paper-based surveys since it must use SGQA names.
7. Often need a programmer to custom-code logic needed for complex branching.
Relevance 1. Supports very complex logic, including 80+ functions and math/string operators.
2. Perfect support for cascading logic.
3. Fast - no extra database calls, supporting 1000+ question surveys.
4. No problems with reloading logic since it does not require SGQA codes.
5. Syntax-highlighting scales to 1000+ question surveys.
6. Easy and fast to use for groups wanting to computerize existing paper-based surveys.
7. It easily supports semi-structured interviews and epidemiological surveys without needing a programmer
1. No GUI for simple conditions - it makes use of syntax-highlighting instead.


Note:
  • We recommend you to use whatever fits better your needs.
  • For a more detailed explanation of the EM features, click on the following link.


Getting Started

The best way to get started with the EM is to:

  • Install the latest stable version from http://www.limesurvey.org/en/download.
  • Import and explore some sample surveys.
  • Explore the use cases and HowTos, and the step-by-step examples.
  • Explore the EM documentation (this page)
    • Unit Tests of Isolated Expressions (advanced)
      • shows examples of using all EM functions and operators, and the PHP and JavaScript results;
      • note there are few functions that generate different results in the PHP and JavaScript versions, so this page lets you plan your EM logic accordingly.

Terminology

These words are commonly used to describe the capabilities of the EM:

EM "thinks" of its functionality in the following terms:

  • Relevance-based Branching - if a question is relevant, then ask it, otherwise don't (e.g., make it invisible and mark it as NULL in the database). You may find the Relevance fields in the question editor panel as well as in the question group editor panel. The later is used to apply a set of conditions to an entire group without having to copy the same condition to each question, and/or combine group and question-level conditional logic).
  • Tailoring - Once you know which questions should be asked, tailoring (sometimes called piping) specifies how the question should be asked. This lets you support not only simple substitution (like {TOKEN:FIRSTNAME}), but also conjugation of verbs and declination of nouns based upon the gender or number of your subjects. It also lets you change the message you deliver to a survey respondent based upon whether they answered (or how they answered) other questions.
  • Equations - EM adds a new question type called Equation which stores the result of an Expression. The equation results are computed and written to the database, even if you hide them on the page. Thus, they are used for hidden scoring calculations, navigation based upon complex equations, assessments, and reports that will be generated and stored within the database.


Relevance and Cascading Relevance

Every question type now has a Relevance option which controls whether the question is displayed or not. The EM processes each Relevance Equation in the order they appear in the survey. If the expression is true (or missing - to support legacy surveys), the question will be displayed. If it is not relevant, then the question will be hidden, and the value will be NULLed in the database. If there are no relevant questions in a group, the entire group will be skipped.

Moreover, if any of the variables within an expression is irrelevant, then the expression always evaluates to false. This enables Cascading Relevance so that you do not have to write very long Relevance equations for each question.

Say you have five questions Q1-Q5, and you only want to show Q2 if Q1 was answered, and Q3 if Q2 was answered, etc.  The relevance equations might be:

Question Code Relevance Question
Q1 1 What is your name?
Q2 Q1 {Q1}, how old are you?
Q3 Q2 So, you are {Q2} years old.  Are you married?
Q4 Q3 == "Y" {Q1}, how long have you been married?
Q5 Q4 How many children do you have, {Q1}?


Group-Level Relevance

ExpressionScript also supports group-level relevance. This makes it easier to implement looping. Say you want to collect information from up to 10 entities (such as products or people from a household), where you first determine how many entities need follow-up (such as by asking how many people live in a household or having people check which products they like from a long list). After knowing how many entities need follow-up, you can use Group-level relevance like {count >= 1}, {count >=2}, ... {count >= 10} for each of the 10 groups of follow-up questions.  Within each group, you can have question-level conditional logic (e.g. gender or age-specific follow-up questions for each subject). The question and group-level relevance equations are ANDed together to determine which should be shown.

To check such an example, import the following survey: Census survey example.


Tailoring / Piping

Anything within curly braces is now treated as an Expression (with one exception described below). Expressions have access to all the LimeReplacementFields and variables (via several aliases), all typical equation operators (mathematical, logical, and comparison), and to dozens of functions (that even work dynamically on the client-side).

By Using these equations, you can do things such as:

  1. Conditionally show tailored messages to the respondents based on prior responses;
  2. Create Assessments and show Assessment results (or conditionally branch or show messages) based upon those results, all without using the Assessments module itself;
  3. Conjugate verbs and decline nouns within questions, answers, and reports;
  4. Show summaries of responses before the "Show your answers" page at the end of the survey.


Equations

There is a new question type called Equation. Think of it as a Text display question type, except that it stores the value of what is displayed in the database. So, if the Equation Question text contains an Assessment computation, that value would be stored in the database in a variable that can be displayed in public or private statistics.


Syntax

Anything contained within curly braces is now considered an Expression (with one exception: there must be no leading or trailing whitespace - this is needed to ensure the ExpressionScript does not try to process embedded JavaScript).

Note that it is OK for expressions to span multiple lines, as long as there is no whitespace after the opening curly brace or before the closing curly brace. This is especially helpful for nested "if()" statements like this:

{if(is_empty(PFTotals),
 '',
 if(PFTotals >= -5 && PFTotals <= -4,
   'Very Soft',
   if(PFTotals >= -3 && PFTotals <= -2,
     'Soft',
     if(PFTotals == -1,
       'Somewhat Soft',
       if(PFTotals == 0,
         'Moderate',
         if(PFTotals == 1,
           'Somewhat Hard',
           if(PFTotals >= 2 && PFTotals <= 3,
             'Hard',
             if(PFTotals >= 4 && PFTotals <= 5,
               'Very Hard',
               ''
             )
           )
         )
       )
     )
   )
 )
)}

The ExpressionScript supports the following syntax:

  • All standard mathematical operators (e.g. +,-,*,/,!);
  • All standard comparison operators (e.g. <,<=,==,!=,>,>=, plus their equivalents: lt, le, eq, ne, gt, ge);
  • Parentheses (so you can group sub-expressions);
  • Conditional operators (e.g. &&,| | and their equivalents: and, or);
  • Single and double-quoted strings (which can each embed strings with the other quote type);
  • Comma operator (so can have a list of expressions and just return the final result);
  • Assignment operator (=);
  • Pre-defined variables (to refer to questions, question attributes, and responses) - e.g., the SGQA codes;
  • Pre-defined functions (there are already 80+, and it is easy to add more).


Operators

EM syntax follows normal operator precedence:

Level Operator(s) Description
1 () parentheses for grouping or calling functions
2 ! - + unary operators: not, negation, unary-plus
3 * / times, divide
4 + - plus, minus
5 < <= > >= lt le gt ge relative comparisons
6 == != eq ne equality comparisons
7 and logical AND
8 or logical OR
9 = assignment operator
10 , comma operator
For consistency between JavaScript and PHP, the plus operator (+) does addition if both operands are numeric, but does concatenation if both parts are non-numeric strings. However, we recommend using the "join()" function for concatenation, as that makes your intent more clear. It also avoids unexpected results if you were expecting strings but got numbers instead (or vice versa).


Caution about using Assignment Operator (=)

You should avoid using the assignment operators unless absolutely necessary, since they may cause unexpected side-effects. For example, if you change the value of a previous response, the cascading relevance and validation logic between that question and the current question is not re-computed, so you could end up with internally inconsistent data (e.g., questions that stay answered but should have been NULLed, or questions that are skipped but should have been answered). In general, if you want to assign a value to a variable, you should create an Equation question type, and use an expression to set its value. However, there are some rare times that people really need this operator, so we made it available.

To help caution you about this operator, it is shown in red font within the syntax equations (so that you don't confuse it with "==").



Using Assignment Operator

The main reasons you may want to use the assignment operator are:

  • You need to set the default value via equation for a question that does not accept default values (such as list radio, where the user interface lets you pick one of the answer options, but does not let you enter an equation). However, be careful, as LimeSurvey will not be able to validate that your equation generates one of the allowable answers for that question;
  • You need to forcibly change the response to a previous question based upon a later response;
  • etc...


You can use all the expression manager system for this purpose. It's better to use an Equation for this purpose.


Some examples:

  • Set answer to a short text question in lowercase : {QCODE=strtolower(QCODE.NAOK)};
  • Set a default answer to an array question type at start of a survey : {Q1_SQ1=(is_empty(Q1_SQ1.NAOK),"A99",Q1_SQ1.NAOK)};
  • Set a default answer to an array texts question type at start of a survey : {Q1_SQY1_SQX1 = (is_empty(Q1_SQY1_SQX1.NAOK),"Inserted answer", Q1_SQY1_SQX1.NAOK)};
  • Set an answer with condition : {QCODE=if(YesNo="Y","A1","")}.


XSS security

With XSS enabled, some parts of the expression manager system cannot be used:

  • starting a HTML tag in expression but ending in another expression;
  • using a complex expression within a URL.


Please note that XSS is enabled by default in any LimeSurvey installation.


Examples and workarounds:

  • {if( 1 ,"<strong>","")}information{if( 1 ,"</strong>","")} is broken with XSS security, here you can use {if(1,"<strong>information</strong>","information")};
  • <a href="/script.php?value={if(QCODE == "Y","yes","no")}">next</a>, here you can use an equation question because using a complete question code is OK : <a href="/script.php?value={EQUATION.NAOK}">next</a>.


Access to Variables

ExpressionScript provides read-only access to whichever variables you might need. For backwards compatibility, it provides access to the following:

  • TOKEN:xxx - the value of a TOKEN (e.g., TOKEN:FIRSTNAME, TOKEN:ATTRIBUTE_5) (only for not anonymous survey).
  • INSERTANS:SGQA - the display value of an answer (e.g., "Yes") - similar to using {QCODE.shown}.
  • All {XXX} values used by templates.
  • In question text, you can use {QID} replaced by the question id and {SGQ} replaced by the SGQA of the question.

In addition, ExpressionScript lets you refer to variables by the Question Code (the 'title' column in the questions table within the database). This is also the variable label used when you export your data to SPSS, R, or SAS. For example, if you have questions about name, age, and gender, you could call those variables name, age, and gender instead of 12345X13X22, 12345X13X23, and  12345X13X24. This makes equations easier for everyone to read and validate the logic, plus making it possible to shuffle questions around without having to keep track of group or question numbers.

Important: It is safer to refer to variables that occur in the preceding pages or questions.

Furthermore, ExpressionScript lets you access many properties of the question:


Syntax Meaning Example Example Result
Qcode an alias for Qcode.code {implode(',',name,gender)} 'Tom','M'
Qcode.code the selected response code for the question if it is relevant (otherwise blank), or the text value if it is not a coded question {implode(',',name.code,gender.code)} 'Tom','M'
Qcode.NAOK same as Qcode - see discussion of NAOK {gender.NAOK} 'M'
Qcode.value the assessment value for the question if it is relevant (otherwise blank), or the text value if it is not a coded question {gender.value} '1'
Qcode.valueNAOK same as Qcode.value - see discussion about NAOK {gender.valueNAOK} '1'
Qcode.shown the dispay value for the question {implode(',',name.shown,gender.shown)} 'Tom','Male'
Qcode.question the text of the question {gender.question} 'What is your gender?'
Qcode.mandatory whether the question is mandatory (Y/N) {gender.mandatory} 'N'
Qcode.qid the internal question number (not the sequential number) {gender.qid} 337
Qcode.type the question type {gender.type} 'G'
Qcode.jsName the correct javascript name for the question, regardless whether declared on or off this page {gender.jsName} 'java1827X3X337'
Qcode.gid the internal group number (not the sequential number) {gender.gid} 3
Qcode.qseq the sequential number of the question, starting from 0 {gender.qseq} 5
Qcode.gseq the sequential number of the group, starting from 0 {gender.gseq} 1
Qcode.relevanceStatus whether the question is currently relevant (0 or 1) {gender.relevanceStatus} 1
Qcode.relevance the question-level relevance equation {gender.relevance} '!is_empty(name)'
Qcode.grelevance the  group-level relevance equation {gender.grelevance} 'num_children >= 5'
Qcode.sgqa the SGQA value for this question {gender.sgqa} '1827X3X337'


HTML editor issue

If you use the HTML editor, some characters are replaced by HTML entities.

  • & by &amp;
  • < by &lt;
  • > by &gt;

If you use HTML editor you need to use :

  • and for &
  • lt for <
  • le for <=
  • gt for >
  • ge for >=


It is recommended to clear your expression of HTML that appears within your expression. If you use the LimeSurvey HTML editor, click on the "Source" button (located in the upper left part of the editor) and delete all the characters that are not related to your expression (e.g.,

,
, and so on).

Qcode Variable Naming

Here are the details of how to construct a Qcode (and access some properties) by question type. In general, Qcodes are constructed as:

 QuestionCode . '_' . SubQuestionID . '_' . ScaleId

For comment and other, the corresponding question codes are QuestionCode_comment and QuestionCode_other, respectively.

Type Description Code SubQs Answer Options Scales Answer Code Answer Shown Relevance
5 5 Point Choice Radio-Buttons Q1 1-5 {Q1} {Q1.shown} {Q1==3}
B Array (10 Point Choice) Radio-Buttons Q2 L1-L6 1-10 {Q2_L2} {Q2_L2.shown} {Q2_L2==7}
A Array (5 Point Choice) Radio-Buttons Q3 1-5 1-5 {Q3_1} {Q3_1.shown} {Q3_1>=3}
1 Array (Flexible Labels) Dual Scale Q4 sq1-sq5 0:a1-a3 1:b1-b3 {Q4_sq1_0} {Q4_sq1_1.shown} {Q4_sq1_1=='b2'}
H Array (Flexible) - Column Format Q5 1-5 s,m,t {Q5_1} {Q5_1.shown} {Q5_1=='s'}
F Array (Flexible) - Row Format Q6 F1-F5 1-5 {Q6_F3} {Q6_F3.shown} {Q6_F3==4}
E Array (Increase/Same/Decrease) Radio-Buttons Q7 1-7 I,S,D {Q7_4} {Q7_4.shown} {Q7_4=='D'}
: Array (Multi Flexi) 1 To 10 Q8 ls1,todo,ls2 min,max,avg {Q8_ls1_max} {Q8_ls2_avg.shown} {Q8_ls2_min==7}
; Array (Multi Flexi) Text Q9 hp,st,sw 1st,2nd,3rd {Q9_hp_3rd} {Q9_hp_3rd.shown} {Q9_hp_3rd=='Peter'}
C Array (Yes/Uncertain/No) Radio-Buttons Q10 1-5 Y,N,U {Q10_1} {Q10_1.shown} {Q10_3=='Y'}
X Boilerplate Question Q11 {Q11.shown}
D Date Q12 {Q12} {Q12.shown}
* Equation Q13 {Q13} {Q13.shown} {Q13>5}
~124~ File Upload (records number of files uploaded) Q14 {Q14} {Q14>0}
G Gender Drop-Down List Q15 M,F {Q15} {Q15.shown} {Q15=='M'}
U Huge Free Text Q16 {Q16} {Q16.shown} {strlen(Q16)>100}
I Language Question Q17 {Q17} {Q17.shown} {Q17=='en'}
! List - Dropdown Q18 1-5 {Q18} {Q18.shown} {Q18==3}
L List Drop-Down/Radio-Button List Q19 A-Z {Q19} {Q19.shown} {Q19=='X'}
O List With Comment Drop-Down/Radio-Button List + Textarea Q20 A-F {Q20},{Q20comment} {Q20.shown} {Q20=='B'}
T Long Free Text Q21 {Q21} {Q21.shown} {strstr(Q21,'hello')>0}
M Multiple Choice Checkbox Q22 A-F, other {Q22_E}, {Q22_other} {Q22_E.shown}, {Q22_other.shown} {Q22_E=='Y'}
P Multiple Choice With Comments Checkbox + Text Q23 A-F {Q23_D}, {Q23_Dcomment} {Q23_D.shown} {!is_empty(Q23)}
K Multiple Numerical Question Q24 self,mom,dad {Q24_self} {Q24_self.shown} {Q24_self>30}
Q Multiple Short Text Q25 A-F {Q25_B} {Q25_B.shown} {substr(Q25_B,1,1)=='Q'}
N Numerical Question Type Q26 {Q26} {Q26.shown} {Q26 > 30}
R Ranking Style Q27 1-4 {Q27_1} {Q27_1.shown} {Q27_1==3}
S Short Free Text Q28 {Q28} {Q28.shown} {Q28=='mine'}
Y Yes/No Radio-Buttons Q29 {Q29} {Q29.shown} {Q29=='Y'}


Usage of NAOK

NAOK --> "Not Applicable" (NA) is alright (OK)

Using NAOK, means that all or some of the variables are irrelevant (e.g. "Not Applicable" (NA) is alright (OK)).

For example: count(Q1_SQ1,Q1_SQ2,Q1_SQ3,Q1_SQ4) give always an empty string if one subquestion of Q1 is filtered. To count the number of checked subquestion in such question can be count(Q1_SQ1.NAOK,Q1_SQ2.NAOK,Q1_SQ3.NAOK,Q1_SQ4.NAOK). If the subquestion is hidden, the EM returns an empty string.

Without NAOK, if one question or one subquestion is hidden, the EM returns always an empty string (same to returning false).

The .shown always use the NAOK system (empty string if hidden) but if you need the code of the answer: it's always a good idea to add .NAOK after the question code (except if you need it and know what you do).

More information is provided in the Overriding Cascading Conditions subsection.


The reserved "this", "self", and "that" variables

Quite often you want to evaluate all the parts of a question, such as counting how many subquestions have been answered or summing up the scores. Other times you want to process just certain rows or columns of a question (such as getting the row or column sums and storing them in the database). These reserved variables make that process relatively painless.


"This" variable

The "this" variable is used exclusively within the "Whole question validation equation" and "Subquestion validation equation" options (the later is not possible from GUI). It expands to the variable names of each of the cells within those questions. So, if you want to make sure that each entry is greater than three, you would set the "Sub-question validation equation" to (this > 3).


"Self" variable

The "self" and "that" variable are more powerful, and serve as macros which are expanded prior to processing equations. The syntax choices for the "self" variable are:

  • self
  • self.suffix
  • self.sub-selector
  • self.sub-selector.suffix
  1. suffix is any of the normal qcode suffixes (e.g., NAOK, value, shown)
  1. sub-selector can be one of the following:
  • comments - only subquestions that are comments (e.g., multiple choice with comment and list with comment);
  • nocomments - only subquestions that are not comments;
  • sq_X - where X is a row or column identifier.  Only subquestions matching pattern X are selected. Note that search is done on complete code identifier, then sq_X match and include subquestions nX, X, Xn (e.g. if you use sq_1, subquestions a1, 1a, 1, 11 or 001 was included). Put attention at dual scale question type where subquestions code are QCODE_SQCODE_1 and QCODE_SQCODE_1 and to ranking question type where subquestions code are QCODE_1,QCODE_2 ....

Examples:

  • Has any part of a question been answered? -> {count(self.NAOK)>0}
  • What is the assessment score for this question? -> {sum(self.value)}

You can also use these to get row and column totals.  Say you have an array of numbers with rows A-E and columns 1-5.

  • What is the grand total? -> {sum(self.NAOK)}
  • What is the total of row B? -> {sum(self.sq_B.NAOK)}
  • What is the total of column 3? -> {sum(self.sq_3.NAOK)}


"That" variable

The "that" variable is like the "self" variable, but it allows you to refer to other questions. Its syntax is:

  • that.qname
  • that.qname.suffix
  • that.qname.sub-selector
  • that.qname.sub-selector.suffix

qname is the question name without any subquestion extensions. So, let's create a question 'q1', 'q' representing also its qname.

Examples:

  • Has any part of question q1 been answered? -> {count(that.q1.NAOK)>0}
  • What is the assessment score for q2? -> {sum(that.q2.NAOK)}
  • What is the grand total of q3? -> {sum(that.q3.NAOK)}
  • What is the total of row C in q4? -> {sum(that.q4.sq_C.NAOK)}
  • What is the total of column 2 in q4? -> {sum(that.q4.sq_2.NAOK)}

The "self" and "that" variables can be used in any relevance, validation, or tailoring.

The one caveat is that when you use the Show Logic File feature, it will show you the expanded value of "self" and "that". This lets you see the actual equation that will be generated so that you (and the EM) can validate whether the variables exist or not. This may seem confusing since you may see quite lengthy equations. However, if you edit the question, you will see the original equation using "self" and/or "that".

You should not use these variables if
  • you want to explicitly name each variable used in an equation, or
  • use variables that do not have subquestions (e.g., single response questions). In those cases, prefixing a variable with "that" is overkill, and you run the risk of getting unexpected results.


Access to Functions

The ExpressionScript provides access to mathematical, string, and user-defined functions, as shown below. It has PHP and JavaScript equivalents for these functions so that they work identically on server-side (PHP) and client-side (JavaScript).  It is easy to add new functions.


Implemented Functions

The following functions are currently available:

Function Meaning Syntax
abs Absolute value number abs(number)
acos Arc cosine number acos(number)
addslashes Quote string with slashes string addslashes(string)
asin Arc sine number asin(number)
atan Arc tangent number atan(number)
atan2 Arc tangent of two variables number atan2(number, number)
ceil Round fractions up number ceil(number)
checkdate Returns true(1) if it is a valid date in gregorian calendar bool checkdate(month,day,year)
convert_value Convert a numerical value using a inputTable and outputTable of numerical values number convert_value(fValue, iStrict, sTranslateFromList, sTranslateToList)
cos Cosine number cos(number)
count count the number of answered (non-blank)questions in the list number count(arg1, arg12, ..., argN)
countif Count the number of answered questions in the list equal the first argument number countif(matches, arg1, arg2, ... argN)
countifop Count the number of answered questions in the list which pass the criteria (arg op value) number countifop(op, value, arg1, arg2, ... argN)
date Format a local date/time string date(format [, timestamp=time()])
exp Calculates the exponent of e number exp(number)
fixnum Display numbers with comma as radix separator, if needed string fixnum(number)
floor Round fractions down number floor(number)
gmdate Format a GMT date/time string gmdate(format [, timestamp=time()])
html_entity_decode Convert all HTML entities to their applicable characters (always uses ENT_QUOTES and UTF-8) string html_entity_decode(string)
htmlentities Convert all applicable characters to HTML entities (always uses ENT_QUOTES and UTF-8) string htmlentities(string)
expr_mgr_htmlspecialchars Convert special characters to HTML entities (always uses ENT_QUOTES and UTF-8) string htmlspecialchars(string)
expr_mgr_htmlspecialchars_decode Convert special HTML entities back to characters (always uses ENT_QUOTES and UTF-8) string htmlspecialchars_decode(string)
idate Format a local time/date as integer string idate(string [, timestamp=time()])
if Excel-style if(test,result_if_true,result_if_false) if(test,result_if_true,result_if_false)
implode Join array elements with a string string implode(glue,arg1,arg2,...,argN)
intval Get the integer value of a variable int intval(number [, base=10])
is_empty Determine whether a variable is considered to be empty bool is_empty(var)
is_float Finds whether the type of a variable is float bool is_float(var)
is_int Find whether the type of a variable is integer bool is_int(var)
is_nan Finds whether a value is not a number bool is_nan(var)
is_null Finds whether a variable is NULL bool is_null(var)
is_numeric Finds whether a variable is a number or a numeric string bool is_numeric(var)
is_string Find whether the type of a variable is string bool is_string(var)
join (New in 2.0 build 130129) Join elements as a new string join(arg1, arg2, ... argN)
list Return comma-separated list of non-blank values string list(arg1, arg2, ... argN)
log The logarithm of number to base, if given, or the natural logarithm. number log(number,base=e)
ltrim Strip whitespace (or other characters) from the beginning of a string string ltrim(string [, charlist])
max Find highest value number max(arg1, arg2, ... argN)
min Find lowest value number min(arg1, arg2, ... argN)
mktime Get UNIX timestamp for a date (each of the 6 arguments are optional) number mktime([hour [, minute [, second [, month [, day [, year ]]]]]])
modulo-function The modulo function is not supported yet. You can use the floor() function instead floor(x/y)==(x/y)
nl2br Inserts HTML line breaks before all newlines in a string string nl2br(string)
number_format Format a number with grouped thousands string number_format(number)
pi Get value of pi number pi()
pow Exponential expression number pow(base, exp)
quoted_printable_decode Convert a quoted-printable string to an 8 bit string string quoted_printable_decode(string)
quoted_printable_encode Convert a 8 bit string to a quoted-printable string string quoted_printable_encode(string)
quotemeta Quote meta characters string quotemeta(string)
rand Generate a random integer, see this example int rand() OR int rand(min, max)
regexMatch compare a string to a regular expression bool regexMatch(pattern,input)
round Rounds a number to an optional precision number round(val [, precision])
rtrim Strip whitespace (or other characters) from the end of a string string rtrim(string [, charlist])
sin Sine number sin(arg)
sprintf Return a formatted string string sprintf(format, arg1, arg2, ... argN)
sqrt Square root number sqrt(arg)
stddev Calculate the Sample Standard Deviation for the list of numbers number stddev(arg1, arg2, ... argN)
str_pad Pad a string to a certain length with another string string str_pad(input, pad_length [, pad_string])
str_repeat Repeat a string string str_repeat(input, multiplier)
str_replace Replace all occurrences of the search string with the replacement string string str_replace(search, replace, subject)
strcasecmp Binary safe case-insensitive string comparison int strcasecmp(str1, str2)
strcmp Binary safe string comparison int strcmp(str1, str2)
strip_tags Strip HTML and PHP tags from a string string strip_tags(str, allowable_tags)
stripos Find position of first occurrence of a case-insensitive unicode string (starting by 0, return false if not found) int stripos(haystack, needle [, offset=0])
stripslashes Un-quotes a quoted string string stripslashes(string)
stristr Case-insensitive strstr string stristr(haystack, needle [, before_needle=false])
strlen Get string length int strlen(string)
strpos Find position of first occurrence of an unicode string (starting by 0, return false if not found) int strpos(haystack, needle [ offset=0])
strrev Reverse a string string strrev(string)
strstr Find first occurrence of a string string strstr(haystack, needle[, before_needle=false])
strtolower Make a string lowercase string strtolower(string)
strtotime Parse about any English textual datetime description into a Unix timestamp int strtotime(string)
strtoupper Make a string uppercase string strtoupper(string)
substr Return part of an unicode string string substr(string, start [, length])
sum Calculate the sum of values in an array number sum(arg1, arg2, ... argN)
sumifop Sum the values of answered questions in the list which pass the criteria (arg op value) number sumifop(op, value, arg1, arg2, ... argN)
tan Tangent number tan(arg)
time Return current UNIX timestamp number time()
trim Strip whitespace (or other characters) from the beginning and end of a string string trim(string [, charlist])
ucwords Uppercase the first character of each word in a string string ucwords(string)
unique Returns true if all non-empty responses are unique boolean unique(arg1, ..., argN)


Click here if you wish to find out more about planned (or being constrained) functions.


ExpressionScript Knows Which Variables are Local

In order to properly build the JavaScript for a page, the ExpressionScript needs to know which variables are set on the page, and what their JavaScript ID is (e.g., for document.getElementById(x)). It must also know which variables are set on other pages (so that it can ensure that the needed <input type='hidden' value='x'> fields are present and populated).


Cascading Conditions

If any of the variables are irrelevant, the whole equation will be irrelevant (false). For example, in the following table, N/A means that one of the variables was not relevant


Operator Example a b Result
+ (unary) +a N/A false
! !a N/A false
== (or eq) a == b N/A 5 false
== (or eq) a == b N/A 0 false
== (or eq) a == b N/A N/A false
!= (or ne) a != b N/A 5 false
!= (or ne) a != b N/A N/A false
!= (or ne) a != b N/A 0 false
> (or gt) a > b N/A 5 false
>= (or ge) a >= b N/A 5 false
< (or lt) a < b N/A 5 false
<= (or le) a <= b N/A 5 false
and a and b N/A 5 false
and a and b N/A N/A false
or a or b N/A N/A false
or a or b N/A 5 false
+ a + b N/A 5 false
* a * b N/A 5 false
/ a / b 5 N/A false
() (a) N/A false
(exp) (a && b) N/A 5 false
(exp) op (exp) (b + b) > (a && b) N/A 5 false
function sum(a,b,b) N/A 5 false
function max(a,b) N/A 5 false
function min(a,b) N/A 5 false
function implode(', ',a,b,a,b) N/A 5 false
function if(a,a,b) N/A 5 false
function is_empty(a) N/A false
function is_empty(a) 0 (or blank) true
function !is_empty(a) N/A false


Overriding Cascading Conditions

Say you want to show a running total of all relevant answers. You might try to use the equation {sum(q1,q2,q3,...,qN)}. However, this gets translated internally to LEMif(LEManyNA("q1","q2","q3",...,"qN"),"",sum(LEMval("q1"),LEMval("q2"),LEMval("q3"),...,LEMval("qN"))). So, if any of the values q1-qN are irrelevant, the equation will always return false. In this case, the sum() will show "0" until all questions are answered.

To get around this, each variable can have a ".NAOK" suffix (meaning that Not Applicable is OK) added to it. In such cases, the following behavior occurs. Say you have a variable q1.NAOK:

  1. q1 is not added to the LEManyNA() clause
  2. LEMval('q1') will continue to check whether the response is relevant and will return "" if it is not (so individual irrelevant responses will be ignored, but they will not void the entire expression).

So, the solution to the running total problem is to use the equation sum(q1.NAOK,q2.NAOK,q3.NAOK,...,qN.NAOK).

The use of the .NAOK suffix also lets authors design surveys that have several possible paths but then converge on common paths later. For example, say subjects answer a survey in a way that is outside the normal range of responses. The author could alert the subjects that they may not get valid results, and ask them whether they really want to continue with the survey. If they say "Yes", then the rest of the questions will be shown. The condition for the "rest of the questions" would check whether the initial responses were answered within the normal range OR whether the subject said "Yes" to the question that is only relevant if they answered outside the normal range.

How does ExpressionScript Support Conditional Micro-Tailoring?

Here is an example of micro-tailoring (where Question Type=='expr' means an Equation):


Question Code Relevance Question Type Question
name 1 text What is your name?
age 1 text How old are you?
badage !is_empty(age) expr {(age<16) or (age>80)}
agestop badage message Sorry, {name}, you are too {if( (age<16),'young',if( (age>80),'old','middle-aged') ) } for this test.
kids !badage yesno Do you have children?
parents 1 expr {!badage && kids=='Y'}
numKids parents text How many children do you have?
kid1 parents && numKids >= 1 text How old is your first child?
kid2 parents && numKids >= 2 text How old is your second child?
kid3 parents && numKids >= 3 text How old is your third child?
kid4 parents && numKids >= 4 text How old is your fourth child?
kid5 parents && numKids >= 5 text How old is your fifth child?
sumage 1 expr {sum(kid1.NAOK,kid2.NAOK,kid3.NAOK,kid4.NAOK,kid5.NAOK)}
report parents text {name}, you said you are {age} and that you have {numKids}.  The sum of ages of your first {min(numKids,5)} kids is {sumage}


To download the above survey example, click on the following link: Number of kids survey example.

All of these questions can be on a single page (e.g. in the same group), and only the relevant questions will display.  Moreover, as you enter the ages of children, the sum() expression in the last question will dynamically update on the page.


ExpressionScript provides this functionality by surrounding each expression with a named <span> element.  Every time a value changes, it recomputes the expression that should appear in that <span> element and regenerates the display.  You can have dozens, or even hundreds, of such tailored expressions on the same page, and the page will re-display all of them in a single screen refresh.

Syntax Highlighting

To help with entering and validating expressions, the EM provides syntax highlighting with the following features:

Types and Meanings of Syntax Highlighting

Color Sample Meaning Tooltip Comments
tan background Sample the whole equation none Anything within curly braces that is recognized as an equation (e.g., there is no leading or trailing whitepace) will be color-coded with a tan background to help distinguish it from surrounding text
bold red text Sample An error Some explanation on error Can be an unknow variable or an error in function. Survey is broken and the questions that rely on the respective expression will not be shown to the respondents.
blue text Sample function name meaning and allowable syntax It refers to function names or things that should be functions since they are followed by an open parenthesis. They are displayed in bold blue text. Tooltips show the meaning and allowable syntax for the function.
grey text Sample string none Single and double-quoted strings are shown in grey text.
cyan text Sample variable set on the same page, [name or SGQA code]: question; value; answerList showing codes for each value Any variable that is set on the same page as the question you are currently editing is shown in cyan text (it can be updated in javascript). The tooltip shows its name (if you used INSERTANS:xxx) or its SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set). If the question type expects responses from an enumerated value set, the mapping of the codes to display values is shown.
green text Sample variable set on a prior page [name or SGQA code]: question; value; answerList showing codes for each value Any variable that is set on a prior page is shown in bold green text. The tooltip shows its name (if you used INSERTANS:xxx) or SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set). If the question type expects responses from an enumerated value set, the mapping of the codes to display values is shown.
bold pink text Sample variable set on a later page in general : empty at survey start, but can be filled with index or move previous [name or SGQA code]: question; value; answerList showing codes for each value Any variable that is set on a prior page is shown in bold pink text. The tooltip shows its name (if you used INSERTANS:xxx) or SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set). If the question type expects responses from an enumerated value set, the mapping of the codes to display values is show.
bold tan text Sample a lime replacement value the value Lime Replacement Strings (like {TOKEN:xxx}, {PRIVACY_MESSAGE}) are shown in bold tan text.
red text Sample assignment operator (=) warning message If you use one of the assignment operator (=), that operator will be displayed in red text. This is meant to help prevent accidental re-assignment of values when you really meant to check whether a == b instead of setting the value of a = b.
normal black text Sample punctuation none All other punctuation signs within the expression are shown as normal black text.
red-boxed text a bold red line surrounds the error syntax error description of the error Any detected syntax errors are shown within red boxes. The tooltip shows the error. Examples include unmatched parentheses, use of undefined functions, passing the wrong number of arguments to functions, poorly structured expressions (e.g., missing operators between variables), trying to assign a new value to a read-only variable, trying to assign values to non-variables, or using unsupported syntax. Note that the syntax error dectection system may only report one error in an expression even if there are multiple errors; however, if any errors are detected, at least one error will be shown.


By tooltips, we refer to the popup message that is displayed when you hover over certain functions and variables.

Additional Reading

ExpressionScript sample surveys

Use Cases and HowTos

Step-by-Step Examples

Reference for Developers

RoadMap/Status/ToDo List

</translate>