Pair interactions in online assessments of collaborative problem solving: case-based portraits

Research and Practice in Technology Enhanced Learning

Table 3 Use of algorithm to relate actions to the element systematicity of the collaborative problem-solving construct (adapted from Adams et al. 2015)

Indicator name	Details	Algorithm	Output
U2L004A U2L004B	Systematic approach All positions have been covered. Scoring rule: threshold value Task name: Laughing Clowns	Step 1: Find all drop ball occurrences captured as dropShute and their corresponding positions as dropShuteL, dropShuteR and dropShuteM. Step 2: Then count all the occurrences of the action recorded under ‘dropShute’ and their unique positions from the log. Step 3: Increase the value of the indicator by 1 if 1 or more ‘dropShute’ occurs in the form of dropShuteR, dropShuteL or dropShuteM. Step 4: If the total number of unique dropShutes (dropShuteR, dropShuteL and dropShuteM) from the log is less than 3, the value of the indicator is defined as − 1 to indicate missing data	Count values

In Table 3, the first column represents the name of the indicator, being unique for each indicator. In the example, ‘U2’ points to the Laughing Clowns task, ‘L’ refers to local and explains that the indicator is unique to the task, ‘004’ means that the indicator is fourth created for the task and ‘A’ means that the indicator is applicable to students A and ‘B’ that it is applicable to student B