Table 5 Rubrics for analyzing creativity and difficulty levels

Creativity of the problem poser

The context addressed in the problem is same as textbook programming problems e.g. “Check if a number is prime”. The use of constructs is conventional.

Prior knowledge used in the problem comes from courses experienced in school level.

Attempt of a new context (prior knowledge used in the problem comes from the real-world experiences) and innovative use of constructs.

Difficulty of the problem

Problems with well-understood logic and straightforward solution.

Problems with some amount of logical challenge and do not have a straightforward solution.

Problems which are highly logically challenging and have no straight forward solution.