# Experimental study of learning support through examples in mathematical problem posing

- Kazuaki Kojima
^{1}Email author, - Kazuhisa Miwa
^{2}and - Tatsunori Matsui
^{3}

**10**:1

https://doi.org/10.1007/s41039-015-0001-5

© The Author(s) 2015

**Published: **23 June 2015

## Abstract

When using mathematics to solve problems in everyday life, problem solvers must recognize and formulate problems by themselves because structured problems are not provided. Therefore, in general education, fostering learner problem posing is an important task. Because novice learners have difficulty in composing mathematical structures (*solutions*) in problem posing, learning support to improve the composition of solutions is required. Although learning by solving examples is adopted in general education, it may not be sufficiently effective in fostering learner problem posing because cognitive skills differ between problem solving and problem posing. This study discusses and experimentally investigates the effects of learning from examples on composing solutions when problem posing. We studied three learning activities: learning by solving an example, learning by reproducing an example, and learning by evaluating an example. In our experiment, undergraduates were asked to pose their own new, unique problems from a base problem initially presented after the students learned an example by solving, reproducing, or evaluating it. The example allowed the undergraduates to gain ideas for composing a novel solution. The results indicated that learning by reproducing the example was the most effective in fostering the composition of solutions.

### Keywords

Production task Problem posing Learning from examples Mathematical learning## Background

In addition to solving problems provided by a teacher or textbook, problem posing, by which learners create problems, has also been identified as an important activity in mathematics education. In fact, some mathematicians and mathematics educators have pointed out that problem posing lies at the heart of mathematical activity (English 1997; Polya 1945; Silver 1994). Problem posing is a necessary skill for problem solving in everyday life. Because structured problems are not provided when using mathematics in everyday life, problem solvers must recognize and formulate problems by themselves (Ishida and Inoue 1983; Singer and Voica 2013). Therefore, it is an important task in general education to foster learner problem posing. Several studies have addressed this issue in terms of a learning activity to improve problem solving, despite insufficiently addressing the skill of learner problem posing itself.

The problem-posing research has empirically confirmed that novice learners succeeded in posing new problems based on mathematical structures provided in formulae or equations, whereas they had difficulty in composing novel mathematical structures on their own (Christou et al. 2005; Kojima et al. 2010). Because problem posing in everyday life is performed under various constraints with different materials, fostering the skill to pose diverse problems appropriately is highly desirable. In human problem solving, two attributes of problems are recognized as crucial: one is surface features such as contextual settings in problem texts (e.g., purchase of goods or transfer by vehicles) and the other is structural features such as mathematical structures (Gentner 1983; Forbus et al. 1995; Holyoak and Thagard 1996). We refer to these two attributes as *situations* and *solutions*. Studies in cognitive science have demonstrated that novice learners are strongly influenced by situations in problem solving and often fail in understanding solutions and adapting them to problem solving (e.g., Novick 1988; Reed et al. 1985; Ross 1987). Similarly in problem posing, composing novel solutions is more difficult than generating new situations. Therefore, learning support is required to improve the composition of solutions by novice learners. Here, composition of solutions is a process in which a problem poser generates mathematical relationships and then forms equations and stories in texts along with the relationships. Problem posing in everyday life must require composition of solutions from information given to or generated by the poser. Our study addressed improvement of solution composition as prerequisite for fostering problem-posing skill.

To support novice learners, using examples is efficient and effective. Examples are indispensable for learning in any domain, including mathematics. In general mathematics education, procedures for solving problems are initially taught using examples. Cognitive science studies have also argued how to foster transfer of a solution learned in an example to problem solving (e.g., Gick and Holyoak 1983; Novick and Holyoak 1991). However, the general method of learning from examples in problem solving may not be sufficiently effective in problem posing because cognitive skills in problem solving and problem posing are different. We refer to the former task as a comprehension task and the latter as a production task. In fact, some researchers report that learning tasks such as comprehension and production have no mutual influence (Singley and Anderson 1989). Accordingly, to improve composition of solutions in problem posing, learning examples using production tasks may be more effective than those using comprehension tasks.

To provide a basis for computational support that uses examples in problem posing, this study discussed and experimentally investigated the effects of activities for learning from an example on composing solutions in problem posing. In our experiment, undergraduates were asked to pose their own new, unique problems from a base problem initially presented after they had learned an example. We compared three activities for learning from an example adopted in general mathematical education or computational support systems for problem posing. In the next session, we discussed problem posing and the activities of learning from problem-posing examples.

## Theoretical background

### Relationships and differences between problem solving and problem posing

Although problem solving and problem posing differ, they are not entirely different cognitive activities but are closely related. Several researchers have experimentally confirmed that problem-solving ability and problem-posing performance are correlated and that problem posing positively influences problem solving (Bernardo 2001; Ellerton 1986; Nikata and Shimada 2005; Silver and Cai 1996). Problem posing offers many benefits: For example, it enhances problem-solving ability and the grasp of mathematical concepts, generates diverse and flexible thinking, alerts both teachers and learners to misunderstandings, and improves learners’ attitudes and confidence in mathematics (English 1998; Silver 1994). Although problem posing is rarely adopted in general education owing to certain constraints in practical classrooms, it is as critical a skill as problem solving.

Problem solving and problem posing differ, of course, in the features and formats of their tasks. Problem solving is a comprehension task, by which a learner extracts a mathematical structure from given information and reaches a correct answer. In contrast, problem posing is a production task that requires generation of information and its synthesis. Learners show difficulty in problem posing even if they can easily solve the problems. Akay and Boz (2009) asked prospective science teachers to respond to questionnaires about problem posing after participation in a course oriented to mathematical problem posing. The prospective teachers responded that problem posing was difficult because of its nature (e.g., not knowing the steps of problem posing), their abilities (not being creative), or lack of mathematical knowledge (having difficulties understanding abstractions) although they were not novices but had been trained as teachers.

Base (A_{1}): I bought some 60-yen oranges and 120-yen apples for 1020 yen. The total number of oranges and apples was 12. How many oranges and apples did I buy?

Solution:

Let *x* denote the number of oranges and *y* denote the number of apples.

*x* + *y* = 12

60*x* + 120*y* = 1020

According to the equations above, *x* = 7 and *y* = 5.

Computational support of learning by problem posing has already been developed in various domains (Barak and Rafaeli 2004; Hirashima et al. 2007; Hirashima et al. 2010; Hirai et al. 2009; Takagi and Teshigawara 2006; Yu et al. 2005). However, such computational support focuses mainly on improving performance of comprehension tasks through problem posing, such as understanding domain knowledge or procedures in problem solving. Some studies empirically analyzed problems posed by learners (e.g., Cankoy 2014; English 1998; Leung 1997; Yu and Wu 2013); however, these studies have not addressed learning from examples in problem posing.

### The effects of examples in problem posing

The research field of Intelligent Tutoring Systems/Artificial Intelligence in Education has long addressed learning from examples. Interactive scaffolding that enhances learning from examples has been implemented, and its effects have been discussed (e.g., Conati and VanLehn 2000; Koedinger and Aleven 2007; Schwonke et al. 2009; McLaren and Isotani 2011). However, the central issue in such research is basically limited to problem solving and does not include problem posing.

Even so, some studies have addressed learning from examples in problem posing. Hsiao et al. (2013) experimentally confirmed the effect of seeing worked examples on problems posed by undergraduates in the business mathematics domain. The undergraduates posed problems with a web-based learning management system in three homework exercises after lecture classes. In each exercise, half of the students were provided two problems as examples solved through concepts or formulae learned in the lecture classes. The results demonstrated the effects of the examples: undergraduates who provided examples posed fewer problems not oriented to what they had learned in the lecture classes than those who provided no examples. Hsiao et al. also examined problems posed by undergraduates in terms of complexities. However, the examples’ effects on the problems’ complexities were limited—the examples did not expand the average complexity of each posed problem. Because Hsiao et al. provided each as a worked example, the undergraduates must have read only its solution, indicating that they learned the example through comprehension tasks.

We implemented a support system to facilitate learners’ posing of diverse problems by using examples (Kojima and Miwa 2008). In the system, learners engage in the same task as the one described above (Kojima et al. 2010). They pose new problems and input the texts and equations of their solutions into the system. The system automatically understands the situations and solutions in the problems and evaluates their variety. It can also present learners with problems as examples to provide hints for idea generation. The variety of learners’ problems is evaluated, and the presentation of examples is controlled on the four-category basis shown in Fig. 1. Experimental evaluations of the system confirmed that to some extent, it could facilitate learners’ posing of diverse problems. The number of problems posed in the I/I category decreased and those in D/I and D/D increased after the learners had posed problems with the system, and the system showed them various examples belonging to D/I and I/D. However, the presentation of examples did not increase the number of problems in I/D. The lack of problem posing in I/D was consistent with the results obtained by Kojima et al. (2010).

Although the system presents examples to learners and prompts them to compare the base with their posed problems, it does not give any instructions on how to learn from the examples. The examples are merely shown to the learners. We have not examined how the learners actually learned from the presented examples: the learners may have simply read the presented examples. In other words, the learners may have understood the examples through performing a comprehension task. The comprehension of examples may have helped in generating various situations; however, it may not have necessarily facilitated understanding of the solution structures. For learners to adequately study the solutions from examples and transfer that knowledge to their problem posing, further support must be introduced. Because problem posing is a production task, it effectively allows a learner to examine each example through a productive activity.

### Learning activities of examples in problem posing

#### Learning by solving examples

Solving examples and understanding the solution is of course one of the most popular activities in mathematical learning. As mentioned above, however, learning by solving may not be effective in improving the composition of solutions in learner problem posing because problem solving differs from problem posing.

#### Learning by reproducing examples

We designed a method of learning from examples through imitation, a learning activity adopted in productive task domains (Kojima et al. 2013). Imitation—the method by which learners reproduce existing example works—has long been adopted as a major learning activity in the domains of creative generation, such as art and music. The relationship between imitation and creation has been consistently noted in such domains and the effects of imitation have been documented. For example, Ishibashi and Okada (2006) argue that imitating examples can prompt imitators’ understanding of examples and their conceptual background; imitation facilitates a creative performance by imitators. In their experiment, subjects were engaged in an artistic drawing task before and after they created copies of a presented example. Results showed that the subjects deeply understood the example through its imitation, and understanding the example then elicited understanding of the subjects’ own expressions.

Based on this insight, we implemented a system for learning by reproducing examples in problem posing (Kojima et al. 2013) as an enhancement of the system previously described (Kojima and Miwa 2008). Learning by reproduction of an example allows learners to understand the ideas used in formulating the example from the viewpoint of the poser.

We experimentally verified that learning by reproducing an example facilitated problem posing through directly adopting ideas used in the example’s generation (Kojima et al. 2013). However, we have not yet confirmed whether such learning can foster composition of solutions in the learner’s own problem posing.

#### Learning by evaluating examples

Some computational systems for supporting learning by problem posing (e.g., Barak and Rafaeli 2004; Hirai et al. 2009; Takagi and Teshigawara, 2006; Yu et al. 2005) adopt problem evaluation among learners as an activity in addition to problem posing. Experiments have shown that learning through such activities improves learning performance as well as the quality of learner problems. These studies basically designed the systems from the viewpoint of collaborative learning and focused on improving understanding of domain knowledge through problem posing. Although it is empirically confirmed that evaluations of problems posed by learners had predictive effects on the problems’ qualities (Yu and Wu 2013), these studies have not immediately produced evidence about the cognitive impacts of a learner evaluating activity on problem posing by the learners themselves.

Evaluation is a process involved in the creative generation of ideas or products. The importance of evaluative skills in creativity has been documented (Runco and Chand 1994). Furthermore, the effects of evaluating examples on the evaluator’s idea generation have been empirically demonstrated. Lonergan et al. (2004) experimentally observed that evaluation of examples according to certain standards improved the originality and feasibility of ideas generated by the evaluators, depending on the qualities of the examples and standards. Therefore, evaluation of existing ideas or products can be regarded as a production task because evaluation is a cognitive activity that can contribute to creative generation.

According to the above-mentioned studies, we experimentally investigated the effects of learning from an example on solution composition for problem posing. In the investigation, we studied the learning activities of reproducing and evaluating an example. To examine differences between comprehension and production tasks, we also studied the effects of learning by solving the same example. Because novice learners pose few such problems as examples, the investigation used an I/D problem as an example of a problem having a solution more complex than the base. As mentioned above, it is important to foster posing such problems because composing novel solutions is necessary but difficult, whereas generation of new situations is easy.

## Methods

### Procedures and materials

Undergraduates participated in the experimental investigation conducted in three classes of a cognitive science lecture from 2010 to 2012. The undergraduates were first given a learning task in the domain of word problems solved with simultaneous equations. They were told that the learning task’s purpose was to instruct them how to pose a novel problem from a base. The base in the learning task was the problem A_{1} (see Fig. 2). The undergraduates learned the following problem, A_{2}, as an example of output in the domain of A_{1}.

A_{2}: Last year, I bought some 40-yen pencils and 110-yen pens. The total number was 13. This year, I bought 2 times as many pencils as last year, as many pens as last year, and a 300-yen pen case for 1430 yen. How many pencils and pens did I buy last year?

Solution.

Let *x* denote the number of pencils and *y* denote the number of pens.

*x* + *y* = 13

40 × 2*x* + 110*y* = 1430–300

According to the equations above, *x* = 10 and *y* = 3.

The solution of A_{2} was composed by an alteration that added two parameters and operations to A_{1}. Thus, this process can hint at composing complex solutions in problem posing by the undergraduates. A_{2} is an I/D problem more complex than the base and difficult to pose for novice learners. The undergraduates had to learn the example in 15 min.

The learning task was followed by a problem-posing task, in which the undergraduates were asked to pose their own problems in the domain of word problems solved with unitary equations. The base in the problem-posing task was the following problem B.

B: I want to buy some boxes of cookies. If I buy 110-yen boxes of cookies, then I have 50 yen left. If I buy 120-yen boxes of chocolate cookies, then I need 20 yen more. How many boxes do I want?

Solution.

Let *x* denote the number of boxes.

110*x* + 50 = 120*x* − 20

According to the above equation, *x* = 7.

Prior to the problem-posing task, the undergraduates were instructed to pose as many diverse and unique problems as possible in 20 min.

### Condition groups

Undergraduates in the same school of the same university participated as one of the three condition groups each year. Because it is an interdisciplinary school, the background of the undergraduates varied but no one majored in mathematics. All of the undergraduates had trained to solve problems in the domain of word problems solved with linear equations in middle and high school education.

In the 2010 class, undergraduates were provided sheets of paper on which the text and solution of A_{1} and the text of A_{2} were printed. They were asked to solve A_{2} and write the answer on the sheet. The undergraduates were hence referred to as the solving group.

In 2011, undergraduates were first presented A_{1} and A_{2} on a screen. After A_{2} had been removed from the screen, they were provided printed sheets with A_{1} and generation process information indicating how to compose A_{2} from A_{1}. The generation process information had been created by the system mentioned above (Kojima et al. 2013). The undergraduates were asked to reproduce, according to the information, the same problem as A_{2}. They were also told that their problems’ texts did not need to be identical with the example as long as the problems could be solved by a solution identical to the example. We refer to the undergraduates as the reproduction group. Appendix 1 shows the information presented to this group.

In 2012, undergraduates were provided sheets on which A_{1} and A_{2} were printed. They were asked to evaluate A_{2} with a view toward originality and feasibility as a mathematical problem by using a 5-point scale and to describe the reasons for the evaluations. These viewpoints are generally used in researching creative thinking (e.g., Finke et al. 1996). We refer to these undergraduates as the evaluation group.

### Analysis

In fact, transfer of the example enabled posing I/D problems whose solutions were more complex than the base by altering the solution of the base. To verify the effect, we examined the following research questions:

RQ1: Do the undergraduates pose I/D problems after learning the example?

RQ2: Do the undergraduates learn how to compose solutions by altering the example and transferring it to their problem posing?

RQ3: After they learn the example, are the undergraduates fostered to compose solutions more complex than the base?

Problems posed by the undergraduates were analyzed in terms of variety, strategies to alter solutions, and complexities of solutions. To examine RQ1, the variety of each problem was evaluated on the basis of the four categories shown in Fig. 1. The example A_{2} is a problem in category I/D.

To examine RQ2, strategies to alter solutions of problems posed by the undergraduates were evaluated by comparing each problem’s solution structure with that of the base. The undergraduates’ problems were classified into *not altered*, *partially altered* (adding/removing operations to/from the solution of the base), or *overall altered* (composing a solution entirely different from the base). A_{2} was posed with partially altered.

To examine RQ3, the complexities of the undergraduates’ problems were estimated by comparing the numbers of operations required to reach the answers with the number required for the base. The number of operations in the base is three. Only the complexities of I/D and D/D problems were analyzed because the structure of solutions in I/I and D/I problems are always equal to the base.

In the study previously described (Kojima et al. 2010), we acquired problems posed by undergraduates in the same task without any learning through example in another class of the cognitive science lecture in 2009. The effects of learning with the example were verified through a comparison of the solving, reproduction, or evaluation groups in this investigation as *experimental groups* with those of the previous study as a *control group*. The procedures and material of the problem-posing task in the control group were the same as those described in the “Procedures and materials” section. For the comparison, this study used the same problem-posing task.

In the reproduction group, some undergraduates did not reproduce A_{2} and instead posed problems that were slightly different from A_{2} (e.g., changing parameters or operations in A_{2}); some others did not complete reproduction in the learning task. Such undergraduates were excluded from the analysis. Some others in the reproduction group failed to reproduce A_{2}. Although they wrote the same solution as A_{2}, their problem texts were contradictory to the solution. Therefore, the data of those who failed in the learning task (*reproduction-f group*) were separately described from those who succeeded (*reproduction-s group*). Appendix 2 shows an example of a contradictory problem posed by the reproduction-f group.

## Results

In the solving group, 62 undergraduates participated; in the reproduction group, 132; and in the evaluation group, 25. In the reproduction group, 44 did not reproduce A_{2}, and 8 did not complete reproduction. In the others, 52 were in the reproduction-s group, and 28 were in the reproduction-f group. Undergraduates in the solving, reproduction-s, reproduction-f, and evaluation groups posed 372 problems in the problem-posing task, 68 of which were excluded because they were in domains other than the base (e.g., solved with inequalities) or unsolvable due to insufficient or contradictory constraints. Because the undergraduates were instructed to pose problems in the domain of the base, posing any problems in other domains was a violation of the instruction. In case of unsolvable problems, solutions described by undergraduates were inconsistent with problem text that they described. Thus, problems that the undergraduates tried to pose were unclear. Appendix 3 shows some examples of problems posed in the experimental groups. In the control group, 76 undergraduates participated. They posed 146 problems and 29 were excluded in the same manner.

### Variety

*χ*

^{2}(3) = 11.51,

*p*< .01). Furthermore, the results of residual analysis indicated that the number of D/I problems was significantly high in the control group but significantly low in the solving group. The number of I/D problems was significantly high in the solving group but significantly low in the control group. Similarly, a significant difference existed between the reproduction-s and control groups (

*χ*

^{2}(3) = 15.26,

*p*< .01). The number of I/I problems was significantly high in the control group but significantly low in the reproduction-s group. The number of I/D problems was significantly high in the reproduction-s group but significantly low in the control group. There was also a significant difference between the evaluation and control groups (

*χ*

^{2}(3) = 14.48,

*p*< .01). The number of D/I problems was significantly high in the control group but significantly low in the evaluation group, whereas the number of I/D problems was significantly high in the evaluation group but significantly low in the control group. There was no difference between the reproduction-f and control groups (

*χ*

^{2}(3) = 4.64, n.s.).

The numbers of posed problems in each category

Groups | I/I | D/I | I/D | D/D |
---|---|---|---|---|

Control | 35 | 31* | 8** | 38 |

Solving | 19 | 13* | 17** | 34 |

Control | 35* | 31 | 8** | 38 |

Reproduction-s | 12* | 17 | 19** | 31 |

Control | 35 | 31 | 8 | 38 |

Reproduction-f | 7 | 7 | 6 | 10 |

Control | 35 | 31* | 8** | 38 |

Evaluation | 6 | 2* | 8** | 9 |

### Solution-altering strategies

*χ*

^{2}(2) = 7.98,

*p*< .05). Furthermore, the results of residual analysis indicated that the number of not altered problems was significantly high in the control group but significantly low in the solving group, whereas the number of fully altered problems was significantly high in the solving group but significantly low in the control group. Similarly, there was a significant difference between the reproduction-s and control groups (

*χ*

^{2}(2) = 13.20,

*p*< .01). The results of residual analysis indicated that the number of not altered problems was significantly high in the control group but significantly low in the reproduction-s group. The number of partially altered problems was significantly high in the reproduction-s group but significantly low in the control group. There was also a significant difference between the evaluation and control groups (

*χ*

^{2}(2) = 8.20,

*p*< .05). The results of residual analysis indicated that the number of not altered problems was significantly high in the control group but significantly low in the evaluation group, whereas the number of partially altered problems was significantly high in the evaluation group but significantly low in the control group. There was a moderate but significant difference between the reproduction-f and control groups (

*χ*

^{2}(2) = 5.61,

*p*< .10). The results of residual analysis indicated that the number of partially altered problems was significantly high in the reproduction-f group but significantly low in the control group.

The numbers of posed problems with each solution-altering strategy

Groups | Not altered | Partially altered | Overall altered |
---|---|---|---|

Control | 66** | 9 | 37* |

Solving | 32** | 11 | 40* |

Control | 66** | 9** | 37 |

Reproduction-s | 29** | 19** | 31 |

Control | 66 | 9* | 37 |

Reproduction-f | 14 | 7* | 9 |

Control | 66* | 9* | 37 |

Evaluation | 8* | 6* | 11 |

### Complexities

*χ*

^{2}(2) = 11.36,

*p*< .01). Furthermore, the results of residual analysis indicated that the number of decrease was significantly high in the control group but significantly low in the reproduction-s group. The number of increase was significantly high in the reproduction-s group but significantly low in the control group. There was no difference between the solving and control groups (

*χ*

^{2}(2) = 2.58, n.s.), the reproduction-f and control groups (

*χ*

^{2}(2) = 1.06, n.s.), or the evaluation and control groups (

*χ*

^{2}(2) = 0.06, n.s.).

The numbers of altered problems whose operations increased or decreased

Groups | Increased | Same | Decreased |
---|---|---|---|

Control | 17 | 7 | 22 |

Solving | 27 | 5 | 19 |

Control | 17* | 7 | 22** |

Reproduction-s | 31* | 11 | 8** |

Control | 17 | 7 | 22 |

Reproduction-f | 4 | 2 | 10 |

Control | 17 | 7 | 22 |

Evaluation | 6 | 3 | 8 |

## Discussion and conclusion

The results presented above indicate that the experimental groups posed more I/D problems than the control group, indicating that the example facilitated posing I/D problems regardless of the learning activities. Thus, RQ1 was verified in all of the experimental groups.

On the other hand, there was a difference among the experimental groups in the solution-altering strategies. Overall altered problems posed increased in the solving group, whereas partially altered problems posed increased in the production-s, production-f, and evaluation groups. The latter three groups adapted ideas used in the example because it was composed by altering the base (partially altered). The solving group learned the example through a comprehension task, whereas the reproduction-s, reproduction-f, and evaluation groups did so through a production task. Therefore, RQ2 was verified in the reproduction-s, reproduction-f, and evaluation groups, demonstrating that learning the example through a production task facilitated its transfer to the undergraduates’ problem posing.

The results shown in Figs. 4 and 5 confirm that learning the example increased production of problems whose solutions differed from the base. As pointed out in the introduction, novices find it difficult to compose novel solutions when problem posing. The experimental groups posed problems with novel solutions in some senses, even though only the reproduction-s group posed many problems more complex than the base. The undergraduates could learn how to formulate more complex solutions by adding operations. However, such problem posing was performed only by those who had succeeded in reproducing the example. According to this, RQ3 was verified only in the reproduction-s group. Therefore, the answers to the research questions were as follows:

RQ1: Do the undergraduates pose I/D problems after learning the example? Yes, the example increased I/D problems.

RQ2: Do the undergraduates learn how to compose solutions by altering the example and transferring it to their problem posing? Partially, yes. Those who had learned the example through a production task transferred it.

RQ3: After they learn the example, are the undergraduates fostered to compose solutions more complex than the base? Partially, yes. Only those who succeeded in reproducing the example produced solutions more complex than the base.

The results indicate that learning by solving an example can increase I/D problems. In the previous study (Kojima and Miwa 2008), learners just viewed the examples. Therefore, involving learners with an example is effective to some extent in problem posing. On the other hand, such involvement is not sufficiently effective in fostering the composition of solutions.

The results also prove that in problem posing, learning an example through a production task is effective. The results also confirm that learning by reproducing an example is more effective in terms of a learning activity in a production task. However, this activity also involves difficulty. Although no one in the solving group failed in the learning task, the reproduction-f group did fail. Obviously, the example must be quite easy for undergraduates to solve. Although learning by reproduction is effective, it significantly challenges learners. Therefore, further supportive intervention must be introduced in learning from an example through a production task.

The reproduction-s and the evaluation groups both adapted the example to the problem-posing task. The evaluation group posed many I/D problems, as well as partially altered problems. However, like the control group, the evaluation group posed many I/D and D/D problems that were simpler than the base. Although this group evaluated the example as to its originality and feasibility, alternative viewpoints might be needed to improve an example’s effects. Furthermore, to enhance the effects of evaluation, presenting a nasty problem as an example is one alternative. A learner may devise a good idea through evaluating such an example and find how to improve the example. Further study is needed to thoroughly examine this point.

The results of the solving and reproduction-s groups were consistent with the report by Singley and Anderson (1989). They experimentally confirmed that there was little transfer from training of evaluating LISP code to generating LISP code and vice versa. In the same way, this study confirmed that solving the given example did not effectively transfer to posing new problems. On the other hand, reproducing the example fostered problem posing while transferring ideas used in the example. It indicates that experience to follow processes of generating the example was required for learning in problem posing. Therefore, the effects of learning the example were insufficient in the evaluation group because of the absence of such experience to follow generation processes.

This study has limitation in terms of influence of individual aspects of the undergraduates on problem posing. Mathematical abilities such as reasoning skills (Ellerton 1986) and some other variables such as self-efficacy in mathematics and attitudes toward mathematics (Akay and Boz 2010) can positively influence on behaviors and products in problem posing. This study has not addressed these aspects. We have to further study the influence of these aspects on the effects of learning examples in problem posing.

## Declarations

### Acknowledgements

This study was partially supported by the Grant-in-Aid for Young Scientists (B) 23700990 and 25870820 of the Ministry of Education, Culture, Sports, Science and Technology, Japan.

## Authors’ Affiliations

## References

- Akay H, Boz N. Prospective teachers’ views about problem-posing activities. Procedia Social and Behavioral Sciences. 2009;1:1192–8.View ArticleGoogle Scholar
- Akay H, Boz N. The effect of problem posing oriented analyses-II course on the attitudes toward mathematics and mathematics self-efficacy of elementary prospective mathematics teachers. Australian Journal of Teacher Education. 2010;35(1):59–75.View ArticleGoogle Scholar
- Barak M, Rafaeli S. On-line question-posing and peer-assessment as means for web-based knowledge sharing in learning. International Journal of Human-Computer Studies. 2004;61:84–103.View ArticleGoogle Scholar
- Bernardo ABI. Analogical problem construction and transfer in mathematical problem solving. Educational Psychology. 2001;21:137–50.View ArticleGoogle Scholar
- Cankoy O. Interlocked problem posing and children’s problem posing performance in free structured situations. International Journal of Science and Mathematics Education. 2014;12:219–38.View ArticleGoogle Scholar
- Christou C, Mousoulides N, Pittalis M, Pitta-Pantazi D, Sriraman B. An empirical taxonomy of problem posing processes. International Review on Mathematical Education. 2005;37:149–58.Google Scholar
- Conati C, VanLehn K. Toward computer-based support of meta-cognitive skills: a computational framework to coach self-explanation. International Journal of Artificial Intelligence in Education. 2000;11:398–415.Google Scholar
- Ellerton NF. Children’s made up mathematics problems: a new perspective on talented mathematicians. Educational Studies in Mathematics. 1986;17:261–71.View ArticleGoogle Scholar
- English LD. Promoting a problem-posing classroom. Teaching Children Mathematics. 1997;4:172–9.Google Scholar
- English LD. Children’s problem posing within formal and informal contexts. Journal for Research in Mathematics Education. 1998;29:83–106.View ArticleGoogle Scholar
- Finke RA, Ward TB, Smith SM. Creative cognition: theory, research, and applications. Cambridge, MA: MIT Press; 1996.Google Scholar
- Forbus KD, Gentner D, Law K. MAC/FAC: a model of similarity-based retrieval. Cognitive Science. 1995;19:141–205.View ArticleGoogle Scholar
- Gentner D. Structure-mapping: a theoretical framework for analogy. Cognitive Science. 1983;7:155–70.View ArticleGoogle Scholar
- Gick ML, Holyoak KJ. Schema induction and analogical transfer. Cognitive Psychology. 1983;15:1–38.View ArticleGoogle Scholar
- Hirai Y, Hazeyama A, Inoue T. Assessment of learning in concerto III: a collaborative learning support system based on question-posing. In: Proceedings of Computers and Advanced Technology in Education. Calgary, Canada: ACTA Press; 2009. p. 36–43.Google Scholar
- Hirashima T, Tomoto T, Okamoto M, Takeuchi A. Learning by problem-posing as sentence-integration and experimental use. In: Proceedings of the 13th International Conference on Artificial Intelligence in Education. Amsterdam: IOS Press; 2007. p. 254–61.Google Scholar
- Hirashima T, Yamamoto S, Waki H. An interactive learning environment for problem-changing exercise. In: Proceedings of the 10th International Conference on Intelligent Tutoring Systems, Part II. Berlin, Heidelberg: Springer; 2010. p. 343–5.View ArticleGoogle Scholar
- Holyoak KJ, Thagard P. Mental leaps: analogy in creative thought. Cambridge, MA: MIT Press; 1996.Google Scholar
- Hsiao J, Hung C, Lan Y, Jeng Y. Integrating worked examples into problem posing in a web-based learning environment. The Turkish Online Journal of Educational Technology. 2013;12:166–76.Google Scholar
- Ishibashi K, Okada T. Exploring the effect of copying incomprehensible exemplars on creative drawings. Proceedings of the 28th Annual Meeting of the Cognitive Science Society (pp. 1545–1550). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.; 2006.Google Scholar
- Ishida K, Inoue Y. How to teach pupils to write mathematics problems. Journal of Japan Society of Mathematical Education. 1983;65:109–12.Google Scholar
- Koedinger KR, Aleven V. Exploring the assistance dilemma in experiments with cognitive tutors. Educational Psychological Review. 2007;19:239–64.View ArticleGoogle Scholar
- Kojima K, Miwa K. A system that facilitates diverse thinking in problem posing. International Journal of Artificial Intelligence in Education. 2008;18:209–36.Google Scholar
- Kojima K, Miwa K, Matsui T. An experimental study on support for leaning of problem posing as a production task. Transactions of Japanese Society for Information and Systems in Education. 2010;27:302–15.Google Scholar
- Kojima K, Miwa K, Matsui T. Supporting mathematical problem posing with a system for learning generation processes through examples. International Journal of Artificial Intelligence in Education. 2013;22:161–90.Google Scholar
- Leung SS. On the role of creative thinking in problem posing. International Reviews on Mathematical Education. 1997;29:81–5.Google Scholar
- Lonergan DC, Scott GM, Mumford MD. Evaluative aspects of creative thought: effects of appraisal and revision standards. Creativity Research Journal. 2004;16:231–46.View ArticleGoogle Scholar
- McLaren BM, Isotani S. When is it best to learn with all worked examples? In: Proceedings of 15th International Conference on Artificial Intelligence in Education. Berlin, Germany: Springer; 2011. p. 222–9.Google Scholar
- Nikata K, Shimada H. Facilitation of analogical transfer by posing an analogous problem for oneself. Japanese Journal of Educational Psychology. 2005;53:381–92.View ArticleGoogle Scholar
- Novick LR. Analogical transfer, problem similarity, and expertise. Journal of Experimental Psychology: Learning, Memory, and Cognition. 1988;14:510–20.Google Scholar
- Novick LR, Holyoak KJ. Mathematical problem solving by analogy. Journal of Experimental Psychology: Learning, Memory, and Cognition. 1991;17:398–415.Google Scholar
- Polya G. How to solve it. Princeton, NJ: Princeton University Press; 1945.Google Scholar
- Reed SK, Dempster A, Ettinger M. Usefulness of analogous solutions for solving algebra word problems. Journal of Experimental Psychology: Learning, Memory, and Cognition. 1985;11:106–25.Google Scholar
- Ross BH. This is like that: the use of earlier problems and the separation of similarity effects. Journal of Experimental Psychology: Learning, Memory, and Cognition. 1987;13:629–39.Google Scholar
- Runco MA, Chand I. Problem finding, evaluative thinking, and creativity. In: Problem finding, problem solving, and creativity. Norwood, NJ: Ablex; 1994. p. 40–76.Google Scholar
- Schwonke R, Renkl A, Krieg C, Wittwer J, Aleven V, Salden R. The worked-example effect: not an artefact of lousy control conditions. Computers in Human Behavior. 2009;25:258–66.View ArticleGoogle Scholar
- Silver EA. On mathematical problem posing. For the Learning of Mathematics. 1994;14:19–28.Google Scholar
- Silver EA, Cai J. An analysis of arithmetic problem posing by middle school students. Journal for Research in Mathematics Education. 1996;27:521–39.View ArticleGoogle Scholar
- Singer FM, Voica C. A problem-solving conceptual framework and its implications in designing problem-posing tasks. Educational Studies in Mathematics. 2013;83(1):9–26.View ArticleGoogle Scholar
- Singley MK, Anderson JR. The transfer of cognitive skill. Cambridge, MA: Harvard University Press; 1989.Google Scholar
- Takagi M, Teshigawara Y. A WBT system enabling to create new or similar quizzes collaboratively by students. In: Proceedings of the 3rd International Conference on Educational Technology. Calgary, Canada: ACTA Press; 2006. p. 263–8.Google Scholar
- Yu F, Wu C. Predictive effects of online peer feedback types on performance quality. Educational Technology & Society. 2013;16:332–41.Google Scholar
- Yu F, Liu Y, Chan T. A web-based learning system for question-posing and peer assessment. Innovations in Education and Teaching International. 2005;42:337–48.View ArticleGoogle Scholar

## Copyright

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.