Model-based analysis of thinking in problem posing as sentence integration focused on violation of the constraints
- Ahmad Afif Supianto^{1, 2}Email author,
- Yusuke Hayashi^{1} and
- Tsukasa Hirashima^{1}
https://doi.org/10.1186/s41039-017-0057-5
© The Author(s) 2017
Received: 18 December 2016
Accepted: 29 May 2017
Published: 7 June 2017
Abstract
The advancement of computer and communication technologies has enabled researchers to conduct and analyze the learning process of posing problems. This study investigates what learners think while posing problems as sentence integration in terms of intermediate products as well as the posed problems as the resultant product. Problem posing as sentence integration defines the arithmetic word problem structure, and posing a problem is a task to satisfy all the constraints and requirements to build a valid structure. A previous study shows that, in problem posing as sentence integration for arithmetic word problems, learners try to satisfy a relatively large number of constraints in the posed problems. In contrast, this study focuses on the violation of constraints in the intermediate products while posing problems. The result shows that learners were inclined to avoid as many violated constraints as possible throughout the problem-posing process. Although learners tend to avoid the violated constraints, naturally, they cannot avoid some mistakes. Further analysis shows that learners actually have difficulty in fulfilling particular constraints while posing the problems. Based on this analysis, it is possible to detect the difficulty of learners’ actions from the model perspective. Hence, it is possible to give accurate feedback and appropriately support the learners.
Keywords
Problem-posing process Intermediate products Arithmetic word problems Learning analyticsIntroduction
Problem posing is recognized as a key component in the nature of mathematical thinking (Kilpatrick 1987). Posing a problem involves generating new problems and questions aimed at exploring a given situation as well as reformulating a problem during the course of solving a related problem (Silver 1994). The development of problem-posing skills for learners is one of the main aims of learning mathematics, and it should occupy a significant role in mathematical activities (Crespo 2003). There is an increased emphasis on providing learners with opportunities for posing problems in the mathematics classroom (Stoyanova 2005; Singer et al. 2011; Cankoy 2014). Several investigations have confirmed that learning by problem posing in classrooms is a promising activity in learning mathematics (Silver and Cai 1996; English 1998). The quality of problems that learners generate depends on the given assignments (Leung and Silver 1997). In posing a problem, assessment of each problem and assistance based on it are necessary (Hirashima et al. 2007). Teacher assessment of posed problems encompasses learners’ development of diverse mathematical thinking processes (English 1997). Since learners are usually allowed to pose several kinds of problems in a broad range, it can be challenging for teachers to complete the assessment and feedback for the posed problems in classrooms.
To address this issue, technology-enhanced approaches have been conducted to realize learning by problem posing in a practical way, especially regarding assessment and feedback. Self- and peer-assessed posed problems were examined to determine the effect of learners’ self-assessment of their mathematical creativity (Shriki and Lavy 2014), to explore learner’s learning and knowledge sharing while engaged in an online question-posing and peer-assessment activity (Barak and Rafaeli 2004) and to determine which peer-assessment mode(s) students perceive most positively using student generation of questions (Yu 2011). In contrast, diagnosis functions that can automatically assess and provide feedback for each posed problem have been proposed (Nakano et al. 1999; Hirashima et al. 2000). This automatic method of diagnosis-facility assessment is called agent assessment. Furthermore, a learning system named Monsakun, which uses agent assessment for operations of addition and subtraction, has been developed (Hirashima et al. 2007). The system has many problem-posing assignments and requests learners pose the required problem by combining three simple sentences from given sentences until they successfully pose the required problem in each assignment. Using this system, the opportunity to pose the problems for learners increases. The feedback to learners according to their mistakes is provided, and for teachers, checking the validity of the posed problems becomes easier. This study aims at analyzing the practical realization of agent assessment to understand the learning process of posing problems.
Using Monsakun as a problem-posing learning system, learners’ abilities to solve problems as well as to understand them are promoted. In practical use and long-term evaluation, it was confirmed that learning by problem posing with Monsakun is interesting and useful as a learning method (Hirashima et al. 2008). Lectures and exercises with Monsakun improve not only learners’ problem-posing skills but also their problem-solving skills (Yamamoto et al. 2012). Through previous research, the usefulness of Monsakun has been confirmed for learning through posing problems. The basis of Monsakun is the triplet structure model (Hirashima et al. 2014) that defines the structure of an arithmetic word problem using sentence integration. This model deals with an arithmetic word problem that is solved using only one arithmetical operation. This is the fundamental unit of conceptual quantity representation, and much more complex arithmetic word problems can be composed by the combination of the units. An arithmetic word problem in this model is an integration of three sentences representing numerical concepts. In addition to that, the model defines constraints for valid problems that must be satisfied. When a learner can pose the required problem in Monsakun, the problem certainly meets the constraints. In other words, posing problems in Monsakun is the division of the task to pose an arithmetic word problem into two sub-tasks: generation and integration of three sentences satisfying the required constraints and the replacement of the generation (sub-) tasks by selecting tasks of sentences. This is the same as the concept of the “kit-build concept map” and focuses learner’s thinking processes on the structure of the learning content (Hirashima et al. 2015).
Although the usefulness of Monsakun has been confirmed for learning by problem posing, it is necessary to investigate the validity of the learners’ problem-posing process in Monsakun. There are two main points that explain the necessity of the investigation in this study. First, the previous study reported that although learners gave many wrong answers to get the correct answer in some assignments, they did not pose the required problems randomly, and their many wrong answers are not meaningless as the results of thinking (Hasanah et al. 2015b). In the study, problem posing as sentence integration is presumed from the trends of posed problems as the result of the process. However, we extend the analysis by involving the process of arranging the problem. We assume that learners must think the constraints form a valid problem throughout the problem-posing process. In regard to the process in posing problems, further analysis demonstrated that learners attempted to pose problems to satisfy as many constraints as possible based on their own understanding (Supianto et al. 2016a). In contrast, this study investigates the problem-posing process and reveals the trends of the process, focusing on the violation of constraints. We conduct this study to prove that learners tend to avoid as many violated constraints as possible in composing problems.
Second, the fact that learners gave wrong answers illustrates that learners cannot avoid some mistakes. Therefore, it is essential to understand the learners’ difficulties while posing the problems. Supianto et al. (2016b) detected important circumstances in the situation in which learners experience bottlenecks and misunderstanding of the structure of the problems. The study proposed a method to visualize learners’ actions from Monsakun log data. In contrast, this study analyzes the problem-posing process based on the Monsakun model. However, based only on the triplet structure model, it is not obvious which constraints are difficult for learners to satisfy because the model just shows all the possibilities of the principle. Therefore, this study combines the Monsakun model and Monsakun log data. This study investigates learners’ actions based on the Monsakun model. We show that learners have difficulty avoiding some specific types of constraints.
In this paper, we conduct a process analysis of elementary school students during problem-posing activities using Monsakun based on two main research questions. The research questions are (1) whether learners pose problems by attempting to avoid as many violated constraints as possible and (2) whether learners have difficulty in avoiding a particular type of constraints.
Related work
In recent years, interest in integrating problem posing in mathematical instruction has continuously grown among mathematics education researchers and practitioners (Norman 2011; Ellerton 2013; Singer et al. 2015; Cai and Jiang 2016). Investigations of problems posed by learners and teachers in classrooms have provided insight into the relationships between mathematical knowledge, skills, and processes (Chen et al. 2011; Stickles 2011; Kılıç 2013; Van Harpen and Presmeg 2013). Given the importance of problem-posing activities in school mathematics, some researchers have investigated various aspects of problem-posing processes. One important direction is to examine thinking processes related to problem posing (e.g., Bonotto 2013; Şengül and Katranci 2015). Other studies underline the need to incorporate problem-posing activities into mathematics classrooms to determine prospective teachers’ problem-posing skills appropriate to selecting, translating, comprehending, and editing models and the possible difficulties they could encounter during the process in fraction problems (Işık et al. 2011), to explore students’ creativity in mathematics by analyzing their problem-posing abilities in geometric scenarios (Van Harpen and Sriraman 2013) and to examine the knowledge influences of learners’ abilities in posing combinatorial problems (Melušová and Šunderlík 2014). Furthermore, some studies provide evidence that problem posing has a positive influence on students’ abilities in problem solving (e.g., Kar et al. 2010; Şengül and Katranci 2012). Kar et al. (2010) asserted that the positive relation between posing and solving problems is an indicator of the acceptance of problem-posing skills as a phase in the development of problem-solving skills. In the analysis of the posed problems, the participants map the level of their own notions and concepts, understanding, and various interpretations and realize possible misconceptions and erroneous reasoning (Tichá and Hošpesová 2009). Learning to pose problems might also enhance learning to understand mathematical concepts (Pirie 2002). Pirie (2002) said that in asking questions on mathematical concepts, students might come to understand those concepts in a more generalized, less context-dependent way. In addition, Toluk-Uçar (2009) emphasized that problem posing has a positive effect on understanding fractions as well as on learners’ views about what it means to know mathematics.
On the other hand, investigations of problem posing from the viewpoint of interactive learning systems promote active engagement in learning through the activities of learners. Chang et al. (2012) developed game-based problem-solving modules in a mathematics problem-posing system and investigated the effects of the problem-posing system on students’ abilities to pose and solve problems. Yamamoto et al. (2012) and Abramovich and Cho (2015) demonstrated how the appropriate use of digital technology tools can motivate problem-posing activities and evaluate the learner’s performance by assessing the number of posed problems. Hung et al. (2014a) investigated the effects of an integrated mind mapping and problem-posing approach on learners’ in-field mobile learning performance in an elementary school natural science course. Moreover, Majumdar and Iyer (2015) presented how an online visual analytic tool can be used to analyze clicker responses during an active learning strategy where the instructor poses a multiple-choice question. In this study, an interactive learning system is used to encourage learners in posing arithmetic word problems. The system asks learners to arrange and integrate five or six presented sentence cards into a problem, which consists of three sentence cards. We analyze the learners’ tendencies while posing the problems in the system.
Several studies examined learners’ behaviors through a collaborative problem-posing strategy. Beal and Cohen (2012) demonstrated that the mathematics problem-posing skill was improved when the activity was carried out over an online collaborative learning system. Mishra and Iyer (2015) implemented a collaborative problem-posing activity in which two learners collaborated as a team to generate questions. Sung et al. (2016) conducted a group collaborative problem-posing mobile learning activity. They found that such an approach could improve learning achievement and group learning self-efficacy. In this study, we analyze log data of learners’ individual activity collected from a tablet personal computer-based software for learning by posing arithmetic word problems.
Several problem-posing techniques on interactive learning systems have been conducted. One approach is using the question-posing technique. The systems allow students to generate different types of questions using different media formats with peer-assessment using one type of communication mode (Wilson 2004) and multiple peer-assessment modes (Yu 2011). The studies evaluated students’ abilities to pose questions and their processes in an online learning system. Lan and Lin (2011) developed a system integrating a reward mechanism into assessment activities and analyzed student’s abilities to pose questions in a web-based learning system. Moreover, Hung et al. (2014b) investigated the effect of promoting questioning ability in problem-based scientific inquiry activities. The research developed a ubiquitous problem-based learning system regarding learners’ question-raising performance. This study used agent assessment, which can assess the validity of posed problems and automatically give feedback to the learners according to their mistakes. We investigate the learners’ difficulty based on their actions, which are logged in the system.
The second approach is learning from the example technique. This support system is developed to facilitate posing of diverse problems by learners using examples. Leikin (2015) described posing various types of problems associated with geometry investigations using examples from a course with prospective mathematics teachers, while Hsiao et al. (2013) conducted examples across three homework exercises in which students were required to generate at least one applied problem. The studies showed that integrating worked examples into problem posing has a significant skill development effect on posing more oriented and complex problems. Moreover, Kojima et al. (2015) presented examples that are merely shown to the learners and prompted them to compare the base with their posed problems. They investigated the effects of learning from an example on solution composition for posing problems. The system used in this study provides sentence cards and requests learners to create a problem according to the requirements in the task. The learners’ activities while arranging the sentence cards are recorded by the system. Then, we check their thinking processes in posing the problem focused on violation of the constraints.
Another approach is learning by problem posing as sentence integration. Problem posing as sentence integration requires learners to interpret the sentence cards and integrate them into one problem. In an assignment, the system presents a requirement, which consists of a story type and a numerical expression. The system asks learners to arrange the provided sentence cards based on the requirement. One of the few research studies that has been found in this direction is about analyzing the results of the posed problems. Hirashima et al. (2007) examined whether learners could pose the problems, showing and discussing the number of posed problems and correct problems based on the system log data. Kurayama and Hirashima (2010) analyzed the learning effects by comparing pre- and post-test problem-solving and problem-posing scores. Further analyses have been conducted on this topic by investigating the learners’ thinking processes based on the first selected sentence in assignments (Hasanah et al. 2015a) concerning the completed posed problems (Hasanah et al. 2015b). There is a dearth of research that investigates every action of learners in posing the problems to understand the learning process of problem posing on an interactive learning system. Moreover, no significant research has been found that examines the intermediate products while posing the problems. In this study, we examine every learner’s movements while posing an arithmetic word problem.
There has been considerable thorough and fine-grained investigation of the activities of learners in interactive learning systems to reveal their behavior throughout the learning process. Fournier-Viger et al. (2010) developed a virtual learning system for learning how to operate the Canadarm2 robotic arm on the international space station. The study extracted patterns from learners’ solutions to problem-solving exercises for automatically learning a task model that can then be used to aid and guide them during problem-solving activities. Hou (2012) utilized an online discussion activity adopting a role-playing strategy and conducted an empirical analysis to explore and evaluate both the content structure and behavioral patterns in the discussion process. The study adopted a new method of multi-dimensional process analysis that integrates both content and sequential analyses, whereby the dimension of interaction and cognition are analyzed simultaneously. Hsieh et al. (2015) identified higher and lower engagement patterns to represent students’ learning processes in a game-based learning system. The study investigated a possible connection between students’ verbal (asking themselves, expressing frustration, etc.) and nonverbal (smiling, focusing, moving closer to the screen, moving away from the screen, etc.) behaviors. However, the central issue in such research is basically limited to solving problems and does not include posing problems.
This study aims to investigate the problem-posing process and reveals the trends of the process. Problem-posing activities could provide us with valuable insight into a learner’s understanding of mathematical concepts and processes. Studies in this area suggest that problem posing has a positive influence on a learner’s ability to solve problems. There is significant improvement in the problem-solving performance of learners. In addition, problem posing could guide learners to achieve understanding of mathematical concepts. Technology-enhanced learning has been developed to realize and actively promote learning by problem posing. Several methods of problem-posing activities on an interactive learning system have been proposed, such as posing questions, learning from examples, and learning by problem posing as sentence integration. Additionally, considerable studies have been analyzing the results of posed problems and the learning effects. Moreover, investigational studies that examine the process of a learner’s activities in an interactive learning system to reveal behavior have been conducted, and deep examination of learner behaviors may make beneficial contributions to the educational technology field with the adoption of process analysis. This study investigates the problem-posing processes of Japanese elementary students in actual classes by analyzing the log files of the learners’ problem-posing activities on a computer-based learning system with sentence integration, which is called Monsakun.
Methods
Participants and procedure
In this research, we analyze the Monsakun log data of 39 first-grade students who participated in the practical use of Monsakun; their average age was 6 years old. In practical use, as described by Yamamoto et al. (2012), Monsakun was introduced as a problem-posing system of arithmetic word problems at the beginning of class (5–10 min). The teacher distributed tablets containing Monsakun to learners and explained how to operate the system. Then, the teacher taught problem structures by simulating an assignment on the blackboard (20–35 min). The teacher provided several sentence cards from Monsakun problems and conducted a lesson that resembled the Monsakun problem-posing process. The teacher encouraged participation and active discussion from all learners to pose the correct answer together. Finally, at the end of class, learners used Monsakun to complete an exercise in posing the problems individually (5–10 min). We collected the log data from the activity at this time.
Monsakun has five levels of problems that require different thinking approaches. All levels are the same in terms of posing problems from a card set, but they have different requirements. Levels 1–4 provide the numerical formula of the story, while level 5 is required to consider the unknown number. There are 12 assignments and four story types in the level: combination stories (assignments 1–3), increase stories (assignments 4–6), decrease stories (assignments 7–9), and comparison stories (assignments 10–12). An assignment is completed when learners pose the problem correctly. As a feature of Monsakun, each time a learner makes a mistake, the system will provide explanation feedback according to the mistake. This feedback will stimulate the learner to think about the other solutions and lead them to the correct answer.
Problem-posing activity in Monsakun
The triplet structure model defines an arithmetic word problem solved by addition or subtraction as a composition of three simple sentences with two “existence sentences” and one “relational sentence.” An existence sentence represents a number of single objects that has an independent quantity. A relational sentence has a relative quantity and contains a keyword that represents a story type. Although an existence sentence can be used in any story, each type of relational sentence is used only in one type of story. There are four story types: combination story, increase story, decrease story, and comparison story.
The sentence cards are encoded with an indexing number shown in Fig. 2d. When the slot is still empty, index = 0 is implemented. For instance, when learners pose the problem by selecting sentence card #1 and arrange it into the second slot, state 010 has been obtained, which is shown in Fig. 2a. Another example of a state is shown in Fig. 2b; state 410 happens when learners pose the problem by selecting sentence Card #4 and then arranging it into the first slot and selecting sentence card #1 and then arranging it into the second slot.
Assessment of products: constraints to form a problem
The task model of posing problems via sentence integration has been developed based on the consideration of problem types in the triplet structure model (Kurayama and Hirashima 2010). Based on the task model, five main constraints must be satisfied by each posed problem; they are (1) calculation, (2) story type, (3) number, (4) objects, and (5) sentence structure. The calculation is the numerical expression representing the story type. Calculation structure requires numbers assigned to the correct sentence structure, whether an existence sentence or relational sentence according to the story type. The story type is one of the four available story types. They are combination story, increase story, decrease story, and comparison story. The story type should be identified in the requirement. The number is the quantity in the sentence. Number structure requires the consistency of numbers in the problem. Each number in the problem must be derived from the other numbers. The object is the entity in the sentence. Object structure also requires the consistency of entities in the sentences. For example, if the story type is increase or decrease, the objects in the three sentences must be the same. On the other hand, if the story type is combination or comparison, objects in the independent quantity sentences are different, and both are in the relative quantity sentence. The sentence structure is the composition of sentences. As defined in the triplet structure model, an arithmetic word problem must consist of two existence sentences and one relational sentence. The type of relational sentence is related to the story types. When less than five constraints are satisfied, the posed problem is not valid; that is, the problem cannot be solved, or it is not the required one. The validity is measured based on the number of satisfied constraints.
- 1)
There are 3 white rabbits;
- 2)
There are ? black rabbits;
- 3)
There are 8 white and black rabbits altogether;
- 4)
There are 8 white rabbits;
- 5)
There are 3 more white rabbits than black rabbits; and
- 6)
There are 3 brown rabbits.
Example of several states and their satisfaction of constraints
No. | State | Composition of sentence cards | Constraint | Number of violated constraints | ||||
---|---|---|---|---|---|---|---|---|
C1 | C2 | C3 | C4 | C5 | ||||
1 | 001 | – | ||||||
– | 0 | 0 | 0 | 0 | 0 | 0 | ||
There are 3 white rabbits | ||||||||
2 | 014 | – | ||||||
There are 3 white rabbits | −1 | 0 | 0 | 0 | 0 | 1 | ||
There are 8 white rabbits | ||||||||
3 | 246 | There are ? black rabbits | ||||||
There are 8 white rabbits | −1 | −1 | 1 | −1 | −1 | 4 | ||
There are 3 brown rabbits |
The posed problem represented as state 246 (see Table 1, No. 3) has the validity equal to 1 because the state only satisfies one constraint (number). The state consists of numbers that fit the requirement; they are 8, 3, and the unknown number (?). However, the calculation cannot be made because it is necessary to transform the numerical expression, “8 − 3,” into the numerical expression representing a combination story, “3 + ? = 8.” In that formula, the number “3” and the unknown number “?” should be assigned as existence sentence cards, and the number “8” should be assigned as a relational sentence card, but the number “8” is an existence card on that state. Regarding the story-type constraint, there is no relational sentence card that indicates a combination story type. Then, the object also does not satisfy the constraints because all three objects are different, and they are not connected to each other. Finally, to satisfy the sentence-structure constraint, the state must consist of two existence sentence cards and one relational sentence card, but the state is composed of three existence sentence cards.
According to the triplet structure model, we only can measure the validity of the posed problem products, which is based on the number of satisfied constraints. Therefore, to cover the measurement of the intermediate products, we define three values for each constraint: −1, 0, and 1. The value of −1 indicates the constraint is violated, and the value of 0 indicates the constraint is not violated, while the value of 1 indicates the constraint is satisfied. The number of violated constraints is obtained by counting how many constraints are violated.
The last example in Table 1, state 246, satisfies only one constraint, the number constraint. There is no story that can be built from this composition, nor can the calculation and sentence structure be built. It can be calculated and well-structured when it consists of two existence sentences and one relational sentence, instead of all sentence cards being existence cards. In addition, there is no relation between objects in the composition of the sentence cards. They are independent objects consisting of white, black, and brown rabbits. This condition causes the number of violated constraints to be four because there are four constraints that are violated.
Data collection
The analysis of learners’ performance by examining the average steps and mistakes in posing the problems on Monsakun has been reported in past research (Hasanah et al. 2015b). The average of the steps and mistakes shows how many steps a learner required to give a correct answer in one assignment and how many mistakes the learner made during the process, focusing on the posed problem states, respectively. Ideally, a learner would only need three steps to pose a correct answer because a problem in Monsakun consists of the arrangement of three simple sentence cards. The results show that the average steps and mistakes at level 5 were very high compared to the others, which shows that level 5 was indeed very challenging for learners. In this paper, investigation of every step while posing the problems was conducted, which means the intermediate product states as well as the posed problem states arranged by learners (Fig. 6) were inspected to determine the characteristics of learners at level 5 according to the violation of constraints.
Data analysis
In Monsakun, five or six sentence cards are provided in each assignment. Three of them are correct cards, which satisfy all constraints from the assignment requirement, and when composed correctly will form the correct answer. The rest are dummy cards, which are designed through careful consideration by an expert as a meaningful distraction to the learners in order to learn the structure of a simple arithmetic word problem. Despite the nature of this learning system, it could permit learners to select three sentence cards randomly. Learners’ intention in posing the problems according to the given requirements is analyzed. Three analyses from the log files of learners’ problem-posing activity on Monsakun are conducted. We analyze their sentence card compositions. The first and second analyses provide the answer for the first research question, while the third gives the answer for the second research question.
In the first analysis, we investigate the products and conduct a bivariate correlation analysis between the occurrence frequency of the products and the number of violated constraints. The occurrence frequency shows how many states have been arranged, while the number of violated constraints shows how many constraints are violated based on the state. We assume that the degree of correlation is related to the degree of the learners’ understanding. If the number of violated constraints has a negative correlation to the frequency, then the high number of violated constraints will be followed by the lower number of actions. It means that the high number of violated compositions of sentence cards has a small number of learners’ actions. Therefore, this correlation test will provide an answer to the first research question.
The second part of the analysis investigates the portion of states in the assignment setting to the occurrence frequency. We observe differences between the number of states in the assignment setting and the occurrence frequency. Moreover, we examine the differences for each number of violated constraints. In the low-frequency violated constraints, if the portion of occurrence frequency is higher than the number of states in the assignment setting, then it expresses that learners arrange states that have low error rate. In addition, in the high-violated constraints, if the portion of occurrence frequency is lower than the number of states in the assignment setting, then it shows that learners avoid solutions that potentially have high error rate. Hence, this analysis will support providing the answer to our first research question.
Although two previous analyses show that learners tend to avoid mistakes, they still cannot avoid some mistakes, which demonstrates their difficulty in understanding the problem structure. Therefore, the third part of the analysis inspects the difficulty of learners according to the violation of constraints. We determine the ratio of the number of states in the assignment setting to the occurrence frequency. We examine the relative number of states for each type of constraint and their actual occurrence. If the number of occurrences is high, then the ratio is low. Thus, the minimum ratio in a constraint indicates that learners have difficulty avoiding such types of constraints while posing the problems. This analysis will confirm our second research question regarding whether learners have difficulty avoiding some particular type of constraints.
Results and discussion
In this study, an investigation of learners’ actions at level 5 was conducted. We roughly analyzed every step of the learners. As mentioned in the introduction, the goal of the analysis is to address the following research questions: (RQ1) Do learners pose problems by attempting to avoid as many violated constraints as possible? (RQ2) Do learners have difficulty avoiding a particular type of constraint?
RQ1: Do learners pose problems by attempting to avoid as many violated constraints as possible?
Correlation analysis between the number of violated constraints and the occurrence frequency of the products
Assignment | Pearson’s correlation | p value |
---|---|---|
1 | −0.3701* | 0.0158 |
2 | −0.4928** | 0.0014 |
3 | −0.3879^{+} | 0.0745 |
4 | −0.2565** | 0.0033 |
5 | −0.2778** | 0.0051 |
6 | −0.3460** | 4.51E−05 |
7 | −0.4006** | 1.35E−06 |
8 | −0.3552** | 0.0001 |
9 | −0.3990** | 4.43E−06 |
10 | −0.5619** | 0.0028 |
11 | −0.5570** | 0.0011 |
12 | −0.4486** | 0.0054 |
Difference analysis between portions of number of states in assignment setting to its occurrence frequency
Assignment | Number of violated constraints | Setting vs occurrence | |||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | p | 1 | p | 2 | p | 3 | p | 4 | p | 5 | p | Chi-square | p | ||
1 | Setting occurrence | 0.238 0.230 | ▼ | 0.190 0.370 | ▲ ** | 0.143 0.217 | △ + | 0.190 0.103 | ▼ * | 0.214 0.077 | ▼ ** | 0.024 0.003 | ▽ + | <0.01 | ** |
2 | Setting occurrence | 0.286 0.523 | ▲ ** | 0.214 0.316 | ▲ * | 0.190 0.080 | ▼ ** | 0.214 0.071 | ▼ ** | 0.048 0.003 | ▼ ** | 0.048 0.006 | ▼ ** | <0.01 | ** |
3 | Setting occurrence | 0.308 0.510 | ▲ ** | 0.192 0.189 | ▽ | 0.192 0.161 | ▽ | 0.231 0.107 | ▼ ** | 0.077 0.034 | ▽ | <0.01 | ** | ||
4 | Setting occurrence | 0.324 0.541 | ▲ ** | 0.147 0.196 | △ | 0.176 0.087 | ▼ * | 0.265 0.167 | ▼ * | 0.088 0.009 | ▼ ** | <0.01 | ** | ||
5 | Setting occurrence | 0.324 0.649 | ▲ ** | 0.191 0.191 | 0.265 0.044 | ▼ ** | 0.132 0.103 | ▽ | 0.088 0.013 | ▼ ** | <0.01 | ** | |||
6 | Setting occurrence | 0.324 0.520 | ▲ ** | 0.147 0.190 | △ | 0.176 0.131 | ▽ | 0.265 0.151 | ▼ * | 0.088 0.007 | ▼ ** | <0.01 | ** | ||
7 | Setting occurrence | 0.324 0.500 | ▲ ** | 0.147 0.189 | △ | 0.176 0.149 | ▽ | 0.265 0.139 | ▼ ** | 0.088 0.024 | ▼ * | <0.01 | ** | ||
8 | Setting occurrence | 0.434 0.696 | ▲ ** | 0.081 0.077 | ▽ | 0.265 0.117 | ▼ ** | 0.132 0.077 | ▽ | 0.088 0.034 | ▽ + | <0.01 | ** | ||
9 | Setting occurrence | 0.324 0.546 | ▲ ** | 0.147 0.170 | △ | 0.176 0.106 | ▽ + | 0.265 0.153 | ▼ * | 0.088 0.025 | ▼ * | <0.01 | ** | ||
10 | Setting occurrence | 0.423 0.552 | ▲ * | 0.269 0.256 | ▽ | 0.231 0.161 | ▽ | 0.077 0.031 | ▽ + | <0.10 | + | ||||
11 | Setting occurrence | 0.500 0.912 | ▲ ** | 0.071 0.018 | ▼ * | 0.143 0.055 | ▼ * | 0.048 0.004 | ▼ ** | 0.143 0.011 | ▼ ** | 0.095 0.000 | ▼ ** | <0.01 | ** |
12 | Setting occurrence | 0.333 0.585 | ▲ ** | 0.119 0.118 | ▽ | 0.143 0.094 | ▽ | 0.262 0.180 | ▽ + | 0.095 0.016 | ▼ ** | 0.048 0.007 | ▼ * | <0.01 | ** |
RQ2: Do learners have difficulty avoiding a particular type of constraint?
Ratio of the number of states in the assignment setting to the occurrence frequency according to the type of constraints
Assignment | Type of constraints | ||||
---|---|---|---|---|---|
Calculation | Story | Number | Object | Sentence structure | |
1 | 0.0151^{a} | 0.0230 | 0.0317 | 0.0469 | 0.0350 |
2 | 0.0971^{a} | 0.2308 | 0.3191 | 0.1852 | 0.2308 |
3 | 0.1060^{a} | 0.1224 | 0.2857 | 0.1190 | |
4 | 0.0532 | 0.0458^{a} | 0.1341 | 0.0509 | |
5 | 0.2145 | 0.2113^{a} | 0.6857 | 0.2113^{a} | |
6 | 0.0633 | 0.0467^{a} | 0.1472 | 0.0616 | |
7 | 0.0709 | 0.0559^{a} | 0.1277 | 0.0726 | |
8 | 0.2800 | 0.2778^{a} | 0.3750 | 0.2778^{a} | |
9 | 0.1484 | 0.1297^{a} | 0.2609 | 0.1449 | |
10 | 0.0498 | 0.0448 ^{a} | 0.1081 | 0.0459 | |
11 | 0.9474 ^{a} | 3.3333 | 0.9474^{a} | 1.5000 | 3.3333 |
12 | 0.1705 | 0.1258^{a} | 0.2083 | 0.7143 | 0.2500 |
As previously described, level 5 is required to consider the unknown number because it is not given in the requirement. It is challenging for learners, especially in considering the story constraint. At the previous levels, there is no conflict at the required story type and numerical expression. In addition, the order of numbers in sentences is the same as the numerical expression. For instance, the requirement of level 3 assignment 1: Make a word problem about “How many are there overall” that can be solved by “4 + ? = 10,” learners can pose the required problem by arranging sentences according to the order of numbers in the numerical expression. However, this is not valid for level 5 because the numerical expression does not express the order of numbers in the required story but the solution is to evaluate the unknown number. To complete assignments at this level, for example, in the first assignment, learners need to transform the numerical expression “8 − 3” into the numerical expression representing a combination story, “3 + ? = 8.” Then, learners could assign the existence sentence cards to the number “3” and the unknown number “?.”
Investigation of learners’ activities at the process level promotes an opportunity to discover the learners’ behavior in detail. Moreover, when it is associated with a cognitive load, then the learners’ thinking processes can be explored. Particularly, what conditions learners face difficulties in attempting to pose problems could be detected. With such detections, we could define learning support depending on the learners’ mistakes and develop an adaptive function to overcome learners’ bottlenecks in attempting to pose problems.
Conclusion
We conduct a model-based analysis of problem-posed products as well as intermediate products while posing problems from Monsakun log data of first-grade elementary school students to investigate their methods of thinking in posing arithmetic word problems. This study focuses on the violation of the constraints. The analysis involves intermediate products to prove that the learners attempt to avoid invalid intermediate products. Correlation between the numbers of violated constraints and the frequency of each intermediate product that the learners actually made was reported. Moreover, to determine the detail trends of learners’ actions, a chi-square test between the number of states in the assignment setting and the occurrence frequency was conducted. Significant correlation and difference in 11 out of 12 assignments was found, which shows that many actions performed by learners had the inclination to avoid as many violated constraints as possible. It indicates that they tended to avoid as many mistakes as possible. Furthermore, although learners tended to avoid the violated constraints, they could not avoid some mistakes. However, most of the learners’ mistakes violated at most two constraints. Further analysis shows that, in 12 assignments, learners generally have difficulty fulfilling 2 out of 5 constraints, which are “story” and “calculation” constraints. Based on this analysis, it would be possible to detect the difficulty of learners’ actions from the model perspective. Hence, accurate feedback and appropriate support can be provided.
For future research, we plan to analyze more detail about the characteristics of learners’ thinking processes. We would like to use a data-mining method, such as sequential data mining to discover learners’ action sequences while posing the problems and use the clustering method for grouping learners’ thinking processes. We also would like to explore methods to identify other significant actions. These are required to define learning support, depending on each learner’s cause of mistake and to develop an adaptive function for learning by posing problems.
Declarations
Acknowledgements
This work was supported by JSPS KAKENHI Grant Number 15H02931.
Authors’ contributions
All authors participated in the research designs. AS executed the research under the supervision of YH & TH and drafted the manuscript. All authors read and approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Authors’ Affiliations
References
- Abramovich, S., & Cho, E. K. (2015). Using digital technology for mathematical problem posing. In Mathematical Problem Posing (pp. 71–102). New York: Springer.View ArticleGoogle Scholar
- Barak, M., & Rafaeli, S. (2004). On-line question-posing and peer-assessment as means for web-based knowledge sharing in learning. International Journal of Human-Computer Studies, 61(1), 84–103.View ArticleGoogle Scholar
- Beal, C. R., & Cohen, P. R. (2012). Teach ourselves: Technology to support problem posing in the STEM classroom. Creative Education, 3(4), 513.View ArticleGoogle Scholar
- Bonotto, C. (2013). Artifacts as sources for problem-posing activities. Educational Studies in Mathematics, 83(1), 37–55.View ArticleGoogle Scholar
- Cai, J, & Jiang, C. (2016). An analysis of problem-posing tasks in Chinese and US elementary mathematics textbooks. International Journal of Science and Mathematics Education, 1–20. doi:10.1007/s10763-016-9758-2.
- Cankoy, O. (2014). Interlocked problem posing and children’s problem posing performance in free structured situations. International Journal of Science and Mathematics Education, 12(1), 219–238.View ArticleGoogle Scholar
- Chang, K. E., Wu, L. J., Weng, S. E., & Sung, Y. T. (2012). Embedding game-based problem-solving phase into problem-posing system for mathematics learning. Computers & Education, 58(2), 775–786.View ArticleGoogle Scholar
- Chen, L., Van Dooren, W., Chen, Q., & Verschaffel, L. (2011). An investigation on Chinese teachers’ realistic problem posing and problem solving ability and beliefs. International Journal of Science and Mathematics Education, 9(4), 919–948.View ArticleGoogle Scholar
- Crespo, S. (2003). Learning to pose mathematical problems: exploring changes in preservice teachers’ practices. Educational Studies in Mathematics, 52(3), 243–270.View ArticleGoogle Scholar
- Ellerton, N. F. (2013). Engaging pre-service middle-school teacher-education students in mathematical problem posing: development of an active learning framework. Educational Studies in Mathematics, 83(1), 87–101.View ArticleGoogle Scholar
- English, L. D. (1997). The development of fifth-grade children’s problem-posing abilities. Educational Studies in Mathematics, 34(3), 183–217.View ArticleGoogle Scholar
- English, L. D. (1998). Children’s problem posing within formal and informal contexts. Journal for Research in Mathematics Education, 29(1), 83–106.View ArticleGoogle Scholar
- Fournier-Viger, P., Faghihi, U., Nkambou, R., & Nguifo, E. M. (2010). Exploiting sequential patterns found in users’ solutions and virtual tutor behavior to improve assistance in ITS. Educational Technology & Society, 13(1), 13–24.Google Scholar
- Hasanah, N, Hayashi, Y, & Hirashima, T. (2015a). Analysis of problem-posing process of arithmetical word problems as sentence integration: viewpoint of first selected sentence. In G. Chen, V. Kumar, R. Hong, & S. C. Kong (Eds.), Emerging issues in smart learning (pp. 85–88). Berlin: Springer Berlin Heidelberg.Google Scholar
- Hasanah, N, Hayashi, Y, & Hirashima, T. (2015b). Investigation of students’ performance in Monsakun problem posing activity based on the triplet structure model of arithmetical word problems. In Proceedings of the 23rd International Conference on Computers in Education, pp. 27–36.Google Scholar
- Hirashima, T., Nakano, A., & Takeuchi, A. (2000). A diagnosis function of arithmetical word problems for learning by problem posing. In R. Mizoguchi & J. Slaney (Eds.), PRICAI 2000 Topics in Artificial Intelligence (pp. 745–755). Berlin: Springer, Berlin Heidelberg.View ArticleGoogle Scholar
- Hirashima, T, Yamamoto, S, & Hayashi, Y. (2014). Triplet structure model of arithmetical word problems for learning by problem-posing. In Human Interface and the Management of Information, Information and Knowledge in Applications and Services (pp. 42–50). Cham: Springer International Publishing.Google Scholar
- Hirashima, T., Yamasaki, K., Fukuda, H., & Funaoi, H. (2015). Framework of kit-build concept map for automatic diagnosis and its preliminary use. Research and Practice in Technology Enhanced Learning, 10(1), 17.View ArticleGoogle Scholar
- Hirashima, T., Yokoyama, T., Okamoto, M., & Takeuchi, A. (2007). Learning by problem-posing as sentence-integration and experimental use. Artificial Intelligence in Education., 2007, 254–261.Google Scholar
- Hirashima, T, Yokoyama, T, Okamoto, M, & Takeuchi, A. (2008). Long-term use of learning environment for problem-posing in arithmetical word problems. Proceedings of ICCE, 2008, 817–824.Google Scholar
- Hou, H. T. (2012). Analyzing the learning process of an online role-playing discussion activity. Educational Technology & Society, 15(1), 211–222.Google Scholar
- Hsiao, J. Y., Hung, C. L., Lan, Y. F., & Jeng, Y. C. (2013). Integrating worked examples into problem posing in a web-based learning environment. Turkish Online Journal of Educational Technology-TOJET, 12(2), 166–176.Google Scholar
- Hsieh, Y. H., Lin, Y. C., & Hou, H. T. (2015). Exploring elementary-school students’ engagement patterns in a game-based learning environment. Educational Technology & Society, 18(2), 336–348.Google Scholar
- Hung, CM, Hwang, GJ, & Wang, SY. (2014a). Effects of an integrated mind-mapping and problem-posing approach on students’ in-field mobile learning performance in a natural science course. International Journal of Mobile Learning and Organisation, 8(3), 187–200.Google Scholar
- Hung, PH, Hwang, GJ, Lee, YH, Wu, TH, Vogel, B, Milrad, M, & Johansson, E. (2014b). A problem-based ubiquitous learning approach to improving the questioning abilities of elementary school students. Education Technology & Society, 17(4), 316–334.Google Scholar
- Işık, C., Kar, T., Yalçın, T., & Zehir, K. (2011). Prospective teachers’ skills in problem posing with regard to different problem posing models. Procedia-Social and Behavioral Sciences, 15, 485–489.View ArticleGoogle Scholar
- Kar, T., Özdemir, E., İpek, A. S., & Albayrak, M. (2010). The relation between the problem posing and problem solving skills of prospective elementary mathematics teachers. Procedia-Social and Behavioral Sciences, 2(2), 1577–1583.View ArticleGoogle Scholar
- Kılıç, Ç. (2013). Pre-service primary teachers’ free problem-posing performances in the context of fractions: an example from Turkey. The Asia-Pacific Education Researcher, 22(4), 677–686.View ArticleGoogle Scholar
- Kilpatrick, J. (1987). Problem formulating: where do good problems come from? Cognitive Science and Mathematics Education, 123–147.Google Scholar
- Kojima, K., Miwa, K., & Matsui, T. (2015). Experimental study of learning support through examples in mathematical problem posing. Research and Practice in Technology Enhanced Learning, 10(1), 1.View ArticleGoogle Scholar
- Kurayama, M., & Hirashima, T. (2010). Interactive learning environment designed based on task model of problem-posing. In Proceedings of the 18th International Conference on Computers in Education (pp. 98–100).Google Scholar
- Lan, YF, & Lin, PC. (2011). Evaluation and improvement of student’s question-posing ability in a web-based learning environment. Australasian Journal of Educational Technology, 27(4), 581–599.Google Scholar
- Leikin, R. (2015). Problem posing for and through investigations in a dynamic geometry environment. In Mathematical problem posing (pp. 373–391). New York: Springer.View ArticleGoogle Scholar
- Leung, S. S., & Silver, E. A. (1997). The role of task format, mathematics knowledge, and creative thinking on the arithmetic problem posing of prospective elementary school teachers. Mathematics Education Research Journal, 9(1), 5–24.View ArticleGoogle Scholar
- Majumdar, R, & Iyer, S. (2015). Beyond clickers: tracing patterns in students’ response through iSAT. In Proceedings of the 23rd International Conference on Computers in Education. China: Asia-Pacific Society for Computers in Education, Hangzhou China.Google Scholar
- Melušová, J., & Šunderlík, J. (2014). Pre-service teachers’ problem posing in combinatorics. Proceedings of international conference 12th Mathematics Conference in Nitra held under the auspices. Acta Math., 17, 115–122.Google Scholar
- Mishra, S., & Iyer, S. (2015). An exploration of problem posing-based activities as an assessment tool and as an instructional strategy. Research and Practice in Technology Enhanced Learning, 10(1), 5.View ArticleGoogle Scholar
- Nakano, A., Hirashima, T., & Takeuchi, A. (1999). Problem-making practice to master solution-methods in intelligent learning environment. In Proceedings of ICCE1999 (pp. 891–898).Google Scholar
- Norman, I. (2011). Secondary school students’ problem posing strategies: implications to secondary school students’ problem posing performances. Journal of Edupres, 1, 1–8.Google Scholar
- Pirie, SE. (2002). Problem posing: what can it tell us about students’ mathematical understanding? In Proceedings of the 24th Annual Meeting [of the] North American Chapter of the International Group for the Psychology of Mathematics Education (Vol. 1–4, pp. 927–958), Athens, GA.Google Scholar
- Şengül, S., & Katranci, Y. (2012). Problem solving and problem posing skills of prospective mathematics teachers about the ‘sets’ subject. Procedia-Social and Behavioral Sciences, 69, 1650–1655.View ArticleGoogle Scholar
- Şengül, S., & Katranci, Y. (2015). Free problem posing cases of prospective mathematics teachers: difficulties and solutions. Procedia-Social and Behavioral Sciences, 174, 1983–1990.View ArticleGoogle Scholar
- Shriki, A., & Lavy, I. (2014). Students’ self-assessment of creativity: benefits and limitations. In C. Nicol, S. Oesterle, P. Liljedahl, & D. Allan (Eds.), Proceedings of the 38th Conference of the International Group for the Psychology of Mathematics Education (Vol. 5, pp. 177–184). Vancouver: PME.Google Scholar
- Silver, E. A. (1994). On mathematical problem posing. For the learning of mathematics, 14(1), 19–28.Google Scholar
- Silver, E. A., & Cai, J. (1996). An analysis of arithmetic problem posing by middle school students. Journal for Research in Mathematics Education, 27(5), 521–539.View ArticleGoogle Scholar
- Singer, FM, Ellerton, NF, & Cai, J. (Eds.). (2015). Mathematical problem posing: from research to effective practice. New York: Springer.Google Scholar
- Singer, F. M., Pelczer, I., & Voica, C. (2011). Problem posing and modification as a criterion of mathematical creativity. In Proceedings of the 7th Conference of the European Society for Research in Mathematics Education (CERME 7) (pp. 9–13). Poland: University of Rzeszów.Google Scholar
- Stickles, P. R. (2011). An analysis of secondary and middle school teachers’ mathematical problem posing. Investigations in Mathematics Learning, 3(2), 1–34.Google Scholar
- Stoyanova, E. (2005). Problem-posing strategies used by years 8 and 9 students. Australian Mathematics Teacher, 61(3), 6–11.Google Scholar
- Sung, H. Y., Hwang, G. J., & Chang, Y. C. (2016). Development of a mobile learning system based on a collaborative problem-posing strategy. Interactive Learning Environments, 24(3), 456–471.View ArticleGoogle Scholar
- Supianto, AA, Hayashi, Y, & Hirashima, T. (2016a). An investigation of learner’s actions in problem-posing activity of arithmetic word problems. In Intelligent Tutoring Systems: 13th International Conference, ITS 2016, Zagreb, Croatia, June 7-10, 2016. Proceedings (Vol. 9684, p. 478). Springer.Google Scholar
- Supianto, AA, Hayashi, Y, & Hirashima, T. (2016b). Visualizations of problem-posing activity sequences toward modeling the thinking process. Research and Practice in Technology Enhanced Learning, 11(1), 14.Google Scholar
- Tichá, M, & Hošpesová, A. (2009). Problem posing and development of pedagogical content knowledge in pre-service teacher training. In Proceedings of the 6th Conference of the European Society for Research in Mathematics Education (CERME 6) Lyon, France (pp. 1941–1950).Google Scholar
- Toluk-Uçar, Z. (2009). Developing pre-service teachers understanding of fractions through problem posing. Teaching and Teacher Education, 25(1), 166–175.View ArticleGoogle Scholar
- Van Harpen, X. Y., & Presmeg, N. C. (2013). An investigation of relationships between students’ mathematical problem-posing abilities and their mathematical content knowledge. Educational Studies in Mathematics, 83(1), 117–132.View ArticleGoogle Scholar
- Van Harpen, X. Y., & Sriraman, B. (2013). Creativity and mathematical problem posing: an analysis of high school students’ mathematical problem posing in China and the USA. Educational Studies in Mathematics, 82(2), 201–221.View ArticleGoogle Scholar
- Wilson, E. V. (2004). ExamNet: Asynchronous learning network: augmenting face-to-face courses with student-developed exam questions. Computers & Education, 42(1), 87–107.View ArticleGoogle Scholar
- Yamamoto, S., Kanbe, T., Yoshida, Y., Maeda, K., & Hirashima, T. (2012). A case study of learning by problem-posing in introductory phase of arithmetic word problems. In the Proceedings of the 20th International Conference on Computers in Education (pp. 25–32).Google Scholar
- Yu, F. Y. (2011). Multiple peer-assessment modes to augment online student question-generation processes. Computers & Education, 56(2), 484–494.View ArticleGoogle Scholar