# Kinemathics

Learning is Moving in New Ways
UCB Committee on Research: Faculty Research Grants, 2008-2011 [\$21k]
CDME2018 symposium workshop

The Mathematics Imagery Trainer for Proportion: Make the screen green!

Overview

At EDRL we have become increasingly interested in the idea that “learning is moving in new ways.” This phrase has two meanings: It is both about students learning new concepts by physically moving in new ways and about the field’s theoretical advances in conceptualizing the phenomenon of learning. Through our design-research studies, we are investigating for relations between moving and learning, particularly as these relations may be of relevance to mathematics education.

Since Fall 2008 we have been building and evaluating a type of interactive technological system we call the Mathematics Imagery Trainer. The idea is for students to discover and practice a new way of moving, a purposeful mirco-choreography that is situated in the immediate context of achieving some task objective involving a particular dynamical form of manipulating objects. For example, students sitting at a desk learn to move their hands up from the desk in such a way that the hands’ respective heights over the desk maintain some goal proportion (e.g., 1:2). It is not easy to move this way. One has to figure something out, usually through trial and error. All the while, the students receive automatic feedback on whether or not they are moving correctly. The children learn to move in a new way, and then they describe this motion. The descriptions become mathematical discourse expressing new concepts.

A task-based clinical interview using the Mathematics Imagery Trainer for Proportion.

We are curious about these potential relations between learning to move in this new way and learning the mathematics that these actions might be said to model, such as proportional equivalence. Moreover, we are curious how teachers guide this process of learning to move in new ways; how they frame this new way of moving as a conceptual performance. That is, we are engaged in research on the educational transition from action to concept.

Our premise is that everyday life does not occasion opportunities for children to enact what could then serve as the meaning of some mathematical notions. For example, we can all intuitively gesture what “addition” means and, at a stretch, what “multiplication” means. But what does “proportion” mean or look like? Our design principle is to create interaction problems wherein a student’s coordinated dynamical solution enacts a new sensorimotor scheme underlying the targeted concept. For example, if we program the solution choreography to be proportional motion of two hands, students may develop principled strategies for enacting this physical coordination; if we further interpolate into the learning environment a set of mathematical symbolic artifacts (a Cartesian grid, numerals, etc.), then students may be able to mathematize these emerging strategies in the form of quantitative propositions.

Indeed, this is what we are seeing in empirical data from hundreds of Grade 4-6 students, who participated either in individual, paired, or classroom activities. To date we have worked with Wii, Kinect, and touchscreen (both tablet and large). Particularly exciting findings have come from using eye-tracking technology to study how new mathematical objects emerge into the child’s consciousness (in collaboration with researchers from Utrecht University). This project has also resulted in an NSF-funded effort to create a virtual teacher (GEVAMT).

We have published our findings in numerous peer-reviewed journal articles and conference proceedings, have received grants from federal agencies to fund this line of research, and have been increasingly collaborating on this line of research with other scholars, both in the US and worldwide.

This research on how goal-oriented action on objects gives rise to conceptual notions is theoretically fecund. It invites perspectives from diverse traditions of educational scholarship going back to John Dewey or Lev Vygotsky as well as the many design luminaries who created materials and activities for children to play and learn, such as Maria Montessori or Zoltan Diénès. The action/concept relation is treated by phenomenology philosophers, cognitive linguists, neuroscientists, kinesiologists, and many others. Theoretical models arising from this scholarship are often contested, and certainly their implications to educational practice are heatedly debated. As scientists like to say, “more research is needed.”

Our own research has brought us to the shores of Geneva, so to speak. That is, we realized that our findings resonate strongly with the work of Swiss cognitive-developmental psychologist Jean Piaget — his theory of genetic epistemology. In particular, we have come to characterize learning to move in new ways as developing sensorimotor schemes (how you move) oriented on constructed realities in the field of interaction (what you move). That is, students working with the Mathematical Imagery Trainer apparently develop two interlinked things at the same time: a new bimanual coordination for engaging the field of action, and a new phenomenal category upon or through which this coordination operates. Perhaps most striking are the data visualizations of students’ eye-gaze foci and paths as they figure out and master the interaction problem. We, the researchers, literally see new objects and gaze patterns emerge in the child’s interaction space that were not there before (INTED 2015, HD 2016). As students look at new places and in new ways, they get better at manipulating the interactive device. Soon after, they report on the new objects and patterns they are seeing, and then we help them make mathematical sense of these new objects by way of introducing mathematical frames of reference.

EDRL’s research has become quite interdisciplinary. Some of our closest collaborators are dancers, martial artists, and somatic therapists. The biggest recent boost came from the quarters of sports science. Currently, we are corroborating our findings, refining our theoretical models, developing principles for pedagogical design, and looking to expand our work to other concepts and domains. These are exciting times, and we are constantly inspired. It seems that our learning, too, is moving in new ways. (See also the Mathematics Imagery Trainer page)

Publications

Abdu, R., Tancredi, S., Abrahamson, D., & Balasubramaniam, R. (2023). A complex-systems view on mathematical learning as hand–eye coordination. In M. Schindler, A. Shvarts, & A. Lilienthal (Eds.), Eye-tracking research in mathematics education <Special issue>. Educational Studies in Mathematics. https://doi.org/10.1007/s10649-023-10279-0

ABSTRACT: This paper combines recent developments in theories of knowledge (complex dynamic systems), technologies (embodied interactions), and research tools (multimodal data collection and analysis) to offer new insights into how conceptual mathematical understanding can emerge. A complex dynamic system view models mathematics learning in terms of a multimodal agent who encounters a set of task constraints. The learning process in this context includes destabilizing a systemic configuration (for example, coordination of eye and hand movements) and forming new dynamic stability adapted to the task constraints. To test this model empirically, we applied a method developed to study complex systems, recurrence quantification analysis (RQA), to investigate students’ eye–hand dynamics during a touchscreen mathematics activity for the concept of proportionality. We found that across participants (n = 32), fluently coordinated hand-movement solutions coincided with more stable and predictable gaze patterns. We present a case study of a prototypical participant’s hand–eye RQA and audio–video data to show how the student’s cognitive system transitioned out of prior coordination reflective of additive thinking into a new coordination that can ground multiplicative thinking. These findings constitute empirical substantiation in mathematics education research for cognition as a complex system transitioning among dynamic equilibria.

Abrahamson, D., & Mechsner, F. (2022). Toward synergizing educational research and movement sciences: A dialogue on learning as developing perception for action. Educational Psychology Review, 34(3), 1813-1842. https://doi.org/0.1007/s10648-022-09668-3

ABSTRACT: What could possibly be a meaningful conversation between educational researchers and movement scientists? Curiously, they have much in common. Both groups of researchers increasingly: (1) appreciate the human capacity to enact perceptually guided movement as an overarching psychological model of thinking, problem solving, and learning; (2) theorize the development of perceptual structures, including actual and imaginary percepts, as a key epistemic vehicle for solving motor-control problems; and (3) promote a view of abstract thinking as movement-grounded and movement-oriented perceptual dynamics. Probing toward theoretical synergy between these traditionally disparate fields of research, the present article is built as an interdisciplinary conversation between two researchers—of mathematics education and movement science, respectively—who become aware of their intellectual alignment, garner new insights and inspirations from each other’s work, and speculate on implications of this concordance for their fields. Future exploration into the unity of movement and cognition could enrich dialogue between manifold disciplines, with the overall goal of clarifying, developing, and integrating an interdisciplinary common foundation and framework for the benefit of education.

Tancredi, S., Abdu, R., Balasubramaniam, R., & Abrahamson, D. (2022). Intermodality in multimodal learning analytics for cognitive theory development: A case from embodied design for mathematics learning. In M. Giannakos, D. Spikol, D. Di Mitri, K. Sharma, X. Ochoa, & R. Hammad (Eds.), The multimodal learning analytics handbook (pp. 133-158). Springer International Publishing. https://doi.org/10.1007/978-3-031-08076-0_6

ABSTRACT: Multimodal Learning Analytics (MMLA) grant us insight into learners’ physiological, cognitive, and behavioral activity as it unfolds. In this chapter, we query the relations among modalities, intermodality, in the context of a design-based research program studying the relations between learning to move in new ways and learning to think in new ways. In the first part, we reflect on how different methods have afforded purchase on the investigation, development, and elaboration of theoretical claims about the multimodal enactment of cognitive events, culminating in the use of Recurrence Quantification Analysis (RQA) to quantify the microgenesis of stable new patterns in hand movement and gaze. In the second part, we analyze an RQA case study spanning across hand and gaze modalities to examine the emergence of intermodal coordination at a critical moment in the mathematical task. We conclude with implications and open questions around intermodality in embodied learning.

Tancredi, S., Abdu, R., Balasubramaniam, R., & Abrahamson, D. (2021). Proof of concept: Applying Recurrence Quantification Analysis to model fluency in a math embodied design. In E. de Vries, J. Ahn, & Y. Hod (Eds.), Reflecting the past and embracing the future—Proceedings of the 15th International Conference of the Learning Sciences—ICLS 2021 (pp. 917–919). International Society of the Learning Sciences.

ABSTRACT: We report a subset of results from an exploratory study that modeled mathematics learning using a dynamical systems lens. This study applied Recurrence Quantification Analysis to model participants’ interactions with a touchscreen-based embodied-design learning environment for proportionality, conducting both qualitative (case study) and quantitative (linear regression) analyses. Findings indicate an abrupt change in the RQA meanline metric associated with increased fluency, suggesting a phase transition into a new mode of interaction. These findings suggest theoretical and methodological traction for modeling embodied math learning as phase transitions in a human–technology dynamical system.

Pardos, Z. A., Rosenbaum, L. F., & Abrahamson, D. (2021). Characterizing learner behavior from touchscreen data. International Journal of Child-Computer Interaction, 100357. https://doi.org/10.1016/j.ijcci.2021.100357

ABSTRACT: As educational approaches increasingly adopt digital formats, data logs create a newfound wealth of information about student behaviors in those learning environments for educators and researchers.Yet making sense of that information, particularly to inform pedagogy, remains a significant challenge. Data from digital sensors that sample at the millisecond level of granularity, such as computer mouses or touchscreens, is notoriously difficult to computationally process and mine for patterns. Adding to the challenge is the limited domain knowledge of this biological sensor level of interaction which prohibits a comprehensive manual feature engineering approach to utilize those data streams. In this paper, we attempt to enhance the assessment capability of a touchscreen-based tutoring system by using Recurrent Neural Networks (RNNs) to predict students’ strategies from their 60hz data streams.We hypothesize that the ability of neural networks to learn representations automatically, instead of relying on human feature engineering, may benefit this classification task. Our classification models(including majority class) were trained and cross-validated at several levels on historical data which had been human coded with learners’ strategies. Our RNN approach to this difficult classification task moderately advances performance above logistic regression. We discuss the implications of this performance for enabling greater tutoring system autonomy. We also present visualizations that illustrate how this neural network approach to modeling sensor data can reveal patterns detected by the RNN. The surfaced patterns, regularized from a larger superset of mostly uncoded data, underscore the mix of normative and seemingly idiosyncratic behavior that characterizes the state space of learning at this high frequency level of observation.

Tancredi, S., Abdu, R., Abrahamson, D., & Balasubramaniam, R. (2021). Modeling nonlinear dynamics of fluency development in an embodied-design mathematics learning environment with Recurrence Quantification Analysis. International Journal of Child–Computer Interaction.

ABSTRACT: Although cognitive activity has been modeled through the lens of dynamical systems theory, the field lacks robust demonstrations in the learning of mathematical concepts. One empirical context demonstrating potential for closing this gap is embodied design, wherein students learn to enact new movement patterns that instantiate mathematical schemes. Changes in students’ perceptuomotor behavior in such contexts have been described as bearing markers of systemic phase transitions, but no research to date has characterized these dynamics quantitatively. This study applied a nonlinear analysis method, continuous cross-Recurrence Quantification Analysis (RQA), to touchscreen data excerpts from 39 study participants working with the Mathematics Imagery Trainer on the Parallel Bars problem. We then conducted linear regression analysis of a panel of five RQA metrics on learning phase (Exploration, Discovery, and Fluency) to identify how nonlinear dynamics changed as fluency developed. Results showed an increase in determinism from the Exploration to the Discovery phase, and an increase in recurrence rate, trapping time, mean line length, and normalized entropy from Discovery to Fluency phases. To put these dynamics in context, we qualitatively contrasted the RQA metric trajectories of two case study participants who developed different degrees of fluency. Our results support the hypothesized existence of phase transitions in the human–technology dynamical system during a math learning task. More broadly, this study illustrates the purchase of nonlinear methods on multimodal mathematics learning data and reveals perceptuomotor learning dynamics informative for the design and use of embodied-interaction technologies.

Abrahamson, D. (2021). Grasp actually: An evolutionist argument for enactivist mathematics education. Human Development, 65(2).

ABSTRACT: What evolutionary account explains our capacity to reason mathematically? Identifying the biological provenance of mathematical thinking would bear on education, because we could then design learning environments that simulate ecologically authentic conditions for leveraging this universal phylogenetic inclination. The ancient mechanism coopted for mathematical activity, I propose, is our fundamental organismic capacity to improve our sensorimotor engagement with the environment by detecting, generating, and maintaining goal-oriented perceptual forms regulating action, whether actual or imaginary. As such, the phenomenology of grasping a mathematical notion is literally that—gripping the environment in a new way that promotes interaction. To argue for the plausibility of my thesis, I first survey embodiment literature to implicate cognition as constituted in perceptuomotor engagement. Then, I summarize findings from a design-based research project investigating relations between learning to move in new ways and learning to reason mathematically about these conceptual choreographies. As such, the project proposes educational implications of enactivist evolutionary biology.

Ba, H., & Abrahamson, D. (2021). Taking design to task: A dialogue on task-initiation in STEM activities. Educational Designer, , 4(14), 1–21. http://www.educationaldesigner.org/ed/volume4/issue14/article54/

ABSTRACT: Whereas movement-based STEM learning activities garner increasing interest among designers, researchers, and policy makers, much remains unknown regarding parameters of movement-based activity design affecting learning quality. One such parameter is task-initiation, namely the questions of who decides what should be accomplished with the resources—the designer or the student—and how movement-based STEM learning programs accommodate student choice during task-initiation. In this theoretical paper, we draw on an embodied design theoretical framework to lay out the issue of task-initiation by presenting and comparing two movement-based STEM programs. In both activities, students first perform a task and then model their performance as instantiating STEM concepts, but the programs differ with respect to task-initiation. In one program, the Mathematics Imagery Trainer for Proportion, students learn to perform pre-determined motor-control tasks by developing new perceptuomotor coordinations for enacting goal movements. In another program, Playground Physics, students use real playground equipment, such as a swing, and virtual playground play performances in the app to determine their own task, such as swinging as high as possible. As such, task-initiation design considerations are tightly related to designers’ overall rationales that, in turn, emanate from assumptions concerning, for example, the epistemic constitution of STEM content, the affective allure of STEM practice, manifestations of agency in STEM problem solving, and other contextual details, such as logistical, architectural, institutional, and curricular constraints governing student and teacher experience.

Abrahamson, D., Nathan, M. J., Williams–Pierce, C., Walkington, C., Ottmar, E. R., Soto, H., & Alibali, M. W. (in press). The future of embodied design for mathematics teaching and learning. In S. Ramanathan & I. A. C. Mok (Eds.), Futures of STEM education: Multiple perspectives from researchers (Special issue). Frontiers of Education.

ABSTRACT: A rising epistemological paradigm in the cognitive sciences—embodied cognition—has been stimulating innovative approaches, among educational researchers, to the design and analysis of STEM teaching and learning. The paradigm promotes theorizations of cognitive activity as grounded, or even constituted, in goal-oriented multimodal sensorimotor phenomenology. Conceptual learning, per these theories, could emanate from, or be triggered by, experiences of enacting or witnessing particular movement forms, even before these movements are explicitly signified as illustrating target content. Putting these theories to practice, new types of learning environments are being explored that utilize interactive technologies to initially foster student enactment of conceptually oriented movement forms and only then formalize these gestures and actions in disciplinary formats and language. In turn, new research instruments, such as multimodal learning analytics, now enable researchers to aggregate, integrate, model, and represent students’ physical movements, eye-gaze paths, and verbal–gestural utterance so as to track and evaluate emerging conceptual capacity. We—a cohort of cognitive scientists and design-based researchers of embodied mathematics—survey a set of empirically validated frameworks and principles for enhancing mathematics teaching and learning as dialogic multimodal activity, and we synthetize a set of principles for educational practice.

Flood, V. J., Shvarts, A., & Abrahamson, D. (2020). Teaching with embodied learning technologies for mathematics: Responsive teaching for embodied learning. ZDM Mathematics Education, 52(7), 1307-1331. https://doi.org/10.1007/s11858-020-01165-7

ABSTRACT: As technologies that put the body at the center of mathematics learning enter formal and informal learning spaces, we still know little about the teaching methods educators can use to support students’ learning with these specialized systems. Drawing on ethnomethodological conversation analysis, we present three multimodal ways that educators can be responsive to learners’ embodied ideas and help them transform sensorimotor patterns into mathematically significant perceptions. These techniques include (1) encouraging learners to use gesture to express and reflect on their ideas, (2) presenting multimodal candidate understandings to check comprehension of learners’ embodied ideas, and (3) co-constructing multimodally expressed embodied ideas with learners. We demonstrate how these techniques create opportunities for learning and discuss implications for a multimodal, embodied practice of responsive teaching.

Abrahamson, D., & Abdu, R. (2020, 2020/07/13). Towards an ecological-dynamics design framework for embodied-interaction conceptual learning: The case of dynamic mathematics environments. In T. J. Kopcha, K. D. Valentine, & C. Ocak (Eds.), Embodied cognition and technology for learning [Special issue]. Educational Technology Research and Development, 69, 1889–1923. https://doi.org/10.1007/s11423-020-09805-1.

ABSTRACT: Designers of educational modules for conceptual learning often rely on procedural frameworks to chart out interaction mechanics through which users will develop target understandings. To date, however, there has been no systematic comparative evaluation of such frameworks in terms of their consequences for learning. This lack of empirical evaluation, we submit, is due to the intellectual challenge of pinning down in what fundamental sense these various frameworks differ and, therefore, along which parameters to conduct controlled comparative experimentation. Toward an empirical evaluation of educational-technology design frameworks, this conceptual paper considers the case of dynamic mathematics environments (DME), interactive modules for learning curricular content through manipulating virtual objects. We consider user activities in two paradigmatic DME genres that utilize similar HCI yet different mechanics. To compare these mechanics, we draw from complex dynamic systems theory a constraint-based model of embodied interaction. Task analyses suggest that whereas in one DME genre (GeoGebra) the interaction constraints are a priori inherent in the environment, in another DME genre (Mathematics Imagery Trainer) the constraints are ad hoc emergent in the task. We conjecture differential learning effects of these distinct constraint regimes, concluding that ad hoc emergent task constraints may better facilitate the naturalistic development of cognitive structures grounding targeted conceptual learning. We outline a future empirical research design to compare the pedagogical entailments of these two design frameworks.

Abrahamson, D., & Shulman, A. (2019). Co-constructing movement in mathematics and dance: An interdisciplinary pedagogical dialogue on subjectivity and awareness. Feldenkrais Research Journal, 6, 1–24. https://feldenkraisresearchjournal.org/index.php/journal/article/view/13/8

ABSTRACT: A physical movement can be construed in many ways. For some researchers of mathematics education informed by embodiment theories this is important, as they perceive a mathematical concept as a polysemous structure grounded in multiple interrelated sensorimotor constructions. In this dance is no different. Similarly in both disciplines, the more ways one has of thinking about a movement and the more connections one builds across these different constructions, the deeper and richer one’s understanding and proficiency in enacting the movement and the greater one’s capacity to transpose the learning to new contexts. In both mathematics and dance, instructors thus seek to create conditions for students to develop diverse subjective constructions of the movements they are learning to enact and to explore relations across these different constructions. Any pedagogical discussion of movement, whether in dance or mathematics, must be a discussion of the individual’s subjective phenomenology and increasing awareness. In reflection, the very possibility of the authors’ interdisciplinary dialogue is testimony to the cohesive potential in systemic conceptualizations of human movement.

Shvarts, A., & Abrahamson, D. (2019). Dual-eye-tracking Vygotsky: A microgenetic account of a teaching/learning collaboration in an embodied-interaction technological tutorial for mathematics. Learning, Culture, and Social Interaction, 22, 100316. https://doi.org/10.1016/j.lcsi.2019.05.003

ABSTRACT: Vygotsky conceptualized the teaching/learning process as inherently collaborative. We extend prior evaluations of this claim by enlisting eye-tacking instruments to monitor the perceptual activity of four teacher–student dyads, as the student solves a challenging manipulation problem designed to ground the scientific notion of parabolas in their new sensorimotor routines. Analyzing each dyad’s gaze paths simultaneously with their verbal and gestural utterance led us to model the teaching/learning process as the emergence and dynamic transformation of intersubjective coupling between the student and tutor perception–action systems. While the student’s sensory-motor coordination gradually gravitates towards an effective routine, the tutor’s perception is iteratively launched from the student’s current position, until the tutor detects an optimal moment for verbal intervention. In this micro-zone of proximal development, the student’s motor action comes to align with the tutor’s cultural-perspective strategy; the intervention is thus accomplished by smoothly soliciting from the student a new conceptualization and articulation of their emerged sensory-motor coordination. Our elaboration of the cultural–historical approach to teaching/learning draws on research on joint attention and joint action from the cognitive sciences as well as the embodied-design approach from the educational sciences and demonstrates a compatibility of Vygotsky’s heritage and complex dynamic systems theory. Finally, we discuss the educational value of the observed student–tutor intersubjective coupling phenomena, thus grounding the contribution of this multidisciplinary study within educational concerns.

Abrahamson, D., Flood, V. J., Miele, J. A., & Siu, Y.-T. (2019). Enactivism and ethnomethodological conversation analysis as tools for expanding Universal Design for Learning: The case of visually impaired mathematics students. ZDM Mathematics Education, 51(2), 291-303. https://doi.org/10.1007/s11858-018-0998-1

ABSTRACT: Blind and visually impaired mathematics students must rely on accessible materials such as tactile diagrams to learn mathematics. However, these compensatory materials are frequently found to offer students inferior opportunities for engaging in mathematical practice and do not allow sensorily heterogenous students to collaborate. Such prevailing problems of access and interaction are central concerns of Universal Design for Learning (UDL), an engineering paradigm for inclusive participation in cultural praxis like mathematics. Rather than directly adapt existing artifacts for broader usage, UDL process begins by interrogating the praxis these artifacts serve and then radically re-imagining tools and ecologies to optimize usability for all learners. We argue for the utility of two additional frameworks to enhance UDL efforts: (a) enactivism, a cognitive-sciences view of learning, knowing, and reasoning as modal activity; and (b) ethnomethodological conversation analysis (EMCA), which investigates participants’ multimodal methods for coordinating action and meaning. Combined, these approaches help frame the design and evaluation of opportunities for heterogeneous students to learn mathematics collaboratively in inclusive classrooms by coordinating perceptuo-motor solutions to joint manipulation problems. We contextualize the thesis with a proposal for a pluralist design for proportions, in which a pair of students jointly operate an interactive technological device.

Palatnik, A., & Abrahamson, D. (2018). Rhythmic movement as a tacit enactment goal mobilizing the emergence of mathematical structures. Educational Studies in Mathematics, 99(3), 293–309.

ABSTRACT: This article concerns the purpose, function, and mechanisms of students’ rhythmic behaviors as they solve embodied-interaction problems, specifically problems that require assimilating quantitative information structures embedded into the environment. Analyzing multimodal data of one student tackling a bimanual interaction design for proportion, we observed: (1) evolution of coordinated movements with stable temporal–spatial qualities; (2) breakdown of this proto-rhythmic form when it failed to generalize across the problem space; (3) utilization of available resources to obtain greater specificity by way of measuring spatial spans of movements; (4) determination of an arithmetic pattern governing the sequence of spatial spans; and (5) creation of a meta-rhythmic form that reconciles continuous movement with the arithmetic pattern. The latter reconciliation selectively retired, modified, and recombined features of her previous form. Rhythmic enactment, even where it is not functionally imperative, appears to constitute a tacit adaptation goal. Its breakdown reveals latent phenomenal properties of the environment, creating opportunities for quantitative reasoning, ultimately supporting the learning of curricular content.

Rosen, D. M., Palatnik, A., & Abrahamson, D. (2018). A better story: An embodied-design argument for generic manipulatives. In N. Calder, N. Sinclair, & K. Larkin (Eds.), Using mobile technologies in the learning of mathematics (pp. 189-211). New York: Springer.

ABSTRACT: Mathematics education practitioners and researchers have long debated best pedagogical practices for introducing to students new concepts. We worked with interactive technology of our own design to evaluate an instructional methodology whereby students: (1) first learn to move physically in a new way by solving a coordination problem of moving two virtual objects at the same time, one in each hand; and only then (2) ground these new movements in informal narratives about the objects; as well as (3) generalize these movements as formal mathematical rules. We compared students’ learning gains under two conditions of this methodology, where the virtual objects were either generic (non-representational, not signifying specific contexts, e.g., a circle) or situated (representational, signifying specific contexts, e.g., a hot-air balloon). We summarize findings from analyzing the behaviors of 25 Grade 4 – 6 students who participated individually in tutorial trials with one of the authors. The situated objects gave rise to richer stories than the generic objects, presumably because the students could bring to bear their everyday knowledge of these objects’ properties, scenarios, and typical behaviors. However, in so doing, the students treated the objects’ movements only as framed by those particular stories rather than considering other possible interpretations of those movements, even when those other interpretations would have advanced the learning process, such as by creating productive challenges. We argue that these findings can be explained in light of theoretical models that conceptualize knowledge as emerging from goal-oriented sensorimotor interaction with objects in the environment. We caution that designers and teachers should be aware of the double-edged sword of rich situativity: Familiar objects are perhaps more engaging but can also limit the scope of learning. We advocate for our instructional methodology of entering mathematical concepts through the action level.

Abrahamson, D., & Shulman, A. (2017). Constructing movement in mathematics and dance: An interdisciplinary pedagogical dialogue on subjectivity and awareness. Paper presented at the annual meeting of Movement: Brain, Body, Cognition, Oxford, UK.

ABSTRACT: A physical movement can be construed in many ways. For some researchers of mathematics education informed by embodiment theory this is important, as they perceive a mathematical concept as a polysemous structure grounded in multiple interrelated sensorimotor constructions. In this dance is no different. Similarly in both disciplines, the more ways one has of thinking about a movement and the more connections one builds across these different constructions, the deeper and richer one’s understanding and proficiency in enacting the movement and the greater one’s capacity to transpose the learning to new contexts. In both mathematics and dance, instructors thus seek to create conditions for students to develop diverse subjective constructions of the movements they are learning to enact and to explore relations across these different constructions. Any pedagogical discussion of movement, whether in dance or mathematics, must be a discussion of the individual’s subjective phenomenology and increasing awareness. In reflection, the very possibility of the authors’ interdisciplinary dialogue is testimony to the cohesive potential in systemic conceptualizations of human movement.

Palatnik, A., & Abrahamson, D. (2017). Taking measures to coordinate movements: Unitizing emerges as a method of building event structures for enacting proportion. In E. Galindo & J. Newton (Eds.), “Synergy at the crossroads” — Proceedings of the 39th annual conference of the North-American chapter of the International Group for the Psychology of Mathematics Education (Ch. 13 [Theory and research methods], pp. 1439-1442). Indianapolis, IN: Hoosier Association of Mathematics Teacher Educators.

ABSTRACT: Rhythm is a means of production—a scheme for coordinating the enactment of real or imagined physical movements over time, space, material resources, and concerting participants. In activities requiring the coordination of two or more continuous motor actions, rhythmic re-assembly of the actions creates a goal event structure mediating the enactment. Yet building that structure requires first unitizing continuity. Unitizing could thus be conceptualized as a cultural–historical strategy for supporting mundane routines by parsing, distributing, and codifying activity as a sequence of iterated actions of equivalent magnitude. Ipso facto, unitizing shifts us from naive to disciplinary activity: articulated rhythm is an ontogenetic achievement driving cognitive growth. We present empirical data of a student spontaneously measuring continuous actions as her means of organizing the enactment of a bimanual task designed for proportions.

Duijzer, A. C. G., Shayan, S., Van der Schaaf, M. F., Bakker, A., & Abrahamson, D. (2017). Touchscreen tablets: Coordinating action and perception for mathematical cognition. Frontiers in Psychology, 8(144).

ABSTRACT: Proportional reasoning is important and yet difficult for many students, who often use additive strategies, where multiplicative strategies are better suited. In our research we explore the potential of an interactive touchscreen tablet application to promote proportional reasoning by creating conditions that encourage transitions to multiplicative strategies. The design of this application (Mathematical Imagery Trainer) was inspired by arguments from embodied-cognition theory that mathematical understanding is grounded in sensorimotor schemes. This study draws on a corpus of previously treated data of 9-11 year-old students, who participated individually in semi-structured clinical interviews, in which they solved a manipulation task that required moving two vertical bars at a constant ratio of heights (1:2). Qualitative analyses revealed the frequent emergence of visual attention to the screen location halfway along the bar that was twice as high as the short bar. The hypothesis arose that students used so-called “attentional anchors” (AAs)—psychological constructions of new perceptual structures in the environment that people invent spontaneously as their heuristic means of guiding effective manual actions for managing an otherwise overwhelming task, in this case keeping vertical bars at the same proportion while moving them. We assumed that students’ AAs on the mathematically relevant points were crucial in progressing from additive to multiplicative strategies. Here we seek farther to promote this line of research by reanalyzing data from 38 students (aged 9-11). We ask: (1) What quantitative evidence is there for the emergence of attentional anchors?; and (2) How does the transition from additive to multiplicative reasoning take place when solving embodied proportions tasks in interaction with the touchscreen tablet app? We found that: (a) AAs appeared for all students; (b) the AA-types were few across the students; (c) the AAs were mathematically relevant (top of the bars and halfway along the tall bar); (d) interacting with the tablet was crucial for the AAs’ emergence; and (e) the vast majority of students progressed from additive to multiplicative strategies (as corroborated with oral utterance). We conclude that touchscreen applications have the potential to create interaction conditions for coordinating action and perception for mathematical cognition.

Abrahamson, D., & Bakker, A. (2016). Making sense of movement in embodied design for mathematics learning. In N. Newcombe & S. Weisberg (Eds), Embodied cognition and STEM learning (Special issue). The Psychonomic Society—Cognitive Research: Principles and Implications (CRPI), 1(1), Article #33.

Abstract: Embodiment perspectives from the cognitive sciences offer a rethinking of the role of sensorimotor activity in human learning, knowing, and reasoning. Educational researchers have been evaluating whether and how these perspectives might inform the theory and practice of STEM instruction. Some of these researchers have created technological systems, where students solve sensorimotor interaction problems as cognitive entry into curricular content. However, the field has yet to agree on a conceptually coherent and empirically validated design framework, inspired by embodiment perspectives, for developing these instructional resources. A stumbling block toward such consensus, we propose, is an implicit disagreement among educational researchers on the relation between physical movement and conceptual learning. This hypothesized disagreement could explain the contrasting choices we witness among current designs for learning with respect to instructional methodology for cultivating new physical actions: Whereas some researchers use an approach of direct instruction, such as explicit teaching of gestures, others use an indirect approach, where students must discover effective movements to solve a task. Prior to comparing these approaches, it may help first to clarify key constructs. In this theoretical essay we draw on embodiment and systems literature as well as findings from our design research so as to offer the following taxonomy that may facilitate discourse about movement in STEM learning: (a) distal movement is the technologically extended effect of physical movement on the environment; (b) proximal movement is the physical movements themselves; and (c) sensorimotor schemes are the routinized patterns of cognitive activity that becomes enacted through proximal movement by orienting on so-called attentional anchors. Attentional anchors are goal-oriented phenomenological objects or enactive perceptions (“sensori-”) that organize proximal movement to effect distal movement (“-motor”). All three facets of movement must be considered in analyzing embodied learning processes. We demonstrate that indirect movement instruction enables students to develop new sensorimotor schemes including attentional anchors as idiosyncratic solutions to physical interaction problems. These schemes are by necessity grounded in students’ own agentive relation to the world while also grounding target content, such as mathematical notions.

Significance: Engineering developments in computational technology have created unprecedented opportunities for industry to build and disseminate mathematics-education applications (“apps”). Thousands of these applications are now literally at the fingertips of any child who can access a tablet, smartphone, or personal computer with responsive touchscreen. Educational researchers could contribute to the quality of these ubiquitous consumer products by offering design frameworks informed by theories of learning. However, existing frameworks are derived from interaction theories drawing on epistemological assumptions that are no longer tenable, given the embodiment turn in the cognitive sciences. A proposed systemic reconceptualization of mathematical objects as grounded in sensorimotor schemes for material interaction offers educational designers heuristics for creating activities in which students learn by discovering motion patterns.

Shayan, S., Abrahamson, D., Bakker, A., Duijzer, A. C. G., & Van der Schaaf, M. F. (2017). Eye-tracking the emergence of attentional anchors in a mathematics learning tablet activity. In C. A. Was, F. J. Sansosti, & B. J. Morris (Eds.), Eye-tracking technology applications in educational research (pp. 166-194). Hershey, PA: IGI Global.

ABSTRACT: Little is known about micro-processes by which sensorimotor interaction gives rise to conceptual development. Per embodiment theory, these micro-processes are mediated by dynamical attentional structures. Accordingly this study investigated eye-gaze behaviors during engagement in solving tablet-based bimanual manipulation tasks designed to foster proportional reasoning. Seventy-six elementary- and vocational-school students (9-15 yo) participated in individual task-based clinical interviews. Data gathered included action-logging, eye-tracking, and videography. Analyses revealed the emergence of stable eye-path gaze patterns contemporaneous with first enactments of effective manipulation and prior to verbal articulations of manipulation strategies. Characteristic gaze patterns included consistent or recurring attention to screen locations that bore non-salient stimuli or no stimuli at all yet bore invariant geometric relations to dynamical salient features. Arguably, this research validates empirically hypothetical constructs from constructivism, particularly reflective abstraction.

Morgan, P., & Abrahamson, D. (2016). Cultivating the ineffable: The role of contemplative practice in enactivist learning. For the Learning of Mathematics,36(3), 31-37.

ABSTRACT: We consider designs for conceptual learning where students first engage in pre-symbolic problem solving and then articulate their solutions formally. An enduring problem in these designs has been to support students in accessing their pre-symbolic situated process, so that they can reflect on it and couch it in mathematical form. Contemplative practices may offer practical solutions to this epistemic bottleneck by orienting students not on their explicit thoughts but on nuanced somatic sensations within pre-conceptual liminal space. We support this proposal for a contemplative mathematics program by drawing on Mason and Roth and by citing findings from pilot studies.

Rosen, D. M., Palatnik, A., & Abrahamson, D. (2016). Tradeoffs of situatedness: Iconicity constrains the development of content-oriented sensorimotor schemes.  In M. B. Wood, E. E. Turner, M. Civil, & J. A. Eli (Eds.), Sin fronteras: Questioning borders with(in) mathematics education – Proceedings of the 38th annual meeting of the North-American Chapter of the International Group for the Psychology of Mathematics Education (PME-NA) (Vol. 12, “Technology”, pp. 1509-1516). Tucson, AZ: University of Arizona.

ABSTRACT: Mathematics education practitioners and researchers have long debated best pedagogical practices for introducing new concepts. Our design-based research project evaluated a heuristic framework, whereby students first develop acontextual sensorimotor schemes and only then extend these schemes to incorporate both concrete narratives (grounding) and formal mathematical rules (generalizing). We compared student performance under conditions of working with stark (acontextual) vs. iconic (situated) manipulatives. We summarize findings from analyzing 20 individually administered task-based semi-structured clinical interviews with Grade 4 – 6 participant students. We found tradeoffs of situatedness: Whereas iconic objects elicit richer narratives than stark objects, these narratives may detrimentally constrain the scope of potential sensorimotor schemes students develop in attempt to solve manipulation problems.

Abrahamson, D., Sánchez-García, R., & Trninic, D. (2016). Praxes proxies: Revisiting educational manipulatives from an ecological dynamics perspective. In M. B. Wood, E. E. Turner, M. Civil, & J. A. Eli (Eds.), Sin fronteras: Questioning borders with(in) mathematics education – Proceedings of the 38th annual meeting of the North-American Chapter of the International Group for the Psychology of Mathematics Education (PME-NA) (Vol. 13, “Theory and research methods”, pp. 1565-1572). Tucson, AZ: University of Arizona.

ABSTRACT: The recent proliferation of technological devices with natural user interfaces (e.g., touchscreen tablets) is regenerating scholarship on the role of sensorimotor interaction in conceptual learning. Some researchers of mathematical education have adopted views from constructivism, phenomenology, enactivism, and ecological dynamics to interpret implicit sensorimotor schemes as both forming and manifesting disciplinary competence. Drawing on these views, this theoretical paper discusses what it means to develop a new skill by way of task-oriented interaction with objects. Beginning with sports then moving to mathematics, we focus on a subcategory of pedagogical artifacts that serve students as effective proxies for developing normative application of target schemes. We argue for the contribution of these views to designing artifacts for learning mathematical content.

Flood, V. J., Harrer, B. W., & Abrahamson, D. (2016). The interactional work of configuring a mathematical object in a technology-enabled embodied learning environment. In C.-K. Looi, J. L. Polman, U. Cress, & P. Reimann (Eds.), “Transforming learning, empowering learners,” Proceedings of the International Conference of the Learning Sciences (ICLS 2016) (Vol. 1, “Full Papers”, pp. 466-473). Singapore: International Society of the Learning Sciences.

ABSTRACT: We present a detailed account of interactional mechanisms that support participation in STEM disciplinary practices as an adult and a child explore a technologyenabled embodied learning environment for mathematics. Drawing on ethnomethodological studies of technology-rich workplaces, we trace the process of transforming a vague reference into a mutually available mathematical object: a covariant variable. Our analysis reveals that this mathematical object is an interactional achievement, configured via a reciprocal process of instructing one another’s attention. In particular, we demonstrate how participants’ explicit responsiveness to indexical and multimodal resources achieves this object.

Abrahamson, D., & Sánchez-García, R. (2016). Learning is moving in new ways: The ecological dynamics of mathematics education. Journal of the Learning Sciences, 25(2), 203-239.

ABSTRACT: Whereas emerging technologies, such as touchscreen tablets, are bringing sensorimotor interaction back into mathematics learning activities, existing educational theory is not geared to inform or analyze passages from action to concept. We present case studies of tutor–student behaviors in an embodied-interaction learning environment, the Mathematical Imagery Trainer. Drawing on ecological dynamics—a blend of dynamical-systems theory and ecological psychology—we explain and demonstrate that: (a) students develop sensorimotor schemes as solutions to interaction problems; (b) each scheme is oriented on an attentional anchor—a real or imagined object, area, or other aspect or behavior of the perceptual manifold that emerges to facilitate motor-action coordination; and (c) when symbolic artifacts are introduced into the arena, they may both mediate new affordances for students’ motor-action control and shift their discourse into explicit mathematical re-visualization of the environment. Symbolic artifacts are ontological hybrids evolving from things you act with to things you think with. Students engaged in embodied-interaction learning activities are first attracted to symbolic artifacts as prehensible environmental features optimizing their grip on the world, yet in the course of enacting the improved control routines, the artifacts become frames of reference for establishing and articulating quantitative systems known as mathematical reasoning. [Shorter version appears in PME-NA 2015; See also ICLS 2016 on metaphors as constraints on action.]

Abrahamson, D., Shayan, S., Bakker, A., & Van der Schaaf, M. F. (2016). Eye-tracking Piaget: Capturing the emergence of attentional anchors in the coordination of proportional motor action. Human Development, 58(4-5), 218-244.

ABSTRACT: The combination of two methodological resources—natural-user interfaces (NUI) and multimodal learning analytics (MMLA)—is creating opportunities for educational researchers to empirically evaluate theoretical models accounting for the emergence of concepts from situated sensorimotor activity. 76 participants (9-12 yo) solved tablet-based presymbolic manipulation tasks designed to foster grounded meanings for the mathematical concept of proportional equivalence. Data gathered in task-based semi-structured clinical interviews included action logging, eye-gaze tracking, and videography. Analysis of these data indicates that successful task performance coincided with spontaneous emergence of stable dynamical gaze-path patterns soon followed by multimodal articulation of strategy. Significantly, gaze patterns included unmanipulated, non-salient screen locations. We present cumulative evidence that these gaze patterns served as ‘attentional anchors’ mediating participants’ problem solving. By way of contextualizing our claim, we also present case studies from the various experimental conditions. We interpret the findings as enabling us to revisit, support, refine, and perhaps elaborate on seminal claims from Piaget’s theory of genetic epistemology and in particular his insistence on the role of situated motor-action coordination in the process of reflective abstraction. (Shorter version appears in ICLS 2016; even shorter version in JPS 2016; read Allen & Bickhard (2016) Commentary.)

Eye-tracking data from a Mathematical Imagery Trainer trial reveals that Lars has invented an attentional anchor to coordinate his orthogonal bimanual actions for keeping the screen green. Note how Lars’s eyes keep returning to the origin, and note how the gaze path follows a diagonal line from the origin that corresponds to a linear function. In an exchange not shown here, Lars explains that he is looking at an imaginary diagonal line that connects the left index and right index; he is moving that line  to the right, keeping it at a constant angle.

Hutto, D. D., Kirchhoff, M. D., & Abrahamson, D. (2015). The enactive roots of STEM: Rethinking educational design in mathematics. In P. Chandler & A. Tricot (Eds.), Human movement, physical and mental health, and learning (Special issue). Educational Psychology Review, 27(3), 371-389.

ABSTRACT: New and radically reformative thinking about the enactive and embodied basis of cognition holds out the promise of moving forward age-old debates about whether we learn and how we learn. The radical enactive, embodied view of cognition (REC) poses a direct, and unmitigated, challenge to the trademark assumptions of traditional cognitivist theories of mind— those that characterize cognition as always and everywhere grounded in the manipulation of contentful representations of some kind. REC has had some success in understanding how sports skills and expertise are acquired. But, REC approaches appear to encounter a natural obstacle when it comes to understanding skill acquisition in knowledge-rich, conceptually based domains like the hard sciences and mathematics. This paper offers a proof of concept that REC’s reach can be usefully extended into the domain of science, technology, engineering, and mathematics (STEM) learning, especially when it comes to understanding the deep roots of such learning. In making this case, this paper has five main parts. The section “Ancient Intellectualism and the REC Challenge” briefly introduces REC and situates it with respect to rival views about the cognitive basis of learning. The “Learning REConceived: from Sports to STEM?” section outlines the substantive contribution REC makes to understanding skill acquisition in the domain of sports and identifies reasons for doubting that it will be possible to apply the same approach to knowledge-rich STEM domains. The “Mathematics as Embodied Practice” section gives the general layout for how to understand mathematics as an embodied practice. The section “The Importance of Attentional Anchors” introduces the concept “attentional anchor” and establishes why attentional anchors are important to educational design in STEM domains like mathematics. Finally, drawing on some exciting new empirical studies, the section “Seeing Attentional Anchors” demonstrates how REC can contribute to understanding the roots of STEM learning and inform its learning design, focusing on the case of mathematics.

Shayan, S., Abrahamson, D., Bakker, A., Duijzer, A. C. G., & Van der Schaaf, M. F. (2015). The emergence of proportional reasoning from embodied interaction with a tablet application: An eye-tracking study. In L. Gómez Chova, A. López Martínez, & I. Candel Torres (Eds.), Proceedings of the 9th International Technology, Education, and Development Conference (INTED 2015) (pp. 5732-5741). Madrid: International Academy of Technology, Education, and Development.

ABSTRACT: Embodied cognition is emerging as a promising approach in educational technology. This study is based on the conjecture that a potentially powerful methodology for researching embodied mathematics design would be to gather empirical data on children’s shifting visual attention as they learn to operate the technological devices so as to solve the situated problems. The aim of the study is to gain insight into the role of visual attention in the emergence of new sensorimotor schemes underlying mathematical concepts, especially proportion tasks. The research question is: How does visual attention change in the emergence of sensorimotor schemes during proportional reasoning tasks? An exploratory study was conducted amongst eight 5th- and 6th-grade students (age 10-12 years). Based on the original Mathematical Imagery Trainer for Proportion (MIT-P) designs for Wii and iPad (Abrahamson), a new tablet app has been developed. While students completed the hands-on proportion tasks, a Tobii x2-30 and an external camera were used for real-time processing and storage of both video and gaze data, resulting in integrated videos of hand- and eye movements. Data analysis revealed cross-participant variation in exploration path, progress rate, and inferences. Yet across all participants insight coincided with a shift from: (a) random finger movements accompanied by gazing at salient figural contour; to (b) new bimanual coordinations accompanied by gazing at new non-salient figural features. The study thus supports classical constructivist claims that mathematical concepts are grounded in operatory schemes. In particular, the data literally show the dynamical emergence of attentional anchors for situated problem solving as mediating the development of mathematical concepts. Thus new research methodologies stand to validate claims from embodiment.

Flood, V. J., & Abrahamson, D. (2015). Refining mathematical meanings through multimodal revoicing interactions: The case of “faster”. Paper presented at the annual meeting of the American Educational Research Association, Chicago, April 16-20.

ABSTRACT: How do learners come to connect embodied experience with cultural-historical definitions? We compare two cases of a learner-instructor dyad negotiating the meaning of “faster” to investigate the role embodied, multimodal discourse plays in processes of collaborative semiosis within a technology enhanced discovery-based mathematics learning context (the Mathematical Imagery Trainer for Proportion). We implicate and characterize two new forms of multimodal revoicing interactions: (a) Selective gestural repetition with co-timed elaborated verbal content and (b) Elaborated gestural content with co-timed repeated verbal content in this process. Closer investigation of these forms may lead to deeper understanding of how responsive teaching supports embodied learning.

Abrahamson, D., & Trninic, D. (2015). Bringing forth mathematical concepts: Signifying sensorimotor enactment in fields of promoted action. In D. Reid, L. Brown, A. Coles, & M.-D. Lozano (Eds.), Enactivist methodology in mathematics education research (Special issue). ZDM Mathematics Education, 47(2), 295–306.

ABSTRACT: Inspired by Enactivist philosophy yet in dialog with it, we ask what theory of embodied cognition might best serve in articulating implications of Enactivism for mathematics education. We offer a blend of Dynamical Systems Theory and Sociocultural Theory as an analytic lens on micro-processes of action-to-concept evolution. We also illustrate the methodological utility of design-research as an approach to such theory development. Building on constructs from ecological psychology, cultural anthropology, studies of motor-skill acquisition, and somatic awareness practices, we develop the notion of an ‘‘instrumented field of promoted action’’. Children operating in this field first develop environmentally coupled motoraction coordinations. Next, we introduce into the field new artifacts. The children adopt the artifacts as frames of action and reference, yet in so doing they shift into disciplinary semiotic systems. We exemplify our thesis with two selected excerpts from our videography of Grade 4–6 volunteers participating in task-based clinical interviews centered on the Mathematical Imagery Trainer for Proportion. In particular, we present and analyze cases of either smooth or abrupt transformation in learners’ operatory schemes. We situate our design framework vis-a`-vis seminal contributions to mathematics education research. (See also Abrahamson & Trninic, 2015, in diSessa, Levin, & Brown.)

Abrahamson, D. (2014). Building educational activities for understanding: An elaboration on the embodied-design framework and its epistemic grounds. International Journal of Child-Computer Interaction, 2(1), 1-16.

ABSTRACT: Design researchers should inform the commercial production of educational technology by explicating their tacit design practice in workable structures and language. Two activity genres for grounding mathematical concepts are explained: “perception-based design” builds on learners’ early mental capacity to draw logical inferences from perceptual judgment of intensive quantities in source phenomena, such as displays of color densities; “action-based design” builds on learners’ perceptuomotor capacity to develop new kinesthetic routines for strategic embodied interaction, such as moving the hands at different speeds to keep a screen green. In a primary problem, learners apply or develop non-symbolic perceptuomotor schemas to engage the task effectively; In a secondary problem, learners devise means of appropriating newly interpolated mathematical forms as enactive, semiotic, or epistemic means of enhancing, explaining, and evaluating their primary response. In so doing, learners heuristically determine either inferential parity (perception-based design) or functional parity (action-based design) as epistemic grounds for reconciling naïve and scientific perspectives. Ultimately embodied-learning activities may interleave and synthesize the genres’ elements. This taxonomy opens design practice into richer dialogue with the learning sciences. An appendix lays out the embodied-design framework in a “how to” form amenable for replication both within the domain of mathematics and beyond.

Abrahamson, D., & Lindgren, R. (2014). Embodiment and embodied design. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (2nd Edition) (pp. 358-376). Cambridge, UK: Cambridge University Press.

Abrahamson, D., Lee, R. G., Negrete, A. G., & Gutiérrez, J. F. (2014). Coordinating visualizations of polysemous action: values added for grounding proportion. In F. Rivera, H. Steinbring, & A. Arcavi (Eds.), Visualization as an epistemological learning tool (Special issue). ZDM: The international Journal on Mathematics Education, 46(1), 79-93.

ABSTRACT: We contribute to research on visualization as an epistemic learning tool by inquiring into the didactical potential of having students visualize one phenomenon in accord with two different partial meanings of the same concept. 22 Grade 4-6 students participated in a design study that investigated the emergence of proportional-equivalence notions from mediated perceptuomotor schemas. Working as individuals or pairs in tutorial clinical interviews, students solved non-symbolic interaction problems that utilized remote-sensing technology. Next they used symbolic artifacts interpolated into the problem space as semiotic means to objectify in mathematical register a variety of both additive and multiplicative solution strategies. Finally they reflected on tensions between these competing visualizations of the space. Micro-ethnographic analyses of episodes from three paradigmatic case studies suggest that students reconciled semiotic conflicts by generating heuristic logico–mathematical inferences that integrated competing meanings into cohesive conceptual networks. These inferences hinged on revisualizing additive elements multiplicatively. Implications are drawn for rethinking didactical design for proportions.

Half a unit, half of

a-per-b, multiplicative

Half gets bigger

Half to one, speeds

Students’ strategies for interacting with the Mathematical Imagery Trainer for Proportion: from additive to multiplicative.

Flood, V. J., Schneider, A., Abrahamson, D. (2014) Gesture enhancement of a virtual pedagogical agent: Forms and functions for proportions In J. L. Polman, E. A. Kyza, D. K. O’Neill, I. Tabak, W. R. Penuel, A. S. Jurow, K. O’Connor, T. Lee & L. D’Amico (Eds.), Proceedings of “Learning and Becoming in Practice”, the 11th International Conference of the Learning Sciences (ICLS) 2014 (Vol. 3, pp. 1593-1594). Boulder, CO: International Society of the Learning Sciences.

ABSTRACT: We examine expert human mathematics-tutor gestures in the context of an interactive design for proportionality in order to design a virtual pedagogical agent. Early results implicate distinct gesture morphologies serving consistent contextual functionalities in guiding learners towards quantitative descriptions of proportional relations.

Trninic, D., & Abrahamson, D. (2013). Embodied interaction as designed mediation of conceptual performance. In D. Martinovic, V. Freiman, & Z. Karadag (Eds.), Visual mathematics and cyberlearning (Mathematics education in the digital era, Vol. 1, pp. 119-139). New York: Springer.

ABSTRACT: Can conceptual understanding emerge from embodied interaction? We believe the answer is affirmative, provided that individuals engaged in embodied-interaction activity enjoy structured opportunities to describe their physical actions using instruments, language, and forms pertaining to the targeted concept. In this chapter, we draw on existing literature on embodiment and artifacts to coin and elaborate on the construct of an embodied artifact—a cognitive product of rehearsed performance such as, for example, an arabesque penchée in dance or a flying sidekick in martial arts. We argue that embodied artifacts may encapsulate or “package” cultural knowledge for entry into disciplinary competence not only in explicitly embodied domains, such as dance or martial arts, but also implicitly embodied domains, such as mathematics. Furthermore, we offer that current motion-sensitive cyber-technologies may enable the engineering of precisely the type of learning environments capable of leveraging embodied artifacts as both means of learning and means for studying how learning occurs. We demonstrate one such environment, the Mathematical Imagery Trainer for Proportion (MIT–P), engineered in the context of a design-based research study investigating the mediated emergence of mathematical notions from embodied-interaction instructional activities. In particular, we discuss innovative features of the MIT–P in terms of the technological artifact as well as its user experience. We predict that embodied interaction will become a focus of design for and research on mathematical learning.

Lee, R. G., Hung, M., Negrete, A. G., & Abrahamson, D. (2013). Rationale for a ratio-based conceptualization of slope: Results from a design-oriented embodied-cognition domain analysis. Paper presented at the annual meeting of the American Educational Research Association (Special Interest Group on Research in Mathematics Education), San Francisco, April 27 – May 1.

ABSTRACT: We report encouraging results from the Planning Phase of a co-participatory design-based research project that brings together researchers and teachers interested in incorporating educational technology into high school mathematics classrooms. The following two ideas, which were pivotal to aligning our perspectives, co-emerged in our discourse following curricular reviews and cognitive domain analyses that specifically investigated the potential role of proportional reasoning in learning algebra content: (a) product-based conceptualization of proportional equivalence is pedagogically advantageous over process-based conceptualization; and (b) ratio-based conceptualization of slope is pedagogically advantageous over rate-based conceptualization. We detail findings from our collaborative reflection process and outline principles for the Design Phase, during which our embodied-interaction systems will be further developed to incorporate a product-based conceptualization of slope.

Abrahamson, D. (2013). Toward a taxonomy of design genres: Fostering mathematical insight via perception-based and action-based experiences. J. P. Hourcade, E. A. Miller, & A. Egeland (Eds.), Proceedings of the 12th Annual Interaction Design and Children Conference (IDC 2013) (Vol. “Full Papers,” pp. 218-227). New York: The New School & Sesame Workshop.

ABSTRACT: In a retrospective analysis of my own pedagogical design projects over the past twenty years, I articulate and compare what I discern therein as two distinct activity genres for grounding mathematical concepts. One genre, “perception-based design,” builds on learners’ early mental capacity to draw logical inferences from perceptual judgment of intensive quantities in source phenomena, such as displays of color densities. The other genre, “action-based design,” builds on learners’ perceptuomotor capacity to develop new kinesthetic routines for strategic embodied interaction, such as moving the hands at different speeds to keep a screen green. Both capacities are effective evolutionary means of engaging the world, and both bear pedagogical potential as epistemic resources by which to build meaning for mathematical models of, and solution processes for situated problems. Empirical studies that investigated designs built in these genres suggest a two-step activity format by which instructors can guide learners to reinvent conceptual cores. In a primary problem, learners apply or develop non-symbolic perceptuomotor schemas to engage the task effectively. In a secondary problem, learners devise means of appropriating newly interpolated mathematical forms as enactive, semiotic, or epistemic means of enhancing, explaining, and evaluating their primary response. Whereas my analysis distills activities into two separate genres for rhetorical clarity, ultimately embodied interaction may interleave and synthesize the genres’ elements.

Negrete, A. G., Lee, R. G., & Abrahamson, D. (2013). Facilitating discovery learning in the tablet era: Rethinking activity sequences vis-à-vis digital practices. In M. Martinez & A. Castro Superfine (Eds.),“Broadening Perspectives on Mathematics Thinking and Learning”—Proceedings of the 35th Annual Meeting of the North-American Chapter of the International Group for the Psychology of Mathematics Education (PME-NA 35) (Chap. 10: “Technology,” p. 1205). Chicago, IL: University of Illinois at Chicago.

ABSTRACT: Reflecting on a pilot design-based research intervention with high school participants that implemented a computer-based artifact, we frame our empirical data as a case study of what may occur when digital devices are introduced into a milieu without anticipating preexisting cultural practices surrounding the medium. Three 9th grade students participated in a 25 minutes task-based collaborative clinical interview designed to investigate their mathematical learning via engaging in a tablet-based guided activity for proportion. A tutorial interview protocol we had previously used successfully for a Wii-mote version of the design became undone as the eager students commandeered the tablet’s interface features that set the activity’s interaction mode and numerical items. Whereas our design rationale was thus undermined, we inferred alternative task framings that would respect students’ tablet practices but still support learning.

Trninic, D., & Abrahamson, D. (2012). Embodied artifacts and conceptual performances. In J. v. Aalst, K. Thompson, M. J. Jacobson, & P. Reimann (Eds.), Proceedings of the International Conference of the Learning Sciences: Future of Learning (ICLS 2012) (Vol. 1: Full papers, pp. 283-290). Sydney: University of Sydney / ISLS.

ABSTRACT: Learning scientists are only beginning to appreciate the epistemic, methodological, and pedagogical potential of synergy between two concurrent developments—theory of embodied cognition and technology of embodied interaction. We characterize and evaluate this prospective synergy from a sociocultural perspective. First we analyze learning in explicitly embodied cultural practices (e.g., surfing), then analogize to the implicitly embodied practice of mathematics. We next contextualize the latter via interpreting transcribed tutorial interviews drawn from video data collected in a design-based research study, in which twenty-two 9-to-11year-olds developed notions of proportionality through participating in guided problem-solving activities in an embodied-interaction space. In both surfing and mathematics, we argue, learners develop “embodied artifacts,” i.e. body-based and modular rehearsed actions. Embodied artifacts lend individuals entry into disciplinary competence via participation in action, refinement of operations, and integration into activity structures. Furthermore, embodied artifacts may become signified as “conceptual performances,” wherein performance stands for and constitutes understanding.

Abrahamson, D., Trninic, D., & Gutiérrez, J. F. (2012). You made it! From action to object in guided embodied interaction design. In D. Abrahamson (Chair & Organizer) & M. Eisenberg (Discussant), You’re it! Body, action, and object in STEM learning. In J. v. Aalst, K. Thompson, M. J. Jacobson, & P. Reimann (Eds.), Proceedings of the International Conference of the Learning Sciences: Future of Learning (ICLS 2012) (Vol. 2: Symposia, pp. 99-109). Sydney: University of Sydney.

ABSTRACT: Sixteen established and emerging scholars from seven US universities, who share theoretical perspectives of grounded cognition, empirical contexts of design for STEM content domains, and analytic attention to nuances of multimodal expression, all gather to explore synergy and coherence across their diverging research questions, methodologies, and conclusions. Jointly we ask, What are the relations among embodiment, action, artifacts, and discourse in the development of mathematical, scientific, engineering, or computer-sciences concepts? More specific questions our teams address are: How and when do spatial relations in the perceptual field become the objects we manipulate and name? Does it matter whether we actively engage in a hands-on problem-solving task or just observe vicariously the static or dynamical traces of another person’s current or prior activity? How do we coordinate egocentric and allocentric views into integrated models of phenomena under inquiry? What roles do particular forms of instruction and media play in these learning processes?

Abrahamson, D., Gutiérrez, J. F., Charoenying, T., Negrete, A. G., & Bumbacher, E. (2012). Fostering hooks and shifts: tutorial tactics for guided mathematical discovery. Technology, Knowledge, and learning, 17(1-2), 61-86. DOI: 10.1007/s10758-012-9192-7

ABSTRACT: How do instructors guide students to discover mathematical content? Are current explanatory models of pedagogical practice suitable to capture pragmatic essentials of discovery-based instruction? We examined videographed data from the implementation of a Natural User Interface design for proportions, so as to determine one constructivist tutor’s methodology for fostering expert visualization of learning materials. Our analysis applied professional-perception cognitive–anthropological frameworks. However, several types of tutorial tactics we observed appeared to “fall between the cracks” of these frameworks, due to the discovery-based, physical, and semantically complex nature of our design. We tabulate and exemplify an expanded framework that accommodates the observed tactics. The study complements our earlier focus on students’ agency in discovery (Abrahamson, Trninic, Gutiérrez, Huth, & Lee, 2011) by offering an empirically validated resource for researchers, instructors, and professional developers interested in preparing future teaching for future technology.

Abrahamson, D. (2011, March). Kinemathics: the Mathematical Imagery Trainer. Interactive breakout session and hands on demo session. Cyberlearning Tools for STEM Education Conference. Berkeley, March 8-9.

ABSTRACT: The Kinemathics project uses videogame remote-control technology to create embodied-interaction problem-solving activities for mathematics students to learn challenging topics. Engaging in these activities, students initially discover, rehearse, and explain pre-symbolic, multimodal solution strategies. Subsequently, the students avail of virtual representations, such as a Cartesian grid, as strategic and discursive instruments for progressively elaborating their strategies into grounded conceptual meanings. Our design rationale is inspired by the emerging cognitive-sciences embodied/enactive hypothesis, by which human perception, reasoning, and action share a common neural basis and, in particular, (mathematical) reasoning tacitly engages schematic cognitive traces created in the service of purposeful activity. Our first project took on the middle-school content of proportion (e.g., 2/3 = 4/6). National assessments repeatedly document students’ inappropriate “additive” reasoning about this essentially multiplicative relation (e.g., 2/3 = 4/5). We attribute students’ non-normative reasoning to a paucity of personal opportunity to develop appropriate dynamical imagery by which to make sense of these symbols. Our design, the Mathematical Imagery Trainer (MIT), simulates conceptually appropriate opportunities. The Kinemathics project has been funded by a UC Berkeley grant (COM-FRG; Abrahamson, PI). To date, we have implemented our design with 22 Grade 4-6 students who participated as individuals or pairs in tutorial-style usability tests. Publications coming out of the project have included conference proceedings papers. During the demo session, conference attendees will interact with the design. In the breakout session, we will present video footage of children’s interactions with the MIT.

Abrahamson, D., Trninic, D., & Gutiérrez, J. F. (2011, June). Dialectical investigations of mathematical discovery: the emergence of disciplinary forms in an embodied-interaction design for proportions. Paper presented at the annual meeting of the Jean Piaget Society, Berkeley, June 2-4.

ABSTRACT: Responding to recent calls to develop cognitivist-cum-sociocultural theoretical models of mathematical learning, we present case analyses of students’ creative appropriation of forms emerging from interaction with symbolic artifacts. In this bootstrapping procedure, problem solvers: (1) hook – when a symbolic artifact is first introduced into the interaction space, they engage it because they recognize its contextual utility for enhancing the enactment, explanation, or evaluation of their current solution strategy; then (2) shift – in the course of implementing these new affordances, they notice in these artifacts additional embedded properties as affording a new or reconfigured strategy that better meets domain-general criteria of conciseness, precision, prediction, and – in the case of co-production with a peer – communication, coordination, and collaboration. These new strategies are then sanctioned by the instructor, who views the shift as advancing the child’s process of mathematization closer to disciplinary structures and procedures, in accord with the intervention’s pedagogical objectives. We support and elaborate the proposed constructs with a set of selected episodes from videographed empirical data gathered in a design-based research study that investigated the emergence of mathematical concepts from guided embodied-interaction activity (n=22; ages 9-11). We list and explain critical interaction dimensions enabling such learning.

Trninic, D., Gutiérrez, J. F., Lee, R. G., & Abrahamson, D. (2011, April). Generative immersion and immersive generativity in instructional design. Paper presented at the annual meeting of the American Educational Research Association (SIG Research in Mathematics Education). New Orleans, LA, April 8 – 12, 2011.

ABSTRACT: Design and selection of pedagogically effective mathematical problems raises enduring yet undertheorized problems for educational research. We revisit traditional abstract/concrete and decontextualized/situated dichotomies, questioning their apparent epistemological and ontological assumptions, and evaluate these dichotomies in light of a view of mathematics learning as the mediated cognitive activity of connection building. Orthogonal to traditional dichotomies, we contend, and more pedagogically relevant, are problems’ immersiveness, i.e., capacity to foster personally meaningful situativity, and generativity, i.e., capacity to elicit relevant connections. We illustrate our argument through qualitative analysis of empirical episodes collected in a design-based research study investigating the microgenesis of mathematical meaning.

Abrahamson, D., Gutiérrez, J. F., Lee, R. G, Reinholz, D., & Trninic, D. (2011, April). From tacit sensorimotor coupling to articulated mathematical reasoning in an embodied design for proportional reasoning. In R. Goldman (Chair), H. Kwah & D. Abrahamson (Organizers), & R. P. Hall (Discussant), Diverse perspectives on embodied learning: what’s so hard to grasp? Symposium presented at the annual meeting of the American Educational Research Association (SIG Advanced Technologies for Learning). New Orleans, LA, April 8 – 12, 2011.

ABSTRACT: Mathematics education designers and researchers are beginning to appreciate the pedagogical potential of embodied interaction (EI) instructional activities, yet little theory is available to understand its historical roots, sociocognitive mechanisms, and implementation practice. We draw on empirical data (= 22) from a Grades 4-6 EI interview-based exploratory design for proportionality that involved “What’s-my-rule?” remote-controlling of virtual objects on a computer display. Students were guided to reinvent mathematical concepts by reflectively instrumenting entrained perceptuomotor competence with interpolated symbolical artifacts. Analyzing qualitatively for critical dimensions, we propose and demonstrate three interaction milestones enabling or constraining learners’ participation in conceptual EI activities: (a) re-seeing particular design features as peripheral-technological rather than central-mathematical; (b) re-seeing some would-be pragmatic actions as epistemic; and (c) re-seeing symbolic artifacts as affording or enhancing the enactment, explanation, or evaluation of hands-in immersive solution procedures. We delineate emergent principles for an effective EI mathematics design framework.

Gutiérrez, J. F., Trninic, D., Lee, R. G., & Abrahamson, D. (2011, April). Hooks and shifts in instrumented mathematics learning. Paper presented at the annual meeting of the American Educational Research Association (SIG Learning Sciences). New Orleans, LA, April 8 – 12, 2011.

ABSTRACT: This paper presents and analyzes vignettes selected from empirical data gathered in a design-based research study investigating the microgenesis of proportional reasoning through technology-mediated embodied interaction. 22 Grades 4-6 students participated in individual or paired semi-structured clinical interviews in which they engaged in problem-solving activities involving remote manipulation of virtual objects on a computer screen. At different points throughout these interviews, the interviewer introduced various symbolic artifacts into the problem space, such as a Cartesian grid and y-axis numerals. In our on-going microgenetic analyses, we have observed that participants appropriated the artifacts as strategic or discursive means of accomplishing their goals; yet in the course of enacting these goal-oriented tasks, the participants recognized certain other embedded affordances in these symbolic artifacts as supporting the development of a more sophisticated strategy. We have characterized this two-step mediated-discovery process as: (a) hooks—appropriating an artifact as enactive, explanatory, or evaluative means; and (b) shifts—spontaneously reconfiguring current or emerging strategy to avail of the artifact’s newly discovered affordances. This paper stems from this on-going work and extends the findings. Specifically, I here provide quantitative data about the frequency of participants’ hooking/shifting the grid and numerals and elaborate on interaction parameters enabling or hindering hooks and shifts in artifact-mediated discovery-based learning.

Trninic, D., Gutiérrez, J. F., & Abrahamson, D. (2011). Virtual mathematical inquiry: problem solving at the gestural–symbolic interface of remote-control embodied-interaction design. In G. Stahl, H. Spada, N. Miyake, & N. Law (Eds.), Connecting Computer-Supported Collaborative Learning to Policy and Practice: CSCL2011 Conference Proceedings (Vol. 1 — Long Papers, pp. 272-279). Hong Kong: International Society of the Learning Sciences.

ABSTRACT: What are the unique affordances of embodied-interaction design for mathematics learning? How can the development and implementation of such design aid us in building theory of learning? We draw on media studies to argue that activities situated at the hybrid intersection of two media, for example physical-virtual interfaces in some embodied-interaction designs, provide unique affordances both for learning and for understanding learning. And yet, we look back to seminal theories of human learning at the intersection of media, particularly those of Vygotsky and collaborators, as holding key insights for the future development of effective computer-based learning environments. To support our perspectives, we draw on empirical data from a recent design-based research study that examined the emergence of mathematical concepts from embodied-interaction activity. In particular, we present, analyze, and juxtapose two case-study episodes respectively illustrating students’ success or failure in appropriating a conceptual system embedded in a technological system.

Abrahamson, D., & Trninic, D. (2011). Toward an embodied-interaction design framework for mathematical concepts. In P. Blikstein & P. Marshall (Eds.), Proceedings of the 10th Annual Interaction Design and Children Conference (IDC 2011), Ann Arbor, MI, June 20-23 (Vol. Full papers], pp. 1-10). IDC.

ABSTRACT: Recent, empirically supported theories of cognition indicate that human reasoning, including mathematical problem solving, is based in tacit spatial-temporal action. Implications of these findings for the philosophy and design of mathematics instruction may be momentous. Here, we build on design-based research efforts centered on exploring the potential of embodied interaction (EI) for mathematics learning. We sketch two emerging reciprocal contributions: (1) a sociocognitive view on the role of automated feedback in building the perceptuomotor schemes that undergird conceptual development; and (2) a heuristic EI design framework. We ground these ideas in vignettes of children engaging an EI design for proportion. Increasing ubiquity and access to mobile devices that are geared to avail of EI principles suggests the feasibility of mass-disseminating materials evolving from this research.

Trninic, D., & Abrahamson, D. (2011). Emergent ontology in embodied interaction: automated feedback as conceptual placeholder. In L. R. Wiest & T. Lamberg (Eds.), Proceedings of the 33rd Annual Meeting of the North American Chapter of the International Group for the Psychology of Mathematics Education (pp. 1777-1785). Reno, NV: University of Nevada, Reno.

ABSTRACT: Recent theories of cognition model human reasoning as tacit simulated action. Implications for the philosophy, design, and practice of mathematics instruction may be momentous. We report on findings from a pioneering design-based research study into the embodied roots of proportional reasoning that also explored the pedagogical potential of embodied-interaction (EI), a form of technology-enabled immersive activity. 22 Grade 4-6 individual/paired interviewees remote-controlled virtual objects in a non-symbolic space to solve a problem, then progressively mathematized their strategy using symbolic artifacts interpolated into the space. Drawing on qualitative analyses of the filmed work, we build a sociocognitive account of the role of automated feedback in the mediated construction of perceptuomotor schemes that undergird conceptual development, and we offer a heuristic EI design framework.

Trninic, D., Gutiérrez, J. F., & Abrahamson, D. (2011). Instruction and embodied design. In A. Antle, P. Marshall, & E. van den Hoven (Chairs), workshop on Embodied Interaction: Theory and Practice in HCI. In G. Fitzpatrick & C. Gutwin (Eds.), Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (CHI 2011), Vancouver, May 7-12, 2011.

ABSTRACT: We present a recent embodied-interaction instructional design, the Mathematical Imagery Trainer (MIT), for helping young students develop a grounded understanding of proportional equivalence (e.g., 2/3 = 4/6). The implementation of this design serves as our context for developing a heuristic design framework for instructional embodied-interaction activities.

Abrahamson, D., Trninic, D., Gutiérrez, J. F., Huth, J., & Lee, R. G. (2011). Hooks and shifts: a dialectical study of mediated discovery. Technology, Knowledge, and Learning, 16(1), 55-85.

ABSTRACT: Radical constructivists advocate discovery-based pedagogical regimes that enable students to incrementally and continuously adapt their cognitive structures to the instrumented cultural environment. Some sociocultural theorists, however, maintain that learning implies discontinuity in conceptual development, because novices must appropriate expert analyses that are schematically incommensurate with their naive views. Adopting a conciliatory, dialectical perspective, we concur that naive and analytic schemes are operationally distinct and that cultural–historical artifacts are instrumental in schematic reconfiguration yet argue that students can be steered to bootstrap this reconfiguration in situ; moreover, students can do so without any direct modeling from persons fluent in the situated use of the artifacts. To support the plausibility of this mediated-discovery hypothesis, we present and analyze vignettes selected from empirical data gathered in a conjecture-driven design-based research study investigating the microgenesis of proportional reasoning through guided engagement in technology-based embodied interaction. 22 Grade 4-6 students participated in individual or paired semi-structured tutorial clinical interviews, in which they were tasked to remote-control the location of virtual objects on a computer display monitor so as to elicit a target feedback of making the screen green. The screen would be green only when the objects were manipulated on the screen in accord with a “mystery” rule. Once the participants had developed and articulated a successful manipulation strategy, we interpolated various symbolic artifacts onto the problem space, such as a Cartesian grid. Participants appropriated the artifacts as strategic or discursive means of accomplishing their goals. Yet, so doing, they found themselves attending to and engaging certain other embedded affordances in these artifacts that they had not initially noticed yet were supporting performance subgoals. Consequently, their operation schemas were surreptitiously modulated or reconfigured—they saw the situation anew and, moreover, acknowledged their emergent strategies as enabling advantageous interaction. We propose to characterize this two-step guided re-invention process as: (a) hooking—engaging an artifact as an enabling, enactive, enhancing, evaluative, or explanatory means of effecting and elaborating a current strategy; and (b) shifting—tacitly reconfiguring current strategy in response to the hooked artifact’s emergent affordances that are disclosed only through actively engaging the artifact. Looking closely at two cases and surveying others, we delineate mediated interaction factors enabling or impeding hook-and-shift learning. The apparent cognitive–pedagogical utility of these behaviors suggests that this ontological innovation could inform the development of a heuristic design principle for deliberately fostering similar learning experiences.

Howison, M., Trninic, D., Reinholz, D., & Abrahamson, D. (2011). The Mathematical Imagery Trainer: from embodied interaction to conceptual learning. In G. Fitzpatrick, C. Gutwin, B. Begole, W. A. Kellogg & D. Tan (Eds.), Proceedings of the annual meeting of CHI: ACM Conference on Human Factors in Computing Systems (CHI 2011), Vancouver, May 7-12, 2011 (Vol. “Full Papers”, pp. 1989-1998). ACM: CHI (CD ROM).

ABSTRACT: We introduce an embodied-interaction instructional design, the Mathematical Imagery Trainer (MIT), for helping young students develop grounded understanding of proportional equivalence (e.g., 2/3 = 4/6). Taking advantage of the low-cost availability of hand-motion tracking provided by the Nintendo Wii remote, the MIT applies cognitive-science findings that mathematical concepts are grounded in mental simulation of dynamic imagery, which is acquired through perceiving, planning, and performing actions with the body. We describe our rationale for and implementation of the MIT through a design-based research approach and report on clinical interviews with twenty-two 4th–6th grade students who engaged in problem-solving tasks with the MIT.

Abrahamson, D., & Howison, M. L. (2010, May). Kinemathics: Exploring kinesthetically induced mathematical learning. Paper presented at the annual meeting of the American Educational Research Association, April 30 – May 4.

ABSTRACT: Building on growing evidence that human reasoning simulates multi-modal dynamical imagery drawn from lived experience, we conjectured that some mathematical concepts are challenging because their images are difficult to simulate mentally and that this difficulty, in turn, is directly implicative of the difficulty to enact these concepts physically. For example, two linked equal-rate linear growths are easier to process than two linked different-rate linear growths, because miming the latter is by far more difficult to coordinate ambidextrously. To examine our conjecture, we built a computer-based servo-mechanical device, the Mathematical Imagery Trainer, designed to induce in students the physically challenging concept of proportionality and measured for reflective-learning gains. The full paper reports on a study with thirty 4th-grade students.

Abrahamson, D., & Howison, M. L. (2010, May). Embodied artifacts: Coordinated action as an object-to-think-with. In D. L. Holton (Chair) & J. P. Gee (Discussant), Embodied and enactive approaches to instruction: implications and innovations. Paper presented at the annual meeting of the American Educational Research Association, April 30 – May 4.

ABSTRACT: Building on growing evidence that human reasoning simulates multi-modal dynamical imagery drawn from lived experience (e.g., Barsalou, 2008), we conjectured that some mathematical concepts may be difficult to learn precisely because our everyday experience fails to provide adequate opportunities to develop the requisite body-based imagery underlying those specific concepts. To evaluate this conjecture, we are conducting a study in which we first provide students with a “ready-made” visual–kinesthetic basis for developing imagery pertaining to a difficult mathematical concept and then measure the effects of such provision on their emergent understanding of the targeted mathematical concept. This initially “meaningless” yet embodied experience (aka the “Karate Kid effect” http://www.youtube.com/watch?v=3PycZtfns_U) is to play a pedagogical role analogous to concrete artifacts, such as an abacus, pendulum, or dice, in terms of creating opportunities for guided reflection, mathematization, and reinvention of culturally knowledge.

Our study is thus geared to comment on theoretical models that argue for an embodied basis of mathematical learning and reasoning. Prior arguments build either on theoretical analyses of human reasoning (Barsalou, 1999; Goldin, 1987; Lakoff & Núñez, 2000), empirical studies of human activity in general (Clark, 1999; Hatano, Miyake, & Binks, 1977), interpretations of mathematics students’ behaviors (Abrahamson, 2004, 2009; Fuson & Abrahamson, 2005; Nemirovsky, Tierney, & Wright, 1998), or specifically evidence of gestures accompanying speech utterances produced during the solution of mathematical problems (Alibali et al., 1999; Edwards, Radford, & Arzarello, 2009). Whereas these studies furnish strong support for the potential viability of the embodied conjecture, and whereas they have demonstrated the plausibility of an embodied substrate for working memory, they have not established conclusively a sine qua nonrole of multi-modal dynamical imagery in the ontological development of mathematical concepts. Namely, it has yet to be shown compellingly that imagery plays more than a supportive or epiphenomenal role in the instruction of essentially abstract concepts (cf., Schwartz & Black, 1999).

We chose the mathematical content domain of proportionality because rational numbers are fraught with conceptual challenges (e.g., Lamon, 2007). We conjecture that students’ difficulties with proportionality, and in particular their “additive” or “same difference” errors, stem from their lack of a suitable dynamic image in which to ground their understanding of proportionality. We have developed a device that trains the user to perform arm motions describing proportional growth.

Clearly, this is pioneering work in progress, and assessment tools are still under development. Yet, we feel confident that there is already sufficient theoretical material for sparking useful scholarly discourse. Notwithstanding, by AERA we will have collected and analyzed empirical data from a study we are conducting this fall with thirty 4th-grade students. During the symposium, we will also demonstrate the technology.

Reinholz, D., Trninic, D., Howison, M., & Abrahamson, D. (2010). It’s not easy being green: embodied artifacts and the guided emergence of mathematical meaning. In P. Brosnan, Erchick, D., & Flevares, L. (Eds.), Proceedings of the Thirty-Second Annual Meeting of the North-American Chapter of the International Group for the Psychology of Mathematics Education (PME-NA 32) (Vol. VI, Ch. 18: Technology, pp. 1488 – 1496). Columbus, OH: PME-NA.

ABSTRACT: Situated at the intersection of research on embodied cognition and semiotic mediation, this on-going design-based research study of deep mathematics learning focuses on Grade 4-6 students’ guided task-based interaction with a novel computer-based hand-tracking system built to suggest the limitations of naïve additive schemes and create opportunities to develop core notions of proportionality as elaborations on these schemes, even before engaging numerical semiotic forms. Study participants struggled with canonical issues inherent to rational numbers: embarking from additive expectation expressed as virtual manipulation, they formulated a string of insights leading up to a new type of equivalence class. Reported as a case study of Itamar, a 5th-grade middle-achieving male student, our analyses reveal emergence of conceptually critical mathematical meanings in an activity that initially bears little mathematical significance.

Trninic, D., Reinholz, D., Howison, M., & Abrahamson, D. (2010). Design as an object-to-think-with: semiotic potential emerges through collaborative reflective conversation with material. In P. Brosnan, Erchick, D., & Flevares, L. (Eds.), Proceedings of the Thirty-Second Annual Meeting of the North-American Chapter of the International Group for the Psychology of Mathematics Education (PME-NA 32) (Vol. VI, Ch. 18: Technology, 1523 – 1530). Columbus, OH: PME-NA.

ABSTRACT: We chart a historical analysis of a collaborative design-based research project investigating the emergence of mathematical meaning from embodied interaction with a technological tracking-system supporting the learning of proportionality. Recounting iterative cycles of a conceptually critical perceptual feedback element, we articulate three interconnected images of research-based designers: (a) Janus the two-headed keeper of passageways who sees artifacts alternately as a student would or as an expert would; (b) an investigator searching to explicate design decisions coherently in light of learning-sciences theory; and (c) a reflective practitioner who embraces tradeoffs and is open to constructive criticism and to implementing radical changes to design and theory. Ultimately, we posit, we as researchers are continuously developing professional vision for our own design even as the design changes.

Abrahamson, D., & Howison, M. (2008). Kinemathics: kinetically induced mathematical learning. Paper presented at the UC Berkeley Gesture Study Group (E. Sweetser, Director), December 5, 2008.

Tutor and student co-manipulate virtual objects on the Mathematical Imagery Trainer for Proportion.

The mechanical version of the Mathematical Imagery Trainer