Metacognitive links connecting the Arts and STEM

by Jessica Santangelo and Ilona Pierce, Hofstra University

We may be an unlikely pair at first glance – an actor and a biologist. We met after Jess gave a talk about the role of metacognition in supporting student learning in biology. Ilona realized during the talk that, though unfamiliar with the term metacognition, what she does with theatre students is inherently metacognitive. This has led to rich conversations about metacognition, the role of metacognition in teaching, and the overlap between the arts and STEM (Science, Technology, Engineering and mathematics).

Here we offer a condensed version of one of our conversations in which we explored the overlap between metacognition in the arts and STEM (STEAM).

Ilona: In actor training, (or voice/speech training, which is my specialty) self-reflection is the core part of an actor’s growth. After a technique is introduced and application begins, we start to identify each student’s obstacles. In voice work, we examine different ways we tighten our voices and bodies then explore pathways to address the tension. As tension is released, I’ll typically ask, “What do you notice? How are things different than they were when we began?”  This is what hooked me in at your lecture….you worked with the students, uncovering their shortcomings (their version of TENSION) and you watched their test scores go up. It was a great thing to see, but I sat there thinking, “doesn’t every teacher do that?”

Jess: In my experience, most STEM courses do not intentionally or explicitly support students reflecting on themselves, their performance, or their learning strategies. I’m not entirely sure why that is. It may be a function of how we (college-level STEM educators) were “brought up,” that many of us never had formal training in pedagogy, and/or that many STEM educators don’t feel they have time within the course to support students in this way.

When you contacted me after the lecture, I had an “aha!” moment in which I thought “Woah! She does this every day as an inherent part of what she does with her students. It’s not something special, it’s just what everyone does because it’s essential to the students’ learning and to their ability to grow as actors.” Though you hadn’t been aware of the term “metacognition” before the talk, what you are having your students do IS metacognitive.

Ilona: Of course, the students have to be taught to notice, and prodded into verbalizing their observations. In the beginning, when I ask, “What do you notice?” I’m typically met with silence. They don’t know what they notice. I have to guide them: “How has your breathing changed? Are you standing differently? What emotions arose?” As the course goes on, I’ll ask for deeper observations like, “How does your thinking/behavior during class help you/hinder you? What patterns are arising?” It’s not unusual to hear things like, “I realized I talk fast so that people don’t have the chance to interrupt me,” or “If I speak loudly, I’m afraid people will think I’m rude.”

Jess: I think that highlights a difference in the approach that educators within our respective fields take to our interactions with students. Your class is entirely focused on the student, the student’s experience, and having the student reflect on their experience so they can adjust/adapt as necessary.

In contrast, for many years, the design of STEM courses and our interactions with students focused on the conveyance of content and concepts to students. Some STEM classes are becoming more focused on having the students DO something with content/concepts in the classroom (i.e., active learning and flipped classrooms), but that hasn’t always been the case. Nor does having an active learning or flipped classroom mean that the course intentionally or explicitly supports student metacognitive development.

Ilona: Principles and content are an important part my coursework as well, but most of it is folded into the application of the skills they’re learning. The environment helps to support this kind of teaching. My students are hungry young artists  and the class size is 16 – 18 max. This allows me to begin by “teaching” to the group at large, and then transition to doing one-on-one coaching.

When you work with your students, do you work individually or in small groups?

Jess: I am pretty constrained in terms of what I can do in the classroom as I generally have 44-66 students/section (and faculty at other institutions are even more constrained with 100+ students/section!). However, even with my class size, I generally try to minimize whole-group lecture by having students work in small groups in the classroom, prompting them to discuss how they came to a conclusion and to make their learning visible to each other. One-on-one “coaching” generally occurs during office hours.

I’m really drawn to the word “coaching” here. I feel like you literally coach students – that you work with them, meeting them wherever they are in that moment, and help them gain awareness and skills to get to some endpoint. Does that accurately capture how you view yourself and your role? How does that play out in terms of your approach to your classes and to your interactions with students?

Ilona: I think it’s “teacher” first and then I transition to “coach”.  But I also use one-on-one coaching to teach the entire class. For example, one student gets up to share a monologue or a poem.  Afterwards, I ask a question, maybe a couple: ”What did you notice about your breathing? Your body? Your emotions?” If the student has difficulty answering, I’ll guide them to what I noticed: “Did you notice… i.e. your hands were in fists the whole time?” I might turn to the class and say, “Did you guys notice his hands?” The class typically will notice things the performer doesn’t. I’ll ask the class, “As an audience member, how did his clenched hands make you feel (emotionally, physically)? Did you want him to let them go, or did it help the piece?”  So the coaching bounces from the individual to the group, asking for self-reflection from everyone.

Jess: It sounds like we do something similar in that, as I prompt one student in a small group to explain how they arrived at a conclusion, I’m using that as an opportunity to model a thought process for the rest of the group. Modeling the thought process alone isn’t necessarily metacognitive, but I take it a step farther by asking students to articulate how the thought process influenced their ability to come to an accurate conclusion and then asking them to apply a similar process in other contexts. I’m essentially coaching them towards using thought process that is inquisitive, logical, and evidence-based – I’m coaching them to think like a scientist.

When I reflect on my title: professor/teacher/instructor/educator versus coach, I’m struck that the title brings up very different ideas for me about my role in the classroom – it shifts my perspective. When I think of professor/teacher/instructor/educator, I think of someone who is delivering content. When I think of a coach, I think of someone standing on the sidelines, observing an athlete perform, asking the athlete to do various exercises/activities/drills to improve various aspects of their performance. You seem to fit squarely in the “coach” category to me – you are watching the students perform, asking students to reflect on that performance, and then doing exercises to improve performance via the release of tension.

Ilona: I definitely do both. Coaching to me implies individualized teaching that is structured in a way to foster independence. Eventually, a coach may just ask questions or offers reminders. It’s the last stop before students leave to handle things on their own. Like parenting, right? We start with “hands on”, and over time we teach our children to become more and more independent, until they don’t need us anymore.

Jess: I wonder how often STEM educators think of themselves at coaches? How does viewing oneself as a coach alter what one does in the classroom? Is there a balance to be struck between “teaching” and “coaching”? How much overlap exists between those approaches?

In thinking about myself, I can wear both hats depending on the circumstance. I can “teach” content and “coach” to help students become aware of their level of content mastery. When I think of myself as a teacher, I feel responsible for getting students to the right answer. When I think of myself as a coach, I feel more responsible for helping them be aware of what they know/don’t know and supporting their use of strategies to help them be successful. Isn’t that the point of an athletic coach? To help an athlete be aware of their bodies and their abilities and then to push an athlete to do and achieve more within their sport? The academic analogy then would be to push a student to be aware of what they know or don’t know and to effectively utilize strategies to increase their knowledge and understanding. The goal is to get students doing this on their own, without guidance from an instructor.   

The other piece to this is how the students respond and use the metacognitive skills we are trying to help them develop. I wonder: Are your students, who are being encouraged to develop strong metacognitive skills in their theatre classes, naturally transferring those skills and using them in other disciplines (like in their bio class!)? If not, and if they were prompted to do so, would they be more likely to do so (and do so successfully) than non-theatre students who haven’t been getting that strong metacognitive practice?

Ilona: One would hope so. My guess is that when they get into non-acting classes, they revert to the student skills they depended on in high school. Although, I often get “metacognitive success stories” after summer break. Students will report that during their lifeguard or food-service gig, they realized their growing skills of self-awareness helped them to do everything from using their voices differently to giving them greater insight into their own behavior. If they can make connections like this during a summer job, perhaps they can apply these skills in their bio class.

 


Selecting a quantitative measure of metacognition  

by Dr. Jessica Santangelo, Hofstra University

If you are interested in metacognition and promoting the development of metacognitive skills, you may also be interested in measuring metacognition. But how does one assess a person’s metacognitive development?

Metacognitive development can be assessed via quantitative or qualitative measures. Quantitative measures include self-report measures, often using Likert-style survey instruments, while qualitative measures use coding of responses to open-ended prompts (e.g., Stanton 2015). While quantitative measures are generally easier and faster to score, a drawback is that self-report measures are not always accurate (Schunk 2008). Qualitative data can be more rich, providing deeper and more nuanced information, but is much more labor intensive and time consuming to analyze. Ideally, one uses a combination of quantitative and qualitative data to develop as complete a picture of metacognitive development as possible.

When I set out to assess the metacognitive development of 484 (!) students, I was overwhelmed by the number of quantitative tools available. The focus of the tools varies. Some tools attempt to assess metacognition directly while others assess factors or attributes associated with metacognition (e.g., study skills, self-regulated learning). Some are not explicitly intended to assess metacognition (e.g., LASSI), but are used by some authors as an indicator of metacognitive development (e.g., Downing et al 2007, 2011). Some have been through many iterations over the years (e.g., ASI, RASI, and ASSIST) while others remain relatively unchanged (e.g., MAI, MSLQ). Some are free while others have a per student fee. Some are longer (120 items, ILS) and others are shorter (18, RASI).

How does one choose the “best” quantitative tool? Unfortunately, there is no easy answer. It depends on the specific question being addressed and the amount of time and money available to administer the tool. I compiled a (non-comprehensive) list of tools I encountered in my search along with some information about each one to assist anyone looking for a quantitative measure of metacognitive development.

For my 484-student project, I chose to use the Metacognitive Awareness Inventory (MAI; Schraw and Dennison 1994) in combination with coding responses to open-ended prompts I created. I chose the MAI because it purports to measure metacognition directly (rather than being a study or learning skills inventory), is free, and is of moderate length (52 items). Others have found correlations between MAI results and other quantitative measures of student success (e.g., GPA and end of course grades), even suggesting using the MAI as a screening tool to identify students who could benefit from metacognition training (Young and Fry 2008). These characteristics  fit with the questions I was asking: Can we rapidly (and accurately) assess metacognitive development at the beginning of an introductory course? Does including explicit instruction and implicit practice with metacognitive skills in a course increase student metacognitive development?

While coding the open-ended responses is taking months to complete, it has revealed some clear and interesting patterns. In contrast, the quantitative data from the MAI, though gathered in about 5 minutes running scantron sheets through a machine, show no patterns at all. There does not appear to be any relationship between the quantitative MAI data and the qualitative data or any other measure of student success (GPA, exam and course grades, etc.). I’m not entirely surprised – metacognitive skills are unlikely to be wholly captured by a number generated by a 52-item self-report questionnaire. However, given the results of others (e.g., Sperling et al 2004, Young and Fry 2008) I was hopeful there would be at least some relationship between the quantitative and qualitative results.

This is not to say that rapid assessments via self-report questionnaires are worthless. It is simply a caution to not rely on these quantitative tools as one’s sole measure of metacognitive development. Indeed, I have colleagues who have had more “success” with tools other than the MAI (e.g, with the MSLQ), where success is defined as the quantitative tool reflecting similar patterns or trends as other, more time-consuming qualitative measures.

As with many things in science, there is no easy answer. My hope is that this compilation of available tools makes the choice of which one to use a little easier.

For more in-depth reading on measuring metacognition, I recommend:

Mogashana, D., J. M. Case, and D. Marshall. 2012. What do student learning inventories really measure? A critical analysis of students’ responses to the approaches to learning and studying inventory. Studies in Higher Education 37:783–792.

Schraw, G., and J. Impara, eds. 2000. Issues in the Measurement of Metacognition. Buros Institute of Mental Measurements, Lincoln, NE.

References

Downing, K., F. Ning, and K. Shin. 2011. Impact of problem‐based learning on student experience and metacognitive development. Multicultural Education & Technology Journal 5:55–69.

Downing, K., R. Ho, K. Shin, L. Vrijmoed, and E. Wong. 2007. Metacognitive development and moving away. Educational Studies 33:1–13.

Schraw, G., and R. S. Dennison. 1994. Assessing metacognitive awareness. Contemporary educational psychology 19:460–475.

Schunk, D. H. 2008. Metacognition, self-regulation, and self-regulated learning: research recommendations. Educational Psychology Review 20:463–467.

Sperling, R. A., B. C. Howard, R. Staley, and N. DuBois. 2004. Metacognition and self-regulated learning constructs. Educational Research and Evaluation 10:117–139.

Stanton, J. D., X. N. Neider, I. J. Gallegos, and N. C. Clark. 2015. Differences in metacognitive regulation in introductory biology students: when prompts are not enough. CBE-Life Sciences Education 14:ar15.

Young, A., and J. Fry. 2008. Metacognitive awareness and academic achievement in college students. Journal of the Scholarship of Teaching and Learning 8:1–10.

 


Teach Students How to Learn: A review of Saundra McGuire’s strategy-packed book

by Jessica Santangelo, Ph.D. Hofstra University

For those interested in helping students develop strong metacognitive skills, Dr. Saundra McGuire’s book, Teach Students How to Learn: Strategies You Can Incorporate Into Any Course to Improve Student Metacognition, Study Skills, and Motivation, is concise, practical, and much less overwhelming than trying to figure out what to do on your own. It is both a consolidation of the research surrounding metacognition, mindset, and motivation and a how-to guide for putting that research into practice.

I have been interested in metacognition for several years. Having waded through the literature on teaching metacognition (e.g., using tutors, student self-check, writing assignments, reflective writing, learning records, “wrappers”, or any number of other strategies) I found Dr. McGuire’s book to be an excellent resource. It places many of the strategies I already use in my courses in a larger context which helps me better articulate to my students and colleagues why I am teaching those strategies. I also picked up a few strategies I had not used previously.

While metacognition is the focus of the book, Dr. McGuire includes strategies for promoting a growth mindset (Chapter 4) and for boosting student motivation (Chapters 7, 8 and 9). I hadn’t expected such an explicit focus on these two topics, but the book makes clear why they are important: they increase the probability of success. If students (and faculty) have a growth mindset, believing that success is due to behaviors and actions rather than innate talent or being “smart”, they are more likely to embrace the metacognitive strategies outlined in the book. The same principle applies to a person’s emotional state. Both emotions and learning arise in the brain and affect each other. If students and faculty are motivated to learn, they are more likely to embrace the metacognitive strategies.

The part of the book that is perhaps most practically useful is Chapter 11: Teaching Learning Strategies to Groups. Dr. McGuire details an approach she has honed over many years to teach metacognitive skills to groups of students in one, 50-minute presentation (a detailed discussion of the metacognitive skills and evidence for them are provided in Chapters 3-5). Slides that can be tailored for any course are available at the book’s accompanying website, along with a video of Dr. McGuire giving the presentation throughout which she sprinkles in data and anecdotes that foster a growth mindset and increase student motivation.

Before reading Dr. McGuire’s book, I had had success using several strategies to promote student metacognition. I had a student go from failing exams to making high C’s, and other students move from C’s to B’s and A’s. However, I felt like my approach was haphazard since I had pulled ideas from different places in the literature without a cohesive framework for implementation. The book provided the framework I was missing.

This semester, I decided to use Dr. McGuire’s cohesive 50-minute session to see its impact on my students. I adapted it to be an online workshop because 1) I have limited class time this semester, and 2) an online intervention may benefit my colleagues who are interested in this approach but who aren’t able to use a class period for this purpose. In addition to the online workshop, I re-emphasize key points from the book when students come to office hours. I use phrasing and examples presented in the book to reinforce a growth mindset and boost motivation. I intentionally discuss “metacognitive learning strategies” rather than “study skills” because, as Dr. McGuire points out, many students think they have all the “study skills” they need but are often intrigued by how “metacognitive learning strategies” (which most have not heard of before) could help them.

You can jump in with both feet, as I did, or start with one or two strategies and build from there. Either way, this book allows you to take advantage of Dr. McGuire’s extensive experience as Director Emerita of the Center for Academic Success at LSU. I anticipate my copy will become dogeared with use as I continue to be metacognitive about my teaching and the strategies that work best for me, my students, and my colleagues. Stay tuned for an update on my online adaptation of Dr. McGuire’s session once the semester wraps up!