Are College Students Picky About Using Metacognitive Reading Strategies?

 by Roman Taraban, Texas Tech University

“Picky, picky” is a phrase we use to gently chide someone for being overly selective when making an apparently simple choice.  However, being picky is not always a bad thing, as I will try to show. Oddly enough, this phrase comes to mind when thinking about thinking about thinking, i.e., thinking about metacognition.  To explain the connection, I would like to consider the idea of being picky from two perspectives: research on metacognition and students’ metacognitive behaviors.

My students and I were first attracted to research on metacognition upon reading the work of Michael Pressley and colleagues, which focused on metacognitive strategies for reading comprehension.  Noteworthy in those early efforts were projects involving elementary school teachers and classroom interventions geared toward young students in an effort to teach them how to be more metacognitive in their daily schoolwork (Pressley et al., 1995).  Other work by Pressley and colleagues analyzed adult metacognitions when reading, using a think-aloud method (e.g., Pressley & Afflerbach, 1995), and metacognitions of experts when reading in their discipline (Wyatt et al., 1993). This research made a lot of sense, as it fit nicely within the broader constructs of active learning and constructivism — the belief that students needed to actively engage materials in order to benefit from study.  A simple inference to make is that the application of any active learning strategy will benefit students.   That was our assumption when we constructed and tested the Metacognitive Reading Strategies Questionnaire (MRSQ) (Taraban et al., 2000), drawing on the work of Pressley and others.   Data from 324 undergraduates from a variety of majors and levels were telling.  Of the 35 strategies that we tested, only seven were significantly associated with students’ grade-point averages (GPA).  The strategies were Evaluate text for goals, Set goals for reading, Draw on my prior knowledge, Vary reading style based on goals, Search out information for goals, Infer information, and  Look for important information (here presented in order of greatest to smallest effect sizes).  It was clear that all metacognitive strategies did not predict GPA equally well, and that the successful strategies were mostly related to reading goals. The significant correlations of academic proficiency, measured by GPA, with goal-related reading strategies, are consistent with Garner’s (1987) suggestion that skilled readers know multiple strategies and also know when to apply them.

Recent work on text recall (Schumacher & Taraban, 2014) with an undergraduate sample similar to the earlier study gave us another opportunity to examine students’ strategy use.  We asked students to read and study two expository texts and to recall as much as they could either immediately or after a 48-hour delay.  After they recalled the information, we asked them to report the strategies they used to learn the information. We organized the specific self-reported strategies into five types, as shown in the table below.  A hypothesis that application of any of these strategies would benefit subsequent performance was again not supported.  Of the five strategy types, Self-Testing was the only one that was significantly and positively correlated with recall.  We might infer that for this sample of readers and the criterion measure, which was recall, the most appropriate strategies were those related to Self-Testing.

Key Types of Self-Reported Strategies

1. REPETITION:  Re-Reading; Memorize; Repetition
2. FOCUSING ON SPECIFIC ELEMENENTS: Key words; Key concepts; Grouping terms or sentences; Identifying related concepts; Parts that stood out; Parts that were difficult
3. SELF TESTING: Summarizing; Recalling; Quizzing self; Forming acronyms
4. GENERATING COGNITIVE ELABORATIONS: Activating prior knowledge; Recalling related experiences; Re-explaining parts of the text in other ways; Comparing and contrasting ideas; Using analogiesusing mental imagery
5. SEGMENTATION: Grouping sentences for purposes of study; Divide by paragraph

In conclusion, we can draw a few observations.  As researchers, as instructors, as students, it is important to be cognizant of three interacting factors when students choose and apply metacognitive reading strategies: the criterion measure, reader-selected goals in light of the criterion measure, and readers’ sense of their own ability as it affects their choices of strategies.

ThreeFactors

The assumption that the application of any metacognitive strategy will always enhance performance is too simplistic.  It does not acknowledge the complexity of strategy choice, and it does not do justice to picky students, who are attempting to choose appropriate strategies for specific circumstances.  Some strategies lead to better retention of information and some to better grades. While these will often go together, it might further be the case that picky students know when to employ which strategy.  So maybe sometimes it’s good to be picky.

 

References

Garner, R. (1987). Metacognition and reading comprehension. Norword, NJ: Ablex.

Pressley, M., & Afflerbach, P. (1995). Verbal protocols of reading: The nature of constructively responsive reading.  Hillsdale, NJ: Erlbaum.

Pressley, M., Brown, R., El-Dinary, P. B., & Afflerbach, P. (1995).  The comprehension instruction that students need: Instruction fostering constructively responsive reading.  Learning Disabilities Research and Practice, 10, 215-224.

Schumacher, J., & Taraban, R. (2014, April). Strategy use complements testing effects in expository text recall. Paper presented at Southwestern Psychological Association (SWPA) Conference. San Antonio, TX.

Taraban, R., Rynearson, K., & Kerr, M. (2000).  College students’ academic performance and self-reports of comprehension strategy use. Journal of Reading Psychology, 21, 283-308.

Wyatt, D., Pressley, M., El-Dinary, P., Stein, S., Evans, P., & Brown, R. (1993). Comprehension strategies, worth and credibility monitoring, and evaluations: Cold and hot cognition when experts read professional articles that are important to them.  Learning and Individual Differences, 5, 49-72.


Metacognitive Strategies: Are They Trainable?

by Antonio Gutierrez, Southern Georgia University

Effective learners use metacognitive knowledge and strategies to self-regulate their learning (Bol & Hacker, 2012; Bjork, Dunlosky & Kornell, 2013; Ekflides, 2011; McCormick, 2003; Winne, 2004; Zeidner, Boekaerts & Pintrich, 2000; Zohar & David, 2009). Students are effective self-regulators to the extent that they can accurately determine what they know and use relevant knowledge and skills to perform a task and monitor their success. Unfortunately, many students experience difficulty learning because they lack relevant knowledge and skills, do not know which strategies to use to enhance performance, and find it difficult to sequence a variety of relevant strategies in a manner that enables them to self-regulate their learning (Bol & Hacker, 2012; Grimes, 2002).

Strategy training is a powerful educational tool that has been shown to overcome some of these challenges in academic domains such as elementary and middle school mathematics (Carr, Taasoobshirazi, Stroud & Royer, 2011; Montague, Krawec, Enders & Dietz, 2014), as well as non-academic skills such as driving and anxiety management (Soliman & Mathna, 2009). Additional benefits of strategy training are that using a flexible repertoire of strategies in a systematic manner not only produces learning gains, but also empowers students psychologically by increasing their self-efficacy (Dunlosky & Metcalfe, 2009). Further, a common assumption is that limited instructional time with younger children produces life-long benefits once strategies are automatized (McCormick, 2003; Palincsar, 1991; Hattie et al., 1996).

In addition to beginning strategy instruction as early as possible, it should be embedded within all content areas, modeled by teachers and self-regulated students, practiced until automatized, and discussed explicitly in the classroom to provide the greatest benefit to students. Pressley and Wharton-McDonald (1997) recommend that strategy instruction be included before, during, and after the main learning episode. Strategies that occur before learning include setting goals, making predictions, determining how new information relates to prior knowledge, and understanding how the new information will be used. Strategies needed during learning include identifying important information, confirming predictions, monitoring, analyzing, and interpreting. Strategies typically used after learning include reviewing, organizing, and reflecting. Good strategy users should possess some degree of competence in each of these areas to be truly self-regulated.

Additional strategies have been studied by Schraw and his colleagues (Gutierrez & Schraw, in press; Nietfeld & Schraw, 2002). They demonstrated that a repertoire of seven strategies is effective at improving undergraduate students’ learning outcomes and comprehension monitoring, a main component of the regulatory dimension of metacognition. Table 1 contains the seven strategies explicitly taught to students. Moreover, these strategies can function not only in contrived laboratory settings but also in ecologically valid settings, such as classrooms.

Table 1. Summary of Metacognitive Strategies and their Relation to Comprehension Monitoring

 

Strategy

LearningProcesses

Hypothesized Influence on Comprehension

Review main objectives of the text and focus on main ideas and overall meaning Review and monitor Enhance calibration through clarifying misunderstandings and tying details to main ideas
Read and summarize material in your own words to make it meaningful; use elaboration and create your own examples Read and relate Enhances calibration by transforming knowledge into something personally meaningful
Reread questions and responses and reflect on what the question is asking; go through and take apart the question paying attention to relevant concepts Review, relate, and monitor Purposefully slowing information processing allows for a more accurate representation of the problem, thus decreasing errors in judgment
Use contextual cues in the items and responses, e.g., bolded, italicized, underlined, or capitalized words Relate Using contextual cues allows the mind to focus on salient aspects of the problem rather than seductive details, thereby increasing accuracy
Highlight text; underline keywords within the question to remind yourself to pay attention to them; use different colors to represent different meanings Review, relate, and monitor Highlighting and underlining can assist one to focus on main ideas and what is truly important, increasing accuracy; however, relying too much on this can be counterproductive and may potentially increase errors
Relate similar test questions together and read them all before responding to any Relate and monitor Relating information together provides a clearer understanding of the material and may highlight inconsistencies that need to be resolved; it may point to information the learner may have missed, increasing accuracy
Use diagrams, tables, pictures, graphs, etc. to help you organize information Review and relate These strategies help simplify complex topics by breaking them down to their constituent parts; this increases accuracy by decreasing errors

Adapted from Gutierrez and Schraw (in press).

However, while the studies by Shaw and colleagues have shown that teachers can effectively use these strategies to improve students’ comprehension monitoring and other learning outcomes, they have not thoroughly investigated why and how these strategies are effective. I argue that the issue is not so much that students are not aware of the metacognitive strategies, but rather that many lack the conditional metacognitive knowledge−that is, the where, when, and why to apply a given strategy taking into consideration task demands. Future research should investigate these process questions, namely when, how, and why different strategies are successful.

Bjork, R. A., Dunlosky, J., & Kornell, N. (2013).  Self-regulated learning: Beliefs, techniques and illusions. Annual Review of Psychology, 64, 417-447.

Bol, L. & Hacker, D. J. (2012). Calibration research: where do we go from here? Frontiers in Psychology, 3, 1-6.

Carr, M., Taasoobshirazi, G., Stroud, R., & Royer, J. M. (2011). Combined fluency and cognitive strategies instruction improves mathematics achievement in early elementary school. Contemporary Educational Psychology, 36, 323–333.

Dunlosky, J., & Metcalfe, J. (2009).  Metacognition. Thousand Oaks, CA: Sage Publications.

Ekflides, A. (2011). Interactions of metacognition with motivation and affect in self-regulated learning: The MASRL model. Educational Psychologist, 46, 6-25.

Grimes, P. W. (2002). The overconfident principles of economics students: An examination of metacognitive skill. Journal of Economic Education, 1, 15–30.

Gutierrez, A. P., & Schraw, G. (in press). Effects of strategy training and incentives on students’ performance, confidence, and calibration. The Journal of Experimental Education: Learning, Instruction, and Cognition.

Hattie, J., Biggs, J., & Purdie, N. (1996). Effects of learning skills interventions on student learning: A meta-analysis. Review of Educational Research, 66, 99-136. doi: 10.3102/00346543066002099

McCormick, C. B. (2003). Metacognition and learning. In W. M. Reynolds & G. E. Miller (Eds.), Handbook of psychology: Educational psychology (pp. 79-102). Hoboken, NJ: John Wiley & Sons.

Montague, M., Krawec, J., Enders, C. & Dietz, S. (2014). The effects of cognitive strategy instruction on math problem solving of middle-school students of varying ability. Journal of Educational Psychology,106,469 – 481.

Nietfeld, J. L., & Schraw, G. (2002). The effect of knowledge and strategy explanation on monitoring accuracy. Journal of Educational Research, 95, 131-142.

Palincsar, A. S. (1991). Scaffolded instruction of listening comprehension with first graders at risk for academic difficulty. In A. M. McKeough & J. L. Lupart (Eds.), Toward the practice of theory-based instruction (pp. 50–65). Mahwah, NJ: Erlbaum.

Pressley, M., & Wharton-McDonald, R.  (1997).  Skilled comprehension and its development through instruction.  School Psychology Review, 26, 448-466.

Soliman, A. M. & Mathna, E. K. (2009). Metacognitive strategy training improves driving situation awareness. Social Behavior and Personality,37, 1161-1170.

Winne, P. H. (2004). Students’ calibration of knowledge and learning processes: Implications for designing powerful software learning environments. International Journal of Educational Research, 41,466-488. doi:http://dx.doi.org/10.1016/j.ijer.2005.08.012

Zeidner, M., Boekaerts, M., & Pintrich, P. R.  (2000).  Self-regulation: Directions and challenges for future research.  In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.),  Handbook of self-regulation (pp. 13-39).  San Diego, CA: Academic Press.

Zohar, A., & David, A. (2009). Paving a clear path in a thick forest: a conceptual analysis of a metacognitive component. Metacognition & Learning4(3), 177-195.

 


Are Current Metacognition Measures Missing the Target?

by Chris Was, Kent State University

Clearly, there is some agreement as to what metacognition is, or how to define it. In layman’s terms we often hear metacognition described as “thinking about thinking.” It is often defined as knowledge of and control of one’s cognitive processes.

There is also agreement that metacognition is necessary for one to successfully learn from instruction. Models such as Nelson and Naren’s (1990) model and that presented by Tobias and Everson (2009) stress the importance of knowledge of one’s state of knowledge as a key to learning.

In laboratory settings we have a number of “measures” of metacognition. Judgments of knowing, judgments of learning, feelings of knowing, etc. are all research paradigms used to understand individuals’ ability to assess and monitor their knowledge. These measures are demonstrated to predict differences in study strategies, learning outcomes and host of other performance measures.  However, individuals in a laboratory do not have the same pressures, needs, motivations, and desires as a student preparing for an exam.

How do we measure differences in students’ ability to monitor their knowledge so that we can help those who need to improve their metacognition? Not in the lab, but in the classroom. Although much of the research I have conducted with colleagues in metacognition has included attempts to both measure and increase metacognition in the college classroom (e.g., Isaacson & Was, 2010, Was, Beziat, & Isaacson, 2014), I am not convinced that we have always successfully measured these differences.

Simple measures of metacognitive knowledge monitoring administered at the beginning of a semester long course account for significant amounts of variance in end of the semester cumulative final exams (e.g,, Hartwig, Was, Dunlosky & Isaacson, 2013). However, the amount of the variance for which metacognitive knowledge monitoring in the models accounts is typically less than 15% and often much less. If knowledge monitoring is key to learning why then is it the case that it accounts for so little variance in measures of academic performance? Are the measures of knowledge monitoring inaccurate? Do scores on a final exam depend upon the life circumstances of the student during the semester? The answer to both questions is likely yes. But even more important, it could be that students are aware that their metacognitive monitoring is inaccurate and they therefore use other criteria to predict their academic performance.

The debate over whether the unskilled are unaware continues (cf. Krueger & Dunning, 2009; Miller & Geraci, 2011). Krueger and Dunning have provided evidence that poor academic performers carry a double burden. First, they are unskilled. Put differently, they lack the knowledge or skill to perform well. Second, they are unaware. That is, they do not know they lack the knowledge or skill and therefore have a tendency to be overconfident when predicting future performance.

There is however, a good deal of evidence that low-performing students are aware that when they are asked to predict how they will perform on an examination their predictions are overconfident. When asked to predict how well they will do on a test, the lowest performing students often predict scores well above how they eventually perform, but when asked how confident they are about their predictions these low performing students often report little confidence in their predictions.

So why does a poor performing student predict that they will perform well on an exam, when they are not confident in that prediction? Interestingly, my colleagues and I have (as have others) collected data that demonstrates that many students scoring near or above the class average under-predict their scores, and are just as uncertain as to what their actual scores will be.

An area we are beginning to explore is the relationship between ego-protection mechanisms and metacognition. As I stated earlier, students in a course, be it k-12, post-secondary or even adult education, are dealing with demands of the course, their goals in the course and the instructors goals, their attributes of success and failure in the course, and a multitude of other personal issues that may influence their performance predictions. The following is an anecdotal example from a student of mine. After several exams (in one of my undergraduate courses I administer 12 exams a semester plus a final exam) which students were required to predict their test scores, I asked a student why she consistently predicted her score to be 5 – 10 points lower then the grade she would receive. “Because when I do better than I predict, I feel good about my grade,” was her response.

My argument is that to examine metacognition of our students or to try to improve the metacognition of our students in isolation, without attempting to understand the other factors (e.g., motivation) that impact students’ perceptions of their knowledge and future performance, we are not likely to be successful in our attempts.

Isaacson, R., & Was, C. A.  (2010). Believing you’re correct vs. knowing you’re    correct: A significant difference?  The Researcher, 23(1), 1-12.

Krueger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in    recognizing one’s own incompetence lead to inflated self-assessments.    Journal of Personality and Social Psychology, 77(6), 1121-1134.

Miller, T. M., & Geraci, L. (2011). Unskilled but aware: reinterpreting overconfidence    in low-performing students. Journal of Experimental Psychology: Learning    Memory, and Cognition, doi:10.1037/a0021802

Nelson, T. O., & Narens, L. (1990). Metamemory: A theoretical framework and some    new findings.  In G. H. Bower (Ed.), The psychology of learning and motivation    (Vol. 26, pp. 125–173).  New York: Academic Press.

Tobias, S., & Everson, H. (2009).  The importance of knowing what you know: A    knowledge monitoring framework for studying metacognition in education.    In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of    Metacognition in Education. (pp. 107-128). New York, NY: Routledge.
Beziat, T. R. L., Was, C. A., & Isaacson, R. M. (2014). Knowledge monitoring accuracy    and college success of underprepared students. The Researcher, 26(1), 8-13.


What do we mean when we say “Improve with metacognition”? (Part Two)

by John Draeger (SUNY Buffalo State) and Lauren Scharff (U.S. Air Force Academy*)

The nature and many benefits of metacognition might seem obvious to those of us working in the field. But because our casual conversations had revealed some “fuzziness” in how the term was interpreted, we asked a convenience sample at our institutions (30 faculty and 11 students) what they believe the term ‘metacognition’ means and why it might be important. As summarized in Part I of this two-part exploration, most respondents offered “thinking about thinking” as a rough shorthand for the meaning of metacognitive processes. Beyond that general response, many faculty offered refinements that we grouped into the categories of awareness, intentionality and understanding. While that conversation is ongoing, this week’s post will focus on responses to the second question in our “survey”, “why might it be important for students and instructors to know about metacognition and perhaps incorporate it in their classes?”

When considering the benefits, the majority of our respondents affirmed importance of metacognition in academic settings. In particular, metacognition was reported to be beneficial because it “improves student learning” and “improves teaching.” As in our last post, where we argued that, while defining ‘metacognition’ as “thinking about thinking” can be a helpful way to get the conversation started but is too simplistic, the goal in this post also is to move toward more useful refinements.

Refinements to “improved student learning” can be grouped into two categories:

(1)  Metacognition improves student learning by increasing efficiency and prompting students to  take ownership of their own learning

  • “As a student, if you can understand how you think and learn, then you can more easily choose the method that will work for you.”
  •  Metacognition can “help [students] create strategies to enhance their study of new concepts to increase their retention of the concepts.”
  •  “I can study faster and more efficiently …”
  •  “Metacognition forces students to take positive control of their own development. Much like the first step to getting your finances in order is to see where your money is going, metacognitive questions help a learner assess whether s/he has actually increased his/her level of understanding or knowledge.”
  • “…they [learners] become more independent in their learning…”

(2)  Metacognition increases the depth of learning engagement with material and supports critical thinking

  • “By reflecting on our understanding we’re more likely to improve that understanding and make connections between bodies of knowledge.”
  • “…figuring out why the wrong answers (and the reasoning behind them) are wrong.  This is often more important than getting the right answer.  It is by repairing errors in our thinking that we learn surprising things we didn’t know we were ignorant about…”
  • “[Metacognition is] an important step in the critical thinking process. If I am not aware of how I am thinking about something, the context, the role and the perspective, then it is difficult to think critically”
  • “The issue is being able to use critical-thinking skills to sift through the mass of information to develop appropriate conclusions, theses, etc.  Metacognition enables us to analyze how we’re doing this and thus, do it better.”
  • “If we can get students to think about thinking, their own and others, it will help them to be better thinkers.  It might also encourage them to be more slow, careful and deliberate in their thinking / writing / speaking.”

 

Refinements to “improves teaching” can be grouped into two categories:

(1)  The more instructors understand about their students’ learning processes and are aware of their state of learning, the more then they can adapt to the needs of their students.

  • “I also have to be able to teach in different ways for people who learn differently than me, and have an idea how they learn”
  • “…helps us [instructors] structure our teaching to best support student learning”
  • “It’s important as instructors because if we understand how our cadets [students] think, we can tweak our teaching methods appropriately. “
  • “Because the more aware that students and teachers are about how each other thinks and learns, the more effective classroom learning techniques can be.”

(2)  The more instructors communicate about metacognition, the better they can help students become better learners.

  • “…if professors and students communicate about metacognition it can allow the instructors to use every resource available to them to better convey information to the students.”
  • “…It’s one thing to be aware of how you learn something or think through complex issues.  However, even better is to have the ability to identify which processes are most effective for you.  Metacognition becomes important when it informs us about how to improve, how to be more efficient, and how to “sift the wheat from the chaff,” so to speak… This self-awareness is not always obvious to a student and thus is most likely enhanced when facilitated by faculty members…”

In conclusion, both teaching and learning are dynamic processes that interact with each other.  Thus, we must continue to adapt to the ever-changing circumstances of our current students’ state of learning and help them do so also. Because instructors are not ever-present in students’ lives, our ultimate goal as instructors should be to help develop independent learners.

Metacognition can play a crucial role in both teaching and learning because it prompts us to be “tuned into” these dynamic processes and because it reminds us to be on the lookout for ways to improve and promote deep, life-long learning. These goals are especially important given recently reported shortcomings in higher-education  (e.g. Arum & Roksa, 2011).  Students need to know how to think critically and communicate well. The term ‘metacognition’ can be understood in a variety of ways and there are many benefits to metacognition. However, they boil down to supporting deep learning goals (beyond mere memorization) and critical thinking at a time when students in higher-education need it most.

References:

Arum, R., & Roksa, J. (2011). Academically adrift: Limited learning on college campuses. Chicago, IL: University of Chicago Press.

* Disclaimer: The views expressed in this document are those of the authors and do not reflect the official policy or position of the U. S. Air Force, Department of Defense, or the U. S. Govt.


What do we mean when we say “Improve with metacognition”? (Part One)

by Lauren Scharff (U.S. Air Force Academy*) and John Draeger (SUNY Buffalo State)

This website is being built to help instructors, students, and researchers improve with metacognition.  We and many others are convinced that the use of metacognition has many benefits. Yet, in conversations between ourselves and others, we realize that, while the term ‘metacognition’ is used widely and its usage is growing, it is potentially used differently by students, instructors, and researchers within and across institutions.  To get a sense of how the term is being used, we gave an informal survey to a convenience sample of faculty and students at our institutions. A self-selecting group of volunteers (30 faculty and 11 students) provided quick thoughts on what they believe is meant by the term ‘metacognition’ and why they believe metacognition is important. This post will focus on some perceptions of metacognition and next week’s post will focus on some of its perceived benefits.

When asked “what is metacognition?,” the majority of student and faculty respondents answered “thinking about thinking.”  While this response captures the essence of the topic, it is also fairly cliché and too vague to be useful by itself. It signals, for example, an intentional and conscious effort (thinking) about a process (thinking). It is unsatisfying in itself because it does not say enough about what is meant by thinking.  Thus, it would be difficult for someone to use if wanting to implement metacognitive practices.

For the majority of the faculty, the response of ‘thinking about thinking’ was the opening shorthand for further elaboration. Refinements to “thinking about thinking” often fell into three broad categories. In particular, metacognition might involve:

(1)   an awareness of how problems are set up, how ideas are worked through and  which learning strategies seem most effective.

“…an awareness of one’s own thinking and decision-making processes.”

“…being aware of how you most effectively learn something or think through complex issues.”

“…recognizing how he/she learns.”

(2)   some level of intentionality or purposeful choosing of a learning strategy. Even if it turns out not to work well, students are exhibiting metacognition when they make a conscious decision about how to approach a learning task (e.g., how to study, solve a problem, make a decision).

“…ability to regulate (or choose) the best cognitive process for solving a problem or engaging a task.”

“…taking time to figure out how we best learn, remember, and use information.”

(3)   Understanding or developing an understanding of processes related to thinking and learning

“Metacognition is the process of understanding our own thinking, including capabilities, limitations, biases.”

“…an understanding of how we learn and incorporate new knowledge.”

“…getting a student to think about why they hold a certain point of view, how did they come to hold that point of view.”

For students, ‘thinking about thinking’ was all that most could say about metacognition, with more than half of the students responding that they had no idea at all. Only one student gave a more elaborate answer:

“It is being aware of the thought process that goes on inside one’s own mind, and being able to understand how one thinks and makes decisions”

As instructors who might try to or who are currently incorporating metacognitive practices into our courses, we should remember that the vast majority of our students are likely to have either no concept of metacognition or only a superficial understanding of it. Thus, we must be as explicit as we can about what we mean by the term and what precisely we are aiming for when we teach metacognition. By going beyond the simple definition of “thinking about thinking,” we will be able to better develop specific behaviors related to effective learning.

However, rather than choosing to focus on just one of the three categories of refinements as if they were interchangeable, we believe that each of the refinement categories offers distinct contributions to our ability to understand and develop metacognition. Awareness is not the same as understanding; without understanding, one may choose less appropriate learning strategies. On the other hand, one can technically understand aspects of learning without being aware of one’s own learning processes, which is also likely to lead to less effective choice of strategies. Finally, a student’s intentional choice does not guarantee learning effectiveness, but using learning techniques out of convenience or ignorance of alternate strategies is even less likely to consistently lead to success.

In sum, while ‘metacognition’ encompasses a relatively complex set of processes, the quick shorthand offered by many of our participants, “thinking about thinking,” gets us going in a useful direction. If we also consider the various refinements offered, then ‘thinking about thinking’ might be approximated as “intentional awareness to achieve understanding about a process, such as learning, in order to enhance the development of that process.”

Next week we will explore reasons why it might be important for faculty and students to learn about and begin to incorporate and practice metacognition within academic settings.

 

* Disclaimer: The views expressed in this document are those of the authors and do not reflect the official policy or position of the U. S. Air Force, Department of Defense, or the U. S. Govt.


Science and Social Controversy – a Classroom Exercise in Metacognition

by David Westmoreland, U.S. Air Force Academy*

One of the many challenges for science educators is teaching about topics that are largely resolved in the scientific community, yet remain controversial in broader society.  Such topics often make students uncomfortable, and thus meet with resistance to learning (Johnson and Peeples 1987, Byford et al. 2009). When instructors present such topics as no longer under question, students are likely to perceive the teacher as strongly biased to one side of a controversy that they consider to be ongoing.

This conflict of perception arises partly from a lack of a meaningful understanding of how scientific thinking differs from the broader practices of everyday, social thinking.   I have found that explicit instruction on the difference between scientific and social thinking enables students to be more objective when learning about controversial subjects.  In turn, I am better able to break through socially derived barriers to learning (Clough 1994, Sinclair et al. 1997, Shipman et al. 2002).

I introduce this exercise as a metacognitive lab that attempts to answer the question “How do you know?”  I define metacognition for the students,as the effort to understand one’s own thought processes, in addition to understanding the thought processes used by others.   Students are split into small groups of 3-4 individuals seated to foster within-group discussion while minimizing between-group discussion.  Each group is presented with 4-5 of the “Truth” statements listed below.

Students are asked to proceed through each statement, imagining themselves as a person who takes the statement to be true.  What would that person give as his or her basis for accepting its truth?  From this, students compile on the board a “ways of knowing” list.  A typical list, paired with its corresponding “Truth” statement, is shown below.  It is not important that students identify these exact categories of knowledge.  The point of the exercise is to have students recognize that social thinking incorporates a wide variety of thought processes.

“Truth” statement

Typical “Way of Knowing” categories identified by students

Eggs are fragile. Personal experience
The nucleus, which occupies the interior of a cell, is smaller than the cell itself. Logic
Water freezes at 32 degrees F. AuthorityPersonal experience (often listed, then retracted after students realize they have never personally measured the temperature of freezing water)
Everyone has a moral sense. Desire for the statement to be trueAuthorityIntuition
I don’t trust him/her.  (Having just met the person.) Intuition
A higher power is punishing America for its acceptance of sinful lifestyles. AuthorityDesire for the statement to be trueDirect revelation
If a = b and b + 1 = 5, a = 4. Logic
There are ten fundamental rules that a higher power instructs us to live by. Direct revelation (if Moses)Authority (everyone else)
President Obama does not have a valid American birth certificate. AuthorityRumor mill (no identifiable authority, but so often repeated that the statement becomes accepted as truth)
Crystal therapy can restore harmony and peace of mind by clearing negative energy blocks that we have deep within us. AuthorityPersonal experienceDesire for the statement to be true

 

In the last part of the exercise, students are asked to strike lines through ways of knowing that are not used in science.   Some ways of knowing are eliminated easily (revelation, desire for a thing to be true, rumor mill), while others require deeper analysis.  For example, intuition is used in science for formulating ideas, but not as a basis for concluding that ideas have scientific validity.  Typically, three ways of knowing are left at the end:  authority, logic, and personal experience.

By comparing the ways of knowing used in social thinking to those used in science, one can see why social controversies often persist when a scientific consensus has been reached.  Social thinking incorporates a wider variety of ways of knowing, and is not necessarily grounded in the three tenets of science (Schafersman 1994):  (a) empiricism, a demand for data that can be independently verified; (b) skepticism, a willingness to abandon established conclusions in light of new information; and (c) rationalism, the principle of noncontradiction.

Having prepared students with an introduction to metacognition, I encounter less resistance when teaching theories of evolution, global warming, and genetic engineering.  Having recognized the fundamental differences between scientific and social thinking, students are better able to accept that different conclusions are likely to result from divergent practices in thinking.

 

Byford, J., Lennon, S., & Russell III, W.B. (2009.)  Teaching controversial issues in the social studies: a research study of high school teachers. The Clearing House 82(4), 165 – 170.

Clough, M. P.  (1994.)  Diminish students’ resistance to biological evolution.  The American Biology. Teacher 56(7), 409 – 415.

Johnson, R. L., & Peeples, E.E.  (1987.)  The role of scientific understanding in college. The American Biology. Teacher 49(2), 93 – 98.

Schafersman, S. D.  (1994.)  An introduction to science: scientific thinking and the scientific method. Available online at: http://www.freeinquiry.com.

Shipman, H. L., Brickhouse, N.W., Dagher, Z. & Letts IV, W.J.  (2002.)  Changes in student views of religion and science in a college astronomy course.  Science Education 86(4), 526 – 547.

Sinclair, A., Pendarvis, M.P., & Baldwin, B.  1997.  The relationship between college zoology students’ beliefs about evolutionary theory and religion.  Journal of Research and Development in Education 39(2), 118 – 125.

 

* Disclaimer: The views expressed in this document are those of the authors and do not reflect the official policy or position of the U. S. Air Force, Department of Defense, or the U. S. Govt.


On The Importance of Teaching Metacognition: A Call for Research!

by Aaron S. Richmond, *Anastasia M. Bacca, *Jared S. Becknell,  *Mary P. Mancuso, *Ryan P. Coyle, and *Eric Klein

Metropolitan State University of Denver

(*) Undergraduate students

Much of the literature regarding metacognition has focused on awareness of metacognitive processes (Antonietti, Ignazi, & Perego, 2000; Metallidou, 2009; Schraw & Dennison, 1994; Topcu & Ubuz, 2008), defining metacognitive skill sets (Nelson & Narens, 1994; Veenman, Van Hout-Wolters, & Afflerbach, 2006), and how to accurately measure metacognition (Pieschl, 2009; Schraw, Kuch, & Gutierrez, 2013). While researchers have gained understanding about the components of metacognition and the importance of this skill for academic and professional success, few have examined effective ways to teach metacognition to students (Brownlee, Purdie, & Boulton-Lewis, 2001).

Brownlee et al. (2001) examined the effectiveness of an experimental program designed to increase cognitive reflection and development of more advanced epistemological beliefs (i.e., beliefs about knowing). The experimental group received an intervention that encouraged students to consider their epistemological beliefs. This group was asked to relate their knowledge about thinking to their own process of thinking and reflect on this interaction in the form of journal entries. Students who were asked to reflect demonstrated increased advanced epistemological beliefs when compared to the control group.

In another study aimed at increasing metacognitive skill in college classrooms, Was, Beziat, and Isaacson (2013) had educational psychology students engage in monitoring practices (e.g., calibration) over the course of a semester. Specifically, Was and colleagues assessed students 13 times via short exams. Prior to each assessment, students were asked to predict their scores. After each exam, teaching assistants would discuss the students’ predictions and actual scores. Was et al. found that students’ monitoring improved over the course of the semester, in that they become better judges of their learning and performance as a result of the intervention.

Seeking to learn more about effective strategies for teaching metacognition, Richmond and Richmond (2012) compared active learning instruction to direct learning instruction of the topic of metacognitive theory. The active learning condition was characterized by group work and interaction with the instructor, and discussing effective learning strategies with one another to enhance awareness of best learning practices. In contrast, the direct learning condition was characterized by lecture presentation of metacognitive theory and rewriting information from PowerPoint slides presented. Richmond and Richmond (2012) found that active learning instruction increased higher level learning of metacognitive theory over that of students who received direct instruction.

As demonstrated by the above preliminary studies (e.g., Brownlee et al., 2001; Richmond & Richmond, 2012; Was et al., 2013), there are promising interventions but there is still a great need for more research on implementing effective instructional strategies to increase metacognitive skills in higher education courses. Specifically, What type of instruction is best suited for increasing metacognitive skills in the regular higher education classroom? Is metacognitive development best  accomplished through experience and reflection (e.g., Brownlee et al. 2001; Was et al., 2013),  or are there other effective instruction methods, such as Socratic or inquiry-based instruction? We believe that metacognitive instruction should be embedded into the content beginning at the start of the semester and continuing throughout the semester, similar to that of Was et al. (2013). However, more research is needed to see if this really is the most effective approach. Additionally, research should focus on higher and lower level learning and how these instructional strategies may differentially affect level of learning (e.g., Richmond & Richmond, 2012). Finally, instructional strategies should be designed so that students can transfer the metacognitive strategy across higher education courses.

Although the above suggestions for future research are not a comprehensive list, we believe that they represent an important start. As such, we are asking our fellow colleagues to spread the word and to begin conducting important research that seeks to answer these questions. The preliminary results invariably suggest that our students will greatly benefit from such endeavors as will the quality of faculty instruction.

References

Antonietti, A., Ignazi, S., & Perego, P. (2000). Metacognitive knowledge about problem-solving methods. British Journal of Educational Psychology, 70(1), 1-16. doi:http://dx.doi.org/10.1348/000709900157921

Metallidou, P. (2009). Pre-service and in-service teachers’ metacognitive knowledge about problem-solving strategies. Teaching and Teacher Education, 25(1), 76-82. doi:http://dx.doi.org/10.1016/j.tate.2008.07.002

Nelson, T. O. & Narens, L. (1994). Why investigate metacognition. In J. Metcalf, & A. P. Shimamura (Eds), Metacogntiion, knowing about knowing (pp. 1-25). Cambridge: MIT.

Pieschl, S. (2009). Metacognition calibration—an extended conceptualization and potential applications. Metacognition Learning, 4, 3-31. doi: 10.1007/s11409-008-9030-4

Richmond, A. S. & Richmond, A. (2012, October). Teaching metacognition to preservice educators: A focus on transfer and retention. Paper presented at the annual meeting of the Northern Rocky Mountain Educational Research Association, Park-City, UT.

Schraw, G., & Dennison, R. S. (1994). Assessing metacognitive awareness. Contemporary Educational Psychology, 19, 460-475.

Schraw, G., Kuch, F., & Gutierrez, A. P . (2013). Measure for measure: Calibrating ten commonly used calibration scores. Learning and Instruction, 24, 48-57. http://dx.doi.org/10.1016/j.learninstruc.2012.08.007

Topcu, A., & Ubuz, B. (2008). The effects of metacognitive knowledge on the pre-service teachers’ participation in the asynchronous online forum. Educational Technology & Society, 11(3), 1-12.

Veenman, M. J., Van Hout-Wolters, B. H. A. M., & Afflerbach, P. (2006). Metacognition and learning; Conceptual and methodological considerations. Metacognition and Learning, 1(1), 3-14. doi:10.1007/s11409-0066893-0.

Was, C. A., Beziat, T. L. R., & Isaacson, R. M. (2013). Improving metacognition in a college classroom: Does enough practice work? Journal of Research in Education 23(1). Retrieved from http://www.eeraonline.org/journal/files/v23/JRE_v23n1_Article_5_Was_et_al.pdf


Cultivating a habit of constructive discomfort

by John Draeger, SUNY Buffalo State

As both a gym rat and an academic, I often think about the parallels between physical exercise and intellectual engagement. Both depend on individual ability and personal circumstances. Both can be done in variety of ways and for a variety of reasons. Both require consistent practice and good habits. Both require metacognitive awareness of particular strategies and the likelihood that they will lead to progress towards goals. And because the process is dynamic, we need to cultivate continued awareness of our strategies for physical and intellectual engagement.

Further, I submit that both physical exercise and intellectual engagement require cultivating a habit of constructive discomfort.  It isn’t easy to push our bodies and minds, but maintaining physical and intellectual growth requires it. Unlike the discomfort that comes from putting off an entire week’s worth of exercise until Saturday or waiting until the night before to begin writing a paper, the benefits of constructive discomfort are derived from consistently pushing ourselves in a way that facilitates progress towards our goals.

Related to this notion of constructive discomfort, Vygotsky (1978) argues that learning is most effective within the “zone of proximal development.” It is the space slightly beyond a learner’s current knowledge base and skill level, but a place where learning is still within a person’s reach. It is aspirational without being discouraging. It is challenging without setting someone up for failure.  In the case of exercise, my long-term goal might be to run a marathon. Given my perceived level of fitness, I should probably start with a “couch to 5k” and move up to a marathon later. It is possible that I am in better shape than I think and I can push myself beyond the 5k now. By consciously attending to my state of health and progress towards my long-term goals, I can make micro-adjustments that keep me in the zone of constructive discomfort and headed in the right direction. Instructors can make similar micro-adjustments in the classroom as they gauge the level of student ability. Again, metacognitive awareness of student understanding and progress towards well-articulated goals is essential to identifying the best strategies for a given group of students. Much like a “couch to 5k” program, assignment scaffolding in the classroom can maintain an appropriate level of constructive discomfort and guide students through the zone of proximal development (Wass, Harland, and Mercer, 2011). As students become more aware of their own learning processes, they can learn to make their own micro-adjustments. If, for example, they find themselves bored by some particular piece of classroom content, then they might ask themselves whether it is because they are not being challenged (much like  runners capable of doing more than a 5k) or because they are overwhelmed (much like runners who start out strong only to “over train” and lag behind their goals). As a scholar seated at my writing table, I often find myself asking these sorts of questions about my writing process and making micro-adjustments to keep me in the zone of constructive discomfort and heading towards my goals.

A person can be uncomfortable in a multitude of ways and there is little to be gained by discomfort for the sake of discomfort. If, however, constructive discomfort can contribute to physical and intellectual growth, then we should strive for it. Because knowing whether some particular instance of discomfort is constructive requires a metacognitive awareness of our individual circumstances and individual goals, we should cultivate a habit of metacognitive awareness for our learning, fitness, or any other skill we hope to develop.


References:

Vygotsky, L. S. (1978). Mind and society: The development of higher mental processes. Cambridge, MA: Harvard University Press.

Wass, R., Harland, T., and Mercer, A. (2011). “Scaffolding critical thinking in the zone of Proximal development.” Higher Education Research and Development, 30 (3), 317-328.

 


What Extra Credit Participation Teaches Us about Creating Buy-in for Metacognition

by Lauren Scharff, U.S. Air Force Academy*

At a surface level you might wonder what sort of parallel I sense between metacognition and extra credit activity engagement.  After all, metacognition is a cognitive process – a process by which someone becomes consciously and intentionally aware of their state of performance and of strategies that might help or are hindering their performance.  Extra credit, on the other hand, is an opportunity to earn extra points on an assignment or in a course.

One possible link is that an instructor’s inclusion of both types of activities is motivated by their desire to increase students’ success in a course. While this is likely true, I believe that a more crucial link for us to attend to is the pattern of student “buy-in” to the activities, with stronger students often showing earlier adoption and motivation, and weaker students often showing low motivation and resistance.

As many instructors have observed through their years of teaching, the students who choose to participate in extra credit activities, especially early in a term, are often those who are least likely to need the extra credit. The weaker students, who arguably could benefit most from both the points and additional learning opportunities, choose not to participate, or wait until the very last chance to participate at the end of the semester.  Similarly, some of us who have intentionally implemented metacognitive practices into our courses have found that the students who most readily appreciated the benefits of metacognitive practices and used them to modify their learning behaviors to increase their success were the stronger, more advanced students. Many of the weaker students complained that the metacognitive activities were a waste of time because they were focused on learning behaviors and not the specific course material to be learned.

I argue that we should care about this pattern because we want to maximize the learning and success of the full range of our students.  Thus, a “one-size-fits-all” approach when implementing metacognitive strategies will almost inevitably fail for too many of our students, and we need to scaffold the activities more than we might initially realize.

This need for scaffolding may not be obvious at first to those of us who already understand a lot about human learning processes and who already believe in and practice metacognition. The benefits seem so apparent to us!  But, we must realize that many of our students, especially the weaker ones, won’t immediately perceive the benefits of taking time to reflect on their learning and try new strategies. Many of these students have been “successful” using a limited range of learning behaviors, and have not yet reached the realization that alternate learning approaches would be worth their while, especially as the academic demands within courses increase.  Further, shifting learning behaviors takes time and effort, so in the short run, they might see more cost than benefit.  Therefore, they avoid spending time trying new learning strategies, and report that metacognitive activities are an even greater “waste of time” because they don’t immediately seem to help them accomplish typical course assignments for which they’ll receive points. In their chapter on “desirable difficulties,” Elizabeth and Robert Bjork note several learning strategies that slow apparent learning in the short term, but enhance long-term learning.  While the authors don’t explicitly mention the use of metacognitive strategies, they too fit that category of providing a desirable difficulty.

Some of the differences between the observed levels of motivation and engagement across students might also be linked to student mindset (see Carol Dweck’s work, e.g. Dweck, 1996). Students who show incremental/malleable intelligence beliefs, i.e. mindset, believe that they can improve their abilities in certain skill areas (e.g. math, writing, speaking) rather than believing that they are inherently “good” or “okay” or “bad” at such skills (a fixed/entity mindset). Typically the former type of student seeks learning challenges and mastery-oriented learning behaviors.  Metacognitive reflection could be considered a type of mastery-oriented learning behavior. [Hmmmm… sounds like a great topic to research!  What IS the relationship between mindset and adoption of metacognitive approaches?]

Changing gears back to application, if you’re an instructor who plans to incorporate metacognitive approaches into your course in order to promote student learning, awareness of different levels of buy-in and some possible reasons behind the differences can help your effort be more successful. You can increase your awareness of how the activities are being received by asking students for their feedback.  What do they think about the activities?  Do they believe the activities help their learning, why or why not? What is something new they’ve tried and how did it go for them?

Just understanding the student perceptions isn’t enough, however.  How and what you do to present the activities and embed them in your course will impact student perceptions and likelihood to engage in the activities. For example, you should be sure to explain (and re-visit multiple times throughout the semester) the potential benefits of metacognitive reflection, addressing student feedback in your discussions.  If possible, collect data about their learning and share it with them (e.g. exam performance based on self-reported learning strategies). You might need to take time to explicitly share alternate learning strategies for your course so that if students reflect that what they’re doing is not working well, they have some accessible alternate options to try. Finally, it might be beneficial to make the metacognitive activities worth some points toward the course grade.

The bottom line is that, as instructors, we have control over how we present the value of metacognition in our courses, and by being thoughtful about it, we will be able to increase the “buy-in” from a greater range of our students, hopefully reaching more of those who need it the most.

——-

Bjork, E. L., & Bjork, R. A. (2011). Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning. In M. A. Gernsbacher, R. W. Pew, L. M. Hough, & J. R. Pomerantz (Eds.), Psychology and the real world: Essays illustrating fundamental contributions to society (pp. 56-64). New York: Worth Publishers.

Dweck, C. (1996). Implicit theories as Organizers of Goals and Behaviors, pp. 69-90. In: Gollwitzer, P. & Bargh, Eds, The psychology of action: Linking cognition and motivation to behavior, J. Guilford Press: New York.

* Disclaimer: The views expressed in this document are those of the authors and do not reflect the official policy or position of the U. S. Air Force, Department of Defense, or the U. S. Govt.