“Clickers” and metacognition: A quasi-experimental comparative study about metacognitive self-regulation and use of electronic feedback devices

In this quasi-experimental study by Brady, Seli, and Rosenthal (2013), the authors demonstrated that through the use of “clickers” they could increase metacognition and exam performance. For more information please see the reference below.

Brady, M., Seli, H., & Rosenthal, J. (2013). “Clickers” and metacognition: A quasi-experimental comparative study about metacognitive self-regulation and use of electronic feedback devices. Computers & Education, 65, 56-63. doi:10.1016/j.compedu.2013.02.001


How do students really study (and does it matter)?

In this article by Regan Gurung (2005), he investigated specific study techniques and how they correlated with academic performance (exam scores). Not surprisingly, Gurung found that effective study techniques (i.e., elaboration) were positively correlated with performance, while ineffective study techniques (i.e., listening to music) were negatively correlated withe academic performance. For the full article, see reference and hyperlink below.

Gurung, R. A. (2005). How do students really study (and does it matter)?. Education, 39, 323-340.


The Motivated Strategies for Learning Questionnaire

The Motivated Strategies for Learning Questionnaire (MSLQ) was developed by Pintrich, Smith, Garcia, and McKeachie (1993). This measure has been cited in over 1600 articles and is a very well established measure of not only metacognition, but motivation. The MSLQ is split into two main scales. The Motivation Scale is comprised of the Intrinsic Goal Orientation, Extrinsic Goal Orientation, Task Value, Control of Learning Beliefs, Self-Efficacy for Learning and Performance, and Test Anxiety sub-scales. the Learning Strategies Scale is comprised of the Rehearsal, Elaboration, Organization, Critical Thinking, Metacognitive Self-Regulation, Time and Study Environment, Effort Regulation, Peer Learning, and Help Seeking sub-scales. For more information on the MSLQ please refer to the reference and hyperlink below.

Pintrich, P. R., Smith, D. A., García, T., & McKeachie, W. J. (1993). Reliability and predictive validity of the Motivated Strategies for Learning Questionnaire (MSLQ). Educational and Psychological Measurement, 53(3), 801-813.


The Need for Cognition Scale

A classic personality measure of metacognition was developed by John Cacioppo and Richard Petty (1982) entitled, The Need for Cognition Scale (NCS). This is a widely used 18-item Likert scale that assesses “the tendency for an individual to engage in and enjoy thinking” (Cacioppo & Petty, 1982, p. 116). The NCS has been cited in over 3000 articles and has well established psychometric properties. For more information please read the original article by Cacioppo and Petty (1982).

Cacioppo, J. T., & Petty, R. E. (1982). The need for cognition. Journal of Personality and Social Psychology, 42(1), 116.

 


The Memory Self-Efficacy Questionnaire

Berry and colleagues (1989) developed the Memory Self-Efficacy Questionnaire (MSEQ). This metacognitive measure is a cross between a self-report and actual measure of metacognition. It requires respondents to rate their confidence of remembering grocery lists, phone numbers, pictures, locations, words, and digit span. Essentially, in the MSEQ, respondents are given up to 10 pictures (or grocery items), then they are asked how confident they are in remembering 2 items, then 4 items, then 6 items, then 8 items, then all 10 items. It has been found to be both reliable and valid in many populations. For more information check out the original article by Berry et al. (1989).

Berry, J. M., West, R. L., & Dennehey, D. M. (1989). Reliability and validity of the Memory Self-Efficacy Questionnaire. Developmental Psychology, 25(5), 701.


Assessing Metacognitive Awareness

Constructed by Rayne Sperling and Gregory Schraw (1994), the Metacognitive Awareness Inventory (MAI) is a well established and useful assessment of metacogntion. The MAI has been used in hundreds of studies, ranging from basic to applied research. It is a 52-item inventory with two broad categories (i.e., knowledge of cognition and regulation of cognition), with several sub-categories.

Schraw, G., & Dennison, R. S. (1994). Assessing metacognitive awareness.Contemporary educational psychology19(4), 460-475.

 


The Effects of Metacognition and Concrete Encoding Strategies on Depth of Understanding in Educational Psychology

Suzanne Schellenberg, Meiko Negishi, and Paul Eggen (2011) from the University of North Florida describe a useful method to increase the metacognition of their students. They found that when educational psychology students were taught specific encoding strategies they academically outperformed a control group in learning course material.

Schellenberg, S., Negishi, M., & Eggen, P. (2011). The Effects of Metacognition and Concrete Encoding Strategies on Depth of Understanding in Educational PsychologyTeaching Educational Psychology7(2), 17-24.


Changing Epistemological Beliefs in Pre-service Teacher Education Students

Joanne Brownlee, Nola Purdie, and Gillian Boulton-Lewis (2010) describe an interesting method to increase student’s epistemological beliefs using reflective journal assignments. Brownlee and colleagues found that when students engaged in these reflective practices, they had significantly improved their epistemological beliefs over that of students who did not complete these activities.

Brownlee, J., Purdie, N., & Boulton-Lewis, G. (2001). Changing epistemological beliefs in pre-service teacher education studentsTeaching in higher Education,6(2), 247-268.


Meta-Teaching: Improve Your Teaching While Improving Students’ Metacognition

By Aaron S. Richmond, Metropolitan State University of Denver

To-date, many of the wonderful blogs posted on Improve with Metacognition  have aptly focused on metacognition itself. They varied from classroom exercises to improve student metacognition (see Westmoreland, 2014) to increasing higher level thinking through metacognitive practices (see Nuhfer, 2014) to the merits of measuring metacognition (Was, 2014). Not yet covered is that of the secondary purpose of this website. That is, the emphasis will be the process of teaching about metacognition and teaching metacognitively. As such, there is great potential and room discourse on meta-teaching or meta-pedagogy as a way to both improve student learning of metacognition and our own teaching practices.

Yet first, it is important to begin with a solid operational definition of meta-teaching. As Chen (2013) states,

Like meta-cognition and meta-learning, meta-teaching, as ‘teaching about teaching’, can serve to design, examine and reflect on teaching. From practice-orientation, it defines what teaching activity is and what it is for, under which theoretical framework it is being carried out, and what experience and rules can be applied to it. Meanwhile, meta-teaching can assist teachers in discovering drawbacks in the teaching system and solving problems. This demonstrates that meta-teaching contains such functions such as understanding teaching, changing teaching and reflecting on teaching. (p. S64)

Therefore, by using this definition, how can we first improve our teaching using meta-teaching practices? And second, how can we use meta-teaching to specifically improve our teaching of metacognitive theory and the metacognition of our students?

Why Engage in Meta-Teaching Practices?

Drawn from the literature on meta-teaching, there are several benefits and reasons why college professors should employ meta-teaching practices. First, and foremost it promotes student learning (Chen, 2013). When teachers reflect and evaluate whether their teaching methods actually have an impact on student learning and adjust their practices accordingly, inevitably student learning and performance improves. Second, meta-teaching can invigorate and create a passion for teaching. In that, engaging in this process has been found to increase teacher’s love for the profession (Chen, 2013). Moreover, Chen states, “When the teacher takes action, he/she begins to observe and reflect on the action, impelling him/her to stay highly conscious of what he/she is doing….Without meta-teaching action, a teacher would hardly keep his /her motivation and enthusiasm for better teaching.” (p. S69) Finally, meta-teaching promotes the teaching profession through formal and informal scholarship of teaching and learning (SoTL). That is, SoTL cannot be conducted without proper meta-teaching practices.

Meta-Teaching Strategies Used to Improve Metacognition

Plan, strategy, monitor, and evaluate.  Spring (1985) suggests that teachers should use meta-teaching strategies by properly planning lessons, critically reflecting on appropriate instructional strategies/methods to obtain instructional goals, monitor student learning, and evaluate the efficacy of the strategy. For example, in a recent study I conducted (Richmond, in press), I used meta-teaching strategies to improve pre-service education students’ knowledge of various learning strategies. See Table 1 for an illustrative example of how I employed the meta-teaching strategies of planning, instructional strategy, student monitoring, and evaluation to improve my teaching and increase my student’s knowledge of metacognitive theory (e.g., learning strategies).

Table 1. Example of Implementing Meta-Teaching to Teach Learning Strategies
Meta-Teaching Strategy Richmond’s (in press) Educational PsychologyClassroom Example
Planning and Goals
  • Increase both higher and lower level learning of the learning strategies of rehearsal, organization, elaboration, spacing vs. massed practice, and distributed practice.
  • Increase retention of the knowledge of learning strategies.
  • Attempt to assist students in transferring these strategies to their own learning.

 

Instructional Strategy
  • Used Active learning (e.g., small group discussion, experimentation, elaboration) vs. direct instruction (e.g., lecture) to teach about learning strategies.
Monitoring Student Learning
  • Formally assessed prior knowledge of student’s understanding of learning strategies.
  • Formally assessed immediate retention of knowledge of learning strategies.
  • Formally assessed long-term retention (4-weeks) of knowledge of learning strategies.
  • Informally assessed (e.g., why questions and a 1-minute written assessment) progress of learning about learning strategies during class.
Evaluation
  • Analyzed which instructional method was most effective and found that only active learning instruction increased higher-level learning.
  • Found that students were unable to transfer strategies.
  • Found that students taught with active learning instruction retained more information over time.

Encourage metacognition in students. Not only can teachers use meta-teaching strategies to improve their own teaching, student learning, and to teach about metacognition, they can also model and encourage metacognitive thinking in their students. Similar to that of meta-teaching strategies, Chen suggests students should set a plan/goal for learning, develop a strategy to achieve this goal, monitor the progress of the given strategy, and finally evaluate the effectiveness of the strategy. Moreover, when teachers effectively use meta-teaching strategies they explain the reasoning behind specific pedagogical practices (e.g., formal and informal assessments, specific teaching strategies, assignments, etc.) and they explain the successes and failures of meta-teaching strategies (Chen, 2013). This process may model metacognitive practices to students. Additionally, Chen argues that teachers using meta-teaching strategies (no matter the content domain) always specifically infuse and teach metacognitive strategies to students.

Closing Meta-Remarks

I believe that many exemplar teachers inherently use meta-teaching strategies. However, for the rest of us, it is extremely important to investigate and learn how to improve our teaching through these practices. Additionally, when we convey the process to our students we are modeling metacognitive processes to students, which they too can use to improve their learning and performance in whatever endeavor they so choose.

References

Chen, X. (2013). Meta-teaching: Meaning and Strategy. Africa Education Review, 10(1), S63-S74. doi:10.1080/18146627.2013.855431

Nuhfer, E. (2104). Metacognition for guiding students to awareness of higher-level thinking (part 2). Retrieved from https://www.improvewithmetacognition.com/metacognition-for-guiding-students-to-awareness-of-higher-level-thinking-part-2/

Richmond, A. S. (in press). Teaching learning strategies to pre-service educators: Practice what we preach! In M. C. Smith, & N. DeFrates-Densch (Eds.). Challenges and innovations in educational psychology teaching and learning. Hersey, PA: IGI Global.

Spring, H. T. (1985). Teacher decision making: A metacognitive approach. The Reading Teacher, 290-295.

Was, C. (2014). Are current metacognition measures missing the target? Retrieved from https://www.improvewithmetacognition.com/are-current-metacognition-measures-missing-the-target/

Westmoreland, D. (2014). Science and social controversy – A classroom exercise in metacognition. Retrieved from https://www.improvewithmetacognition.com/science-and-social-controversy-a-classroom-exercise-in-metacognition/


On The Importance of Teaching Metacognition: A Call for Research!

by Aaron S. Richmond, *Anastasia M. Bacca, *Jared S. Becknell,  *Mary P. Mancuso, *Ryan P. Coyle, and *Eric Klein

Metropolitan State University of Denver

(*) Undergraduate students

Much of the literature regarding metacognition has focused on awareness of metacognitive processes (Antonietti, Ignazi, & Perego, 2000; Metallidou, 2009; Schraw & Dennison, 1994; Topcu & Ubuz, 2008), defining metacognitive skill sets (Nelson & Narens, 1994; Veenman, Van Hout-Wolters, & Afflerbach, 2006), and how to accurately measure metacognition (Pieschl, 2009; Schraw, Kuch, & Gutierrez, 2013). While researchers have gained understanding about the components of metacognition and the importance of this skill for academic and professional success, few have examined effective ways to teach metacognition to students (Brownlee, Purdie, & Boulton-Lewis, 2001).

Brownlee et al. (2001) examined the effectiveness of an experimental program designed to increase cognitive reflection and development of more advanced epistemological beliefs (i.e., beliefs about knowing). The experimental group received an intervention that encouraged students to consider their epistemological beliefs. This group was asked to relate their knowledge about thinking to their own process of thinking and reflect on this interaction in the form of journal entries. Students who were asked to reflect demonstrated increased advanced epistemological beliefs when compared to the control group.

In another study aimed at increasing metacognitive skill in college classrooms, Was, Beziat, and Isaacson (2013) had educational psychology students engage in monitoring practices (e.g., calibration) over the course of a semester. Specifically, Was and colleagues assessed students 13 times via short exams. Prior to each assessment, students were asked to predict their scores. After each exam, teaching assistants would discuss the students’ predictions and actual scores. Was et al. found that students’ monitoring improved over the course of the semester, in that they become better judges of their learning and performance as a result of the intervention.

Seeking to learn more about effective strategies for teaching metacognition, Richmond and Richmond (2012) compared active learning instruction to direct learning instruction of the topic of metacognitive theory. The active learning condition was characterized by group work and interaction with the instructor, and discussing effective learning strategies with one another to enhance awareness of best learning practices. In contrast, the direct learning condition was characterized by lecture presentation of metacognitive theory and rewriting information from PowerPoint slides presented. Richmond and Richmond (2012) found that active learning instruction increased higher level learning of metacognitive theory over that of students who received direct instruction.

As demonstrated by the above preliminary studies (e.g., Brownlee et al., 2001; Richmond & Richmond, 2012; Was et al., 2013), there are promising interventions but there is still a great need for more research on implementing effective instructional strategies to increase metacognitive skills in higher education courses. Specifically, What type of instruction is best suited for increasing metacognitive skills in the regular higher education classroom? Is metacognitive development best  accomplished through experience and reflection (e.g., Brownlee et al. 2001; Was et al., 2013),  or are there other effective instruction methods, such as Socratic or inquiry-based instruction? We believe that metacognitive instruction should be embedded into the content beginning at the start of the semester and continuing throughout the semester, similar to that of Was et al. (2013). However, more research is needed to see if this really is the most effective approach. Additionally, research should focus on higher and lower level learning and how these instructional strategies may differentially affect level of learning (e.g., Richmond & Richmond, 2012). Finally, instructional strategies should be designed so that students can transfer the metacognitive strategy across higher education courses.

Although the above suggestions for future research are not a comprehensive list, we believe that they represent an important start. As such, we are asking our fellow colleagues to spread the word and to begin conducting important research that seeks to answer these questions. The preliminary results invariably suggest that our students will greatly benefit from such endeavors as will the quality of faculty instruction.

References

Antonietti, A., Ignazi, S., & Perego, P. (2000). Metacognitive knowledge about problem-solving methods. British Journal of Educational Psychology, 70(1), 1-16. doi:http://dx.doi.org/10.1348/000709900157921

Metallidou, P. (2009). Pre-service and in-service teachers’ metacognitive knowledge about problem-solving strategies. Teaching and Teacher Education, 25(1), 76-82. doi:http://dx.doi.org/10.1016/j.tate.2008.07.002

Nelson, T. O. & Narens, L. (1994). Why investigate metacognition. In J. Metcalf, & A. P. Shimamura (Eds), Metacogntiion, knowing about knowing (pp. 1-25). Cambridge: MIT.

Pieschl, S. (2009). Metacognition calibration—an extended conceptualization and potential applications. Metacognition Learning, 4, 3-31. doi: 10.1007/s11409-008-9030-4

Richmond, A. S. & Richmond, A. (2012, October). Teaching metacognition to preservice educators: A focus on transfer and retention. Paper presented at the annual meeting of the Northern Rocky Mountain Educational Research Association, Park-City, UT.

Schraw, G., & Dennison, R. S. (1994). Assessing metacognitive awareness. Contemporary Educational Psychology, 19, 460-475.

Schraw, G., Kuch, F., & Gutierrez, A. P . (2013). Measure for measure: Calibrating ten commonly used calibration scores. Learning and Instruction, 24, 48-57. http://dx.doi.org/10.1016/j.learninstruc.2012.08.007

Topcu, A., & Ubuz, B. (2008). The effects of metacognitive knowledge on the pre-service teachers’ participation in the asynchronous online forum. Educational Technology & Society, 11(3), 1-12.

Veenman, M. J., Van Hout-Wolters, B. H. A. M., & Afflerbach, P. (2006). Metacognition and learning; Conceptual and methodological considerations. Metacognition and Learning, 1(1), 3-14. doi:10.1007/s11409-0066893-0.

Was, C. A., Beziat, T. L. R., & Isaacson, R. M. (2013). Improving metacognition in a college classroom: Does enough practice work? Journal of Research in Education 23(1). Retrieved from http://www.eeraonline.org/journal/files/v23/JRE_v23n1_Article_5_Was_et_al.pdf


Teaching Metacognition to Improve Student Learning

This Faculty Focus article  by Maryellen Weimer summarizes and expands Tanner’s (2012) study on promoting student learning. She discusses metacognitive promoting strategies such as questions to ask students (e.g., How have I prepared for class today?).

Please check it out (http://www.facultyfocus.com/articles/teaching-professor-blog/teaching-metacognition-to-improve-student-learning/)

Tanner, K. D. (2012). Promoting student metacognition. Cell Biology Education—Life Sciences Education, 11 (Summer), 113-120.


Improving Students’ Learning With Effective Learning Techniques: Promising Directions From Cognitive and Educational Psychology

In this article by John Dulosky and colleagues (2013) they review an incredible amount of research on various learning strategies (e.g., elaborative interrogation, self-explanation, keyword mnemonic, etc.). This is a truly amazing resource. See below for full citation.

Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students’ learning with effective learning techniques promising directions from cognitive and educational psychology. Psychological Science in the Public Interest14(1), 4-58.