Author: Ashley Welsh

Meaningful Reflections for Improving Student Learning

by Ashley Welsh, Postdoctoral Teaching & Learning Fellow, Vantage College

I am a course coordinator and instructor for a science communication course (SCIE 113) for first-year science students. SCIE 113 focuses on writing, argumentation and communication in science and is part of the curriculum for an enriched, first-year experience program for international, English Language Learners. Throughout the term, students provide feedback on their peers’ writing in both face-to-face and online environments. The process of providing and receiving feedback is an important skill for students, however many students do not receive explicit instruction on how to provide or use constructive feedback (Mulder, Pearce, & Baik, 2014). In order to better understand my students’ experience with peer review, I conducted a research project to explore how their use and perceptions of peer review in their writing developed over the course of the term.

Many of the data collection methods I used to assess students’ perceptions and use of peer review in SCIE 113 this past term incorporated acts of reflection. These included in-class peer review worksheets and written reflections, small and large group discussions, an end-of-term survey about peer review, and my own researcher reflections. Periodically throughout the semester, I paired up the students and they engaged in peer review of one another’s writing. They each had a worksheet that asked them to comment on what their partner did well and how that person could improve their writing. During this activity, my teaching assistant and I interacted with the pairs and answered any potential questions. Afterwards, students independently completed written reflections about the usefulness of the peer review activity and their concerns about giving and receiving feedback. Before the class finished, we discussed students’ responses and concerns as a whole group. Students’ worksheets and written reflections, as well as classroom observations, offered insight into how my pedagogy mapped to their use of and reflections about peer review.

As of late, I have been more deliberate with designing pedagogy and activities that offer students the time and space to reflect and record their strengths and weaknesses as learners. The term reflection, is often used when discussing metacognition. As Weinert (1987) describes, metacognition involves second-order cognitions such as thoughts about thoughts or the reflections of one’s actions. With respect to metacognitive regulation, Zohar and Barzilai (2013) highlight that an individual can heighten their awareness of their strengths/weaknesses and evaluate their progress via reflection. This reflection process also plays a key role in metacognition-focused data collection as most methods require students to reflect upon how their knowledge and skills influence their learning. Providing survey responses, answering interview questions, and writing in a journal require a student to appraise their personal development and experience as a learner through reflection (Kalman, 2007; Aktruk & Sahin, 2011).

While the act of reflection is an important component of metacognition and metacognitive research, its use in the classroom also presents its own set of challenges. As educators and researchers, we must be wary of not overusing the term so that it remains meaningful to students. We must also be cautious with how often we ask students to reflect. An extensive case study by Baird and Mitchell (1987) revealed that students become fatigued if they are asked to reflect upon their learning experiences too often. Furthermore, we hope these acts of reflection will help students to meaningfully evaluate their learning, but there is no guarantee that students will move beyond simplistic or surface responses. To address these challenges in my own classroom, I attempted to design activities and assessments that favoured “not only student participation and autonomy, but also their taking responsibility for their own learning” (Planas Lladó et al., p. 593).

While I am still in the midst of analyzing my data, I noticed over the course of the semester that students became increasingly willing to complete the reflections about peer review and their writing. At the beginning of the term, students wrote rather simplistic and short responses, but by the end of the term, students’ responses contained more depth and clarity. I was surprised that students were not fatigued by or reluctant to complete the weekly reflections and discussions about peer review and that this process became part of the norm of the classroom. Students also became faster with completing their written responses, which was promising given that they were all English Language Learners. As per John Draeger (personal communication, April 27, 2016), students’ practice with these activities appears to have helped them build the stamina and muscles required for successful and meaningful outcomes. It was rewarding to observe that within class discussions and their reflections, students became better aware of their strengths and weaknesses as reviewers and writers (self-monitoring) and often talked or wrote about how they could improve their skills (self-regulation).

Based on my preliminary analysis, it seems that tying the reflection questions explicitly to the peer review process allowed for increasingly meaningful and metacognitive student responses. The inclusion of this research project within my class served as an impetus for me to carefully consider and question how my pedagogy was linked to students’ perceptions and ability to reflect upon their learning experience. I am also curious as to how I can assist students with realizing that this process of reflection can improve their skills not only in my course, but also in their education (and dare I say life). This research project has served as an impetus for me to continue to explore how I can better support students to become more metacognitive about their learning in higher education.

References

Akturk, A. O., & Sahin, I. (2011). Literature review on metacognition and its measurement. Procedia Social and Behavioral Sciences, 15, 3731-3736.

Baird, J. R., & Mitchell, I. J. (1987). Improving the quality of teaching and learning. Melbourne, Victoria: Monash University Press.

Kalman, C. S. (2007). Successful science and engineering teaching in colleges and universities. Bolton, Massachusetts: Anker Publishing Company, Inc.

Mulder, R.A., Pearce, J.M., & Baik, C. (2014). Peer review in higher education: Student perceptions before and after participation. Active Learning in Higher Education, 15(2), 157-171.

Planas Lladó, A., Feliu Soley, L., Fraguell Sansbelló, R.M., Arbat Pujolras, G., Pujol Planella, J., Roura-Pascual, N., Suñol Martínez, J.J., & Montoro Moreno, L. (2014). Student perceptions of peer assessment: An interdisciplinary study. Assessment & Evaluation in Higher Education, 39(5), 592-610.

Weinert, F. E. (1987). Introduction and overview: Metacognition and motivation as determinants of effective learning and understanding. In F. E. Weinert & R. H. Kluwe (Eds.), Metacognition, motivation, and understanding (pp. 1-16). Hillsdale, New Jersey: Lawrence Erlbaum Associates, Inc.

Zohar, A., & Barzilai, S. (2013). A review of research on metacognition in science education: Current and future directions. Studies in Science Education, 49(2), 121-169.


Supports and Barriers to Students’ Metacognitive Development in a Large Intro Chemistry Course

by Ashley Welsh, Postdoctoral Teaching & Learning Fellow, Vantage College

First off, I must admit that this blog posting has been a long time coming. I was fortunate enough to meet both John Draeger and Lauren Scharff at the ISSOTL conference in Quebec City in October of 2014. Their “Improving With Metacognition” (IWM) poster was a beacon for someone such as myself who is engaged with metacognition in both my teaching and research. I was thrilled to know there were individuals creating and contributing to a repository of literature and reflections surrounding metacognition. This past January, John asked me to contribute a blog post to the website, however I thought it best to defer my writing until after the completion of my PhD this past spring. Thus, here I am. Ready to write.

For the past 7 years I have been actively engaged with undergraduate science education and research at the University of British Columbia (UBC). Within my research and teaching, I have become increasingly aware of students’ concerns with developing and adapting the appropriate study habits/strategies for success in their introductory courses. This concern was echoed by several of my colleagues teaching large (300+ students/section) introductory math and science courses.

This growing concern led me to exploring students’ metacognitive development in two sections of a large, second year introductory organic chemistry course for biological science majors (~245 students/section). Across the literature and at UBC, this course has a reputation as a challenging, cumulative course where students often fail to develop meaningful learning strategies and fall behind in the course (Grove & Bretz, 2012; Lynch & Trujillo, 2011; Zhao et al., 2014). As a result of its reputation, the instructor with whom I was working designed several formative assessments (e.g. bi-weekly in-class quizzes, written reflections), scaffolded in-class activities (e.g. targeted study strategy readings and discussion), and workshops to improve students’ learning strategies. That is, to improve their ability to control, monitor, evaluate, and plan their learning processes (Anderson & Nashon, 2007; Thomas, 2012). Despite students’ high completion of these targeted activities/homework, many still seemed to be struggling with how to study effectively. As such, we were curious to understand the barriers and supports for students’ metacognitive development in this particular course.

My research adopted an interpretive case study approach (Creswell, 2009; Stake, 1995) with data being collected via a pre/post metacognitive instrument, a student feedback survey, classroom observations, and student interviews. At this point in time I will not get into the nitty gritty details of my thesis, but instead, will draw on a few of the main observations/themes that emerged from my work.

  1. High stakes assessments may overshadow resources designed for metacognitive development: Within this course, students’ placed considerable emphasis on high stakes assessment as a means for studying, learning, and reflection. Despite students perceiving the formative assessment measures (e.g. in-class quizzes, homework assignments, targeted study strategy activities) as useful to their learning, the majority of them attributed the midterm and final examinations as driving their studying and behaviours. The examinations were worth roughly 75% of students’ grades and as such, students expressed being more concerned with their performance on these high stakes assessments than with their own study strategies. Students indicated that because the formative activities and workshops were only worth about 15% of their grade, they rarely reflected back on these resources or implemented the advised learning strategies. While these resources were designed to provide ongoing feedback on students’ learning strategies and performance, students mentioned that their performance on the first midterm exam was the primary crossroad at which they would explicitly reflect upon their learning strategies. As one student mentioned, “The midterm is the first major point at which you realize you didn’t understand things”. Unfortunately this was often too late in the semester for most students to effectively change their strategies.
  1. The majority of students reported difficulty implementing metacognitive strategies for enhanced learning: While many students were aware of their weaknesses and lack of concentration when studying, they still struggled with effectively monitoring, evaluating and planning their learning. One student mentioned that “while I do study hard, I don’t think I study smart”. Even when students were aware of their issues, implementing change was difficult as they weren’t exactly sure what to do. Despite the instructor modeling effective strategies and providing multiple opportunities for students to reflect on their learning, several students had difficulty with acknowledging, recognizing, or implementing this advice. Students unanimously praised the efforts of the instructor and the multiple resources she created to support their learning, but outside of class, students often struggled with staying on task or changing their behaviours/attitudes. Some students mentioned they were more concerned with getting a question right than with understanding the problem solving process or with implementing the appropriate strategies for learning. The majority of students I spoke to indicated that throughout their education they had rarely received explicit advice about how to study and some even mentioned that despite writing down the advice they received in class, they were “far too lazy to change”. With learning strategies not taking a primary role in their previous and current education, it’s not surprising that most students found it difficult to implement appropriate strategies for learning.
  1. Students emphasized the importance of gaining awareness of oneself as a learner and seeking help from others: While students acknowledged that the demanding course material and high-stakes assessments were barriers to their learning, they also noted the critical influence that their own strategies and abilities as learners had on their experience and performance. Some students viewed their own stubbornness or personal issues as reasons why they were “too lazy to change” or more likely to “stick with what I already know. Like memorizing and cramming”. When asked to provide advice for incoming students, all of the students I interviewed (n=26) mentioned the necessity for students to “know yourself and what suits you best. And change it – experiment with it. Know how you study. Know that.” This comment was echoed by several students who emphasized the need for every student to be aware of their weaknesses as learners and to actively and immediately seek help from others when concerned or confused. Students who exhibited effective learning strategies were more likely to attend office hours, to create study groups, and to implement and evaluate the instructor’s study advice. Furthermore, these students could explicitly articulate the strategies they used for studying and could identify which course resources were most influential to their learning approaches.

The three themes described above are only a snapshot of some of the issues unveiled within my doctoral research. They have led me to consider more research that could explore:

  • How increasing the weight (percentage of the final grade) of the formative assessment/activities relative to the high-stakes examinations might impact students’ learning strategies/behaviours;
  • How to appropriately shift students’ fixations on grades to that of understanding and learning;
  • How we might better support students in seeing value in activities, resources, or low-stakes assessment that have been designed to support them as metacognitive, confident learners; and
  • How we might achieve these assessment and learning goals in large, introductory science courses.

I look forward to any comments/questions you have on this topic!

-Ashley

——————————–

Anderson, D., & Nashon, S. (2007). Predators of knowledge construction: Interpreting students’ metacognition in an amusement park physics program. Science Education, 91(2), 298-320. doi: 10.1002/sce.20176

Creswell, J. W. (2009). Research design, qualitative, quantitative, and mixed methods approaches (3rd ed.). Thousand Oaks, CA: Sage.

Grove, N. P., & Bretz, S. L. (2012). A continuum of learning: from rote memorization to meaningful learning in organic chemistry. Chemistry Education Research and Practice, 13, 201-208.

Lynch, D. J., & Trujillo, H. (2011). Motivational beliefs and learning strategies in organic chemistry. International Journal of Science and Mathematics Education, 9(1351- 1365).

Stake, R. E. (1995). The art of case study research. Thousand Oaks, CA: Sage.

Thomas, G. (2012). Metacognition in science education: Past, present, and future considerations. In B. J. Fraser, K. Tobin & C. J. McRobbie (Eds.), Second International Handbook of Science Education (pp. 131-144): Springer International Handbooks of Education.

Zhao, N., Wardeska, J. G., McGuire, S. Y., & Cook, E. (2014). Metacognition: An effective tool to promote success in college science learning. Journal of College Science Teaching, 43(4), 48-54.