Assessing Metacognition: A Plan for Learning Improvement

In the fourth post of “The Evolution of Metacognition in Biological Sciences” guest series, Dr. Lindsay Doukopoulos describes the goals and outcomes of the spring meetings of the Biology curriculum committee that were led by Biggio Center and the Office of Academic Assessment. Namely, they sought to create a questionnaire that would be given to all graduating students that would allow them reflect on their learning over the course of their academic career and to create a rubric to measure the quality of metacognition in their responses.

by Dr. Lindsay Doukopoulos, Assistant Director of the Biggio Center for the Enhancement of Teaching and Learning. In collaborating with the Office of Academic Assessment on the Learning Improvement Initiative, she leads faculty development initiatives designed to connect faculty with strategies, resources, and partners to support their teaching. 

In Spring of 2019, Katie Boyd and I led four meetings with Biology’s curriculum committee with the two-part goal of producing a set of metacognitive-reflection questions to be completed by every graduating student in their capstone course and a rubric to assess the quality of metacognition evidenced in the reflections.  

Developing the Rubric

In the first workshop, our goal was to help faculty unpack the definition of metacognition into categories and decide how many levels or standards to maintain within the rubric. In other words, we were hoping to fill in the x and y axes of the Metacognition rubric.

To facilitate this discussion, we brought two rubrics designed to measure metacognition. One came from the General Learning Outcome site of Cal State University-San Bernardino (CSUSB). The other came from the AAC&U Value rubric on Lifelong Learning, specifically, the two elements called Transfer and Reflection. Both rubrics appeared to offer valuable ways of assessing the metacognition evident in a written reflection. Rather than choose one or the other, we combined the two categories (rows) of the AAC&U Value rubric and the three categories (rows) of the CSUSB rubric. We also decided to use four standards of quality (columns) and discussed terminology resulting in: Beginning or N/A, Emerging/Developing, Mastery, and Exceeding Expectations.  

photo of a curriculum meeting
Spring 2019 Biology undergraduate curriculum meeting number 1: creating a rubric to assess metacognition using the newly defined and approved SLO 6.

In the second workshop, our goal was to fill in the performance criteria or behavioral anchors that would make up the rubric. After much discussion, we again decided to leave the rubric big and pilot it in our next meeting to determine whether the AAC&U elements or the CSUSB elements would be preferable.

In our third workshop, piloted the rubric by we scoring a packet of student reflections that had come out of the Biology undergraduate research capstone course the previous year. In practice, the faculty found the two elements of the AAC&U rubric easier to apply and more valuable for differentiating between the quality of metacognition in the student responses. Thus, we reduced the final rubric to those two elements.

chart showing a metacognition rubric for biological sciences
This is the rubric to assess metacognition that came out of Biology’s spring curriculum committee meetings with Biggio Center and Academic Assessment.

Developing the Reflection Questions

In the final workshop, our goal was to draft and finalize questions that would be given to sophomores and seniors in the program. These questions would parallel those already being used in the undergraduate research capstone course. These are the questions the committee created:

  1. What has been your favorite learning moment in your major? Please describe it in detail and explain why it was your favorite.
  2. What were the most useful skills you learned in your major and why?
    1. Regarding the skills you listed in question 2: how do you know you learned them? Please provide specific examples.
    2. How do you plan to apply these skills in future courses or your career?
  3. As a student, what could you have done to learn more? If you could go back in time and give yourself advice, what you say?
  4. Evaluate your capacity to design an experiment and generate hypotheses. Please provide specific examples of aspects of the scientific process you’re most and least confident about.
  5. Reflect on your view of science. How has your participation in your Biological Sciences major changed your view of science, if at all? Please provide specific examples.
  6. Reflecting on your learning journey, what do you value most about your major curriculum (i.e. the courses you took and the order you took them in)?

This question-writing process concluded the initial phase of the Learning Improvement Initiative as it led to the creation of the instrument the department will use to gather baseline data on the metacognition SLO. Moving forward, all students (roughly 75 majors per year) will complete the questionnaire during their capstone course and the curriculum committee will lead assessment using the rubric we created.

The goal is to have every student scored on the rubric every year beginning with baseline data collection in spring 2020 with students who have not experienced the “treatment” conditions, i.e. courses redesigned by faculty to improve metacognition. Over time, we expect that the faculty development workshops around transparent assignment design, reflective writing assignments, and ePortfolio pedagogy will result in graduates who are more metacognitive and data that reflects the learning improvement.  


Re-Defining Metacognition: Generating Faculty Engagement

In the third post of “The Evolution of Metacognition in Biological Sciences” guest series, Dr. Chris Basgier describes the workshops series led by Office of University Writing and the Biggio Center that helped the department redefine metacognition in such a way that they felt like they could understand it, teach it, and assess it. He also unpacks the value of the new definition and points to the work ahead as Biology embraces ePortfolios as part of a pedagogical strategy to increase metacognition in their students.

by Christopher Basgier, Associate Director of University Writing 

In the fall semester of 2018, Lindsay Doukopoulos and I had the opportunity to guide faculty from Auburn University’s Department of Biological Sciences (DBS) through a series of workshops devoted to metacognition. These workshops were a direct response to the “metacognition massacre” that had occurred at the August 2018 faculty retreat, as Dr. Robert Boyd recounted in the first blog post in this series.

Photo of Fall 2018 Biology faculty workshop number one: using the TILT Higher Ed transparent assignment design framework to improve metacognition.
Fall 2018 Biology faculty workshop number one: using the TILT Higher Ed transparent assignment design framework to improve metacognition.

Essentially, DBS faculty were uneasy with the definition of metacognition contained in the department’s student learning outcome (SLO), and unsure how to implement metacognitive activities in their courses. Working together, Lindsay and I decided to use these workshops to introduce faculty to the principles of transparent assignment design, offer guidance on integrating reflective writing into courses, and work with them to redefine the metacognition SLO in more familiar terms. 

Transparent Design

We began with transparent assignment design and reflective writing—rather than the SLO—to generate faculty engagement in metacognition. With concrete such strategies for promoting metacognition under their belts, we decided, faculty would be more invested in redefining the SLO and more willing to commit to aligning their courses to that outcome.  

Lindsay led the effort to introduce transparent assignment design to DBS workshop participants. According to Mary-Ann Winkelmes with TILT Higher Ed (2016), transparent assignment design invites faculty to clarify how and why students are learning course content in particular ways. Transparently designed assignments include   

  1. The assignment’s purpose, including the skills they will practice and the knowledge they will gain  
  2. The task, including what students will do and the steps they should take to complete the assignment  
  3. Criteria for success, including a checklist or rubric and examples of successful student work  

From our perspective, transparently designed assignments can promote metacognition. They make explicit what is often implicit in course assignments, and they help students see how a given assignment fits within the larger context of a course, and even a curriculum. The best designed assignments show students how to draw on what they already know, and help them imagine future implications of their work.  

We gave faculty ample time during the first workshop to consider how they would revise one or more assignments using the transparent assignment design framework, but we also knew that students needed to take an active role in their learning if they were to enhance their metacognitive capabilities. Therefore, I led a second workshop on reflective writing.   

Reflective Writing Component

In Auburn’s Office of University Writing, where I work as Associate Director, we spend a lot of time introducing principles of reflective writing to faculty, namely because we are in charge of the ePortfolio Project, which is Auburn’s Quality Enhancement Project required for accreditation in the SACSCOC.

The ePortfolios we support are polished, integrative, public-facing websites that students can use to showcase their knowledge, skills, and abilities for a range of audiences and purposes. A key component of ePortfolios, reflective writing is a metacognitive practice that invites students to articulate learning experiences, ask questions, draw connections, imagine future implications, and repackage knowledge for different audiences and purposes. After introducing DBS faculty to various levels of reflective writing, I gave them time to develop a reflective writing activity that would support a project or experience already in play in the courses.   

Our hope in these first two workshops was to give DBS faculty practical tools for promoting metacognition in their courses that would not require wholesale course redesign. Transparent assignment design and low-stakes reflective writing are fairly easy to implement in most course contexts.

Redefining the Metacognition Learning Objective

Our third workshop required more intellectual heavy lifting, as it focused on redefining the metacognition SLO. The original metacognition SLO read as follows:  

Students will develop metacognitive skills and be able to distinguish between broad categories of metacognition as applied to their major. In particular, they will distinguish between foundational (i.e., knowledge recall) and higher order (i.e., creative, analysis, synthesis) metacognitive skills.  

The trouble with this definition is that it seems to require students to be able to define different kinds of metacognition (which is difficult enough for faculty), rather than put different kinds of metacognition into practice, regardless of whether or not they can name the metacognitive “categories” they are using.

As an alternative, I turned to research by Gwen Gorzelsky and colleagues, scholars in writing studies who developed a taxonomy of kinds of metacognition. In their framework, the richest form of metacognition is constructive metacognition, which they define as “Reflection across writing tasks and contexts, using writing and rhetorical concepts to explain choices and evaluations and to construct a writerly identity” (2016, p. 226). 

Attracted to the notion that metacognition involves reflection on choices and the construction of identity, Lindsay and I tried our hand at a revised definition:  

Metacognition is defined as the process by which students reflect on and communicate about their role in learning. Reflection and communication may include: 1. students’ choices made in response to the affordances and constraints on learning, and/or 2. students’ evaluations of the success of such choices, particularly across tasks and contexts. Ultimately, these activities should help students develop and articulate identities as scientists.  

Our goal in composing this definition was not to suggest to DBS faculty that it was the right one, only that alternatives were possible. During the final workshop, we asked them to review the original SLO as well as our alternative, and then apply some “critical resistance” to each by reflecting on which terms or ideas made sense, which did not, and what language they might like to include. After much discussion, the group developed a revised SLO:  

Students will develop their metacognitive skills. Metacognition is defined as the process by which students reflect on and communicate about their role in learning. Reflection and communication may include: 1. Awareness of choices made in response to the opportunities (i.e., homework, office hours, review sessions) and constraints (i.e., challenging problems, short time frames) on learning, and/or; 2. Evaluation of the success of such choices, particularly across tasks and contexts. Ultimately, these activities should help students develop and articulate their science knowledge and its value to their professional and lifelong learning goals.   

This definition includes some key changes and additions. It eliminates jargon like “knowledge recall” and “affordances” in favor of more accessible language like “opportunities,” which are further defined in parentheses. Faculty also pushed back on the idea that all students should develop identities as scientists. A great number of students who take DBS courses plan to go into medical fields, so instead, they wanted to put the emphasis on science knowledge, a much more portable focus than science identity. They also added the notion of professional and lifelong learning goals to acknowledge the varied contexts in which their science knowledge might be relevant.   

In the end, our metacognition workshop was a success: the department approved the new definition in December 2018, and many commented on how much clearer and easier to implement and assess it appeared. But our work is not done. Faculty still need to integrate metacognition throughout the curriculum—or at least in courses where it is feasible. The department has agreed that ePortfolios are an effective vehicle for doing so.

ePortfolios to Support Implementation

DBS had joined the ePortfolio Cohort (the group of departments and units committed to implementing ePortfolios) in 2017, and have been working steadily on implementation. Valerie Tisdale, the department’s academic advisor, began the effort to introduce ePortfolios in BIOL 2100, a professional practice course for undergraduate biology majors, in fall 2018. Most recently, in spring 2019, DBS faculty applied for and were awarded with a grant to support an intensive summer workshop to further the integration of ePortfolios in support of metacognition and written communication. My colleague Amy Cicchino and I met with three department members—Lamar Seibenhener, Joanna Diller, and Valerie Tisdale—for four weeks in summer 2019. Utilizing the resources of the ePortfolio Project, the departmental team developed a host of materials for a new, required course that asks students to complete their final ePortfolios during their senior year. 

In the interest of transparent assignment design, they also created an ePortfolio “roadmap” that would help DBS majors understand what an ePortfolio is, why it is important for students in the sciences, and where in the curriculum they might encounter artifacts that could be used as evidence of their knowledge, skills, and abilities. The department approved the new course and completed the roadmap at a retreat in late 2019.

At this point, we are awaiting university-level approval of the new course. In the meantime, we are also planning workshops for DBS faculty on designing meaningful assignments that can be used as ePortfolio artifacts. Taken together, these efforts will help DBS support metacognition through ePortfolios in the years to come.  

References

Gorzelsky, G., Driscoll, D. L., Paszek, J., Jones, E., & Hayes, C. (2016). Cultivating constructive metacognition: a new taxonomy for writing studies. Critical transitions: Writing and the question of transfer, 215

Winkelmes, M. A., Bernacki, M., Butler, J., Zochowski, M., Golanics, J., & Weavil, K. H. (2016). A teaching intervention that increases underserved college students’ success. Peer Review, 18(1/2), 31-36. 


Project Beginnings

In the second post of “The Evolution of Metacognition in Biological Sciences” guest series, Dr. Katie Boyd describes the activities the year prior to the Metacognition Massacre. These early activities started with the Learning Improvement Initiative that marked the beginning of the collaboration between Biology, Office of Academic Assessment, and the Biggio Center. She also describes how the initial definition of the metacognition learning outcome came about, how the department came to a greater understanding of metacognition, and how that understanding prompted a redefinition of what they believe metacognition is and should be within their context.

by Katie Boyd, Associate Director of the Office of Academic Assessment 

Luckily, the work of the Department of Biological Sciences to increase their graduating students’ metacognitive skills did not simultaneously begin and end with the “Metacognition Massacre” of 2018! If we back up just one year, the department was coming off of a strong fall faculty retreat and was ready to turn attention to the thoughtful examination of their curriculum and the knowledge, skills, and abilities expected of all students graduating from their program(s).    

In 2017, each undergraduate degree program in the Department of Biological Sciences (Marine Biology, Microbial, Cellular, & Molecular Biology, and Organismal Biology) had two (2) student learning outcomes and they addressed critical reading, information literacy, and communication skills. Metacognition had only just entered the conversation: it had not been a thoughtful component of the curriculum nor was it a learning outcome for their graduating students. The Department of Biological Sciences needed help. 

Partnering with the Teaching & Learning Center

Enter Auburn University’s Biggio Center for the Enhancement of Teaching and Learning, and Office of Academic Assessment.  That fall semester the two offices joined forces to support programs interested in evidencing learning improvement and jointly issued a request for learning improvement proposals.  

The learning improvement initiative was a way for programs to demonstrate a positive impact by showing how investment in innovative curricular experiences could lead to the improvement of student learning.  The Biggio Center and Office of Academic Assessment wanted to help programs evidence this improvement.  Of note, most departments redesign their curriculum too infrequently or do not have data to inform their curricular redesign, thus delaying their ability to showcase the improved preparedness of their graduates. We anticipated that the joint support of a teaching and learning center AND an assessment office would provide programs with many benefits, such as:   

  • A streamlined approach to aligning assessment processes with curricular innovation(s)  
  • The possibility of improving their students’ learning  
  • Strengthened program reputation  
  • Faculty satisfaction with process and outcome(s)  
  • Demonstrated good stewardship of departmental/college resources  
  • Opportunity for presentation/publication  

Biological Sciences submitted a proposal asking for support to define, measure, and improve metacognition amongst their graduates and they were chosen as one of six programs to participate in the inaugural cohort of learning improvement teams. Their specific reasons for choosing this outcome effort for their Learning Improvement Project are outlined below: 

  1. Metacognition was an element in the Action Plan developed by departmental  representatives at the PULSE Institute in June 2016. It was selected for the Action Plan  because it was a neglected element in our curricular planning.  
  2. This SLO was a new one on the department-wide list of SLOs, and of all the SLOs was the one with which faculty were least familiar. Specifically, the program felt they would need the most assistance integrating that into their degree programs. 
  3. A final reason was the hope that working with the Office of Academic Assessment and Biggio Center on improving students’ metacognition would eventually provide a model by which Biological Sciences could plan and implement curricular changes for their other SLOs.   

Writing the Learning Outcomes

Thus began the learning improvement project and, throughout the Fall semester, the Office of Academic Assessment facilitated a number of Biological Sciences curriculum committee meetings to re-write all of the department’s student learning outcomes (SLOs). The committee made incremental progress with bi-weekly meetings led by the Department’s intrepid chair.  The department chair quickly led the committee to write six of the seven student learning outcomes, but conversation continued around the metacognition outcome. 

Photo: Bob Boyd showcases Biology's Learning Improvement Project at the year one celebration event hosted by Biggio Center and Academic Assessment in fall 2018.
Bob Boyd showcases Biology’s Learning Improvement Project at the year one celebration event hosted by Biggio Center and Academic Assessment in fall 2018.

A number of committee members advocated for the importance of metacognition and reflection and admitted to embedding reflection components into weekly lectures and/or assignments.  On another hand, the former department chair  advocated for a definition that would be easily measurable and liked the idea of students being able to identify the level/type of learning being assessed in specific types of questions on exams or similar instruments (knowledge, comprehension, application).  Bloom’s taxonomy drove a lot of this conversation. 

Eventually, the committee finalized a metacognition SLO (6) and completed their list of seven department-wide SLOs (8 or 9 if you include major-specific outcomes).  At the time, the metacognition SLO was defined by the curriculum committee as:  

Students will develop metacognitive skills and be able to distinguish between  broad categories of metacognition as applied to their major. In particular, they willdistinguish between foundational (i.e., knowledge recall) and higher order (i.e., creative,analysis, synthesis) metacognitive skills. 

The list of outcomes was shared with all program faculty during a fall faculty meeting and they voted to accept the list as the new set of outcomes.  There were few questions regarding the outcomes during this meeting.  However, I think we can all agree that this is pretty typical when these sorts of items/topics are brought up in faculty meetings.   

Creating the Curriculum Map

A secondary goal of the curriculum committee was to draft a curriculum map aligning the new student learning outcomes with the required courses in each of the three undergraduate curricula.  The first few meetings allowed the committee to finalize the list of classes they wanted to include in the map and a subsequent discussion about how accurate a curriculum map would be when drafted by a subset of the faculty.  The curriculum committee entered the curriculum mapping conversations with some apprehension because the faculty in the room did not represent or teach all of the courses within the curriculum map. 

Eventually, it was decided that they would draft an aspirational curriculum map in which the ideal alignments would be suggested and discussed in a future faculty retreat. When it came to the metacognition outcome, the committee strongly felt as though it should be covered in each required course and that each course truly should be contributing to the students’ lifelong learning.    

Starting to Consider Assessment

With a set of student learning outcomes agreed upon, and a drafted curriculum map, the learning improvement conversation finally began to move towards assessment and measurement. Essentially, there needed to be a way to evaluate whether students were thinking about thinking and knowing about knowing. Enter the Office of University Writing.  It was at this point that Biological Sciences seriously considered ways in which ePortfolios could be used to both teach and assess metacognition.

Initial conversations targeted ePortfolios as a way to encourage reflective writing and simply “house” student assignments. This idea has blossomed and become much more than a data warehouse, and Chris Basgier (Office of University Writing) will expand on this in the next blog post.     This brings us to the Fall 2018 faculty retreat, which allowed for a guided and thoughtful discussion around each outcome and the aspirational curriculum map.  It was this thoughtful discussion that led to the very effective massacre of SLO 6, ultimately pointing to the need for a better definition of metacognition as a learning outcome. 


“The Metacognition Massacre”

In the first post of “The Evolution of Metacognition in Biological Sciences” guest series, Dr. Bob Boyd reflects on 2018 faculty retreat where Biology faculty rejected responsibility for teaching metacognition in their courses. He also shares where and how Biology’s journey to learning improvement around metacognition began.

By Robert Boyd, Professor of Biological Sciences and former Undergraduate Program Officer for Department of Biological Sciences (DBS). Currently, Associate Dean for Academic Affairs, College of Sciences and Mathematics 

My most memorable moment regarding metacognition occurred at a departmental faculty retreat in August 2018, right before the start of Fall Semester. Before this retreat, our departmental Curriculum Committee had created an “aspirational” curriculum map that purported to show which required courses addressed our brand-new list of eight or nine Student Learning Outcomes (SLOs) for each of the three majors in our department.

The Massacre

Metacognition, our new SLO 6, was selected as being a part of every required course. At the retreat, breakout groups were assigned to discuss and describe some aspects of several SLOs (one SLO per group, including a group assigned to “metacognition”) and put their ideas on a flipchart. When all the breakout groups reported, the metacognition group presented a blank flipchart page and said that they had been unable to decide what metacognition was.

Later during the retreat, when we discussed our “aspirational” curriculum map to convert it into a map that showed which SLOs were actually addressed in our core classes, almost all the checkmarks for metacognition were removed from the map. We asked faculty to place Post Its over the SLOs that they didn’t feel like their courses needed to address. In my mind, that retreat was a metacognition massacre. It showed that we needed to do some serious work to define that SLO as well as decide how to integrate it and measure it in our curricula.

Photo of a chart showing a curriculum map from a faculty retreat

Image 1: Biology’s ideal curriculum map presented at the 2018 Retreat. Faculty used slips of pink paper to indicate rejection of an SLO they didn’t think their individual course (left hand column) addressed. SLO 6, metacognition, was almost entirely stricken from the curriculum.

This blog series will present my department’s work on metacognition, mainly focusing on how we have proceeded since the memorable metacognition massacre at that faculty retreat. But I want to take some time now to set the stage by describing my department and some of our work prior to that retreat.

Setting the Stage for the Metacognition Massacre

Auburn University is a land-grant school with about 30,000 students, and has recently achieved the status of a Carnegie R1 institution (meaning that research is an important part of our mission). My department of 43 faculty is a Biological Sciences department, and our courses are vital to the university’s educational mission as well. As evidence of this, in an academic year we teach about 45,000 student credit hours. 

This new outcome effort began in January 2016, when one of our faculty, Jason Bond, became Chair and encouraged us to review our curricula, something that had not been done since 2008. Coincidentally, also in January 2016, our department was invited to participate in an NSF-funded Institute at Wofford College in South Carolina designed to help us begin the process of reviewing and revamping our programs.

In June 2016, a small departmental team attended the retreat which was focused on a report by the American Association for Advancement of Science (AAAS) on undergraduate biology education in the US. The report, entitled “Vision and Change in Undergraduate Biology Education: A Call to Action” (referred to as V&C below) and available from this link (https://live-visionandchange.pantheonsite.io/wp-content/uploads/2013/11/aaas-VISchange-web1113.pdf), pointed out that undergraduate biology education needed reform and the workshop involved assessing our department and its curricula.The assessment used a rubric that listed “Student Metacognitive Skills” as one of the ten elements evaluated, with an exemplary department described as “Instructors regularly integrate practice of effective metacognitive strategies within assignments. Most students become adept at reflecting upon, and improving, their own learning and coaching their peers.”

To begin the work of moving as a department from having no outcomes related to metacognition to one that placed it squarely in the SLOs for all of our programs, we held a retreat in 2017 which focused on High Impact Practices (HIPs). This retreat was facilitated by two nationally known educational leaders: Dr. Ellen Goldey (Dean, Wilkes Honors College, Florida Atlantic University) and Dr. April Hill (Chair, Department of Biology, University of Richmond). Faculty engagement at this event was strong and led us to begin the work of formally committing to a curriculum that would address metacognition as an outcome of our undergraduate programs.

In the spring of 2018, we held faculty meetings to introduce V&C concepts and ask the faculty in each of our three majors to evaluate our programs. In every case we decided we were at a “Beginning” stage. According to the V&C rubric, this means “Rarely are students encouraged to reflect on their learning strategies and skills. Study strategies, when discussed, may not be specifically geared to STEM learning or the particular student’s needs.” These meeting led to the 2018 Faculty Retreat described earlier which showed us how challenging it would be for us to understand and embrace our metacognition SLO. 

Citations  Brewer, C. A., & Smith, D. (2011). Vision and change in undergraduate biology education: a call to action. American Association for the Advancement of Science, Washington, DC.


The Evolution of Metacognition in Biological Sciences

By Lindsay Doukopoulos, Assistant Director of the Biggio Center for the Enhancement of Teaching and Learning at Auburn University, and blog mini-series editor.

Much of the literature on metacognition focuses on strategies that faculty can use to improve metacognitive skills in their students and the benefits of such skills. Our mini-series tackles a different kind of problem: how can a department redesign its curriculum to improve metacognition for all students and how will it know if improvement has actually occurred?  We believe our efforts can inform others across a variety of disciplines.

Our answer to this question takes the form of a case study in five parts about our collaborative and ongoing efforts to redesign the Department of Biological Sciences’ undergraduate curriculum and program assessment with a goal of improving metacognition for its students and demonstrating that improvement with data. We use a narrative structure to present the key inflection points in this process as well as lessons learned and best practices from our diverse perspectives.

Our collaborators include: Associate Dean for Academic Affairs for the College of Sciences and Mathematics, Bob Boyd (also a Biological Sciences professor and formerly the department’s Undergraduate Program Officer); Associate Director of Academic Assessment, Katie Boyd; Associate Director of the Office of University Writing, Chris Basgier; Chair of the Department of Biological Sciences, Scott Santos; and Assistant Director of the Biggio Center for the Enhancement of Teaching and Learning, Lindsay Doukopoulos.  

This timeline provides an overview of our efforts while our individual posts go into more detail about specific strategies and outcomes:  

Ideation: 

June 2016: Department leaders attend PULSE Institute and decide to make metacognition a student learning outcome (SLO) for all undergraduate programs the Department of Biological Sciences (hereafter, Biology) 

May 2017: Program assessment reports at this time include only two student learning outcomes (metacognition not one of them) for each of the three undergraduate programs in Biology 

August 2017: Faculty retreat led by NSF Vision & Change experts introducing metacognitive teaching strategies  

Commitment: 

October 2017: Learning Improvement Initiative launched by Biggio Center and Office of Academic Assessment: Biology proposes to improve SLO 6 – Metacognition  

Spring 2018: Biology’s curriculum committee develops a plan for improvement and creates an ideal (“aspirational”) curriculum map to share at the 2018 fall faculty retreat 

Lindsay Doukopoulos leading faculty development on metacognition at the 2018 Biology Faculty Retreat
Lindsay Doukopoulos leading faculty development on metacognition at the 2018 Biology Faculty Retreat

Conflict: 

August 2018: Faculty retreat, aka “Metacognition Massacre” – widespread faculty rejection of the metacognition SLO on the curriculum map 

A New Approach: 

Fall 2018: A three-part workshop series created by Office of University Writing (OUW) and the Biggio Center leads faculty to redefine the metacognition SLO and introduces strategies to support faculty teaching  

Turning Point:  

December 2018: Outcomes of the workshop series, including the new definition of SLO 6, are presented at a faculty meeting and the faculty vote to approve the new definition  

Assessing Metacognition:  

January – April 2018: Office of Academic Assessment and the Biggio Center lead Biology’s curriculum committee in creating a metacognitive questionnaire for graduating students and a rubric to assess the level of metacognition evidenced in the responses 

Improving Metacognition: 

Summer 2019: Biology invests in comprehensive strategy to promote metacognition across the curriculum using ePortfolios and several faculty participate in an intensive course redesign program 

What now?  

Fall 2019: OUW and Biggio provide ongoing support of teaching interventions to improve metacognition; Office of Academic Assessment provides ongoing support of the assessment of this work 

What’s next? 

Spring 2020: Gather baseline data on graduates’ metacognitive capabilities  Goals: Based on our efforts and an ongoing collection of data, we expect to see increases in students’ metacognitive abilities over time