Meta-Teaching: Improve Your Teaching While Improving Students’ Metacognition

By Aaron S. Richmond, Metropolitan State University of Denver

To-date, many of the wonderful blogs posted on Improve with Metacognition  have aptly focused on metacognition itself. They varied from classroom exercises to improve student metacognition (see Westmoreland, 2014) to increasing higher level thinking through metacognitive practices (see Nuhfer, 2014) to the merits of measuring metacognition (Was, 2014). Not yet covered is that of the secondary purpose of this website. That is, the emphasis will be the process of teaching about metacognition and teaching metacognitively. As such, there is great potential and room discourse on meta-teaching or meta-pedagogy as a way to both improve student learning of metacognition and our own teaching practices.

Yet first, it is important to begin with a solid operational definition of meta-teaching. As Chen (2013) states,

Like meta-cognition and meta-learning, meta-teaching, as ‘teaching about teaching’, can serve to design, examine and reflect on teaching. From practice-orientation, it defines what teaching activity is and what it is for, under which theoretical framework it is being carried out, and what experience and rules can be applied to it. Meanwhile, meta-teaching can assist teachers in discovering drawbacks in the teaching system and solving problems. This demonstrates that meta-teaching contains such functions such as understanding teaching, changing teaching and reflecting on teaching. (p. S64)

Therefore, by using this definition, how can we first improve our teaching using meta-teaching practices? And second, how can we use meta-teaching to specifically improve our teaching of metacognitive theory and the metacognition of our students?

Why Engage in Meta-Teaching Practices?

Drawn from the literature on meta-teaching, there are several benefits and reasons why college professors should employ meta-teaching practices. First, and foremost it promotes student learning (Chen, 2013). When teachers reflect and evaluate whether their teaching methods actually have an impact on student learning and adjust their practices accordingly, inevitably student learning and performance improves. Second, meta-teaching can invigorate and create a passion for teaching. In that, engaging in this process has been found to increase teacher’s love for the profession (Chen, 2013). Moreover, Chen states, “When the teacher takes action, he/she begins to observe and reflect on the action, impelling him/her to stay highly conscious of what he/she is doing….Without meta-teaching action, a teacher would hardly keep his /her motivation and enthusiasm for better teaching.” (p. S69) Finally, meta-teaching promotes the teaching profession through formal and informal scholarship of teaching and learning (SoTL). That is, SoTL cannot be conducted without proper meta-teaching practices.

Meta-Teaching Strategies Used to Improve Metacognition

Plan, strategy, monitor, and evaluate.  Spring (1985) suggests that teachers should use meta-teaching strategies by properly planning lessons, critically reflecting on appropriate instructional strategies/methods to obtain instructional goals, monitor student learning, and evaluate the efficacy of the strategy. For example, in a recent study I conducted (Richmond, in press), I used meta-teaching strategies to improve pre-service education students’ knowledge of various learning strategies. See Table 1 for an illustrative example of how I employed the meta-teaching strategies of planning, instructional strategy, student monitoring, and evaluation to improve my teaching and increase my student’s knowledge of metacognitive theory (e.g., learning strategies).

Table 1. Example of Implementing Meta-Teaching to Teach Learning Strategies
Meta-Teaching Strategy Richmond’s (in press) Educational PsychologyClassroom Example
Planning and Goals
  • Increase both higher and lower level learning of the learning strategies of rehearsal, organization, elaboration, spacing vs. massed practice, and distributed practice.
  • Increase retention of the knowledge of learning strategies.
  • Attempt to assist students in transferring these strategies to their own learning.

 

Instructional Strategy
  • Used Active learning (e.g., small group discussion, experimentation, elaboration) vs. direct instruction (e.g., lecture) to teach about learning strategies.
Monitoring Student Learning
  • Formally assessed prior knowledge of student’s understanding of learning strategies.
  • Formally assessed immediate retention of knowledge of learning strategies.
  • Formally assessed long-term retention (4-weeks) of knowledge of learning strategies.
  • Informally assessed (e.g., why questions and a 1-minute written assessment) progress of learning about learning strategies during class.
Evaluation
  • Analyzed which instructional method was most effective and found that only active learning instruction increased higher-level learning.
  • Found that students were unable to transfer strategies.
  • Found that students taught with active learning instruction retained more information over time.

Encourage metacognition in students. Not only can teachers use meta-teaching strategies to improve their own teaching, student learning, and to teach about metacognition, they can also model and encourage metacognitive thinking in their students. Similar to that of meta-teaching strategies, Chen suggests students should set a plan/goal for learning, develop a strategy to achieve this goal, monitor the progress of the given strategy, and finally evaluate the effectiveness of the strategy. Moreover, when teachers effectively use meta-teaching strategies they explain the reasoning behind specific pedagogical practices (e.g., formal and informal assessments, specific teaching strategies, assignments, etc.) and they explain the successes and failures of meta-teaching strategies (Chen, 2013). This process may model metacognitive practices to students. Additionally, Chen argues that teachers using meta-teaching strategies (no matter the content domain) always specifically infuse and teach metacognitive strategies to students.

Closing Meta-Remarks

I believe that many exemplar teachers inherently use meta-teaching strategies. However, for the rest of us, it is extremely important to investigate and learn how to improve our teaching through these practices. Additionally, when we convey the process to our students we are modeling metacognitive processes to students, which they too can use to improve their learning and performance in whatever endeavor they so choose.

References

Chen, X. (2013). Meta-teaching: Meaning and Strategy. Africa Education Review, 10(1), S63-S74. doi:10.1080/18146627.2013.855431

Nuhfer, E. (2104). Metacognition for guiding students to awareness of higher-level thinking (part 2). Retrieved from https://www.improvewithmetacognition.com/metacognition-for-guiding-students-to-awareness-of-higher-level-thinking-part-2/

Richmond, A. S. (in press). Teaching learning strategies to pre-service educators: Practice what we preach! In M. C. Smith, & N. DeFrates-Densch (Eds.). Challenges and innovations in educational psychology teaching and learning. Hersey, PA: IGI Global.

Spring, H. T. (1985). Teacher decision making: A metacognitive approach. The Reading Teacher, 290-295.

Was, C. (2014). Are current metacognition measures missing the target? Retrieved from https://www.improvewithmetacognition.com/are-current-metacognition-measures-missing-the-target/

Westmoreland, D. (2014). Science and social controversy – A classroom exercise in metacognition. Retrieved from https://www.improvewithmetacognition.com/science-and-social-controversy-a-classroom-exercise-in-metacognition/


Promoting Student Metacognition

by Kimberly D. Tanner

This article starts out with two student scenarios with which many faculty will easily resonate (one student with poor and one with good learning skills), and which help make the case for the need to incorporate metacognitive development in college courses. Kimberly then shares some activities and a very comprehensive list of questions that instructors might ask students to answer regarding the planning, monitoring and evaluating of their own learning. While Kimberly makes a point of teaching metacognition within the disciplines, these questions are all generic enough to be used in any discipline. Of note in this article, there is a section that discusses metacognitive instruction, and includes a series of questions that faculty should ask of themselves as they plan, monitor and evaluate their teaching.

CBE—Life Sciences Education; Vol. 11, 113–120, Summer 2012

https://www.lifescied.org/doi/full/10.1187/cbe.12-03-0033


Teaching Metacognition to Improve Student Learning

By: Maryellen Weimer, PhD; published in Teaching Professor Blog October 31, 2012

This blog post offers suggestions for manageable approaches to getting students started in metacognitive types of reflection. Her suggestions are modifications of some shared by Kimberly Tanner in her article on “Promoting Student Metacognition”. Maryellen also astutely points out that, “When you start asking questions about learning, I wouldn’t expect students to greet the activity with lots of enthusiasm. Many of them believe learning is a function of natural ability and not something they can do much about. Others just haven’t paid attention to how they learn.”

http://www.facultyfocus.com/articles/teaching-professor-blog/teaching-metacognition-to-improve-student-learning/


Promoting general metacognitive awareness

This informative article by Gregory Schraw begins with a distinction between knowledge of cognition and regulation of cognition (lots of great references included), continues with a a discussion of generalization and a summary of some additional research that examines the relationship between metacognition and expertise (cognitive abilities), and finishes with several strategies that instructors can use to develop both metacognitive awareness and regulation.

http://wiki.biologyscholars.org/@api/deki/files/87/=schraw1998-meta.pdf 


Metacognition for Guiding Students to Awareness of Higher-level Thinking (Part 2)

by Ed Nuhfer (Contact: enuhfer@earthlink.net; 208-241-5029)

Part 1 introduced the nature of adult intellectual development in terms of the stages ascended as one becomes educated. Each stage imparts new abilities that are valuable. This Part 2 reveals why awareness of these stages is important and offers metacognitive exercises through which students can begin to engage with what should be happening to them as they become better thinkers.

 

A disturbingly tiny contingent of professors in disciplines outside adult education have read the adult developmental research and recognized the importance of Perry’s discovery. Even fewer pass on this awareness directly to their students. Thus, recognition that the main value of a university education does not lie in acquired knowledge of facts and formulae but rather in acquiring higher level thinking abilities remains off the radars of most students.

Given what we know from this research, a potential exists for American higher education’s evolving into a class-based higher educational system, with a few institutions for the privileged supporting curricula that emphasize developing the advanced thinking needed for management and leadership, and a larger group of institutions fielding curricula emphasizing only content and skills for producing graduates destined to be managed. Until students in general (and parents) recognize how these two educational models differ in what they offer in value and advantages for life, they will fail to demand to be taught higher-order thinking. Overcoming this particular kind of ignorance is a struggle that neither individual students nor a free nation can afford to lose.

 

Teaching Metacognition: Mentoring Students to Higher Levels of Thinking

One way to win this struggle is to bring explicit awareness of what constitutes becoming well educated directly to students, particularly those not enrolled in elite, selective schools. All students should know what is happening to them, which requires understanding the stages of adult intellectual development and the sequence in which they occur offers the explicit framework needed to guide students to do beneficial “thinking about thinking.” (See Part 1, Table 1.) This research-based framework offers the foundation required for understanding the value of higher-level thinking. It offers a map for the journey on which one procures specific abilities by mastering successively higher stages of adult thinking. Through learning to use this framework metacognitively, individuals can start to discover their current stage of intellectual development and determine what they need for achieving the next higher stage.

I have included two exercises for students to show how the research that informs what we should be “thinking about” can be converted into metacognitive components of lessons. These modules have been pilot tested on  students in introductory general education and critical thinking courses.

The first, “Module 12 – Events a Learner Can Expect to Experience,” uses the research that defines the Perry stages (Table 1) as a basis for authoring an exercise that guides students through key points to “think about” as they start to reflect upon their own thinking. Instructors can employ the module as an assignment or an in-class exercise, and should modify it as desired. For many students, this will serve as their first exposure to metacognition. If this is the reader’s first introduction to adult intellectual development, work through this module, ideally with a colleague on a lunch break. Start to procure some of the key resources listed in the references for your personal library.

With the exception of Perry Stages 7, 8, and 9, Module 12 largely addresses the cognitive realm. However, when intellectual development occurs successfully, affective or emotional development occurs in parallel as one advances through higher cognitive stages (see Nuhfer, 2008). Metacognition or “thinking about thinking” should extend also to a reflective “thinking about feelings.” Since the 1990s, we have learned that our feelings about our learning–our affective component of thinking– influence how well we can learn. Further, our affective development or “emotional intelligence” determines how well that we can work with others by connecting with the through their feelings, which is a huge determinant in work and life success.

The second “Module 4—Enlisting the Affective Domain” helps students to recognize why the feelings and emotions that occur as one transitions into higher stages are important to consider and to understand. At the higher levels of development, one may even aspire to deeply understand another by acquiring the capacity for experiencing another’s feelings (Carper, 1978; Belenky and others, 1986).

Frequent inclusion of metacognitive components in our assignments is essential for providing students with the practice needed for achieving better thinking. Guiding students in what to “think about” can help students engage in challenges that arise at the finer scales of metadisciplines, disciplines, courses, and lessons. This requires us to go beyond articulating: “What should students learn and how can we assess this?”  by extending our planning to specify “What is essential that students should think about, and how can we mentor them into such thinking?”

REFERENCES CITED (additional references are provided in the two exercises furnished)

Arum, R. and Roksa, J. (2011). Academically Adrift: Limited Learning on College Campuses. Chicago, IL: University of Chicago Press.

Belenky, M.F., B.M. Clinchy, N.R. Goldberger, and J.M. Tarule. (1986) Women’s Ways of Knowing: The Development of Self, Voice, and Mind, New York: Basic Books. (Reprinted in 1997).

Carper, B. A. (1978). Fundamental patterns of knowing in nursing. Advances in Nursing Science 1 1 13–24.

Flavell, J. H. (1976). Metacognitive aspects of problem solving. In L. B. Resnick (Ed.), The nature of intelligence (pp. 231–235). Hillsdale, NJ: Erlbaum.

Journal of Adult Development (2004). Special volume of nine papers on the Perry legacy of cognitive development. Journal of Adult Development (11, 2) 59-161 Germantown NY: Periodicals Service Co.

Nuhfer, E. B (2008) The feeling of learning: Intellectual development and the affective domain: Educating in fractal patterns XXVI. National Teaching and Learning Forum, 18 (1) 7-11.

Perry, W. G., Jr. (1999). Forms of intellectual and Ethical Development in the College Years. (Reprint of the original 1968 1st edition with introduction by L. Knefelkamp). San Francisco: Jossey-Bass.


Metacognition for Guiding Students to Awareness of Higher-level Thinking (Part 1)

by Ed Nuhfer (Contact: enuhfer@earthlink.net; 208-241-5029)

When those unfamiliar with “metacognition” first learn the term, they usually hear: “Metacognition is thinking about thinking.” This is a condensation of John Flavell’s (1976) definition: “Metacognition refers to one’s knowledge concerning one’s own cognitive processes or anything related to them…” Flavell’s definition reveals that students cannot engage in metacognition until they first possess a particular kind of knowledge. This reminds us that students do not innately understand what they need to be “thinking about” in the process of “thinking about thinking.” They need explicit guidance.

When students learn in most courses, they engage in a three-component effort toward achieving an education: (1) gaining content knowledge, (2) developing skills (which are usually specific to a discipline), and (3) gaining deeper understanding of the kinds of thinking or reasoning required for mastery of the challenges at hand. The American higher educational system generally does best at helping students achieve the first two. Many students have yet to even realize how these components differ, and few ever receive any instruction on mastering Component 3. Recently, Arum and Roksa (2011) summarized the effectiveness of American undergraduate education in developing students’ capacity for thinking. The record proved dismal and revealed that allowing the first two components to push aside the third produces serious consequences.

This imbalance has persisted for decades. Students often believe that education is primarily about gaining content knowledge—that the major distinction between freshmen and seniors is “Seniors know more facts.” Those who never get past this view will likely acquire a degree without acquiring any significantly increased ability to reason.

We faculty are also products of this imbalanced system, so it is not too surprising to hear so many of us embracing “covering the material” as a primary concern when planning our courses. Truth be told, many of us have so long taught to content and to skills necessary for working within the disciplines that we are less practiced in guiding our students to be reflective on how to improve their thinking. Adding metacognitive components to our assignments and lessons can provide the explicit guidance that students need. However, authoring these components will take many of us into new territory, and we should expect our first efforts to be awkward compared to what we will be authoring after a year of practice. Yet, doing such work and seeing students grow because of our efforts is exciting and very worthwhile. Now is the time to start.

Opportunities for developing metacognitive reflection exist at scales ranging from single-lesson assignments to large-scale considerations. In my first blog for this site, I chose to start with the large-scale considerations of what constitutes development of higher-level thinking skills.

 

What Research Reveals about Adult Thinking

More than five decades have passed since William Perry distinguished nine stages of thinking that successful adult intellectual development (Table 1) produces. The validity of his developmental model in general seems firmly established (Journal of Adult Development, 2004). Contained within this model is the story of how effective higher education improves students’ abilities to think and respond to challenges. Knowing this story enables us to be explicit in getting students aware of what ought to be happening to them if higher education is actually increasing their capacity for thinking. This research enables us to guide students in what to look for as they engage in the metacognition of understanding their own intellectual development.

Enhanced capacity to think develops over spans of several years. Small but important changes produced at the scale of single quarter or semester-long courses are normally imperceptible to students and instructors alike. Even the researchers who discovered the developmental stages passed through them as students, without realizing the nature of the changes that they were undergoing. For learning that occurs in the shorter period of a college course, it is easier to document measurable changes in learning of disciplinary content and the acquisition of specific skills than it is to assess changes in thinking. Research based on longitudinal studies of interviews with students as they changed over several years finally revealed the nature of these subtle changes and the sequence in which they occur (Table 1).

 

Table 1: A Summary of Perry’s Stages of Adult Intellectual Development

Stage 1 & 2 thinkers believe that all problems have right and wrong answers, that all answers can be furnished by authority (usually the teacher), and that ambiguity is a needless nuisance that obstructs getting at right answers.
Stage 3 thinkers realize that authority is fallible and does not have good answers for all questions. Thinkers at this stage respond by concluding that all opinions are equally valid and that arguments are just about proponents’ thinking differently. Evidence to the contrary does not change this response.
Stage 4 thinkers recognize that not all challenges have right or wrong answers, but they do not yet recognize frameworks through which to resolve how evidence best supports one among several competing arguments.
Stage 5 thinkers can use evidence. They also accept that evaluations that lead to best solutions can be relative to the context of the situation within which a problem occurs.
Stage 6 thinkers appreciate ambiguity as a legitimate quality of many issues. They can use evidence to explore alternatives. They recognize that the most reasonable answers often depend upon both context and value systems.
Stages 7, 8 and 9 thinkers incorporate metacognitive reflection in their reasoning, and they increasingly perceive how their personal values act alongside context and evidence to influence chosen decisions and actions.

In part 2 of this blog, we will provide metacognitive class exercises that help students to understand what occurs during intellectual development and why they must strive for more than learning content when gaining an education.


Using metacognition to uncover the substructure of moral issues

By John Draeger, SUNY Buffalo State

As a moral philosopher, my introductory courses revolve around various controversial issues (e.g., abortion, euthanasia, hate speech, same sex marriage, invasions of privacy in the name of national security or commerce). It is not hard to generate discussion about these topics, but important philosophical issues often to get lost in the mayhem. My students try to keep things straight by focusing on particular bits of content. They hope that a laundry list of terms and distinctions will help them make sense of particular ethical issues. For my part, however, most of the interesting stuff occurs behind the scenes. I don’t much care about which topics we discuss because at some level I don’t think that we are talking about the particular topical issues anyway. Details matter, of course, but I am most interested in helping students uncover the underlying value conflicts common to many ethical debates. This, I argue, requires developing metacognitive awareness.

Consider three possible positions on hate speech: (1) ban hate speech on college campuses because it harms individual students, (2) allow hate speech because banning it would violate the rights of individual students, (3) allow hate speech because banning it would do more harm than good in the long-run. Now consider three possible views on governmental surveillance in the name of national security: (1) allow governmental surveillance because it promotes an important good (e.g., national security), (2) ban governmental surveillance because it violates the rights of citizens (e.g., privacy), (3) ban governmental surveillance because it does more harm than good in the long-run. Note the similar underlying value structures of these positions. One favors well-being (e.g., protect individual students or a nation) over other considerations. Another favors rights (e.g., free-speech or privacy) over harms to well-being caused by the exercise of those rights. The last considers two forms of well-being (e.g., short-term and long-term).

As an instructor, I know that teaching students a process by which they can uncover underlying value structures requires scaffolding and plenty of opportunities to practice (Duron, Limback, & Waugh, 2006). Among my many activities and assignments, I ask students to answer the following questions about each of the readings: (1) what is the author’s core insight/thesis? (2) what are the core values at issue? (3) what are the central philosophical problems at issue? (4) what are the central topics at issue? It is not long before students understand that the last two questions are not actually redundant (e.g., well-being versus rights is not the same as hate speech versus governmental surveillance).

This exercise helps students focus on what I take to be most important, namely the underlying value structure. It also sets up the next exercise in which I ask students to use the resources found in one reading (e.g., hate speech) to answer the topical question raised in another (e.g., government surveillance).  This can be difficult until students recognize there are values common across different topical debates and they recognize the similarities in the philosophical substructure (e.g., well-being over rights, rights over well-being, long-term well-being over short-term well-being). Because it isn’t always easy to fit one view into the structure of another, this exercise leads to many questions about each of the readings. As the semester moves along, we discuss each reading in relation to those that came before.  By the end of the semester, we pick author names “at random” and discuss the connections between them.

With an understanding the underlying value structure of a particular moral issue, students can begin to “think like a philosopher.” It puts them in a position to move beyond mere coffee shop conversation and the rehash of media pundit drivel towards a more careful consideration of the issues. Through the process outlined above, they begin to notice when their discussions lapse into media drivel and thus when they need steer the conversation back towards the underlying value structure. Insofar as this exercise moves students towards the ability to consciously and explicitly understand the substructure of values underlying a wide variety of ethical issues, it moves them towards a more sophisticated understanding of those issues and towards a metacognitive awareness of their own learning.

References

Duron, R., Limbach, B., & Waugh, W. (2006). “Critical Thinking Framework for Any Discipline.” International Journal of Teaching and Learning in Higher Education, 17 (2), 160-166.

 


Breaking through the barriers to learning

by David Westmoreland, U.S. Air Force Academy*

Teachers of science increasingly find themselves entangled in social controversies. This is true for physicists teaching about the origin of matter, geologists discussing the age of the planet, biologists teaching evolution, and climatologists teaching about global warming. In most cases, the science is relatively clear, and there is little controversy within the scientific community.

In my field of biology, for example, a significant percentage of students enter the classroom with preconceived notions about the theory of evolution. Public perception of this field has changed little in the past 30 years. In the most recent poll, 42% of Americans rejected evolution outright, a figure that has fluctuated between 40 and 47% for more than 3 decades (Newport 2014). Among college-educated Americans, there is greater acceptance of evolution as valid science; in 2014, about 25% espoused a creationist perspective. Still, it is surprising that one-fourth of college-educated Americans reject evolution, given the expansive effort to incorporate evolutionary biology into public education and the positive presentation of evolution in the media.

Why? One possibility is that we have we have failed to use the right approach to overcome a socially derived obstacle to learning. In undergraduate biology courses, the concept of evolution is often introduced in concert with empirical evidence supporting it, with the expectation that students will be open to ideas that, in fact, they are resistant to learn.
My research on cadets at the Air Force Academy indicates a barrier to learning evolution by about 25% of students. I sampled 147 cadet volunteers who self-categorized as creationists (rejecting evolution), theistic evolutionists (acknowledging evolutionary change with some degree of divine influence) or atheistic evolutionists (acknowledging evolution by natural processes alone). Each student responded to surveys that quantified (a) their knowledge of the subject, and (b) their perspective on evolution as science, in addition to demographic information. The results are intriguing.

Knowledge Test Score

              Creationists         36               3.7A ± 0.38
Theistic evolutionists 75 6.2B ± 0.25
Atheistic evolutionists 36 6.3B ± 0.37

Despite having a similar educational background to the other groups, creationists’ knowledge scores were roughly half those of the other groups. The difference is statistically significant.

One might think that, if creationist students were more open to learning evolutionary concepts, their acceptance of evolution might rise. But think again – the correlation of knowledge and perception is not so clear. Knowledge is significantly related to acceptance for theistic and atheistic evolutionists, but not for creationists. For them, learning facts does not appear to influence perception.

This is where metacognition comes in. In a review of 26 research articles on undergraduates’ knowledge and acceptance of evolution, Lloyd-Strovas and Bernal (2012) concluded that acceptance is related to student understanding of the nature of science – that is, science as a cultural and intellectual endeavor. When students learn that science should not be regarded as a repository of absolute truth, but rather, an ongoing effort to understand and explain the natural world, the barrier to learning is breached. As emphasized by Lombrozo et al. (2008): “…Students may be more likely to accept evolution if they understand that a scientific theory is provisional but reliable, that scientists employ diverse methods for testing scientific claims, and that relating data to theory can require inference and interpretation.”

In other words, instructors must prepare the field before engaging students in social controversies. Otherwise, students are more likely to engage in social cognition – the tendency to form opinions on the basis of social identity (Bloom and Weisberg 2007). If an individual strongly identifies herself as belonging to a group that holds a common opinion on a topic, she is likely to express that opinion even in the absence of competent understanding of the subject. For such persons, empirical information is likely to be ignored due to a fundamental desire to reinforce a social network. Consider, for example, the strong relationship between political affiliation and skepticism about global warming.

College courses are no strangers to controversy. We often engage students in debate, and have them present and defend positions. What is missing, I think, is pushing our students to critically evaluate the processes they used to form the opinions in the first place.

References

Bloom, P., and D. S. Weisberg. (2007). Childhood origins of adult resistance to science. Science 316: 996-997.

Lloyd-Strovas, J. D., and X. E. Bernal. (2012). A review of undergraduate evolution education in U.S. universities: building a unifying framework. Evolution Education Outreach 5: 453–465.

Lombrozo, T., A. Thanukos, and M. Weisberg. (2008). The importance of understanding the nature of science for accepting evolution. Evolution Education Outreach 1: 290-298.

Newport, F. (2014, June 2). In U.S., 42% believe creationist view of human origins. Retrieved from http://www.gallup.com

* Disclaimer: The views expressed in this document are those of the authors and do not reflect the official policy or position of the U. S. Air Force, Department of Defense, or the U. S. Govt.