Mastery – Page 2 – Learning Aloud

Mastery approaches

I became familiar with the idea of learning personalization for mastery in the 1970s. Even though there are recent applications of mastery concepts making use of technology, I continue to point to the early mastery work because of the research base associated with that time period. The examples of more recent mastery approaches I will link to these early efforts do not come with a rich collection of peer reviewed studies I look for when advocating for what amounts to a serious departure from day to day classroom practice.

To me there were two very different approaches labelled as mastery methods – Fred Keller’s Personalized System of Instruction (PSI) and Bloom’s Learning for mastery.

The Keller Plan

Keller (1968) advocated a truly individualized approach to instruction based primarily on written material (not be confused with the programmed instruction of that time which was often paper-based as well). Keller did make use of teacher presentations, but these were not used for the core approach. Keller liked written materials because individual students could work on written content on their own and could read at whatever rate was productive for them. Instructional text was associated with study guides for guidance. When students felt prepared, they would ask a tutor for an examination over that material. The tutor presented the assessments, evaluated the assessments, and helped learners with challenges they seemed to have encountered. Movement to the next unit depended on a satisfactory score on the unit exams and failure to meet this standard directed the learner to restudy the same material.

Bloom’s Learning for Mastery

Bloom’s (1968) approach to mastery learning was group based. A group of learners would focused on content (e.g., chapter) to be learned for approximately a week and would then be administered a formative evaluation. Those who passed this evaluation would continue to supplemental learning activities and those who did not pass would receive remediation appropriate to their needs. At the end of this second period of time (at about the two-week mark), students would receive the summative examination to determine their grade.

There are many variations and details of these approaches not explained here. My intent was to establish the more individualized and the more group-based approaches. I see the Kahn Academy as similar to the Keller Plan and Modern Classroom Project as similar to Bloom’s approach. My guess is more educators are aware of the Kahn Academy and understand that students can work on this technology-delivered content demonstrating mastery of specific skills at different rates. Many use this content for supplemental learning, but it can also be used as the basis for comprehensive approach. The Modern Classroom does not individualize progress to the same degree and is not necessarily as dependent on technology administered mastery checks. I encourage exploration of the links provided here for those unfamiliar and interested in the present, more technologically based mastery approaches receiving a lot of attention at present.

The idea of mastery and what teaching for mastery means in practice varies to some degree to how essential it is to master specific skills or concepts. I would think that all knowledge/skill deficits are not equally damaging. It might be useful to differentiate general and prerequisite deficits. A prerequisite deficit would describe a skill or concept necessary in the short term to understand/master a more advanced skill/unit of understanding that builds on the deficit skill. A general deficit would identify a skill or a unit of understanding that is missing, but not necessary for the mastery of other units soon to be taught. Original approaches to mastery (Bloom, Keller) focused on an acceptable level of general skill. Kahn approach is more focused on the identification and remediation of specific deficits. I would think technology would offer a much more practical approach to the linking skills and for tracking individual student mastery of prerequisite.

Note that both Keller and Bloom are not absolutists. Technology allows a much more specific approach with Kahn’s complex identification of prerequisites and specific mastery checks in the Modern Classroom approach. Being specific about the identification of unmastered skills does not stop progress as learners can continue to work on other skills with technology allowing the more careful identification of problem areas in contrast to the mastery approaches of the 1960s.

References

Benjamin, S., Dhew, E., & Bloom, B. (1968). Learning for mastery. Eval. Comment, 1, 1-12.

Keller, F. S. (1968). “Good-bye teacher”. Journal of Applied Behavior Analysis, 1, 79–89

Components of mastery instructional methods

I explained what I considered the essential components of a mastery system to my educational psychology and educational technology students for years. I used the following list based on my reading of multiple sources and explained using terminology I hoped would be easy to understand. I see different mastery approaches as implementation of these components to varying degrees so I will try to describe the components as ideal and then it becomes useful to explore the degree to which different implementations approach each ideal.

Components of a mastery system:

Objectives / Goals
Small Units of Instruction
Multiple, nonpunitive assessments
Mastery before progress
Keyed remediation

Objectives / Goals – mastery requires the identification of what is to be learned in a way that is more explicit than is the case in a traditional approach. You cannot teach a “bunch of stuff”, but because of the requirements of some of the other components you must specific what is to be learned and what is based on or follows what.

Small units of instruction – mastery approaches attempt to reduce individual differences in existing knowledge. When the pace of instruction exceeds the time required for an individual to learn, a student may be expected to advance lacking prerequisite knowledge. Small units of instruction combined with other components (mastery before progress) to reduce the gaps in knowledge important in learning related material. Smaller units reduced the probability gaps will be missed.

Multiple, nonpunitive assessments – to use assessment to guide instruction, it may be necessary to reteach and retest. Multiple assessments determine when the expected level of understanding/mastery has been achieved. Nonpunitive implies that the number of assessments necessary to demonstrate understanding will not be used in evaluating/grading learners. When content is mastered, it is mastered.

Mastery before progress – a standard for mastery is set and meeting that standard determines when a student moves from one unit to the next.

Keyed remediation – assessment results should be used in targeting instruction when an assessment determines that content has not been mastered. It is also possible that a previous method of instruction will be changed as that method may be partly responsible for a student failing to achieve mastery

It is interesting to note that early approaches were couched in what I would label as a behavioral tradition. For example, the specification of “objectives”. This can be seen in the general focus journals hosting some of the earliest descriptions of mastery approaches. Historically, from my experience, acceptance of some of these ideas may be related to resistance to mastery concepts. I see this as unfortunate as core ideas about what learning is can easily be described within a cognitive tradition. For example, building from what is known fits with Piaget’s notions of assimilation and accommodation or with concepts such as conceptual change theory describing the interaction of existing models with new information.

Identification of these components serve multiple purposes. I ask students to use these components to identify existing practices that may meet individual components. I use these components to contrast different instructional tactics labelled as a mastery or competency-based approach to describe if and how well the different components are addressed. Researchers have studied many studies of mastery tactics in attempts to determine which components are most essential.

Buskist and colleagues (1991) provide one example of the type of component analysis that has been conducted. The components used differ a bit from my list. This is in part results from their analysis of a single mastery approach, The researchers conclude that unit mastery, multiple short quizzes, quick performance feedback, and review units were concluded to generate achievement advantages. Self-pacing (students having freedom work work when they wanted) and time spent with proctors were not.

My final post in this series will use the components I describe here to differentiate a couple of the original mastery strategies and then link these original strategies to my interest in technology-enhanced mastery approaches.

Reference:

Buskist, W., Cush, D., & DeGrandpre, R. J. (1991). The life and times of PSI. Journal of Behavioral Education, 1(2), 215-234.

Research on mastery instruction is extensive

I have decided to write several posts focused on mastery learning. My motivation for doing this comes from a recent Chalkbeat article claiming that mastery approaches are receiving greater attention since the COVID pandemic, but “evidence remains thin”. Having followed instructional approaches labeled mastery learning since the 1970s, I am troubled by the message this title offers. There have been hundreds of studies evaluating mastery strategies using achievement data. The Chalkbeat article is focused on technology-enabled approaches and this happens to be my own interest. Perhaps less is known about mastery approaches that put technology in a central role, but the underlying concepts of mastery instruction are well researched (see citations at conclusion of this post).

So, my effort here will be to offer a broader background on what mastery learning is and to describe some of the original models similar to more recent technology-enabled approaches.

Mastery learning has always intrigued me because the underlying assumptions make so much sense. I would describe the most basic argument of mastery learning to be that learners master content and skills at different rates. I understand these differences in learning rate as the consequence of a combination of aptitude and existing knowledge. These factors are interrelated in practice.

I would describe aptitude as similar to what others might think of as intelligence. As an individual difference, I don’t think it matters much if intelligence is a biologically based variable. This is a different topic. I think it is obvious that the rate at which learners can learn differs from individual to individual. Label this difference as you see fit. I call this capacity to learn “aptitude”.

Aside from aptitude, existing knowledge plays an important role in learning rate. Differences in existing knowledge have been demonstrated in some circumstances to play a more important role than aptitude (e.g., studies of reading comprehension based on reading skill and topic-related knowledge). These two variables are related because education does not assure that learning has occurred when the system of instruction moves on. This means that learners move ahead differing in aptitude and also differences in the existing knowledge and skills that may be necessary for new learning. Variability increases over time in a system that does not adjust to the needs of the individual increasing both the difficulty of learning new skills or knowledge AND the motivation to deal with the personal circumstances that new learning involves.

Individualization does not make the rate of learning equal, it makes the differences more determined by aptitude than the combination of aptitude and existing knowledge. For many content areas, most individuals would learn what is being taught if the learning environment allows them sufficient time. Addressing the “IF” is the key.

Some major reviews of mastery versus traditional instruction:

Kulik, C., Kulik, J. & Bangert-Drowns, R.L. (1990). Effectiveness of mastery learning programs: A meta-analysis. Review of Educational Research, 60, 265-299.

Kulik, C., Kulik, J. & Bangert-Drowns, R.L. (1990). Is there better evidence on mastery learning? A response to Slavin. Review of Educational Research, 60, 303-307.

Kulik, J. A., Kulik, C. L. C., & Cohen, P. A. (1979). A meta-analysis of outcome studies of Keller’s personalized system of instruction. American psychologist, 34(4), 307- 318

Slavin, R. (1987). Mastery learning reconsidered. Review of Educational Research, 57(2), 175-213.

Mastery Learning

I have been writing about and conducting research on mastery learning since the late 1970s. I always thought some of the core concepts (learners develop knowledge and skills at different rates, ignoring such differences leads to failed understanding and learner frustration) were recognized by educators, but largely accepted as the way things have to be because of practical demands of group instruction.

Since I began working with technology in the late 80s and even more so when the Internet allowed wide access to designated resources, I thought technology might overcome some of the practical challenges. There have been hints that others have recently come to the same conclusion. Kahn of Kahn Academy fame described one potential application of the tools he and colleagues were creating as offering a mastery approach (One World Schoolhouse).

Even more recently, a group labeling itself the Modern Classroom Project has proposed an instructional approach that sounded very much like mastery learning to me. You have to work at finding references to mastery learning in the description of their approach, but I was pleased to read this post from the Cult of Pedagogy blog which is based on an interview with Kareem Farah of the Modern Classroom group entitled “How to setup mastery grading in your classroom”. I don’t like the emphasis on “grading” in the description, but the content provided is quite useful.

If the idea of individualizing for mastery interests you, I offer a broader perspective on the basics of mastery learning on my site.

Personalize lessons in Google forms

I have been exploring approaches that might be used by teachers and students to individualize student progress through a sequence of learning experiences. I am interested in approaches that might allow a mastery model; i.e., students move ahead at the rate they are able to demonstrate mastery of instructional goals. Recently, I have been exploring a model called the Modern Classroom Project and I have been thinking about some of the practical requirements for implementing this model.

Approaches that individualize student progress need a way to communicate the sequence of tasks to individual students and to locate competency checks within this sequence of tasks. If I were going to do this, I would probably create a document (probably Google docs) that linked to a series of web pages to present content and layer these content pages using InsertLearning. InsertLearning would allow me to add prompts, questions, and discussion items to the content pages (which would consist of text, images, and video). I could use the questions to encourage processing of the content and also as a competency check at the end of each content page. The nice thing about InsertLearning for this type of approach is that it collects student responses to questions and I would use these responses to evaluate understanding of the content presented within a page. These responses would enable me to provide feedback to students telling them if they can move on to the next unit and to identify students I might want to spend time with to help them sort out difficulties they seem to be having.

InsertLearning is not a free service ($8 per class per month or $40 a year) so how else might a similar goal of sequencing learning be accomplished. Many educators have probably heard of hyperdocs. The term hyperdoc was coined to refer to creative use of Google tools (docs, forms, sheets, and slides) to create content delivery, learning experience, and evaluation tasks by teachers for their students. Often, this would be done in place of traditional curriculum materials which I would describe as placing classroom educators into the role of an instructional designer. One of the challenges I see in this approach is creating a simple way to allow multiple students through the sequence of an instructional unit at different speeds. My guess is that the authors of the Hyperdoc Handbook would do this through a combination of Google docs and Google forms. You can do a lot with docs because you can both present content (text, images, video) and require responses within the same shared document. The problem for me if relying on docs would be individualization. You would possibly have to create a unique copy of each doc for each student if you wanted to evaluate performance on tasks with the material to be examined added within the doc.

What follows is my attempt to use Google forms as an alternative. Forms are crude in comparison to docs, but forms have the advantage of writing the response to embedded questions to a spreadsheet. The collection of data is the primary function of a form. The link for the same form can be sent to many different individuals and inputs to questions in the form are stored separately in a spreadsheet. I think of trying to use forms for the task I am interested in as trading data collection for the sophistication of content presentation. I have come up with a few ideas in the use of forms others may find useful.

Here is a summary of the issues and my ideas. You can present text, images, video, and questions in forms, but to combine them you have to be creative. The biggest challenge is to combine text with anything else. I use WordPress as my blog platform (this blog) and WordPress now uses what are called blocks. There are blocks for lists, text, images, embeds, quotations, video, etc. and you create posts by adding blocks and then adding content to each block. Forms works in a similar way, but allows far less flexibility in how blocks can be combined.

With forms, it helps to think in terms of sections. There is the title section and sections that follow. Below each section heading, there is an opportunity to add text. You can add as much text as you want, but this is the only place within a section that text can be added. You can add multiple images, videos, and questions below this body of text. The questions are of many types, short answer, paragraph, multiple choice, etc. The responses to these questions are written to a spreadsheet that will appear in the same Google drive account that stores the form.

Here are a few images to give you an idea of what this looks like. The following image shows two sections – the title section and a second section. You can see text that has been inserted under the title. Again, this is the only place text can be added to this section. Below, the text you can see a question. You will need to associate an identification (name) with each response from students. So, the form I created begins with the request for a name. Questions either require a response or not. I want students to be able to complete parts of this unit (consisting of multiple sections) in stages and I want to record any input generated during that visit to the site. I require a response to the name question, but not to any questions that follow. A student can then respond to questions associated with other sections or not and I will also store these responses associated with the name or other form of identification. The student must move through all sections for the form to send any data added to the spreadsheet. This is not ideal and I am sure some students will forget to do this and no work they have completed will be recorded. There is no way to change this in a form with multiple sections. The image below shows the beginning of a second section with again allows a heading (title) and then the one opportunity to add text.

The following image shows the form tools. The tools have been labeled. There are options associated with the different tools (e.g., for questions – what type of question and will a response be required).

The following image shows what the spreadsheet with responses looks like. Long responses distort the shape of the spreadsheet, but clicking within a cell makes the content submitted far easier to read.

If you are interested in examining the demo form I created for this tutorial, you can view it using this link.

North Dakota will facilitate K12 mastery learning opportunities

My past couple of posts have returned to a topic I have addressed several times over the years – technology can made practical the benefits of personalized mastery learning. To conclude this focus and offer an example to justify my claim of practicality, I want to bring attention to legislation recently passed in the state of North Dakota. I spent a good part of my working life as an academic in North Dakota. I don’t regard North Dakota as a progressive state for educational innovation, but perhaps that is my point. Innovation can be a function of the efforts of individual innovators as administrators or educators with administrative support and such individuals can be quite influential.

North Dakota just passed legislation makes it easier for districts wanting to institute personalized approaches to pace and the demonstration of competence in meeting graduation requirements. In addition, the state will facilitate the development of a learning continuum as a resource for those schools wanting to offer students an alternative to the more traditional time-based definitions of courses and progress.

Shall facilitate the development and implementation of a North Dakota learning continuum in collaboration with the department of career and technical education, upon the recommendation of the kindergarten through grade twelve education coordination council.

Here are a couple of resources explaining the intent of the legislation.

Statement from the Office of the Governor.

Wording of registrations

My point in this post is to offer the suggestion that the concepts and procedures identified in the two previous posts about standards for hybrid learning and plans for personalization instruction through what I refer to as mastery methods are being implemented in locations and this activity may not be familiar to many educators.

Mastery Updated

Mastery learning is described in some detail in previous posts over the years. Here are a couple of important topics for this post. First students vary significantly in what might be called “learning rate”. The word “aptitude” would be my personal preference, but this term is less descriptive. While the origins of differences in learning rate are perhaps disputed (e.g., is it what was traditionally called intelligence), I don’t think any practitioner would dispute that students acquire knowledge and skills at different speeds. An important issue is whether the instruction that students receive accommodates these differences. If instruction moves on to new material before a student has learned the present focus of instruction, students at best would have a knowledge or skill gap and at worse would be missing the background to learn something new that is based on or assumes other learning has been accomplished. Over time, these gaps accumulate, increasing the variability of learning rate. The frustration students experience in dealing with demands they are ill-prepared to master only magnifies the problem.

There have been attempts to deal with the variability in the rate of learning through practices such as ability grouping (tracking) and tutoring. Ability grouping comes with multiple difficulties such as labeling and equity issues and tutoring while very successful is prohibitively expensive.

Mastery instructional techniques have been investigated for years. My personal study of this topic begins with publications in 1968 – Bloom’s group based mastery and Keller’s personalized system of instruction (PSI). I provide greater detail on these approaches elsewhere. Interest in such approaches seemed to wane likely because of practical issues and because the systems required alterations in traditional educational practices rather than because of lack of effectiveness. The potential of technology for taking on some of the components of mastery instruction increasing efficiencies and changing attitudes of educational practice may encourage reconsideration of mastery approaches possibly with different terminology and different variations on the components of a mastery approach.

I consider the components of PSI and Bloom’s group-based mastery strategies to be – a) clearly stated and integrated objectives/goals, b) small units of instruction, c) mastery before progress, d) multiple, nonpunitive assessments, and e) remediation keyed to individual needs. When I work with graduate students on this topic, I typically ask them to explain how these components appear in PSI and Bloom’s group based mastery, but also in new instructional approaches that mention a commitment to typical mastery goals.

Briefly, here are a couple of examples of more recent instructional approaches with mastery characteristics. The Kahn Academy is a recent example of a technology-enabled approach that Kahn began to label as mastery (e.g., see One World Schoolhouse). My focus is not on the Kahn Academy here, but it seems to me to be similar to PSI when implemented as a full-blown system (using the short videos, competence checks, and hierarchical linking of learning units).

A second example I want to highlight is called the Modern Classroom Project. The modern classroom model is based on three components – blended instruction, self-paced learning, and mastery evaluation. Blended instruction proposes that educators replace face-to-face lectures to a group with short videos – think flipping the classroom. The idea is lecture involves limited interaction so why waste valuable face-to-face instructional time when videos can be viewed whenever a learner wants. Keller had the same idea in 1968 which he captured in the title of his paper – Goodbye teacher … The title might be misinterpreted if the paper is not actually read. What Keller noted was that lecturing to a group was not productive when students could read (back in the day when reading the textbook was assumed preparation for class). Reading could be completed whenever and to give Keller credit for an important insight reading was under the control of the learner – content could be reread if necessary and at the pace required by the learner.

Self-paced learning in the Modern Classroom to me is similar to Bloom’s group-based method of instruction. Bloom did not employ a pure mastery system absolutely requiring mastery before progress, but divided content into units often of two weeks. At a point during this time, students completed a formative assessment (you may have heard this term – this is where it comes from) on essential content. Those who passed this check were often moved on to self-guided supplemental activities while the teacher worked on the most essential skills with those not meeting the expectations of the assessment. A summative unit concluded the unit and all moved on. The Modern Classroom includes content identified as must do, should do, aspire to do. Students have great flexibility when they attempt to demonstrate competence of the related skills with the instructor keeping an eye on things and working with the students most needing assistance.

Mastery assessment is pretty much what it sounds like. Performing at the expected level of the knowledge/skill checks. While this is the only use of the work mastery in descriptions of the Modern Classroom, I hope that you can see the system applies other of the core mastery components I have identified under other labels. Technology plays a second role in the Modern Classroom in tracking goal accomplishments and helping the teacher identify those most in need of help.

Advocates of the Modern Classroom urge creativity in educators applying the core concepts they have identified. So, examples of implementation come in many different shapes and sizes.

The Modern Classroom Project is an organization offering resources and mentorship to interested schools. A free tutorial on the core concepts is available.