Mastery Updated

Mastery learning is described in some detail in previous posts over the years. Here are a couple of important topics for this post. First students vary significantly in what might be called “learning rate”. The word “aptitude” would be my personal preference, but this term is less descriptive. While the origins of differences in learning rate are perhaps disputed (e.g., is it what was traditionally called intelligence), I don’t think any practitioner would dispute that students acquire knowledge and skills at different speeds. An important issue is whether the instruction that students receive accommodates these differences. If instruction moves on to new material before a student has learned the present focus of instruction, students at best would have a knowledge or skill gap and at worse would be missing the background to learn something new that is based on or assumes other learning has been accomplished. Over time, these gaps accumulate, increasing the variability of learning rate. The frustration students experience in dealing with demands they are ill-prepared to master only magnifies the problem.

There have been attempts to deal with the variability in the rate of learning through practices such as ability grouping (tracking) and tutoring. Ability grouping comes with multiple difficulties such as labeling and equity issues and tutoring while very successful is prohibitively expensive. 

Mastery instructional techniques have been investigated for years. My personal study of this topic begins with publications in 1968 – Bloom’s group based mastery and Keller’s personalized system of instruction (PSI). I provide greater detail on these approaches elsewhere. Interest in such approaches seemed to wane likely because of practical issues and because the systems required alterations in traditional educational practices rather than because of lack of effectiveness. The potential of technology for taking on some of the components of mastery instruction increasing efficiencies and changing attitudes of educational practice may encourage reconsideration of mastery approaches possibly with different terminology and different variations on the components of a mastery approach.

I consider the components of PSI and Bloom’s group-based mastery strategies to be – a) clearly stated and integrated objectives/goals, b) small units of instruction, c) mastery before progress, d) multiple, nonpunitive assessments, and e) remediation keyed to individual needs. When I work with graduate students on this topic, I typically ask them to explain how these components appear in PSI and Bloom’s group based mastery, but also in new instructional approaches that mention a commitment to typical mastery goals.

Briefly, here are a couple of examples of more recent instructional approaches with mastery characteristics. The Kahn Academy is a recent example of a technology-enabled approach that Kahn began to label as mastery (e.g., see One World Schoolhouse). My focus is not on the Kahn Academy here, but it seems to me to be similar to PSI when implemented as a full-blown system (using the short videos, competence checks, and hierarchical linking of learning units). 

A second example I want to highlight is called the Modern Classroom Project. The modern classroom model is based on three components – blended instruction, self-paced learning, and mastery evaluation. Blended instruction proposes that educators replace face-to-face lectures to a group with short videos – think flipping the classroom. The idea is lecture involves limited interaction so why waste valuable face-to-face instructional time when videos can be viewed whenever a learner wants. Keller had the same idea in 1968 which he captured in the title of his paper – Goodbye teacher …  The title might be misinterpreted if the paper is not actually read. What Keller noted was that lecturing to a group was not productive when students could read (back in the day when reading the textbook was assumed preparation for class). Reading could be completed whenever and to give Keller credit for an important insight reading was under the control of the learner – content could be reread if necessary and at the pace required by the learner. 

Self-paced learning in the Modern Classroom to me is similar to Bloom’s group-based method of instruction. Bloom did not employ a pure mastery system absolutely requiring mastery before progress, but divided content into units often of two weeks. At a point during this time, students completed a formative assessment (you may have heard this term – this is where it comes from) on essential content. Those who passed this check were often moved on to self-guided supplemental activities while the teacher worked on the most essential skills with those not meeting the expectations of the assessment. A summative unit concluded the unit and all moved on. The Modern Classroom includes content identified as must do, should do, aspire to do. Students have great flexibility when they attempt to demonstrate competence of the related skills with the instructor keeping an eye on things and working with the students most needing assistance. 

Mastery assessment is pretty much what it sounds like. Performing at the expected level of the knowledge/skill checks. While this is the only use of the work mastery in descriptions of the Modern Classroom, I hope that you can see the system applies other of the core mastery components I have identified under other labels. Technology plays a second role in the Modern Classroom in tracking goal accomplishments and helping the teacher identify those most in need of help. 

Advocates of the Modern Classroom urge creativity in educators applying the core concepts they have identified. So, examples of implementation come in many different shapes and sizes. 

The Modern Classroom Project is an organization offering resources and mentorship to interested schools. A free tutorial on the core concepts is available. 

Loading

Kahn Academy for teachers

The Kahn Academy has created a summer course for educators. The proceed at your own speed course (what else would you expect from the Kahn Academy) takes you through how the Kahn Academy works, what the teacher does, what the student sees, the principles that guide the full approach, mastery learning, and using analytics to improve instructions. The course is a combination of videos and activities.

I have been a fan since first watching Kahn’s TED talk and assigning his book (One World Schoolhouse) in a class. I was a fan of mastery learning long before Kahn had anything to do with education. As Kahn’s efforts have matured, his content and delivery system have advanced to the point of becoming a bit intimidating. This course is well worth the time if you are interested in using the system with your students.

Loading

Blended, hybrid and other ideas

As the COVID pandemic resurges I am growing more convinced K12 education will look a lot different in the fall. I encountered this post offering some new proposals for models that cut classroom attendance in half in order to allow distancing. For whatever reason, my imagination had become stuck on a model in which half of the students came to the physical school on one day and the other half came on the next. I had imagined that Wednesdays would be devoted to teacher time for planning and going through student written assignments, projects, maybe a few personal contacts. The major downside I saw with this model was the double duty teachers would have to serve when half of the students were face to face and half were joining for at least part of the time online.

One of the ideas in the content I reviewed described a different approach in which half of the students attending in the morning and half in the afternoon one day and then all students were working remotely on the next. Again, Wednesday might be a time for planning and the other teacher tasks I mentioned above. The advantage in this divided day model would be the elimination of the double duty load each day. My perspective which I admit probably imagines working with older students would focus on more intense instruction for a shorter amount of time which I tend to see as more tolerable than what would seem feasible when engaged with students for an entire day.

Loading

Mastery – a personal history

Academics often change their interests as new issues their training is suited to address change. To some extent this is also true of me. However, I can also identify interests that have remained core to my thinking over what is now more than a 40 year career.

When I was in graduate school I read from two sources both published in 1968 that influenced my thinking to this day. These sources from Benjamin Bloom and Fred Keller focused on ways that education could address the needs of individual learners and these ideas for me will always be described as mastery learning. The core idea of mastery learning is 1) that individuals learn at different rates and 2) if these different rates are not taken into account learners will be less efficient in what they could accomplish or more dangerously will fail to accomplish. If allowed to accumulate the knowledge and skills that accumulate serve as the basis for increasing barriers to new learning . Focusing on those with greater learning struggles, over time, this means that learning capabilities begin to differ from others both in terms of requiring more time because of aptitude AND existing knowledge.

The solutions offered by Bloom and Keller were to individualize learning in an attempt to prevent what might be described as prerequisite knowledge deficits. As a graduate student some of my earliest publications (1978 and 1981) focused on research another graduate student and I conducted with a Professor teaching the introduction to biology course at Iowa State.

The core idea of mastery also influenced some of my research nearer to the end of my career. At this point, I was interested in study behavior and how technology supported study might offer feedback to learners to influence the extent of effort they must invest to achieve higher levels of performance. In some ways this research effort quantified the reality of the different amount of time required and demonstrated over and over that it was the more accomplished students who invested in the use of the tools designed to assist students struggling to succeed. A way to succeed is intended to increase motivation, but the reality of what it takes appears to swamp the incentive to use such systems. Perhaps, the university is far too late to begin emphasizing a focus on trading effort for achievement.

I part of the heavy emphasis I invested in the role of technology in education might be described as the opportunity technology seems to offer for individualization. My thinking on this potential was agin motivated by the work of one of the pioneers I credit for kindling my original interest. Bloom conceptualized what I think of as the 2-sigma challenge. He proposed that the upper limit for the potential of educational research was likely identified in the work of tutoring. Tutors working with individuals or very small groups offered a way to respond to individual needs and the advantage demonstrated in the degree to which tutoring augmented the achievement for group-based instruction. To me, well-designed technology supported tactics provided what might be described as a “poor man’s” approximation to tutors. I don’t see technology, at least in the near future, being the equivalent of a gifted and dedicated tutor, but I also don’t see how the finances of providing human tutors as practical. Teachers working with classes of 25+ in elementary and multiple sections of this number at higher levels certainly can’t provide this level of attention.

I am writing about mastery learning again because the idea has resurfaced in the present circumstances of mandatory technology-supported, distance education. Sal Kahn began describing mastery as a way of thinking about what he was trying to accomplish with the Kahn Academy. Another great adaptation I think offers this type of individualization would be Newsela. Reading the same content at different levels is a way to individualize skill levels of reading assuming that background knowledge relevant to the content is not an issue.

I offer details on mastery in other content I have generated. This writing/video includes specific references to key articles. The citations below are what I described related to early and late efforts on my part.

Historical reference:

Latta, R. M., Dolphin, W. D., & Grabe, M. (1978). Individual differences model applied to instruction and evaluation of large college classes. Journal of Educational Psychology, 70(6), 960.

Grabe, Mark, and R. Michael Latta. (1981). “Cumulative achievement in a mastery instructional system: The impact of differences in resultant achievement motivation and persistence.” American Educational Research Journal, 18, 7-13.

Grabe, M. (1982). Effort strategies in a mastery instructional system: The quantification of effort and the impact of effort on achievement. Contemporary Educational Psychology, 7(4), 327-333.

Grabe, M., & Flannery, K. (2010). A preliminary exploration of on-line study question performance and response certitude as predictors of future examination performance. Journal of Educational Technology Systems, 38(4), 457-472.

Loading

Still good ideas

I have written several posts on my ideas for a new type of textbook. In retirement, some of these ideas make less sense for me to act on so I thought I would summarize them here.

There were basically three interrelated ideas. I will expound on the final of these ideas here.

  1. Textbook authors after proving themselves should write on a small retainer and continuously. The process of scrambling every three years to generate a new edition in a few months is not the best way to generate the best product. Content can be posted online as it is developed offering current work to those who purchase the present book and can be worked into the next edition when it is approved.
  2. A paper book is not the best way to get content to learners. It is important to remember I write books related to educational technology. Differentiating content that is basic and stable from content this is likely to change on a regular basis can be the basis for a shorter and less costly book in combination with online content. Placing some content online allows for the provision of current content intended for the next edition (see point one) AND resources that may be useful for some, but not all courses using the book. This second idea is a way to assure greater flexibility.
  3. Textbook users (professors and learners) have insights and experiences that should be shared as benefits to the author of the book they use and to each other.

I decided to write this post when going through old content I had stored in Google docs. I found my original proposal and a couple of images. When I prepared to explain my ideas to the commercial publisher of our fifth edition, I made a couple of attempts to explain the third concept I list above as diagrams. I ended up using the second, but the first may make this third idea clearer.

The authors, instructors, and learners using a given textbook are connected. They share a common component of instruction whether they selected this component or not. What I was interested in based on my experience and our way of interacting with classroom educators was a way to take advantage of these connections. We worked with classroom teachers before and during our experience as textbook authors. We used projects with permission we observed in our writing. I used to search online for the title of our book and found some syllabi of instructors using this book. It was always interesting to see what other reading was referenced in these syllabi and what assignments were required of students. What seemed reasonable was to attempt to create such relationships on a larger scale. What if the hybrid system used to offer a textbook (book and Internet) also allowed teachers to share with each other (syllabi and perhaps examples of classroom assignments) and students could also share their projects with each other. These sharing would be voluntary and if monetization was involved it would be based on ads placed on the sources offered by teachers, students, and authors.

Our publisher decided they could not implement the first two of my ideas and we ended up writing a Primer and online content on our own (see the cover in the left-hand column of this web site). We now have less interaction with teachers because we are retired. I still think my ideas make some sense, but these ideas run contrary to the total ownership needs of publishing companies.

Loading

Bored, left-behind, or personalized

I have been a supporter of mastery learning since I first read Bloom, Keller, and others in the 1970s. There are many forms of personalization and mastery approaches are but one. Mastery attempts to deal with the issue of individual differences in existing knowledge and rate of learning. Its perspective on learner aptitude argues aptitude should be conceptualized as how long it takes to learn something rather than how much a student can learn in the time provided which is what traditional education requires. For those who could go faster (bored) and those who have been ignored as a class of students move on (left behind), a mastery approach proposes that instruction should address the present situation of each student.


When such ideas were proposed and demonstrated in the ’70s, I would argue that the means to deliver individualized approaches were impractical in most institutions. With technology, the opportunities for practical implementation have changed.

Personalization of student learning has been popularized in recent years. Like so many terms used in education, the meaning of personalization is ambiguous. Personalization could apply to mastery learning, but also to addressing student personal interests. I am an advocate of both concepts. Others are not. For many, student-centered implies student personal interests, but not differences in rate of learning and existing background. I guess the assumption is that somehow differences in learner aptitude and background are being met in traditional classrooms with traditional group-focused approaches. The reality argues otherwise. Many students simply have no realistic chance of dealing with the learning expectations they face.

I just read this commentary on the mastery version of personalization in the New Yorker (https://www.newyorker.com/news/dispatch/the-messy-reality-of-personalized-learning). I also read some of the reactions from pundits who object to the use of technology in this way. I see this as a convoluted problem and I agree with many of the points identified in the New Yorker article. It has beens suggested that “you are doing it wrong” is too often used by tech advocates when addressing complaints about technology. I would use this argument here. If the teacher uses individualized “mastery learning time” to sit at his/her desk and fill out necessary forms or plan lessons for other class sessions, he/she is doing it wrong.

I like to think of mastery approaches as an adaptive textbook presenting content and experiences at the pace suited to the individual. The classroom teacher does not ignore the class just because a traditional textbook is in use and certainly should not ignore students when the computer or laptop is individualizing content and task presentations. The New Yorker article does a nice job of explaining how individualization has become confounded with private schooling and the funding priorities of tech companies. Again, teachers and administrators are not helpless. There are plenty of “free” individualization options available for classroom use (e.g., Kahn Academy) and there is no requirement that schools must take money from Apple, Google, or whatever company happens to be the scapegoat of the moment.

I admit to being frustrated by the lack of individualization in public schools. Your tech integration specialists/coaches/facilitators/etc. should be there to help.

I have written more about mastery approaches elsewhere.

Loading

Salman Kahn at FETC

Salman Kahn was the featured speaker at this year’s Future of Educational Technology Conference. I had hoped that his FETC presentation would be available, but I have not been able to locate it online (I did find this interview). The conference in Orlando was a direct flight from Grand Forks and probably the ed tech conference I found most informative. It was also in late January which was a great time to escape from North Dakota for a few days. I have been following Kahn and his Kahn academy since I first saw his TED presentation. At some point during the process of developing his online resources, Kahn began describing what he was doing as supportive of a mastery approach. I am fairly certain this realization came sometime after his work became popular and I appreciated his association with the mastery learning research that guided my own early thinking about individualization in the 1980s. Too many innovators seem to want to give new names to older concepts. For me, technology provided a practical way to apply mastery concepts in classrooms. The work from the 70s-80s explored the potential of core ideas, but this form of personalization was very difficult for educators to implement. My own thinking about “personalization” assumes there are two issues that should be individualized – a) interests and b) existing knowledge and speed of learning. Neither variable can be addressed with a group-based approach. When the individualization of instruction to address differences in existing knowledge and speed of learning are implemented via a system such as is available through the Kahn Academy, what is happening is unfairly described as students being drilled by a computer. This perception misrepresents how a teacher’s time is intended to be applied. Technology is being applied to individualize information presentation and performance evaluation on an individual basis providing data that allows educators to recognize where their mentorship and tutoring can most usefully be applied. This is a type of interaction that does not happen often enough in most classrooms.

Loading