Layering – Learning Aloud

Highlighting in the age of digital content

I have highlighted much of what I read for probably 50 years. I started in college, and I tried different approaches, sometimes highlighting with different colors. My preference was the slim highlighter in yellow. When I began reading using my phone, iPad, and Kindle, I learned how to highlight using these devices. My interest in educational technology led me to look more deeply into the opportunities to highlight and annotate on these devices, and you may have read what I have had to say about these tools in previous posts.

Here is the thing about highlighting. If you follow the research on the efficacy of different learning/study strategies, you soon understand that highlighting is not particularly useful. I knew this too, and I was interested in study techniques long before personal computers were a thing. I taught educational psychology to college students, and studying was a topic I hoped the students would find relevant.

There are good reviews of the research on highlighting (Dunlosky, et al, 2013) that reach the conclusion that highlighting has low utility. I think it is important to carefully understand the methodology used in the studies that investigate highlighting. What is the breadth of the perspective? In research that examines the application of note-taking, a distinction is drawn between the generative and external functions of notes. I think a similar issue applies here. The research indicates highlighting is not cognitively active and has limited generative value, but what about external storage? If it was an hour before a major test and I was trying to review the 120 pages that were assigned in my textbook, I would rather I had highlighted that book than not.

Here are some of the major findings that challenge the value of highlighting.

Highlighting may improve recall but not comprehension. (see Ponce and colleagues resource as the source for most of the comments focused on recent studies of highlighting)

Learner-generated highlighting can improve memory for the highlighted material. However, this memory boost often doesn’t extend to improved comprehension. If this distinction makes little sense, think of the difference in terms of the types of questions that might be asked to evaluate memory versus understanding. College students seem to gain more memory benefit from self-highlighting than K-12 students, potentially because they are more experienced at identifying key information. Studies focused on the importance of content that is highlighted demonstrate that college students are better at identifying core or main ideas. This makes sense for a couple of reasons. First, highlighting tends not to be encouraged among K-12 students as they use books that are not theirs. Second, college students are more experienced with the educational process and have a better feel for what content is likely to be the focus of future examinations or projects they will complete. As a consequence, and anticipating that advanced learners are likely to make use of highlighting, instruction focused on the identification of priority information is often recommended. Younger students should be asked to highlight and the type of content they designate should be evaluated.

Illusion of Mastery: Like passive rereading, looking at highlighted text can create a false sense of familiarity, leading learners to believe they know the material better than they do. This confuses familiarity with actual retrievability and understanding (Johns).

When I explored highlighting as a study technique with my students, I described a similar phenomenon. I call it the “I’ll get to that later” effect. What I proposed is that students seem to actually identify important content (these are college students), but may be challenged to understand this material. An easy way to move on and complete the reading assignment was to highlight this material, but not stop to struggle with the ideas. Later may not actually happen, or if it does, the highlighted material is then encountered out of context and less easily processed to a deeper level.

Ahrens (citations appear at the end of this post) proposes that underlining (I would assume a practice similar to highlighting) is similar to what Ahrens classifies as fleeting notes. Fleeting notes are taken to quickly capture information, and the idea of smart notes that Ahrens emphasizes focuses on the translation of fleeting notes into smart notes. A smart note can stand alone to convey meaning to the note taker and others and requires the note taker to use personal knowledge to generate a note that is meaningful now and hopefully in the future.

Highlighting of digital material may be different.

Digital reading can be different. Highlights can be exported and saved isolated from the original document. The accumulation of this once-deemed potentially useful text can be searched and examined, or potentially can become the target of an AI chat years later. This is very different than the way we highlighted journal articles or books a decade or so ago. The journals and books were stored in long rows on our office shelves, with the highlighted prose unlikely to be discovered when useful. Some books while read, were returned to the library and not highlighted in the first place.

An Edutopia article on highlighting reached a negative conclusion about the value of highlighting (it may even hinder learning) and suggested solutions that educators should explain in a way very similar to that of the difference between fleeting and permanent notes. Those who are into Personal Knowledge Management methods for taking and retaining useful notes probably recognize this distinction. Ahrens suggested these terms as a way to identify important content (fleeting notes) with the expectation that this original material will receive further processing. He suggests that students a) annotate their highlights with short summaries and personal reflections or b) generate questions related to the content they have highlighted.

The Edutopia suggestions bring me to the perspective I want to emphasize.

Technology-based reading offers advantages over paper-based reading that are seldom emphasized. I rely heavily on highlighting when I write on my Kindle or using a browser extension that allows me to highlight web content. I don’t read from paper much anymore, but when I do, I also highlight a lot. When I use my iPad or computer to read and highlight, I tend to be using tools that allow me to add annotations (actually extended additions I would prefer to describe as notes) as part of the same integrated approach. I suppose I could read from a paper source and have a notebook on my desk at the same time, but I have never actually worked in this way. These highlights and notes are part of the original documents, but can also be exported for storage and further processing.

When I used to take notes from a highlighted book or journal article, it was usually later in some process of reviewing material in preparation to write something myself. In thinking about how I work now, I propose that reading using a technology-supported environment encourages the process of creating meaningful notes earlier in the process of writing, and is often disconnected from the process of creating the end product. There is an efficiency when meaningful notes are made during the initial process of reading new content in comparison to trying to create the same context when trying to make sense of highlights or notes that simply move unprocessed words from one paper source to another after a delay.

Here is my major use of the highlights from what I have read. As an academic researcher I read many, many journal articles. For the last 15 years of my career and since, I did my academic reading on the pdfs of these articles. Like other academics, I had access to these pdfs from pretty much any journal I wanted and I used these pdfs even when I owned the journals and they were on the shelf across the office from my desk. The tools I used to keep a record of the PDFs I read (originally to access the citations for articles) and to highlight these documents changed over the years, but I generated a large collection (hundreds) of highlighted articles. In recent years, I have been able to export the highlights and annotations and store this material using a personal knowledge management tool (Obsidian on my desktop and Mem.AI online). This large collection of has become a resource I can explore, link and tag. In the past couple of years, I have been able to chat with my content using AI tools (e.g., NotebookLM and Smart Connections). The opportunity being able to interact with material I have generated over decades is a very interesting experience and for someone who writes a boon to productivity,

Given the opportunities of reading on a digital device, I think we are at a point where highlighting may have value. Under these conditions, highlighting services as a placeholder for what should be a fairly immediate generation of meaningful notes. The placeholder has two benefits — it marks and saves a location in content that offers the benefit of context should a reader need to make use of the source material later. The marked material is also isolated through highlighting, and this would seem to benefit the note-making process.

One other conclusion for the Ponce and colleagues review of highlighting studies I drew from in previous sections of this post. These authors concluded that the effectiveness of highlighting was greatly enhanced when used in conjunction with more generative learning strategies, such as note-taking or creating graphic organizers. Combining highlighting with these activities showed a notably larger effect size compared to highlighting alone

I suggest it is time to prepare secondary students for these opportunities. I also argue that educators abandon the paper is best assumption. If learning is understood as a process with initial exposure not isolated from studying and review, I cannot see how paper sources have an advantage. Learn to use a digital highlighting and annotation tool and work this tool into your knowledge generation and storage workflow.

If my position makes sense to you, you may find the series of posts I have generated on note-taking to be of value.

Summary

Highlighting has often been dismissed as an effective learning strategy. Here, I argue that this is an outdated perspective based on assumptions related to the use of paper-based content. With digital content, highlighting can be an important first step in the processing of content for comprehension and value over extended periods of time.

Sources

Ahrens, S. (2017). How to take Smart Notes: One simple technique to boost writing, learning and thinking for students, academics and nonfiction book writers

Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students’ learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the public interest, 14(1), 4–58.

Johns, A. (2023). The science of reading: Information, media, and mind in modern America. In The Science of Reading. University of Chicago Press.

Ponce, H. R., Mayer, R. E., & Méndez, E. E. (2022). Effects of learner-generated highlighting and instructor-provided highlighting on learning from text: A meta-analysis. Educational Psychology Review, 34(2), 989-1024.

18 total views

Processing video for Personal Knowledge Management

John’s “The Science of Reading” explores the historical and scientific journey of reading as a science and a practice. Much of my professional life as a researcher focused on reading and reading skills and as a consequence, I was aware of some of the history of the research and theory. What I found my perspective lacked was the broader perspective on what was expected of reading as a determinant of culture and as the basis for citizenship and commercial and scientific advancement. The political perspective associated with assumptions about what specific skills were necessary for the general advancement of nations was an angle I had not considered.

The closest I can come to explaining some of the insights I encountered might be compared to present assumptions concerning political arguments over why “educated” citizens can believe the things they believe and even what should be excluded from classroom consideration to prevent what some see as undesirable outcomes. Those of us involved in the nitty-gritty of the learning and improvement of the skills of reading are often oblivious to broader questions of what the general population may expect the skill to accomplish or the problems the acquisition of a skill may create.

A historical perspective provides both a way to see transitions in a skill and how that skill is developed, but also how in this case to consider that a skill exists in a reciprocal relationship with that knowledge and culture. For example, political values, arguably a part of culture, have varied in demanding that a specific form of communication be prioritized and thus justifies support as a means for accomplishing prioritized goals. Who needs to develop a specific communication skill, what information should this skill target, and how will the use of this skill be controlled? More to the point of this post, are we in an era in which reading is coming to the end of its reign in this broader capacity and are we seeing the early stages of a transition to a different means for recording and transmitting knowledge and culture? Are we in the midst of this transition without acknowledging it and perhaps more importantly supporting and shaping the direction of this transition?

Perhaps asking whether we are moving on from reading seems radical, but these thoughts came to me as I have watched my grandchildren and truthfully most of my relatives spend hours exploring videos on their phones. The time children and adolescents spend on YouTube and other video content exceeds by a considerable margin the time they spend reading. It seems this reality has to be acknowledged. I tried to locate some specific data and found that the results of a recent Gallup poll indicate adolescents report spending an average of 1.9 hours daily on YouTube alone. Adults may be different, but I would wager when they encounter a skill they must execute they are far more likely to see if YouTube has something to offer rather than search for and read the manual that provides related information. I understand that what may seem a similar reaction has been associated with television viewing because everyone spent and spends so much time watching television, but how we make use of televised content seems different and less responsive to transitory personal interests than online video.

A modest proposal

OK. I have not abandoned reading and I rely on reading professionally. I must read journal articles and books to perform my occupational role. Scientific research demands the sharing and reading of text documents in a specific format and with a required approach to citing related sources so that any arguments made can be evaluated based on existing research findings and theory. At this point, I am bound by this approach. However, the process by which the findings of this formal research process reaches potential practitioners is not so rigid. Classroom educators can read articles and blog posts in which proposed instructional activities based on the findings of the research community are offered, but they can also listen to and watch podcasts and YouTube presentations. They can take courses (e.g., Coursera) and interactive classes (e.g., Zoom) that rely on video. We all have been taught to read (and write), but what about the development of skills that optimize learning from video.

For several years now, I have been interested in the role of Personal Knowledge Management (PKM) in self-directed learning. Part of this interest has involved the exploration of specific digital tools that support the processing of information within the context of PKM. The PKM perspective can be applied to traditional educational settings, but it also encourages a long-term perspective which is the environment all of us face once no longer involved in courses that require us to learn to pass examinations and produce projects that demonstrate our learning. Our challenge is remembering specifics earlier exposure to information sources have provided when potentially useful and finding personally useful connections within this great volume of information.

PKM is about tools and tactics. What processes (tactics) allow us to store (internally and externally) a residue from our reflection on the information we have experienced? What external activities (tools) can facilitate storage and processing?

There are plenty of tools and plenty of related suggestions for tactics proposed by the PKM community. My focus here is on the less extensive focus on video and the even more limited focus on digital tools that are used during the initial video experience. How does a video viewer capture ideas for later use? How can skills unique to this approach be learned?

Why an integrated digital note-taking tool?

While watching an informative video, why not just take notes in a notebook next to your laptop or tablet? Why not just open a second window and simple word-processing app in a second window on your laptop? My answer would be you use an integrated digital tool to link the context between the original video and individual notes in ways that recognize future issues and uses. Note-taking is a far from perfect process and being able to recover a missing piece of information necessary to fix a confusing note requires being able to reexamine a specific segment of the original video. I first wrote about the importance of the preservation of context when describing apps that allowed the sound from lectures to be recorded within note-taking apps. These apps automatically establish a link between any note taken with a time-stamp connecting the note to a specific point in the audio recording. I even suggested that when a note-taker realizes she has missed something she knows she should have written down as a note, they simply enter something like ??? in their notes as a signal to later check the recorded audio for something not mentioned in the notes that may have been important.

I have a different reason for proposing the importance of digital notes. I use digital note-taking systems that allow me to quickly search and find notes I may have taken years ago. Students are not in this situation, but the delays say in a course with only a midterm and final exam involve delays that are long enough to be related to a sizable amount of content to review and a time frame likely to increase memory retrieval challenges. Digital notes make searching simple and allow integration and cross-referencing of content over time to be relatively easy. For those of us now functioning to manage large amounts of information outside of a formal and short-term academic setting, such challenges are now often described and addressed as Personal Knowledge Management (PKM).

Reclipped

There are several tools available to annotate videos. My favorite is ReClipped. This tool is an extension that is added to the Chrome browser and is activated when a video source the tool can be used with appears in the browser. When the extension has been added, an icon will appear in the icon bar at the top of your browser and the appearance of this icon will change when it has been activated by the presence of video content within the browser. When active with YouTube, additional icons will appear in YouTube below and to the right of the window displaying the video (see the following image with ReClipped icons identified by a red box). (Note: the video used in this example was created by Dr. Dan Alosso and associated with an online book club he runs.)

I have written about ReClipped before in my series about layering tools. I define a layering tool as a tool that allows additions overlayed on existing online content without actually modifying that content as sent from the host server. I wrote previously about ReClipped as a way an instructor could add content (questions, comments) to a video so that the composite of the original video and the additions could be presented to students and supplement their learning. The difference here is that a learner is adding the additions for personal use.

To keep this as simple as possible, I will focus on one tool — the pencil. The pencil represents the note tool (see the icons with the pencil tool enclosed in a red box below the video window). Clicking on the pencil creates a time stamp in the panel to the right of the video window allowing the user to enter a note associated with that time stamp (see examples in the image). I tend to click the pencil, pause the video, and then enter my notes. Pausing the presentation is obviously an option not available when listening to a live lecture and solves all kinds of issues that learners face in the live lecture setting.

The save and export buttons are also important. ReClipped will archive your annotations for you when you save, but I am more interested in exporting my annotations so I can use them within my broader Personal Knowledge Management strategy. I use a tool called Obsidian to collect all of my notes and to work with this large collection in other ways (reworking, linking, tagging). I also make use of an AI tool ( Smart Connections) to “chat” with my collection of notes.

ReClipped allows the notes associated with a given video to be exported in several formats (e.g., pdf). I export notes in markdown because this is the format Obsidian likes for import. Markdown is a formatting style something like html if you are familiar with the formatting style used in creating web pages. Such additions allow the incorporation of other information with text (e.g., links). For example one of the entries included in the example I have displayed is exported as the text string that appears below.

– [08:43](https://www.youtube.com/watch?v=ukJtbtb8Tb4&t=523s) levels of notes — fleeting, literature, permanent — literature vs permanent is a matter of connecting to what you already know vs summarization. Permanent note has been “filtered by our interest”

When stored in Obsidian it appears as the following image (this is an image and not active).

Within Obsidian, the link is active and will cause the browser to return to the video stored in YouTube at the location identified by the time stamp. So, if necessary, I can review the video I saw when first creating the note at the point associated with that note. This link will simulate that experience. One issue with time stamps — the creation of a time stamp follows the content the stamp references. You listen and then decide to create a note. To reestablish the context for a note it thus requires that you use the link to a time stamp to activate the video and then scrub backward a bit to view the relevant material.

ReClipped allows other content (e.g., screen captures) from a video to be collected while viewing. Taking and exporting notes is straightforward and easy for me to explain in a reasonable amount of time.

There is a free version of ReClipped and the paid unlimited version is $2 a month. Note that ReClipped is presently free to teachers and students.

Research

I try to ground my speculation concerning the application of digital tools and techniques in unique learning situations with links to relevant research. In this case, my preference would be for studies comparing traditional note-taking from video with taking notes using integrated digital note-taking tools similar to ReClipped. I have been unable to locate the type of studies I had hoped to find. I did locate some studies evaluating the effectiveness of scratch-built tools typically incorporating some type of guided study tactic (see Fang and colleagues reference as an example). Though important work, learner application of more flexible and accessible tools seems a different matter and need to be evaluated separately.

Putting this all together

If you agree with the argument that we will increasingly rely on video content for the skills and information we want to learn, my basic suggestion is that we think more carefully about how to optimize learning from such content and teach/learn skills appropriate to this content and context. Digital tools such as Reclipped allow notes to be taken while viewing videos. These notes can be exported and stored within a Personal Knowledge Management system for reflection and connection with information from other sources. This post suggests that experience with such tools under educator supervision would provide learners the skills needed to take a more active approach to learning from videos they encounter.

References:

Fang, J., Wang, Y., Yang, C. L., Liu, C., & Wang, H. C. (2022). Understanding the effects of structured note-taking systems for video-based learners in individual and social learning contexts. Proceedings of the ACM on Human-Computer Interaction, 6(GROUP), 1–21.

Johns, A. (2023). The Science of Reading: Information, Media, and Mind in Modern America. University of Chicago Press.

65 total views

Tapping into the crowd mind with chat

I recently read Paul’s “The extended mind” which deals with how we can harness resources external to our own minds and our own cognitive activities to deal with the abundance and complexity of information we must process daily. One value of a book such as this is that it greatly expands the variety of external resources that can influence our thinking. This variety aside, my main focus continues to emphasize technology (sometimes what some now call a second brain) and collaborations of various types (e.g., peers, experts, those with similar interests we have never met). I offer this brief overview as a recommendation for those who might find this book a useful investment of reading time.

I will focus this post on several social experiences that often are denigrated?—?meetings and lectures (especially online presentations). Without defending these social experiences, I will offer some insights that may increase the productivity of these social gatherings. In both cases, the key idea concerns how to take better advantage of the collective knowledge available in the real-time group setting.

Meetings

The suggestion I discovered here is straightforward so I can describe it quickly. Why are meetings the butt of so many jokes somehow targeting the time wasted and inefficiency of such gatherings? I spent a good part of my years as a college faculty member and department chair. The advantage of meetings is not the distribution of information as this could be accomplished by the distribution of a memo or email. The advantage is the opportunity to tap into uniquely held knowledge and collectively problem-solve. However, patterns of communication often work against these potential advantages. Too often, only a few or even one individual speaks. Paul suggests that this is due to the way issues are presented. When a group leader begins by spending too much time presenting his or her perspective on an issue, few participants tend to respond to add their insights. Paul proposes that the leader begin by asking “what do you think about XXX” and waiting to offer a personal opinion. He even recommends that individuals write their positions on note cards to distribute input more broadly. There must be a digital version of this suggestion.

The challenge of eliciting what individuals know is key to many of the strategies Paul proposes in benefiting from collaboration. Perhaps a better way to describe the message might be collaborative efforts are often actually not that collaborative.

The lecture experience

It is common to diss lectures. It is not that I don’t understand some of the issues. Why is it educator/teacher presentations are singled out for criticism? Why is the reading of a book different from participating in a lecture? Both approaches focus on the communication of information that is to be processed by individuals. Lectures probably offer greater opportunity for collaboration because individuals are in the same location and perhaps more importantly they are present at the same time. Yes, there is such a thing as collaborative reading and that also interests me, but “social presence” is more real in a physical or virtual group experience. Sure, tutoring is superior, but we must recognize practical realities in information exposure and do what is reasonable to take advantage of the social setting. While not a part of most critical reactions, exposure to information is not the end of the learning process, but it seems obvious exposure is a necessary component.

I emphasize thinking opportunities in my general approach to formal and informal learning experiences. How might thinking opportunities be encouraged when and in ways that improve the efficiency and success of learning? The effort I have invested in evaluating and promoting layering activities is based on this perspective. Layering provides a way to embed learning opportunities in what I call the exposure phase of learning. Adding questions on top of reading content or within video presentations makes a good example. When used in this way, questions are a way to add thinking opportunities during a stage of learning that is often passive unless a learner initiates such behaviors without external prompts.

Paul takes a similar perspective with an emphasis on collaboration. Many educators may recognize an example of this emphasis in the active learning method in which a lecturer pauses during a presentation to throw out a discussion challenge to small groups of students typically sitting around tables rather than the lines of chairs in a typical lecture hall. The groups deal with this challenge and may be asked to report a summary or conclusion. Think-pair-share activities are a variant of this approach. With many lecture settings, a group is there, but there is no collaboration.

The pandemic brought an educational emphasis on virtual learning typified by Zoom sessions. I think it fair to say the typical experience has received a great deal of criticism. I had retired from teaching so aside from using ZOOM in other ways I was not teaching online during that time. My experience with ZOOM has involved a book club I join each week and graduate classes in instructional design. The ZOOM classes involved students who found it impractical to come to campus so I was teaching both face-to-face and online simultaneously which comes with its own set of challenges. My personal experience using chat while involved online has been limited to the book club.

There are plenty of suggestions for the use of chat to create active learning experiences while working with students in a synchronous setting. These strategies involve an assortment of proposed benefits. My focus is narrower and addresses the importance of tapping individual experiences of a group members to embellish presentations of the instructor. The intent of this recommendation is to encourage students to connect concepts being presented with personal experiences. Such connections are essential in encouraging transfer?—?making what is learned useful in a more general way. Students can make such connections without external assistance, but the thinking required to make such connections requires that relevant experiences come to mind and learners have the motivation to commit to reflection. Questions and prompts are a way to encourage this effort and a chat system provides the opportunity.

It is easy to imagine how such prompts could work with ZOOM. The chat function extends and expands the impact of asking a question of the group. So, imagine I am presenting the concept of working memory overload. I may think this concept offers important applied insights, but understanding an explanation of the concept does not lead to learner associations. Asking the group to suggest examples typically generates useful responses from the usual participants, but it is often the nonparticipants who are most in need of external supports. Here is the value of chat. All can participate somewhat anonymously with less pressure and not need to be the first to respond. Chat has a very important added benefit. You get to tap into the knowledge of peers. An immediate response might identify the problem of distracted driving which you might not have thought of, but which you recognize and see the connection. Someone else mentions trying to use Instant Messenger in class reducing the attention students pay to what else is happening in class. As the responses roll in, each learner has the opportunity to consider connections both familiar and unfamiliar. Some may not be appropriate examples, but even considering such offerings allows extended thinking about the concept in question.

I do recognize that ZOOM chat offers private messages which obviously provides the potential for nonproductive distraction. So do the side conversations students in a face-to-face classroom might be having with the students sitting next to them.

ZOOM does not have a provision for blocking the responses of others until a personal response has been submitted. Some instructors recognizing this issue have proposed a “Ready, Set, Go” strategy. If the type of activity I have just described is a frequent technique and a pattern of participation has been identified, students understand that a question or request will be made and then students are to consider a response, but not enter it until given the signal. Time for thinking is essential if thinking is expected. Time to submit a response and time to contemplate the responses generated by peers must be allowed. The instructor might also use the post-response delay to identify some of the examples for the group.

Using chat as part of online instruction may sound like the online equivalent of classroom response systems that seemed popular a decade or so ago, but now no longer receive as much attention. This is true. Such systems have a variety of hypothetical benefits. This post has focused on one benefit?—?How to tap into uniquely held knowledge in an online group setting?

Resource

Paul, A. M. (2021). The extended mind: The power of thinking outside the brain. Eamon Dolan Books.

64 total views

Update to AI-Supported Social Annotation with Glasp

Social annotation is a digital and collaborative practice in which multiple users interact with text or video through comments, highlights, and discussions directly linked to specific parts of the source. This practice extends the traditional act of reading and watching into a participatory activity, allowing individuals to engage with both the text and each other in educational ways.

For learners functioning within a formal educational setting or an informal setting, social annotation can benefit learners in multiple ways. It can transform reading from a solitary to a communal act, encouraging students to engage more deeply with texts. Students can pose questions, share interpretations, and challenge each other’s views directly on the digital document. This interaction not only enhances comprehension and critical thinking but also builds a sense of community among learners. Potentially, educators can also participate guiding discussions or reacting to student comments.

Beyond the classroom, social annotation is used in research and professional fields to streamline collaborations. Researchers and professionals use annotation tools to review literature, draft reports, and provide feedback. This collaborative approach can accelerate project timelines and improve the quality of work by incorporating multiple expertises and viewpoints efficiently.

I have written previously about social annotation as a subcategory of my interest in technology tools that allow layering and even earlier in the description of specific annotation tools such as Hypothesis. As now seems the case with many digital topics, social annotation eventually was expanded to incorporate AI. This post updates my description of the capabilities of the AI capabilities of Glasp. Glasp is a free tool used to annotate web pages, link comments to videos, and import annotations from Kindle books. It functions as a browser extension when layering comments and highlights on web pages and videos. The accumulated body of additions is available through a website which is where the AI capability is applied as a mechanism for interacting with the collected content and for connecting with other Glasp users.

The following content is divided into two sections. The first section focuses on the AI capabilities applied to personally collected content and the content collected by others. The second section explains how to locate the content of others who have used Glasp to collect content designated as public. This second section describes capabilities I have personally found very useful. As a retired individual, I no longer have access to colleagues I might interact with frequently. Collaborative tools are only useful when collaborators are available and developing connections can be a challenge.

Interacting with stored annotations using AI

The following image displays the personal browser view from the Glasp site. The middle column consists of thumbnails representing multiple web pages that have been annotated and the right-hand column the highlighted material (no notes were added to the source I used for this example) from the selected source. The red box was added to this image to bring your attention to the “Ask digital clone” button. This image is what you would see when connecting to my site to interact with my content. The button would read “Ask your clone” if I was connecting to my own account to interact with my content. Here is a link you can use to interact with my content. After you have read just a bit further, return and use this link to duplicate my example and then try a few requests of your own.

The next image displays what happens when the “Ask digital clone” button is selected. You should see a familiar AI interface with a text box at the bottom (red box) for initiating an interaction. I know the type of content I have read so I have generated a prompt I know should be relevant to the content I have annotated.

The prompt will generate a response if relevant information is available. However, here is what I find most useful. The response will be associated with a way to identify sources (see red box). Typically, I am most interested in reviewing original material from which I can then write something myself.

The link to relevant highlights should produce something that looks like the following.

Locating content saved by others

Glasp offers a capability that addresses the issue I identified earlier. How do you locate others to follow?

The drop-down menu under your image in the upper right-hand corner of the browser display should contain an option “Find like-minded people”. This option will attempt to identify others with some overlap in interests based on the type of content you have annotated. So, you must start by building at least a preliminary collection of annotated sites yourself. If you have no content, there is nothing available to use as the basis for a match.

Glasp should then generate something like the following. You can click on someone from this display to query their existing public material. If you then want to follow that individual, their site should contain a “Follow” button.

Summary

I hope this is enough to get you started. You can use the link to my account to explore. It seems unlikely to me that Glasp will always be free. They must have development and infrastructure costs. For now, the company has offered an interesting approach that has grown in capability during the time I have used it.

90 total views

Use EdPuzzle AI to generate study questions

This post allows me to integrate my interest in studying, layering, questions, and using AI as a tutor. I propose a specific use of EdPuzzle, a tool for adding (layering) questions and notes to videos, be used as a study tool. EdPuzzle has a new AI feature that allows for the generation and insertion of open-ended and multiple-choice questions. So an educator interested in preparing videos students might watch to prepare for class could prepare a 15 minute mini-lecture and then use EdPuzzle to layer questions on this video and assign the combination of video and questions to students to be viewed before class. Great idea.

The AI capability was added to make the development and inclusion of questions less effortful. Or, the capability could be used to add some questions that educators could embellish with questions of their own. I propose a related, but different approach I think has unique value.

How about instead of preparing questions for students, allow students to use the AI generation tool to add and answer themselves or with peers.

Here is where some of my other interests come into play. When you can interact with AI that can be focused on assigned content you are to learn, you are using AI as a tutor. Questions are a part of the tutoring process.

What about studying? Questions have multiple benefits in encouraging productive cognitive behaviors. There is such a thing as a prequestioning effect. Attempting to answer questions before you encounter related material is a way to activate existing knowledge. What do you already know? Maybe you cannot answer many of the questions, but just trying makes you think of what you already know and this activated knowledge improves understanding as you then process assigned material. Postquestions are a great check on understanding (improving metacognition and directing additional study) and attempting to answer questions involves retrieval practice sometimes called the testing effect. For most learners, searching your memory for information has been proven to improve memory and understanding beyond what just studying external information (e.g., your notes) accomplishes.

I have described EdPuzzle previously, here are some additional comments about the use of the generative question tool.

After you have uploaded a video to EdPuzzle. You should encounter the opportunity to edit. You use edit to crop the video and to add notes and questions. The spots to initiate editing and adding questions are shown in the following images. When using AI to add questions, you use Teacher Assist – Add Questions.

After selecting Add Questions, you will be given the option of adding Open ended or Multiple Choice questions. My experience has been that unless your video includes a good deal of narration, the AI will generate more Open Ended than Multiple Choice questions. If you want to emphasize MC questions, you always have the option of adding questions manually.

Responding to a question will look like what you see in the following image. Playing the video will take the student to the point in the video where a question has been inserted and then stop to wait for a response.

When an incorrect response is generated to a MC question, the error will be identified.

EdPuzzle allows layered videos to be assigned to classes/students.

Anyone can explore EdPuzzle and create a few video lessons at no cost. The pricing structure for other categories of use can be found at the EdPuzzle site.

One side note: I used a video I created fitting the potential scenario I described of an educator preparing content for student use. However, I had loaded this video to YouTube. I found it difficult to download this video and finally resorted to the use of ClipGrab. I am unclear why I had this problem and I understand that “taking” video from some sources can be regarded as a violation of copyright. I know this does not apply in this case, but I did not want to mention this issue.

References:

Pan, S. C., & Sana, F. (2021). Pretesting versus posttesting: Comparing the pedagogical benefits of errorful generation and retrieval practice. Journal of Experimental Psychology: Applied, 27(2), 237–257.

Yang, C., Luo, L., Vadillo, M. A., Yu, R., & Shanks, D. R. (2021). Testing (quizzing) boosts classroom learning: A systematic and meta-analytic review. _Psychological Bulletin_, _147_(4), 399-435.

690 total views , 1 views today

Content focused AI for tutoring

My explorations of AI use to this point have resulted in a focus on two applications – AI as tutor and AI as tool for note exploration. Both uses are based on the ability to focus on information sources I designate rather than allowing the AI service to rely on its own body of information. I see the use of AI to interact with the body of notes I have created as a way to inform my writing. My interest in AI tutoring is more related to imagining how AI could be useful to individual students as they study assigned content.

I have found that I must use different AI services for these different interests. The reason for this differentiation is that two of the most popular services (NotebookLM and OpenAI’s Custom GPTs) limit the number of inputs that can be accessed. I had hoped that I could point these services at a folder of notes (e.g., Obsidian files) and then interact with this body of content. However, both services presently allow only a small number of individual files (10 and perhaps 20) can be designed as source material. This is not about the amount of content as the focus of this post involves using these two services to interact with a single file of 27,000 words. I assume in a year the number of files will be less of an issue.

So, this post will explore the use of AI as a tutor applied to assigned content as a secondary or higher ed student might want to do. In practice, what I describe here would require that a student would have access to a digital version of assigned content not protected in some way. For my explorations, I am using the manuscript of a Kindle book I wrote before the material was converted to a Kindle book. I wanted to work with a multi-chapter source of a length students might be assigned.

NotebookLM

NotebookLM is a newly released AI service from Google. The AI prompts can be focused on content that is available in Google drive or uploaded to the service. This service is available at no cost, but it should be understood that this is likely to change when Google is ready to offer a more mature service. Investing time in this service rather than others allows the development of skills and the exploration of potential, but in the long run some costs will be involved.

Once a user opens NotebookLM and creates a notebook (see red box surrounding new notebook), external content to be the focus of user prompts can be added (second image). I linked Notebook to the file I used in preparation for creating a Kindle book. Educators could create a notebook on unprotected content they wanted students to study.

The following image summarizes many essential features used when using NotebookLM. Starting with the right-hand column, the textbox near the bottom (enclosed in a red box) is where prompts are entered. The area above (another red box) provides access to content used by the service in generating the response to a prompt. The large area on the left-hand side displays the context associated with one of the areas referenced with the specific content used highlighted.

Access to a notebook can be shared and this would be the way an educator would provide students access to a notebook prepared for their use. In the image below, you will note the icon (at the top) used to share content, and when this icon is selected, a textbox for entering emails for individuals (or for a class if already prepared) appears.

Custom GPTs (OpenAI)

Once you have subscribed to the monthly payment plan for ChatGPT – 4, accessing the service will bring up a page with the display shown below. The page allows access to ChatGPT and to any custom GPTs you have created. To create a Custom GPT you select Explore and then select Create a GPT. Describing the process of creating a GPT would require more space than I want to use in this post, but the process might best be described as conversational. You basically interact by describing what you are trying to create and you upload external resources if you want prompts to be focused on specific content. Book Mentor is the custom GPT I created for this demonstration.

Once created, a GPT is used very much in the same way a NotebookLM notebook is used. You use the prompt box to interact with the content associated with that GPT.

What follows are some samples of my interactions with the content. You should be able to see the prompt (Why is the word layering used to describe what the designer does to add value to an information source?)

Prompts can generate all kinds of ways of interaction (see a section below that describes what some of these interactions might be). One type I think has value in using AI as a tutor is to have the service ask you a question. An example of this approach is what is displayed in the following two images. The first image describes a request for the service to generate a multiple-choice question about generative activity which I then respond (correctly) and receive feedback. The second image shows the flexibility of the AI. When responding to the question, I thought a couple of the responses could be correct. After I answered the question and received feedback, I then asked about an answer I did not select wondering why this option could not also be considered correct. As you see in the AI reply, the system understands my issue and acknowledges how it might be correct. This seems very impressive to me and demonstrates that the interaction with the AI system allows opportunities that go beyond self-questioning.

Using AI as tutor

I have written previously about the potential of AI services to interact with learners to mimic some of the ways a tutor might work with a learner. I make no claims of equivalence here. I am proposing only that tutors are often not available and an AI system can challenge a learner in many ways that are similar to what a human tutor would do.

Here are some specific suggestions for how AI can be used in the role of tutor.

Summary

This post describes two systems now available that allow learners to work with assigned content that mimics how a tutor might work with a student. Both systems would allow a designer to create a tool focused on specific content that can be shared. ChatGPT custom GPTs require that those using a shared GPT have an active $20 per month account which probably means this approach would not presently be feasible for common application. Google’s Notebooks can be created at no cost to the designer or user, but this will likely change when Google decides the service is beyond the experimental stage. Perhaps the capability will be included in present services designed for educational situations.

While I recognize that cost is a significant issue, my intent here is to propose services that can be explored as proof of concept and those educators interested in AI opportunities might explore future productive classroom applications of AI.

107 total views

Design learning experiences using generative activities – Layering

I have written multiple posts explaining generative activities and how such external activities encourage productive cognitive behaviors. Some of these posts describe specific classroom applications of individual generative tasks. In this post, I intend to describe how educators can apply some of these generative activities when they assign web content (pages or videos).

In many cases, online content assigned in K12 classrooms was not prepared as instructional content. For example, an article from Scientific American might offer information relevant to a specific standard addressed in sophomore biology. What activities might an instructor add to help learners understand, remember, and possibly apply concepts within this article. For example, a textbook would likely have activities inserted at the end of a chapter, added as boxes within content, or recommended in a teacher’s manual. Instructors often make additions as class assignments. What I am supporting here is similar to what educational researchers have described as adjunct questions. These were originally questions added within instructional texts or attached at the end of such texts. Embedded activities play different roles than even the same activities might play when delayed and isolated from the informative content. At the time of initial exposure, my argument is that there is a difference between information and instructional content and the connection of generative learning activities is a way to make this transition.

A couple of years ago I became interested in a group of online services that were developed to improve the educational value of online content (web pages and videos). I developed my own way of describing what these services were developed to accomplish. Layering seemed a reasonable description because these services could not actually modify the content originally shared by content creators for ethical and legal reasons. What a layering service could do was take the feed from the creator’s service and add elements on top of that content. Elements were additions that could encourage important cognitive behaviors in a learner.

With a layering service, the content a learner encounters is a combination of the content from the content creator and additions layered on this content. Two sources and servers are involved. From the perspective of a designer, a layering service works by accepting the URL for a web page or video from the designer and then allows the designer to add elements that appear within or on top of the content from the designated source. The layering service sends this combination to the learner and this does not change the original document and still downloads the original from the server each time the combination of original and layered content is requested by a user. Ads still appear and the content server still records the download to give the creator credit. The layering service generates a link provided to learners and recreates the composite of content and designer additions each time a learner uses that link.

Questions are my favorite example of an external activity that can be added to encourage a variety of important thinking (internal) behaviors. For example, if you want a learner to link a new concept to everyday experiences the concept is useful in understanding, you might ask the learner to provide examples that show the application of the concept. Many learners may do this without the question, but the question increases the likelihood more learners will work to identify such connections with their existing experiences. Those who think about instruction in this way may describe what they are doing as designing instruction. I offer an extended description of generative activity in a previous post.

Depending on the specific service, the elements that layering services I am aware of include annotations, highlighting, questions, and discussion prompts. Annotations could include additional material such as examples, translations, or instructions. Questions could be open-ended or multiple-choice. A few of these elements could also be added by the learner (highlights and annotations) so elements provided to the designer could be used to encourage specific use of the elements available to students.

My personal interest in promoting layering services is intended to encourage the use of services that allow educators, educational content designers, and learners to work with this content to provide more effective learning resources and more generative learning experiences. In addition, content creators have a right to assume the server used by the content creator will be contacted each time content is requested and inclusions such as ads are included. The expectations of the content creator are not ignored when using a layering service.

I have identified several services that meet my definition of a layering service. Here, I will describe one service focused on web pages and one that focused on video. Other examples can be explored from the page linked above and I assume others exist that I have not identified. Services are constantly being updated, but I have just worked with the two examples I describe here and this information should be current as of the uploading of this post.

Insert Learning

Insert Learning is my best example of the services promoted here. I say this because it offers the most generative options and the generative options are part of an environment allowing an educator to both create multiple lessons, assign these lessons to members of multiple classes, and record data on student completion of some of the types of activity involved in individual lessons.

The following image should give you some idea how this works. Down the left border of the image, you see a menu of icons allowing the designer to select highlight, note, question, and discussion. Highlight and note work as one probably expects. When the icon is selected text can be highlighted by the designer or learner. The note icon adds what appear as Postit notes allowing the inclusion of text, links, images, video, and whatever else works as an embed. The question icon adds questions either multiple choice as appears in the image or open-ended. The discussion icon appears very much like an open-ended question but accumulates and displays responses from multiple learners to a prompt.

As I said, Insert Learning differentiates itself from many of the other services because the layering component is part of a system that allows the assignment of lessons to individual students organized as classes and also collects responses to questions by lesson and student. The following image shows a couple of responses to an open-ended question. I used Insert Learning in a graduate course I taught in Instructional Design. I made use of several of the tools I presented to students even when the most common use would be in K-12. This image shows how responses to questions would appear in the Grade Book. I could assign a score to a response and this score would then be visible to the student submitting a given response.

It has been a few years since I used Insert Learning. When I did, I paid $8 a month. I see the price has now increased to $20 a month or $100 for the year.

EdPuzzle

EdPuzzle is a service for adding questions and notes to videos. It includes a system for adding these elements, assigning these videos to students, and saving student responses to questions. The following images are small to allow them to be inserted in this post. In the following image, the red box on the right allows the selection of the element to be added – MC question, open-ended question, and note. The timeline underneath the video (middle) is also enclosed in a red box. As the designer watches the video, clicking one of these buttons stops the video and allows the selected addition to be included. A dot appears below the timeline to indicate where an element has been added. A learner can either play the video which will stop for a response when one of these inclusions is reached or select one of the dots to respond. The second image shows the dialog box used to add an open-ended question.

In the video I used in this example, I created a demonstration using Python to run LOGO commands and saved the video to YouTube. Again, this was a demonstration used in a graduate edtech course. Early in the video, I showed and explained the LOGO code. The video then showed the result of running this program.

When using EdPuzzle with this video, I inserted a note asking students to take a pencil and sheet of paper to draw what the LOGO program would create. Near the end of the video, I inserted an open-ended question asking that students explain how Papert’s notion of computational understanding would provide a different way of thinking about the traditional definition of circle (i.e., a plane closed figure with points equidistant from a point).

I used the free version of EdPuzzle because I only assigned students to a few examples to experience what the service provided. You can do a lot with this service at no cost. The pro-level price is $13.50 per month. EdPuzzle Pricing

Summary – these two examples demonstrate the use of layering services to add generative activities to a web page and a web video. There are similar services available from other companies that generate similar student experiences. The value in such services is the opportunity to design learning experiences containing activities likely to improve understanding and retention.

91 total views