Searching the Scientific Literature

My work has always required that I locate, read, and keep track of the content of scholarly papers – mostly journal articles. This is typical of those of us whose academic interests combine research with teaching the core ideas of a science-related field of study. My personal focus was educational psychology and, even more specifically, reading skills and study behavior. Over the years with this foundation, I became interested in the role technology could play in these same topics and most recently, including how technology can effectively be employed in the reading, processing, and application of information by independent learners (i.e, learners who guide their own learning outside of formal classroom settings). 

Over the course of 50+ years, the means by which those of us with such interests have experienced many changes in how we locate, read, and keep track of the content that forms of the basis and sometimes the outlet for our work. We usually purchased the journals we could afford and perused others in our local library. We once had postcard-sized forms we used to send requests to researchers to see if they had free copies of papers they would return as a professional courtesy. When you published a paper the journal at one time would provide you 50 or so individual copies you would use to participate in this exchange. Libraries have always had limited budgets and some of the less popular journals might be purchased as microfilm or microfiche that could be used to guide personal notetaking or perhaps be connected to a coin-fed “xerox” machine. Now, there are many more journals and libraries that still have limited budgets may buy access to digital collections of journals that allow patrons to download PDFs.

A challenge then and now in this process is how one goes about finding the specific articles and chapters you would read and collect. Libraries used to subscribe to services that provided intricately organized periodicals that would attempt to label research studies. If you didn’t peruse the journals on the “just arrived” section or the shelves, you would try to use these periodicals to guess what labels had been used to identify the content you might want to find in the stacks of your library or send for. Which articles you found, you would use the “reference” section to identify related work that seemed promising. We still do this, but it only works to find documents that are older than the one you happen to be reading at the time. As technology played a more and more important role in organizing content, large databases were developed that could be searched first by matching key words and now with AI capabilities that can respond to prompts that do not have to rely on exact matches to specific words or phrases. 

This bring me to my goal in this post. There are now many tools available to both academically affiliated and independent learners to find what they hope will be useful resources. Some of these tools will now go further in summarizing what is found and even attempt to apply what was found in the creation of papers for different purposes. I am most interested in the location. I want to read the documents for a variety of reasons that I think are important, but I do not intend to discuss. I also have access to a research library that allows me to download PDFs of documents so I don’t need a service that will do that for me. 

So, to summarize, where this leaves me personally. I am now retired, but retain online access to library resources. I do not have an easy way to work with library personnel or the most powerful tools available if I could work directly from a library. I do not want to spend a great deal of money on what I guess I would call “search tools”, but I have spent a good deal of time exploring a variety of free or inexpensive tools. I want to share insights related to my own experiences.

Here is one issue that may not be obvious to those with access to more expensive tools or those with no reason to explore as I have. Most of the literature I am interested in is behind a paywall. Many probably have been exposed to issues related to this reality. Why can’t citizens who, in a way, pay for much of this research through their taxes, read what the research looks like and what it concludes? Who makes the money from this component of academic scholarship? The researchers don’t get paid by journals for their papers. They are expected to review submitted papers for publication to identify high-quality work without compensation. Where does the huge fees libraries pay for access to scientific journals go?  

These issues aside, most search engines that scour the Internet for information that users can search for cannot typically access content protected by paywalls. My personal issue is this how can I efficiently identify useful sources to read. Others have an even greater challenge. How can those without a “faculty pass” learn what recent research has to offer?

My current approach

I currently make use of the following tools/services:

SciSpace is the only one of these options I pay a subscription service to use so the rest have a free level or do not charge for any of the services provided. Again, I only need to locate citations as I have full access to a research library and I am not under the immediate pressure of working on a thesis or dissertation. 

Comments

For articles behind paywalls, Google Scholar is usually my best starting point. It provides citations (sometimes incomplete in my experience). It also lists other publications that have cited the item you have targeted, which can be very useful. The citations include links to the journals in which the articles are published, which provide the full abstract and may or may not allow downloading the full article, depending on the individual journal’s policy.

Screenshot
Screenshot

Long-time Google Scholar users who have not explored the Google Labs option for Scholar should take a look. Rather than search terms, you can ask research questions much as you would with an AI tool. This approach allows a user to identify key topics and related issues. So, to stay focused on searching for journal articles on cyberbullying, I could request articles that examine school programs to combat it. After evaluating the results, the system identifies relevant papers and explains how each paper addresses your request.

Screenshot

Semantic Scholar provides features similar to Google Scholar (see below), but I have found it less effective in identifying sources I know exist. Given the overlap with Google Scholar, I use this service much less frequently.

Screenshot

I use Research Rabbit once I have identified a source I find valuable. Research Rabbit will then surface other sources from this entry point and show the citation map of how these sources are connected. This is also somewhat redundant, but the interconnection graphs are interesting.

Screenshot

SciSpace is useful for semantic searching and summaries of the contents of papers that are located. It is my impression that it is a hit-and-miss tool for locating documents on paywalled journals and I would not depend on it for this purpose. 

The following sequence of images shows the return from the prompt “What is the average daily writing time for K12 students?”. The tool responds with a summary based on the best sources found and provides access to specific information for the sources it identified. Often, a PDF is not available for paywalled sources, but a citation is available, allowing me to try to find that paper in some cases. 

Perplexity can help you find references and surface source links, but it is a general web answer engine, so it is usually not the best choice for systematically searching scholarly journal literature. I do use it to offer insights into how I might address topics for which references are less important.

When access to a journal is not available

When you have identified an article that looks good but is paywalled, there are still things you can try. Scholars may post prepublication versions of papers elsewhere. Just try a traditional search using the title of the article you want. 

Some official repositories of alternatives can be identified through Google Scholar. After identifying an article of interest, check whether the response indicates there are alternative versions.

In this case, one of the alternatives (see following image) identifies a secondary source as ResearchGate, and this repository offers a full pdf of the article the journal protects. These are not illegal copies so you do not have to hesitate to make use of this option.

Summary

For my purposes, which involve paywalled content, Google Scholar is usually the best starting point because it is broad and often surfaces publisher pages, institutional copies, and free versions when they exist. It also indexes paywalled articles themselves, so you can still discover the citation even when the full text is inaccessible.

Semantic Scholar is also strong for discovery, but it focuses on open-access options where available and is less oriented toward paywalled content than Google Scholar.

Research Rabbit is very good once you already have one paper or author and want related literature through citation chaining, but it is less of a primary search engine for broad paywalled journal discovery.

SciSpace is useful for semantic searching and paper summaries, but it is better as a literature-review assistant than as the main tool for hunting down paywalled journal records.

Perplexity can help you find references and surface source links, but it is a general web answer engine, so it is usually not the best first choice for systematically searching scholarly journal literature.

Loading

Hallucinated Citations and Related Problems

Many of my posts are based on applying research to personal or classroom practice. I am retired, so I am no longer involved in experiments myself, but I now spend time reading both new and older published studies on a topic that interests me. 

My change in location and social circles has led to some adjustments. I can’t walk across the street to a university library, though I still have access to online resources. Without students and colleagues, my interests are now far more self-driven and self-perpetuated. I have used Google Scholar since it was around, but the emergence of newer AI-supported tools for investigating the literature has been of great personal value.

This shift in how I locate the articles I read has exposed me to a strange phenomenon. I get excited when I find a reference relevant to a topic I have missed, particularly when it comes from an influential, productive researcher I follow. The title of this discovery sounds perfect and seems to promise just the type of evidence I have been looking for. I access my library’s online resources, call up the appropriate journal, and enter the title from the citation. The article isn’t there. Maybe the volume or the year of publication isn’t correct. I enter the title in Google Scholar to do a search and related articles appear, but there is no match for the specific paper I want. The citation that generated my excitement is very likely an AI hallucination. 

I first wrote about this issue several years ago when AI was itself less sophisticated and this problem was probably more common. I include the link to this previous post because it contains multiple examples of what such hallucinations look like. I decided to revisit the topic after reading a recent Nature article examining this issue. The recent article did a good job of explaining why such hallucinations seem so real, but also raised questions related to how such hallucinations could appear in newly published research and how and why scholars might end up citing and developing arguments in their own papers related to some literature that does not exist. 

The structure of a citation and why it results in hallucinations

The Nature study included a visual representation of a citation that I found helpful. I did not want to just cut and paste their examples so I had an AI tool develop something similar.

Think of a citation as consisting of several elements and understand that AI is not itself cutting and pasting what it offers in response to a prompt, but generates content. When this happens, some of the possibilities can result in fake outcomes.

  • Author may have published in this general area
  • Authors may have published together but not this paper
  • Words in the title are consistent with some of the work the author has done so are used to create the title
  • Pages fit with the date for this journal but are not appropriate
  • DOI (digital object identifier) – does not point to anything, but is similar to other DOIs for this journal

Ironically, trying to have an AI tool generate a plausible citation and identify its components also resulted in hallucinations (compare the image below with the one above). I tried multiple iterations to get what I wanted, but finally, I just had the tool generate the figure without lines, then used a different app to manually add them myself. 

What are the responsibilities of an author?

How hallucinated citations appear in published work raises other serious issues. Possibly, the author who submitted the paper used a tool to build the reference list, but did not then check the final product. More seriously, the author used AI to write sections of a paper complete with citations and did not actually read the original papers. 

Check your references

In my own efforts to explore relevant courses of action, I learned that many publications now rely on services that verify citation authenticity. I checked on the services and did not find anything that would be financially feasible for individuals. I did find that there are tools, some free, that will check a reference list. 

CiteTrue

CiteTrue is a free online tool that accepts a list of citations and checks each component for accuracy. The following image shows what this looks like. I used part of the list of hallucinated citations I included in the previous post on this topic I describe above, and pasted these into the input box. The output indicated all were inaccurate and speculated about what was incorrect.

Screenshot

Personal Comment

This is not an issue I personally worry about, as I am no longer an active researcher. I do cite sources in some of my posts when a reader cannot follow a link to the source. I admit that not all of my sources follow the APA (American Psychological Association) format. This is due to my laziness. I do read all of the papers I cite, but putting together a citation is sometimes a manual process of accurately pulling together different pieces of information from the pdf for that source. I often copy the title from the pdf and paste it into Google Scholar and then use the citation for that source provided by Google. I am unclear how Google assembles citations in its systems, but they do not always follow the most recent APA guidelines. For example, many do not include a DOI or list the authors in different ways. I know the titles work because that is how I find the citations. 

Loading

A return to RSS to combat the changing media environment

The combination of recent acquisitions of major news outlets by extremely rich individuals in combinations these owners are have made some efforts to influence the tenor of programming and the topics covered is causing me some concern. I admit that it is difficult to operationalize story selection, objectivity, and even the target of humorists has become a topic of public discussion. I occasionally take a look at the data collected by organizations that attempt to measure political orientation (e.g., AllSides) and I see that recent news stories CBS, NBC, and the Washington Post are still listed as “leans left”. Part of the challenge here is that the companies making such determinations make use of public ratings rather than some more objective approach and public perception may influenced by accusations rather than facts.

Wealthy owners have almost by necessity controlled news organizations.

  • The Ochs-Sulzberger family, who own The New York Times.
  • The Murdoch family, owners of Fox News, The Wall Street Journal, and The New York Post

Newer wealthy owners largely come from the tech sector and are far more diversified in their financial interests.

  • Elon Musk, owner of X (formerly Twitter).
  • Mark Zuckerberg, whose platforms—Facebook, Instagram, WhatsApp—reach billions.
  • Larry Page & Sergey Brin, whose Google and YouTube dominate search and video.
  • Jeff Bezos, owner of The Washington Post and Amazon MGM Studios.
  • Larry Ellison, whose companies are expanding into CBS, Paramount, and potentially CNN and TikTok.

Much of my own understanding of major news outlets has been come from reading books focused on the history of the New York Times and Washington Post. For example, my most recent read was Marty Baron’s recent book describing his personal history with the Washington Post (Collision of Power: Trump, Bezos and the Washington Post). I think it fair to suggest that journalism as an ideal is about accurately presenting the facts and there is a constant tension within the professional between this goal and pressures to interpret and motivate.

Recent analyses of online news traffic, ownership structures, and platform consolidation reveal a trend that should concern anyone who cares about democracy, transparency, and the free flow of information. So, are billionaires taking over the news media? The evidence increasingly points toward “yes,” though the story is more nuanced than simple takeover headlines suggest. How objective is the news that we consume and have the few who control what we consume biased what is available to the public?

Why Are Billionaires Buying Up Media?

The motivations vary and are speculative, but here are several of the proposals:

1. Influence, Not Journalism

Owning a media outlet means controlling—not just influencing—the agenda. Which issues get amplified, which voices get sidelined, and which perspectives become “mainstream” can all shift at the whim of ownership.

This happens both subtly, through editorial pressure, and overtly, through firings, policy changes, and platform algorithms.

2. Protecting Business Interests

Billionaires with vast non-media empires benefit from shaping political and public opinion.

A critical news investigation can spark antitrust scrutiny, regulatory action, labor pressure, or public backlash. Owning the outlet that might publish such investigations can conveniently soften that blow.

3. Political Leverage

When politics and media ownership mix, journalism suffers. Several media owners have cultivated close ties to political leaders—particularly U.S. presidents. This relationship can lead to:

  • favorable regulatory rulings,
  • advantageous business deals,
  • less oversight,
  • and more power.

The public rarely sees this influence—but journalists inside the newsrooms often do.

4. Prestige and Legacy

Historically, newspapers have been considered markers of influence and intellectual status. For many billionaires, buying a publication is as much about image and legacy as profit.

Journalism’s core purpose – to hold the powerful accountable – cannot thrive in an environment where the powerful own the press.

Who is at fault?

The unsettling part is that present trends are probably not as devious as might be assumed and are a result of the following:

  • failing local news revenues,
  • the collapse of newspapers,
  • tech giants becoming gateways to information,
  • and billionaires filling the vacuum because they could.

The result is the same: a public sphere increasingly shaped by private interests.

We all bear some responsibility if we rely on “free” social media for news and have given up our subscriptions to newspaper (even digital) and magazines. The combination of free in terms of money and less demanding in terms of the effort to read longer form content is a bad combination. Of course free isn’t really free. We offer our time and attention to those who provide information and we open ourselves up to the manipulation associated with displaying more ads and attention grabbing content fed to us by  algorithms designed to attract our attention. Our personal biases and motivations are fed by these algorithms rather than objective journalism. 

Of course, we are told to purchase national and local newspapers and read in general, but maybe this is too idealistic.

Try RSS Again

RSS (Really Simple Syndication) was popular in the early 2000s as a way for individuals to keep an eye on multiple sources such as blogs and news sites to see if those sites contained any new material. Instead of taking the time to go to each site to check, a news reader kept track for you and offered a way to scroll through a list of updates to select sites you wanted to revisit. You were in control of both the sites you followed and the updated material you took the time to view. 

RSS became less popular when Facebook, Twitter, and other social sites with feeds made it easier to find new content in their feeds, which featured what others found interesting and useful. However, it wasn’t really everything. Algorithms selected what appeared in our feeds and what appeared at the top. In a way, self-selection was replaced by algorithms. 

RSS readers still exist – e.g., Feedly, Inoreader, Reeder. I use a new service called Current. The issue is how such services are used. 

My Proposal

If the goal is to spend more time exposed to unbiased content, here is what I think makes sense. Identify sources based on solid journalism committed to a fact-first approach. I wondered if there was a way to avoid what might be my own biases or at least add solid sources to my personal biases. I decided to involve AI and I suggest others with goals similar to my own might want to take a similar approach.

Step 1: Prompt AI to identify the type of resource 

My Prompt: What are the best unbiased news services for national news in the U.S?

*********

The AI response

A practical way to get “unbiased” U.S. national news

No outlet is perfectly unbiased, so the most reliable approach is to combine:

  1. a straight-wire source (fact-first reporting), and
  2. a bias-comparison / aggregation tool (to see how different outlets frame the same story).

Best “least-biased / straight reporting” services (great for national U.S. news)

  • Associated Press (AP / AP News) — widely used as a baseline “just-the-facts” wire style.
    Sources: AP “About” (independent, nonpartisan), AP News
  • Reuters — another global wire service known for restrained, fact-forward reporting (excellent for politics, courts, and especially business/economy coverage).
    (Reuters is commonly paired with AP in “least biased” recommendations; see also aggregator lists like PureVPN’s list for how it’s often categorized.)

Best “see multiple perspectives” services (reduces single-outlet framing)

  • AllSides — shows coverage “from the Left / Center / Right” and provides bias ratings; helpful for avoiding echo chambers.
    Source: AllSides Balanced News
  • Ground News — compares how outlets across the spectrum cover the same story; useful for spotting omissions and framing differences.
    Source: Ground News

Best “public-service style” national news (generally lower heat, more context)

  • PBS NewsHour — often recommended for measured tone and interviews/context (not a wire, but typically less sensational).
    Mentioned in “least-biased” style lists like: PureVPN’s list
  • NPR — strong reporting and corrections culture; perceptions of lean vary by topic, but many people use it as a core national source alongside a wire.
    (Also commonly listed in “low-bias” roundups: PureVPN’s list; and discussed in evaluation guides like UAA/APU library guide)

If you want a “single app/site” that tries to be neutral

  • Straight Arrow News (SAN) — positions itself as “unbiased / straight facts” and includes meta-coverage tools.
    Source: Straight Arrow News

Quick starter stack (simple and effective)

  • AP or Reuters for your default daily read
  • AllSides or Ground News when something feels politically charged or confusing

If you tell me whether you prefer (a) fastest headlines, (b) deeper explainers, or (c) video, I can narrow this to the best 3–4 for your routine.

*****

Step 2: Create a convenient way to import these sources into the RSS Reader

It would be easy enough to take the list from Step 1, adding each recommendation manually. There is an easier way I thought might work given the coding capabilities of AI. 

My Prompt: Create an opml file to access these sources

AI response

I have created the unbiased_news_feeds.opml file for you. It includes the “Top Stories” and “National” feeds for the sources we discussed: AP News, Reuters, NPR, PBS NewsHour, AllSides, and Straight Arrow News.

You can download the file directly from the interface and import it into any RSS reader (like Feedly, Inoreader, or NetNewsWire) to have a single, organized feed of U.S. national news.

How to use this file:

  1. Download the .opml file from the chat.
  2. Open your RSS reader of choice.
  3. Look for “Import” or “Import OPML” in the settings or sidebar.
  4. Upload the file, and your reader will automatically subscribe to all these sources at once.

If you’d like to add or remove any specific sources, just let me know!

*******

Here is the content of the OPML file. 

<?xml version=”1.0″ encoding=”UTF-8″?>

<opml version=”2.0″>

  <head>

    <title>Unbiased U.S. National News Feeds</title>

    <dateCreated>Fri, 06 Mar 2026 12:00:00 GMT</dateCreated>

  </head>

  <body>

    <outline text=”Unbiased News” title=”Unbiased News”>

      <outline type=”rss” text=”AP News – U.S. News” title=”AP News – U.S. News” xmlUrl=”https://apnews.com/hub/us-news.rss” htmlUrl=”https://apnews.com/hub/us-news”/>

      <outline type=”rss” text=”Reuters – World News” title=”Reuters – World News” xmlUrl=”https://www.reutersagency.com/feed/?best-topics=political-general&amp;post_type=best” htmlUrl=”https://www.reuters.com/”/>

      <outline type=”rss” text=”NPR – National News” title=”NPR – National News” xmlUrl=”https://feeds.npr.org/1003/rss.xml” htmlUrl=”https://www.npr.org/sections/national/”/>

      <outline type=”rss” text=”PBS NewsHour – Nation” title=”PBS NewsHour – Nation” xmlUrl=”https://www.pbs.org/newshour/feeds/rss/nation” htmlUrl=”https://www.pbs.org/newshour/nation”/>

      <outline type=”rss” text=”AllSides – Balanced News” title=”AllSides – Balanced News” xmlUrl=”https://www.allsides.com/rss/news” htmlUrl=”https://www.allsides.com/unbiased-balanced-news”/>

      <outline type=”rss” text=”Straight Arrow News – U.S.” title=”Straight Arrow News – U.S.” xmlUrl=”https://san.com/category/u-s/feed/” htmlUrl=”https://san.com/category/u-s/”/>

    </outline>

  </body>

</opml>

If you want, you can copy and paste the OPML content that appears here. Save it as a text file ending in .opml – e.g., balancednews.opml. If you are already an RSS reader user or want to try one of the tools I listed above, all you need to do is import this source, and you will be following the news sites I follow.

To complete the process, here is what I would do with my reader.

Current offers several ways to add sources. In the image above, my existing sources appear (all education blogs). At the bottom, there is an Import OPML button that allows the AI-created OPML file to be uploaded.

Summary

It seems reasonable given the politicization of news to exercise greater control of the content each of us consumes. News organizations seem less independent. The RSS reader approach allows this control if the sources identified by AI meet the requirements I specified. Hopefully, the description offered here are sufficient to give others what is needed to duplicate my approach. 

Loading

AI reduces skill learning

When a technology offers advantages and disadvantages, the decision-making process can be quite complicated, especially when oversight cannot be guaranteed. For example, many states now ban cell phones, making a use such as telling parents when the schedule for after-school activities has changed difficult. The advantages and disadvantages vary with the field of application and my interests have mainly been focused on education. Just to be clear, by this I mean learning in general, not just the type of learning that occurs under supervision or is associated with educational institutions.

The generic educational situation that raises concern involves tasks undertaken to encourage both skill development and knowledge, and includes a requirement that demonstrates that the task has been attempted by the existence of some product. In educational settings, such products might result from homework or class activities, or simply by visible demonstrations of activity. The issue with AI is that in many cases, such as problem sets or documents of various types, these same products could be generated by AI, avoiding the cognitive activity of the learners. The phrase “cognitive offloading” has been used to describe this alternative form of product creation. Teachers might simply call it cheating. Cognitive offloading itself can be a desirable or undesirable option, requiring decisions regarding when it is appropriate and efficient, and when it is a detriment. 

While cognitive offloading to avoid learning tasks seems an obvious problem, little actual research exists to demonstrate the damage done. Some would argue that if technology can replace an activity and that technology is readily available, why bother to “learn” the skill in the first place? Why learn information if your cellphone can allow you to search for information when it is needed? Why learn basic calculation skills when you cellphone can also serve to do mathematical operations? There are responses to these challenges, sometimes offered by students or parents, but this analysis would take this post in a direction I did not intend. 

Here, I want to focus on learning to write and writing to learn by discussing a different learning task. This may sound unnecessary, but at present, there is a reason to take this approach. The justification for being indirect is that writing is a complex skill consisting of multiple subskills, and we learn to become competent at even a basic level over years and not weeks or hours. We are investigating an alternative to the traditional methods of instruction that can be subverted now, and we cannot rely on experience to help us evaluate and tease apart how the development of subskills are impacted. The insights and evidence of the potential damage done would take to long to emerge. As one perspective, consider the lingering impact of COVID on learning. What about the move to online learning did we not anticipate and what consequences are we still trying to mitigate?

AI in Learning to Code

Shen and Tamkin had an opportunity to investigate the impact of AI with adult programmers learning to make use of a new library. Think of a library as a collection of functions (tools to perform specific and commonly used tasks). Instead of having to write code to accomplish common tasks each time a programmer encounters a need, libraries allow programmers to call prewritten code snippets. It takes some work to make use of a library – what functions are available, how do you call the function you want, what inputs and outputs are involved and how are these integrated with the code you write yourself? The researchers recognized that the learning coders had to do to make use of a new library provided an opportunity to study how AI could help and hinder learning a complex process. 

Shen and Tamkin studied actual programmers as they worked to learn a new library. They suggested that the process be viewed as a tutorial including both background information and simple programming tasks. Programmers were assigned to a control and a treatment group, with the treatment group having access to AI. The learning phase concluded with an assessment evaluating multiple concepts and skills. Video of treatment group participants was collected to document how each individual used AI and worked on the programming exercises.  

The researchers found that the treatment groups did not differ significantly in the time spent learning, which they found surprising. On the post-test, the largest group differences were in debugging skills. Smaller skill differences were found for code reading and conceptual understanding. Those without access to AI made more coding errors on the practice tasks, spent more time practicing debugging, and ended up with better skills on the outcome evaluation. How AI was used differed greatly with some simply asking AI to solve the coding challenges and others who only asked higher-level questions of the AI tool. Some users had the AI tool solve the coding challenges and then retyped the solutions themselves (rather than copying and pasting). This was not an effective strategy. 

Generalizing from the coding study

I have spent considerable time both coding and writing and I have always found the processes to have similarities. While others may find this a strange observation, I have always said that coding and writing were the two professional tasks I learned I could not perform later in the evening if I wanted to get a good night’s sleep. Reading was fine. Grading was fine. Something about both coding and writing was cognitively stimulating, making it difficult to sleep. 

The application of AI to complex skills is interesting, but difficult to study. Clearly, a single skill would seem very unlikely to be developed if a learner could completely substitute AI for practicing the skill. However, it seems possible that learning a multiple-component skill such as reading or coding might benefit from replacing specific components with AI under certain circumstances. We have limited cognitive capacity and substitution for some components of a complex task could allow the remaining components to receive more attention until well learned.

Learning to write might represent an example. I have often referred to Flower and Hayes’ writing process model when describing the components of writing and writing to learn. The use of AI to offer content to provide the basis for a writing task and perhaps even to offer a structure to guide the organization of a writing product could free up capacity to focus on lower-level skills such as spelling, grammar, and coherent paragraphs. In contrast, I typically use Grammarly while I write to allow to move more quickly while relying on this AI tool to alert me to possible spelling and grammatical improvements. 

Part of what Shen and Tamkin observed in their qualitative observations of the different learner-imposed focus of AI and the relationship of differences to what was learned or not learned offers a related perspective. Debugging is an important lower level coding skill and having AI debug code appeared to limit a coder’s ability to debug when working without AI. 

Suggestions for Learning to Write and Writing to Learn

AI can support both “learning to write” (developing writing skill) and “writing to learn” (using writing to deepen understanding), but depending on which writing skills are the goal best practices should differ.

Learning to write: skill development

Here AI should be thought of as a coach, not a ghostwriter.

Emphasize feedback: Tools like Grammarly give immediate feedback on grammar, syntax, cohesion, and organization, helping students revise iteratively while concepts are still fresh.

Structure and separate subprocesses: Generative tools can help students brainstorm ideas, outline structures, or identify expectations for different types of writing (e.g., sample introductions, transitions).

Process?first policies: “Writing first, AI second” approaches ask students to draft independently, then use AI for critique and revision. When coders used AI in the Shen and Tamkin, this is the general theme that seemed most successful. 

Writing to learn: thinking with text

When the goal is conceptual understanding of content knowledge, AI is best used to amplify reflection, not replace it.

Clarifying concepts for the writer: Students can ask AI to reexplain readings, generate examples, or pose practice questions, then respond in their own words, using writing as a space to consolidate understanding.

Challenge personal understanding: AI can generate counterarguments, alternative explanations, or “what if” scenarios that students must address in writing, pushing them beyond summary toward analysis. Why do others disagree with the summary I am creating? What can I offer to support my position and what are the limitations of the alternative?

Shared design principles

There are some guidelines these goals for writing. Across both purposes, similar design choices matter.

Make process visible: Require artifacts – notes, outlines, draft histories, and brief process memos about when and how AI was used. Document the transition from any use of AI to products student has generated. 

Align AI roles with goals: For skills (learning to write), let AI focus on feedback, exemplars, and mechanics; for content learning (writing to learn), keep generative help outside the main composing space and treat it as a prompt.

Previous analysis of technology and the writing process

Sources:

Flower, L., & Hayes, J. R. (1981). A cognitive process theory of writing. College Composition & Communication, 32(4), 365-387

Shen, J. & Tamkin, A. (2026). How AI impacts skill formation. arXiv preprint arXiv:2601.20245 (this study has yet to officially be published)

Loading

AI, Cheating, and Writing to Learn

One thing I miss as a retired academic is going to the office daily and having the chance to share ideas on common interests. My background was in educational psychology and topics such as AI and learning would not only be relevant to me, but also to the people I had lunch with and passed in the halls. I would have been interested in my colleagues’ take on the pros and cons of AI in classroom settings. Were they concerned about cheating? Had they encountered students who cheated and how did they know for sure that their suspicions were justified? Had they modified the assignments they had always used or perhaps abandoned these tactics as untrustworthy? 

I still find myself thinking about such topics and despite no longer having firsthand experience, I wonder what I would do should I still be working. When something is that important in your life and self-view, it doesn’t leave you, and I cannot help but continue to explore such topics and share my findings and opinions through outlets like this. 

Beyond the internet, AI poses a tremendous challenge, with both its opportunities and its risks. Cheating obviously falls in the risks category. It challenges how accomplishments are evaluated and the results shared with learners and other interested parties (e.g., employers, those involved in competitive selection processes for limited-enrollment programs, the instructor in subsequent courses). It also poses a challenge to our efforts to craft assignments we are confident will contribute to student learning. If tasks are not completed as we assume, we cannot trust the markers we use to evaluate what students know, nor can we rely on them to guide our decisions about when to move on and what we can assume will make sense in new instruction. 

Without my colleagues, I now must rely more on what I can read or find online to form my own opinions. This is a difficult and relatively recent problem and little I would regard as proven seems to be available. There is plenty of advice and personal perspectives and folks willing to offer books on the topic. I might as well offer my own perspective on a specific instructional situation, since, at present, ideas focused on specific tasks in a specific type of classroom are the only ones I don’t immediately find myself arguing with. 

The Opposite of Cheating

I have been reading The opposite of cheating: Teaching for integrity in the age of AI (Gallant & Rettinger). It is well written and well referenced, but the type of source I find myself both rejecting and applauding when it comes to specific recommendations. Typically, a negative reaction stems from the impracticality of a suggestion given my own circumstances. I doubt it is reasonable I should expect authors to create a master model differentiating when a specific idea can be applied as that would add too much complexity and readers need to be active participants in finding what they should take from a resource. Anyway, this book made a point that sparked what follows. 

Writing to Learn

Written products played a significant role in some of the courses I taught. I assumed the products were a) an incentive to read the sources I expected students to read and listen to presentations I and students made, b) a way to demonstrate understanding and depending on the assignment consider applications, c) a task that involved the student in thinking in ways that led to understanding and retention, and d) a way to evaluate students. Having students write in isolation is one of those common tasks that has come under suspicion because of AI

Back to the “Opposite of cheating”. One of the authors’ general suggestions is to evaluate the process, not the product. I wrote a post some time ago making a very similar point. I think it helpful to explain why emphasizing what I would describe as subprocesses allows not only what might be described as surveillance, but also a superior instructional approach. 

Similarity to the strategy of showing your work.

    Yes, a requirement in what is probably math classes that you show your work was partially a check on whether a student had done the work, but just as important it was a record of the processing that was involved. A student and the teacher had access to the student’s externalized thinking. This visible record might be used by the student when the process breaks down and must be adjusted. It also provided someone else the opportunity to follow the student’s logic. The concept of externalized thinking has many applications for those who propose that cognitive research is useful to educational issues.

My long term interests in showing your work have focused more on writing and a specific application of writing often called writing to learn. Given a writing to learn task, assigned by a teacher or taken on as a personal strategy, a student could, of course, simply start writing or feed a prompt to their AI tool of choice. Here again, the “show your work” strategy can serve as both a check that you have done the work and a benefit to deeper thinking. 

I have been influenced by the logic and justification of advocates of personal knowledge management and the second brain. These concepts, when considered carefully, are clearly process-oriented: engaging purposefully and thoughtfully in specific processes benefits the products they produce, and externalizing processes that could be performed internally enables them to be performed more skillfully. I have long been interested in the Writing Process Model (Flower & Hayes) and variations. These researchers sought to develop a model that identifies the processes of writing and how the processes interact to create a written product. One benefit they proposed for such a model was the identification of component skills, allowing more efficient development of proficiency in individual skills. Identification of processes could guide both the topics researchers pursue and the instructional practices relevant to the classroom.

Connection with the topic of mitigating cheating

Let me start with this claim: an externalization requirement can serve both the purpose of ensuring that a process has been executed by a person and the educational goal associated with the assigned task. I think this works well when the goal is writing to learn.

I already indicated that writing to learn (or learning to write) can be broken down into subprocesses. Rather than relying on the Writing Process Model, allow me to offer a simpler approach for this situation.

In order to complete a writing to learn assignment, a student must:

Read the content

Identified what she felt are important ideas in the content

Processed this collection of ideas to understand and apply

I assume this is acceptable as a gross level description. If an educator relies on only the product turned in, with AI the educator must guess whether any of these tasks had actually been performed by a given student.

Those of us who make use of Personal Knowledge Management tools engage in these processes even though we are not accountable to an educator responsible for our skill and knowledge development. We do these things because we believe they deepen our understanding and strengthen our ability to craft better products.

We integrate a variety of tools while we read that would allow someone else to agree that we have in fact read.

Most of these tools involve highlighting and annotation as part of the reading process. The highlights and notes serve as an external representation of what we regard as important ideas in the content.

We then extract highlights and annotations from the original context so we can store and manipulate these elements more effectively. Having these elements separated and independent allows their long-term access and allows further processing such as linking, tagging, and secondary elaborations to occur. We value this growing and ever-modifiable collection as what has become popular to describe as a second brain that can be searched and explored for new insights and the generation of products.

The tools we use are ever improving and the skills in using these tools are being constantly scrutinized in search of greater efficiency and effectiveness.

The tools are there and it is easy to find free options. There is long-term benefit in learning to use such tools as skills relevant to lifelong learning. Why not teach these techniques to students and use the potential side benefit of accountability?

Hypothes.is as a starting point – try it you might like it

I first used Hypothes.is because I was interested in social note-taking with students. Simply put, this perspective argues that there may be benefits to a system that allows students to share notes. What did others find interesting or valuable in an assigned reading, and what might comments they made in response to what they highlighted as important reveal that others may not have considered?

This same tool could be applied such that an individual’s highlights and notes be available just to the instructor rather than the entire class. This covers “was it read” and “were ideas I thought important identified? 

The process for exporting from Hypothes.is works like this:

How to Export Annotations

Activate Hypothesis: Go to the webpage or document you’ve annotated and open the Hypothesis sidebar.

Open Sharing Menu: Click the “Share” button.

Select Export: Choose the “Export” tab.

Select Annotations: Use the dropdown to choose which user’s annotations to export (your own, a specific group, etc.).

Choose Format: Select your desired file type (e.g. HTML, plain text).

Export: Click the “Export” button to download the file, or “Copy to clipboard”. 

A screenshot of Hypothes.is in use. Hypothes.is is a browser extension so the content must be something online or something you can open in a browser (e.g., pdf). The content window on the left is where the reader highlights, annotates, and reads. The highlights and notes appear in the column on the right. 

Organize and Elaborate

At this point, I would now bring individual elements into a tool such as Obsidian, which I would not hesitate to introduce to college students. This tool is designed to store a large collection of individual idea notes, tag them, create links among them, and extend individual notes by generating secondary notes (elaboration). I raise this tool as an opportunity, not because there are no other options. Perhaps this mention of this tool will raise the curiosity of those willing to go a little deeper. 

There are other basic ways to do this. In the next stage before writing, you might open a document in any word processing tool and copy and paste individual notes or ideas from the notes or highlights into this document. As you proceed, you might cut and paste from this working document to better organize topics and integrate them into your final product. Even with the many personal knowledge management tools I use, I often take this simple approach when approaching the final stage of a project. I might cut and paste chunks of text and citations from the content I have accumulated into a common document. Often, this is not just about collecting ideas from a single source but bringing together ideas from multiple sources. I open this “collection” document in a separate word processing window and work from this narrowing of material into a draft of the product I am creating. 

Some writing tools even offer visible ways to do this. For example, Scrivener provides notes as note cards that can be moved around in a space to explore organizational options. Even if you do not intend to use a tool like this, visualizing the approach may be helpful. The “corkboard” option in Scrivener is shown below. Here you can see how individual project-related notes have been moved to this corkboard. The notes can be dragged around to create an optimal structure.

Summary  

This post focuses more on a concept for discouraging AI cheating more than on a detailed tutorial for using the tools involved. The core idea is that tasks can be assigned that are both beneficial for applying subskills to the writing-to-learn process and useful for documenting students’ completion of these subskills. I have identified specific tools and tactics, but there are likely alternatives for everything I have used as an example.

Source

Gallant, T. & Rettinger, D. (2025). The Opposite of Cheating: Teaching for Integrity in the Age of AI (Vol. 4). University of Oklahoma Press.

Loading

Newsela – A Follow-Up Look

From time to time, I take a look at a topic I was interested in, say 5 or so years ago, and ask what has happened since. Have classroom strategies that seemed to be enjoyable and productive survived and how have they matured? Here is an example of what I mean.

A decade ago, I was interested in the potential of technology for allowing greater individualization of instruction. My primary interest was in technology that allowed ideas from the 1970s-80s called mastery learning to become practical. Mastery learning proposed that group-based instruction largely ignored differences in aptitude and background knowledge, leading to frustration and learning challenges because the group advanced whether individuals were ready or not. To relate this to a widely recognized alternative based in technology consider the approach now allowed by the Kahn Academy. 

A different approach, maintaining more of a group-based strategy, was proposed by Newsela. This company argued that reading content (individual articles) could be presented at different reading levels allowing a class to read versions of the same material maintaining the opportunity for social opportunities such as class discussions. This approach made sense to me especially when applied to reading tasks that might be described as reading to learn – e.g., assignments in science, social studies, etc. The focus on informative content rather than fiction had obvious implications for present student learning and for the future. The following two images contrast the same content presented at different reading levels.

I wrote multiple posts describing Newsela and how it might be implemented. Others were offering similar observations.

Individualizing literacy instruction with Newsela (2015)

Layering Newsela (2017)

Not all good ideas work or are practical so I decided to follow up what is now a decade later and see how the company and the product seem to be doing. 

Adoption Level

It is difficult to get accurate information about student use. Newsela currently reports that it is used by 3.3 million teachers and 40 million students, the exact total it reported in 2016. Newsela has a lite and pro level and the lite level has attracted a lot of attention and occasional use. Occasional is a guess as I could not find stats on the level of activity. For some classrooms and individuals reading an occasional story would be a productive activity. I am assuming that the combination of those using the lite and the paid levels accounts for the differences in usage statistics that are reported.  

The paid version is better suited to using the tool as part of the curriculum. The startup’s paid product is between $6 to $14 per student. Newsela is sold at a rate of $6000 per school or $1000 per grade. Newsela estimates that gross bookings have grown 115% over the years of the pandemic, and that revenue grew 81%. More than 11 million students were using Newsela under a licensing agreement by the end of 2021.

The version of Newsela I described in my late 2010s posts has changed substantially. Newsela has significantly evolved in recent years to become more AI-driven, expanding both its suite of educational products and the ways users interact with its content and assessment tools. A secondary emphasis on writing has emerged. Usage trends reflect a shift toward greater integration of artificial intelligence and differentiated instruction, as well as changes in accessibility and assessment features for teachers and students.

Efficacy Studies

My tendency when advocating, or at least describing, an instructional strategy implemented through a commercially available tool or product is to search for published research that evaluates the approach I want to describe. The following are descriptions of two studies I located. 

WestEd (2018) Newsela efficacy study: Building comprehension through leveled nonfiction content.

Classes of fifth-grade students from two districts were randomly assigned to a Newsela or a Control condition. Reading instruction in the Newsela classes was modified to include at least two Newsela articles per week – one in class and at least one at home. Students in the Control condition relied on their normal reading curriculum. The study ran for 14 weeks and used the difference in STAR pre and post-performance scores as the dependent variable. Student compliance with the Newsela homework expectation varied widely, with 55% meeting the one-per-week expectation. When those meeting the expected level of engagement were compared with the control group, their achievement gains were significantly greater.

Literacy gains from weekly Newsela ELA use

This year-long study made use of differences in pre and post-MAP reading assessments as the dependent variable. The classes of third and fourth grade educators participated as Newsela and control conditions. The Newsela classes were asked to read at least two stories and take one multiple-choice test per week. Teachers in the control condition relied on their own selection of reading material with the largest source being content they had found through Google sources. Fourth-grade students, but not third-grade students, achieved at a significantly higher level in the Newsela condition. 

Why can’t I find peer-reviewed published studies

Often, I am frustrated when I cannot find studies that directly support the strategy I want to describe. This is the case with Newsela and I have been thinking about why this is the case.

Newsela has engaged outside agencies (e.g., WestEd) to conduct research using their products, but these studies are available as what I would describe as technical reports and don’t seem to appear in scholarly journals. After reading these reports I can see that if I had been asked to review the research for publication, I would also identify issues that would cause me to suggest that the study not be published. In the studies I will describe here, I see flaws in the research design that allow alternate explanations for the positive results. 

Applied research is often very difficult because those implementing the research have their own issues and priorities. Sometimes a methodology does involve tight controls from the beginning and sometimes it seems that original design is allowed to slip as unanticipated issues come up. 

For example, in the first study I describe, the plan was to have a control group and a Newsela group with one in-class and one homework reading assignment a week. It turned out that the homework assignment was ignored in many cases and to generate significant evidence that Newsela was productive the researchers compared those who did the homework against the control group. This may not be important, but it could also mean that the Newsela group now consists of more motivated readers than the control group, and this interest in reading, rather than the Newsela content and approach, was what created the difference in the development of reading skill. It is unclear to me from reading the description why expectations for completing the homework such as including completion as part of the grading scheme was not implemented. I can imagine a different controversy if what I propose was implemented as you would then extra reading required in the Newsela group and not in the control group. Perhaps the most ideal approach would be to maintain control of all of the reading assignments within the classroom setting so that the time allocated could be matched. 

The second study I have described is limited by what I would describe as clear identification of what is the intended independent variable. What has always attracted my interest in Newsela was the group-based, but individualized approach the content allows. Each Newsela document is available at multiple level (5) of complexity. This allows those readers at different levels of aptitude and skill development to read a variant of the same content so that discussion and a social element of instruction can be maintained. My personal interest in technology-supported learning has always been based on the potential of individualization. One argument some make about many technology applications that allow for differences in rate of learning is that students are isolated and miss out on the social benefits of a classroom setting. Newsela offer an alternative approach that maintains the social setting. 

This study creates a different or at least an added difference when comparing the Newsela group and the control group. The authors report that when teachers select the reading content for the control condition this material differs in category from the Newsela treatment. Teachers in the control condition were described as relying on Google searches to find content fitting with the topics that they covered and this content contained significantly less “nonfiction” content. A cleaner approach more consistent with what I think is the unique Newsela content would be to compare the impact of a single version of articles versus multiple versions of the same articles. 

Summary

As a commercial venture Newsela seems to be doing well. It has a solid base of schools that have committed to purchasing the program. My criticism of the weak methodologies used in evaluation efforts is mostly a function of my interest in the impact of the individualization efforts the resources provide. Having current and nonfiction content is important, but the strategy on which the company originally made its name has not been rigorously evaluated.

It now seems educators could use any of several AI tools to create similar content. Prompts such as rewrite this content at a level appropriate to fifth grade students could be applied to any content a teacher could upload. Given this option, the value to a district would depend on the time savings to teachers and the constant access to new content would be the advantages Newsela provides. 

Loading

Where is the thinking in the AI classroom?

The concept of generative activities has consistently shaped my thinking and teaching on learning. I admit that such activities are not ultimately necessary. Still, they represent ways for learners and those who try to help them grow to understand and imagine how skills and knowledge might be applied. Focusing on generative activities was particularly useful in my interest in studying – the work an individual does to make experiences personally informative and useful.

Basic Definitions:

Studying – the mental and external activities a learner engages in after exposure to potentially useful experiences that are intended to store a representation of these and create meaning.

Generative activities – external tasks intended to encourage productive cognitive (mental) behaviors 

Why is this perspective important at this time? My concern is that certain uses of AI are frequently being substituted for generative activities allowing individuals to accomplish tasks without achieving the cognitive benefits (i.e., retention, understanding) engagement with the generative tasks make more likely. 

Why would learners substitute AI for generative activities? It seems likely they see AI as producing an equal or even superior product without the effort required to create such products on their own.  This reflects both a focus on short-term benefits over long-term benefits and probably a lack of understanding of how personal knowledge and skills are developed, or perhaps even a disinterest in developing these personal attributes.

Some background:

When I explain the concept of generative activities I like to start with Rothkopf’s concept of a mathemagenic task because this researcher’s focus tends to make intuitive sense to most people. Rothkopf was interested in questions and variations in how questions might be associated with written material. 

Questions presented before you read. 

Questions presented after you read. 

Inserted questions – questions added within text. 

Different types of questions – application questions, factual questions. 

Mathemagenic tasks

The made-up word mathemagenic translates roughly as giving birth to knowledge, implying that in attempting to answer questions, you might accomplish something else – a better likelihood of future retention, greater likelihood that you would recognize possible applications – that would not have occurred without exposure to the questions. My favorite example relates to the challenge educators often face in encouraging students to see the relevance of general concepts they have been taught. This translates as connecting new ideas with what you already know. The examples and the relevance are potentially there if you can make connections. So, what not ask students directly – provide an example of XXX? If personal examples exist, but learners have not made the effort to make the connections, perhaps the request will encourage that specific cognitive effort. 

There is a huge body of research on all aspects of questioning. Questions are an everyday classroom activity, but the insight is just why do we spend the time, and could a more careful use of questions result in improved results? My favorite example here is what is called wait time – the average delay after asking a question (silence to allow thinking) is a little over a second. If we want students to think, typical behavior in classroom discussions is not particularly rationale. There is reason to examine and challenge typical behavior.

Anyway, questions are an external task that can be used to manipulate – change the odds of – productive cognitive behaviors. I suggest adding one important final point: a learner can ask herself questions, e.g., using flashcards. So various ways in which questions can be generated and used are an aspect of what those interested in study behavior investigate. 

Generative Tasks

The concept of generative activities is simply an expansion of this same idea and asking questions would be one of many generative strategies. The idea of generative activities is not new (Wittrock, 1974, 2010) and to many educators may seem obvious and a reflection of common classroom practices. While true, researchers have attempted to understand the underlying mechanisms and to consider just how efficient different activities were especially in the comparison of one to others ( Fiorella & Mayer, 2016). A personal interest and one clearly relevant to the topic of how AI is applied in classrooms is writing to learn. I have always felt through self awareness that requires careful examination of existing ideas and integration of ideas from a variety of experiences to produce a product. There is a substantial body of research to support such perceptions (e.g., Graham et al., 2020). To be clear, researchers consider a variety of writing activities under the umbrella of writing to learn. The product need not be a massive, semester summarizing paper, but perhaps also notes and short, five-minute end of class descriptions related to the content just presented. 

Caveat

One issue I think is important that may not be apparent in the notions that generative activities are intended to encourage productive cognitive skills is that such skills may occur without this external requirement and guidance and there is always the possibility that for some motivated and capable of thinking deeply, without such tasks, the task represents a form of “busy work”. In other words, the task adds little beyond annoyance. Of course, the reality is that educators in actual classrooms typically do not feel that they can arbitrarily assign tasks to some students and not others, so they must always deal with reactions to assignments, both legitimate and resulting from laziness. 

AI and Generative Tasks

AI discussions related to education always seem to generate a good news / bad news situation. There seem to be several examples that apply to this general topic.

AI can be applied to render the potential benefits of a generative strategy useless. For example, if AI is used to respond wholly to a writing-to-learn assignment, the learner completes the assignment without engaging in much cognitive work. The educator is then in a position of assigning a task that takes valuable learning time and adds a commitment to the effort to provide feedback, but has little impact. 

In contrast, AI can be used to formulate questions (both objective and open-ended) related to assigned material and to respond to a learner’s responses to such questions. Learners can even generate such activities on their own.  It seems to me that the use of what might be described as short essay questions offer a unique advantage that would be difficult or at least very time consuming for the educator to administer. AI tools are very flexible and can ask and react to the answers for different types of questions. Short answer questions are a form of writing to learn and involve greater “retrieval practice” benefits than formats such as multiple choice that are useful, but less demanding of retrieval. 

Summary

My effort here was intended as a way educations might frame their way of thinking about AI in classrooms using  examples I assume are familiar. I hope this approach can be generalized. Of course, the challenge is in manipulating AI-based and any assigned activities so that productive thinking activities are encouraged and also that students gain insight into the importance of the mental work that is required of certain task. I understand this may seem obvious, but the work of adjusting to the advantages and disadvantages of AI tools will take some time and careful study. For example, I wonder if writing and organizing notes may accomplish much the same benefits as creating a writing to learn product. Learning to write is somewhat different than writing to learn although writing across the curriculum offers a secondary benefit of practicing writing skills. There are plenty of options to consider. We presently do little to teach advanced note making skills and note using skills even though these topics have received a great deal of attention as benefits to out of school functioning. 

Citations

Fiorella, L., & Mayer, R. E. (2016). Eight ways to promote generative learning. Educational Psychology Review, 28(4), 717-741.

Graham, S., Kiuhara, S. A., & MacKay, M. (2020). The effects of writing on learning in science, social studies, and mathematics: A meta-analysis. Review of Educational Research, 90(2), 179-226.

Rothkopf, E. Z. (1970). The concept of mathemagenic activities. Review of educational research. 40(3), 325-336.

Wittrock, M. C. (1974). Learning as a generative process . Educational Psychologist, 11(2), 87–95. https://doi.org/10.1080/00461527409529129

Wittrock, M. C. (2010). Learning as a generative process. Educational Psychologist, 45(1), 40-45.

Loading