Study: AI-Edited Email Newsletters Beat the Ones From Human Editors

When discussing the jobs soon to be taken over by AI, critics often claim that some jobs simply can never be automated. If you’re a graphic designer, for instance, you require a human touch that a machine can never replicate.

It appears that it’s time to move a “content editor” position away from the only-for-humans pile of jobs and into the rapidly growing “AI” pile. A new study has indicated that AI-edited email newsletters are opened more often, hold more clickable links, and receive a lower bounce rate than those edited by humans.

The Study

The Donald W. Reynolds Journalism Institute published the findings, which paired metrics from the Austin American-Statesman‘s editor-curated newsletter, Midday Break, with a newsletter powered by news personalization technology Reportory. The researcher accounted for variable factors by designing this similar newsletter, titled “Austin American-Statesman’s News for You.” Here’s the methodology:

“We kept both platforms running for six months, delivering emails at noon each weekday. Midday Break delivered the same editor-selected stories for all users. News for You provided a unique set of articles each day to each user based on the preferences they indicated.”

The results? The AI newsletter saw a 74.85 percent open rate, a 14.47 percent click rate, a zero percent bounce rate, and a 0.11 percent unsubscribe rate, while the human-powered newsletter garnered a 38.02 percent open rate, a 4.56 percent click rate, a 0.11 percent bounce rate, and a 0.02 percent unsubscribe rate. Though the human-edited newsletter saw fewer unsubscriptions, it lost to the AI-edited version in the other three metrics.

What It Means

To be fair, the human-edited Midday Break had been around for far longer, which means it may have had the time to attract subscribers apathetic enough not to open the emails or click their links. But the significant advantage that the AI newsletter held in those areas certainly indicates that AI isn’t worse than human editors, which ought to make it look appealing to a struggling journalism industry.

The power of automation can be easy to ignore, particularly if you’re Treasury Secretary Steve Mnuchin, who said last Friday that a loss of jobs due to automation is “not even on my radar screen” because AI tech is “50-100 more years” away. But as studies like this email newsletter test indicate, automation is already proving that it can quietly slip into many different areas of our life.

Did you find this article helpful? Click on one of the following buttons
We're so happy you liked! Get more delivered to your inbox just like it.

We're sorry this article didn't help you today – we welcome feedback, so if there's any way you feel we could improve our content, please email us at contact@tech.co

Written by:
Adam is a writer at Tech.co and has worked as a tech writer, blogger and copy editor for more than a decade. He was a Forbes Contributor on the publishing industry, for which he was named a Digital Book World 2018 award finalist. His work has appeared in publications including Popular Mechanics and IDG Connect, and his art history book on 1970s sci-fi, 'Worlds Beyond Time,' is out from Abrams Books in July 2023. In the meantime, he's hunting down the latest news on VPNs, POS systems, and the future of tech.
Back to top