is the best AI-generated tool for PR content creation? //
Have you ever wondered what the best AI-generated tool is for creating PR content?
I just completed a series tests to find out. The post generated by Bard:
- A post that I wrote from scratch produced slightly better outcomes than a post.
- Significantly Better results than ChatGPT.
- Dramatically Better results than Claude 2
This article provides more information about the tests, and the surprising result that we didn’t expect but which outperformed the three leading chatbots in the industry.
Test the best AI-generated tool for PR content
In August, Katie Delahaye Paine and I posted four posts to Facebook, LinkedIn, and a blog on consecutive Fridays.
Each post talked about our new course for PR and Communications professionals who want to improve their metrics, and use Google Analytics 4 to demonstrate their value.
I wrote my first post without any help from an AI bot. Then I went back and edited posts generated by an AI chatbot on the same subject.
- OpenAI has developed GPT-3.5, a language model powered by AI.
- Google has developed Bard, an AI collaborative tool.
- Claude 2 is a next generation AI assistant based upon Anthropic’s research.
Google’s Campaign URL Builder is a free tool that allows you to add parameters for campaigns to URLs. This was done at the end of every post, in the “call to action”.
This allowed us to measure our campaign objectively in GA4 as we could track which PR content brought more users to the landing page of Paine Publishing’s website.
While we were analyzing our GA4 tests, we also discovered a much larger surprise that is 15 times more valuable for PR and communication professionals.
Three AI-generated posts from a human-written story
Let’s take a look at the way the posts were generated before diving into the test results.
Human-written content as the baseline
First, I determined that we needed a baseline. I then wrote a 1,150 word chronological narrative entitled “Why Digital PR professionals need to know about Digital Analytics?”
This post contains four case studies that have won awards.
- SEO-PR and Southwest Airlines attributed $2.5 million of ticket sales in 2005 to four optimized press releases.
- During the Great Recession, SEO-PR and SES Conference & Expo put “butts on seats” during a number of events.
- In 2013, SEO-PR, Get City Dealz and other affiliates drove a 85% increase of referral traffic from January to February.
- SEO-PR generated 27% leads in 2019 for a new master’s online program.
Then I posted this article on my blog one Friday afternoon, and then reposted it on my LinkedIn and Facebook pages on subsequent Friday afternoons.
ChatGPT – GPT-3.5
Next, I used ChatGPT powered with the GPT-3.5 to write a blog post entitled “Elevate your PR Game with Google Analytics 4” (GA4).
When I read the first draft I thought it was a bit too cheerful. The headline read:
- “Hello fellow PR and communication enthusiasts!” Are you ready to move your campaigns and programs forward? “Welcome to your secret weapon, Google Analytics 4”
ChatGPT then generated a listicle of 500 words that listed five reasons GA4 is “a game-changing” tool. It also produced these snappy headlines:
- Precision and insight.
- Short-term wins, long-term growth.
- 360-degree attribution.
- Privacy of data is a priority.
- You can set yourself apart with a skill.
ChatGPT created a listicle after I asked it:
- Write a Facebook Post that explains how PR and Communications professionals can benefit from learning to use Google Analytics 4 to measure the success of their short-term and ongoing campaigns.
It generated another listicle even after I revised the prompt that asked OpenAI’s AI-powered language models to “write a LinkedIn Post”.
The language model may have been optimized using Reinforcement learning with human feedback (RLHF) to achieve the results that it was designed to produce.
On a subsequent Friday, I posted this article on my LinkedIn page and my blog.
Bard
Then I used Bard for a draft of a blog post entitled “Why PR and Communications Professionals should learn GA4?”
When I read the draft I was surprised that it used a spiral to generate 550 helpful words.
The spiral method is a teaching technique that involves returning to a topic or skill at regular intervals and each time on a higher level.
The spiral method uses an inverted pyramid structure in order to place the most important information in the first paragraphs of a post.
- Google Analytics GA4 is the next generation of Google Analytics.
- GA4 is more powerful that UA.
- GA4 is more privacy focused.
The following paragraphs provide more details.
- You can track your earned media with GA4.
- GA4 can help you identify your target audience.
- You can track your campaign’s success over time with GA4.
This shows that Bard’s course reflects the latest Google algorithm update. Barry Schwartz discussed this in Google September 20,23 helpful content system rollout.
Prior to this month’s update the previous guidance had stressed:
Google Search’s system for helpful content generates a signal that is used by our automated rankings systems to ensure that people are shown original, helpful content created by people and for people in search results.
In the updated guidance, “create helpful, reliable and people-first content“, it has been deleted that the content is written by people.
Google has updated its guidance and revised one of the questions creators can ask to “gauge whether the content they’re creating is helpful and trustworthy.”
Google has added the word “or reviewed” in the question “Is the content written , or reviewed, by an expert who knows the topic?”
I added a final paragraph and used Google’s Campaign URL Builder for campaign parameters.
I posted it on Facebook on a friday afternoon, and then reposted it on my blog and LinkedIn on subsequent Friday afternoons in order to compare results.
Claude 2
Finaly, I used Claude to write a blog post about the same subject, entitled “Why Should PR & Comms Professionals Use Google Analytics 4?”
When I first asked the next-generation AI Assistant to do something, it initially failed.
- Write an article of 1,000-2,000 words explaining why communication and PR professionals should use Google Analytics 4 to measure the success of their campaigns.
The article was 497-words long.
Claude 2 responded by generating “an expanded version of the article” that was 1,193 words in length. However, this article was only 550.
Then I asked Claude:
- Write a post on social media about why professionals in PR and communication should use Google Analytics 4 to measure their campaigns or programs. Use a Q&A format.”
The next-generation AI assistant created a Q&A of only 325 characters, with five questions and short answers. As an example:
Q : What key metrics are available with GA4 PR?
GA4 connects data across marketing channels. GA4 connects data across marketing channels.
Google reduced the visibility of content that featured Frequently Asked Question (FAQs), I knew this. It happened in early August. But I was curious to see if Claude 2, the new version of Claude, could handle it.
As with the two previous posts, I’ve added a final paragraph and have used Google Campaign URL Builder to include campaign parameters in the URL.
On the last Friday in August, I posted this blog post, as well as my LinkedIn and Facebook pages, to my blog.
This may have resulted in apples to oranges.
Analyzing results
We found the information we were looking for when we analysed the landing page report of GA4:
- The 550 word spiral post, drafted by Bard with the help of eight users.
- The 1,150 word chronological story , written from scratch, generated seven users.
- The 500 word listicle, drafted with ChatGPT, generated five new users .
- The 325 word Q&A, drafted by Claude 1 with the help of one new user .
We also observed that direct users generated 122 conversions, and three new users.
I did a Google search for “link:https://painepublishing.com/training-education/ga4-for-pr-and-comms-course/” – which is an old SEO technique to find a sampling of links to any site.
I was shocked to find that the second listing, after the landing page of Paine’s site, was a LinkedIn post titled “Katie Delahaye Paine’s Post.”
The landing page was directly accessed when I clicked the image at bottom of this short post.
Paine’s image, which he had turned into a linkable image, was the content 15 times more valuable even than the Bard post.
There are several ways to link an image. Click the image in Word and choose “Link”. Enter the link address in the “Address field” by typing or pasting it.
You can add parameters to your URL using Google’s Campaign URL Builder. This will allow you to use GA4 to track the contribution you make to the bottom-line.
A picture can be worth a thousand or more words, even if they are created by an expert who is familiar with the subject or the three best AI tools to generate PR content.
The post Which is the best AI-generated tool for creating PR content? first appeared on Search Engineland.