Bloggers love metrics. Top 10 lists, unique visitors, comment counts – how’s my blog doing? Numbers might seem easy to understand at a glance, but it can be hard to translate those numbers into stories. And people thrive on stories — what is blogging, after all, but storytelling?
What we really want to figure out is engagement. We want reassurance that we’re not just shouting into the void. Who are we reaching, and what do they think? But most metrics out there only represent individual slices of information, and they only give you numbers, not stories. AideRSS changes that.
At AideRSS, what interests us is social engagement. When content is published online, how are people interacting with it? Reading, sharing, discussing, critiquing — analyzing those forms of engagement gives a true indication of social relevance and influence.
Interests and ideas are great, but our lab is where interests and ideas have to prove themselves. Will it work? And, if it does, how does it help people?
To launch this experiment in measuring social engagement, I needed some starter data. Ideally a set that was well established, not too big, but could still provide some interesting comparisons.
As a Community Manager, the obvious choice was The Viral Garden’s Top 25 Marketing & Social Media Blogs. Mack Collier has been compiling the list for over two years, so it’s well established. Top 25 feels a bit meatier than Top 10, and because I and others in the community tend to be very familiar with the those folks and their work, I suspected some of our results could be very interesting when compared to Mack’s rankings according to Technorati stats (which only measures links in to each site).
So how did I go about it? With our custom-designed API — sorry, hasn’t been publicly released yet — I analyzed each feed, which accomplished the following:
- counted number of posts published in each of the last two months (so essentially for May and June)
- counted numbers of each type of engagement we analyze, e.g. 200 clicks, 5 comments, 12 trackbacks, etc.
- weighted each engagement type for level of engagement
- added up the engagement scores for all engagement types for all blog posts for each month to calculate an overall engagement score for each month
- calculated an average engagement score based on dividing total engagement score by number of posts per month
- calculated the percentage increase or decrease in engagement for the blog’s content month over month.
And so, without further ado, the results of the analysis…
AideRSS Enagement Ranking (PDF) Detailed Engagement ranking for May-June 08 (Size: 153.4 KB)
The results do differ from the Top 25 list. Seth Godin’s “no comments’ policy isn’t hurting him at all, in fact it’s driving the more heavily weighted forms of engagement. And, perhaps, ultra-frequent blogging doesn’t necessarily help you engage better with your audience.
Fortunately, PostRank analysis of your blog posts can help you see which ones result in the most social engagement online, allowing you to better target content that really resonates with your audience.
As always, we’d love to hear what you think — questions, comments, functionality you’d like to see? Feel free to leave a comment, email me, or ping me on Twitter: @melle or @aiderss.




18 Responses
Marshall Kirkpatrick
July 8th, 2008 at 12:31 pm
1This is an interesting list and a great exercise in social media marketing as well! If you displayed those bloggers’ names as text instead of in an image they would show up in ego searches and be clickable though. A trackback to their most engaging recent post would also be very effective. What do I know, though, am I on that list? No! lol, good stuff as always though AideRSS folks!
Melanie
July 8th, 2008 at 12:44 pm
2Thanks, Marshall. There were definitely a lot of suggestions and “what ifs?” thrown around internally before we set the parameters of this experiment, but since we wanted to get it out the door before next year, we had to stop somewhere and leave more excitement for the future. :)
Rest assured there’ll be much more on this subject from us!
And as for your “cred”, had you been on the list, based on the overall engagement for marshallk.com, you’d be… #17. w00t! (Jim was just talking about how in the future we’ll have to run stats and show who should make the list.)
How engaged are your readers? Do you know? Soon aideRSS will give you the data soon
July 8th, 2008 at 4:31 pm
3[…] Jim Murphy hinted in his comment on yesterday’s post about aideRSS that cool stuff was coming soon, like really soon. Well I bugged Melanie until I got something. It’s a cool something too: a proof of concept of an “engagement score” for blogs and posts.: What we really want to figure out is engagement. We want reassurance that we’re not just shouting into the void. Who are we reaching, and what do they think? But most metrics out there only represent individual slices of information, and they only give you numbers, not stories. AideRSS changes that. Source: Storytelling ROI: social engagement metrics for Marketing & Social Media bloggers - AideRSS Blog […]
Karl Long
July 8th, 2008 at 7:52 pm
4OMG when is this API coming out, I love this measurement concept. BTW does it track http://disqus.com/ comments?
Ilya Grigorik
July 8th, 2008 at 10:16 pm
5Karl, we do track Disqus comments. For the API, we don’t have a public release date yet. At the moment, we’re still gathering user feedback and ideas for how it should look like.
Hence, any tips or ideas, would be much appreciated!
Brian Clark
July 9th, 2008 at 11:42 am
6This is a very interesting perspective beyond standard metrics. Glad to see Copyblogger hanging on to third. :-)
AideRSS Takes a Stab At Measuring Engagement | chrisbrogan.com
July 9th, 2008 at 1:30 pm
7[…] Interesting post from AideRSS’s community manager Melanie Baker about how blogs measure engagement. I was ranked #1, and for that, I’m grateful, but I’m still working out the logic and thinking about what she had to say. Melanie’s right, though. Bloggers love metrics. Why? Because most of us don’t get paid to write. We do it for love and the desire to connect. Metrics tell us whether we’re connecting. […]
Ryan Moede
July 10th, 2008 at 8:33 am
8This is a solid engagement measurement - nice work. I’ll be looking forward to the release of the API!
Uncategorized | AideRSS Takes a Stab At Measuring Engagement — Recycle Email
July 10th, 2008 at 9:55 am
9[…] Interesting post from AideRSS’s community manager Melanie Baker about how blogs measure engagement. I was ranked #1, and for that, I’m grateful, but I’m still working out the logic and thinking about what she had to say. Melanie’s right, though. Bloggers love metrics. Why? Because most of us don’t get paid to write. We do it for love and the desire to connect. Metrics tell us whether we’re connecting. […]
Marji Chimes
July 10th, 2008 at 11:07 am
10This is great for activities in which the reader does something. But what about all of the folks out there that are just reading the conversations. Sure the bookmarks help — but lots of people don’t know how to use bookmarks yet…
Melanie
July 10th, 2008 at 12:14 pm
11Hi Marji,
Those more passive interactions (clicking, reading, etc.) go in the “Clicking” category of our 5Cs of analysis. We try to do our best to record all interactions, even if they aren’t the more public or visibly interactive.
Sally Falkow
July 10th, 2008 at 12:49 pm
12Sounds great - and well done to Chris for being #1. Well deserved
I’d love to see what kind of engagement score we’d get on the Skin MD natural feeds.
Drew McLellan
July 11th, 2008 at 8:33 am
13This is fascinating. Going to blog about it soon! Congrats on the good work!
Drew
Problems With Blog Metrics And How To Solve Them | Shaun Low
July 15th, 2008 at 8:19 am
14[…] site yet, you need to check it out. A great place to start is with Melanie’s blog post where she remixes Viral Garden’s list of Top 25 marketing bloggers in order of “social engagement.” Also, in case you’re curious, here’s […]
Mamod
July 16th, 2008 at 6:08 am
15Wow, I wasn’t aware of such new important thing being cooked at aideRSS, guys you’re awesome, this is really gonna change the whole blogging metric definition.
I can’t wait to see the release of this new engagement metric API, I have already plans to integrate with my service, really awesome, keep up the great work.
Barb
July 21st, 2008 at 2:22 pm
16Very basic question–
Step #3 = “weighted each engagement type for level of engagement.”
Weighted HOW–what constitutes the deepest/highest-value level of engagement? A click or a tag is less work than a comment, I assume, but I’d be very interested in seeing the rank-order listing of engagement types.
Melanie
July 21st, 2008 at 2:30 pm
17Hi Barb,
Weighted according to what we call the “5 Cs” — more information about that on our PostRank site.
Any additional questions, let me know.
ArabCrunch
August 4th, 2008 at 6:21 pm
18hey this is a great service, can you get posts views, and post links over the web besides social media. if yes how will u get them?
i just mentioned AideRSS in my post:
http://arabcrunch.com/2008/08/feedoor-burns-feedburner-in-a-number-of-new-features.html
@ Melanie Baker: i saw your comment ( http://feedoor.com/blog/?p=16 ) promising to add Feedoor integration with AideRSS API to your mashups page, i could not find it, can you send me the link plz?
RSS feed for comments on this post · TrackBack URI
Leave a reply
Links
& RSS updates
Team Flickr Stream
Home Blog API About FAQ Feedback Contact Media
Privacy Terms © 2007-2008
Powered by WordPress - BloggingPro theme by: DesignDisease