Web Analytics Blogs

Judah Phillips is an experienced web analytics practitioner and Internet expert currently working as a Director at a large multichannel media company. His blog is full of useful, unbiased, actionable insights learned from the real-world practice of a process-oriented, integrated approach to strategic Web Analytics for improving business performance.

Subscribe to Judah Phillips weblog

Questions to Ask When Assessing Web Analytics and some Random Thoughts…

At some point in the career of a web analyst, you will be asked to investigate, assess, and possibly judge the current state of how a company “does” web analytics.  What are some of the areas you should ask about?  Here are some thoughts and a few questions to ask to help inform your analysis (and grease your mental gears):

  • Business strategy.  Why does the organization do web analytics?  What’s the goal of having a web analytics team?  Who defines the strategy?  What is the strategy?
  • Analytics organization and team structure.  Who is the chief owner of web analytics?  What does the analytics team look like?  How has the team structure been formalized in the organization?  Is the web analytics team effectively staffed and have enough control over resources to do the job?
  • Process.  What analytics processes have been defined?  How does a site or site feature progress from not being measured to being effectively measured?
  • Data collection. What methods for data collection are being used?  How much data is being collected, and for how long is it stored, and at what level (i.e. detail, aggregate)?
  • Reporting.  What data is reported?  What do the reports look like?  Who creates them?  How are they distributed, and in what format?  To whom?  When?  How?
  • Analysis.  What’s the difference in this company between reporting and analysis?  How is analysis communicated to stakeholders?  When?  How?
  • KPI’s.  What Key Performance Indicators are you measuring?  How are they relevant to the business?  What actions have people taken from KPI analysis that improved business performance?
  • Segmentation.  What audience and customer segments exist?  What audience and customer dimensions and attributes are segmented?  Why are they meaningful to the business?  What has the business learned and what action has been taken from the current segmentation analysis strategy?
  • Technology.  What analytics technologies are being used?  What does the schema for web analytics look like?  What homegrown technologies are used?  What external technologies have you bought or deployed for analytics?
  • Integration.  How is web analytics data integrated with other internal and external data?  Is it integrated with other systems, how? 
  • Site Optimization.  Does the company test landing pages, and/or use AB or Multivariate testing software?  If so, whose software, and what business gains have been realized?
  • Advertising/Advertisers. How is analytics used to inform or enable advertisers and advertising?
  • Privacy.  What safeguards does the company take in protecting analytics data? 
  • Qualitative Data.  Is qualitative data contextualized with web analytics data? Do you capture voice-of-customer data?  Use Net Promoter Scores?  Have a research department?  Does web analytics collaborate with research? 

Those are just a few questions to ask.  Many others can be asked.  What would you want to know, and what would you ask?  Please leave a comment.  I’d love to hear your thoughts.

Now for some random thoughts:

  • News from Orem.  API / Fusion / Video Tracking… cool.  I’m pretty psyched that Omniture announced a web services API.  That’s fantastic, and confirms how truly important integration is now and will be in the future for analytics data (as I’ve been saying for years… Google will be next). 

Omniture has announced a new methodology, Fusion, and improved capabilities for tracking video.  All sounds very exciting.  But, like Eric, I’m wondering what revolutionary new methodology Fusion really is?  Or is just what Eric’s been saying for the last 4 yearsbranded by Omniture and delivered by the Great Belkin? 

Regarding the video capabilities, I haven’t seen a real demo yet, but I wasn’t immediately impressed with what I saw on my friend Marshall’s blog.  Instead of quartile tracking, it seems like you track the playhead (the part of the video playing) across audience aggregates in increments of one-twelfth, and you get some bubbly visualization (what would that look like with 10,000 videos on your site?), and better access to forums.

I’m hoping I haven’t seen the whole ball of wax, and I look forward to Omniture giving me the grand tour. 

But for a playhead visualization, I was much more impressed with what I saw from Visible Measures and their engagement curve.  And what the heck are those folks at Divinity Metrics up to for measuring video? 

  • News from Novato.  One of my favorite gangs of web analytics folks reside in Northern California.  My colleagues at Semphonic have just released a rather impressive “Omniture Implementation Toolkit.” 

I was able to procure a copy, and I’m totally impressed.  It’s full of hard-learned and hard-earned real world practitioner knowledge.  If you are trying to implement Omniture, it is well worth the money. 

Now I’m not sure if this document competes with or acts as a companion to Fusion.  All I can say is that I know the folks at Semphonic are smart, savvy, and very experienced, and there are thousands of Omniture customers out there who could benefit from this document.

  • X Change Conference.  I am totally excited for X Change brought to us this year by Semphonic and Web Analytics Demystified.  The last X Change in Napa at COPIA was one of the most intimate, educational, stimulating, and enjoyable conferences that I’ve been too (and did I mention the wine?).  It was pure “class” all the way (in both the sense of style and learning, and did I mention the wine? ;-). 

This year attendance is limited to 100 folks (99 if you count me ;).  Last year, I huddled on “Deploying Measurement Systems in Globally Distributed Enterprises.”  

If you aren’t familiar with X Change or Semphonic  check them out, and make sure to read a few of my favorite bloggers - the prolific deep thinker and expert Gary Angel, the always impressive (and fun) June D(ershewitz), and bright author and web analytics veteran, Phil Kemelor.

admin added the following ...

Judah: Great post! I gotta say I’m looking forward to seeing you back at X Change and thanks for the props. I’m not sure I even bothered to ask you before I put you on the list of huddle leaders but I’m glad to see you’re already thinking about it!

E.

Heather Solice added the following ...

There is no need for Visible Measures. Just use Omniture, they do Flash, Windows Media, and Quicktime to name a few. They also do website analytics, so it is a complete package. Then you need divinity Metrics for online video. They measure things OUTSIDE of our site. So both are key.

Judah added the following ...

Eric: Thanks. :-) I’m looking forward to huddling at the Ritz. You did ask, back in Boston (Celtics). :-)

Heather: That’s an interesting take and strong stance! Why do you think that? It would be awesome if you could expand on your thoughts. :-) What if you’re not using Omniture? Why is there “no need” for Visible Measures? You mention that “both” are key (on-site and off-site measurement), and I agree (see my post on “How are you going to measure Internet Video?”).

As I understand it, Visible Measures is all about measuring audience behavior OUTSIDE of the web site for both publishers and advertisers to identify consumption and syndication patterns, top performing content, and interaction with the video player. Divinity Metrics also measures off-site video consumption in the context of “brand,” but I do not belive DM measures instream audience behavior as deeply as Visible Measures.

Omniture’s video capabilities, on the other hand, measure on-site video consumption with an emphasis on being able to identify clickstream and conversion of segments of video consumers (what I call outstream video metrics) and how on-site visitors interacted with the video instream.

That’s certainly useful, but most other analytics vendors also provide on-site video tracking capability from which you can create segments of video viewers to understand their clickstream and conversion, but such vendors do not provide the instream metrics or playhead tracking, which in Omniture’s case seem rudimentary, and perhaps better delivered by partnering with Visible Measures or Divinity Metrics (or maybe even NedStat, TubeMogul, Streametrics, or Traackr). My opinion is still open, and I’m looking forward to digging deeper into Omniture’s offering and furthur watching this hot emerging measurement niche. Thanks for commenting. :-)

Vishal added the following ...

Hi Judah,

Great post, love reading your blog and your thoughts on Web analytics. We are an online video measurement firm providing technology that enables marketers and advertisers to locate critical audiences on online viral video platforms like YouTube, MySpace and engage them with video content.

You have mentioned us quite a few times in your post and we thought that we would reach out and let you know about our Brand20 list we just launched. We picked twenty global brands and using our technology, Scope, we measured how they are doing when it comes to online video.

You can see the chart here: http://www.divinitymetrics.com/charts/brand20/

We also have a great blog post covering it: http://www.divinitymetrics.com/blog/?p=45

If you would like to learn more about our company and our product Scope, give us a shout at info@divinityMetrics.com.

Cheers,

Judah added the following ...

Vishal: Congrats on the new product launch. I’m looking forward to seeing how you guys evolve your business and carve out your niche in internet video analytics. Thanks for the good words about my blogging and for being available if I have more questions about your emerging product suite.


Add to the Conversation

Your email (required) will not be published.

Please note that contributions are moderated and may take a little while to appear.