Web Analytics Blogs

Judah Phillips is an experienced web analytics practitioner and Internet expert currently working as a Director at a large multichannel media company. His blog is full of useful, unbiased, actionable insights learned from the real-world practice of a process-oriented, integrated approach to strategic Web Analytics for improving business performance.

Subscribe to Judah Phillips weblog

Archive for July, 2008

Performance, Performance, Performance

From an article I wrote for MediaPost a few weeks ago:

Reach and frequency and the core concepts of traditional media planning and advertising.  For a given site, program, channel, radio station, billboard, newspaper section, a target audience (the reach) is exposed to a certain number of occurrences of the media (the frequency).  On the web, these concepts manifest themselves in metrics collected and reported from a number of recognizable services.  Audience measurement firms, like comScore and Nielsen, web analytics firms, like Omniture and Unica, to companies somewhere in between, like Quantcast and Google, all have reach and frequency data.  Many new media metrics can be used to proxy frequency- from time-based measures, espoused by audience measurement firms, to concepts like visitor retention or the repeat visitor rate cited by web analytics firms.  On the reach side, companies refer to concepts like “unique visitors.”

These data, of course, available in free tools or in for pay tools are certainly helpful for planning campaigns.  But reach measures can be dirty (cookies, unduplicated unique users, estimates from panels, coverage error).  Frequency measures can be just as dirty (problems recording time in single page visits or visits on the last page, do page views really matter with AJAX and rich media, cookies again, and so on).  We all are aware of the challenges.

Thus using basic reach and frequency measures for planning or evaluating a campaign does not suffice.   So advertisers and agencies target demographics, like gender, age, income, education, and job title.  It’s a given that advertising in the Robb Report reaches a different audience segment than advertising in Popular Mechanics. 

These brave new days we have “behavioral” tracking too.  By taking into account visitor activity across sessions, such as past actions taken on a site or a roster of previous purchases, we can attempt to deduce what a person or segment responds to or is interested in based on their behavior.

Even with reach, frequency, demographics, and behavioral data to help guide advertising and media buying, we are missing an important attribute for maximizing the potential success of our campaigns.  We do not have an available tool, whether free or paid, for advertising or buying media on or across sites according to measures of past performance.  Such measures include ad clickthrough rates, conversion rates, goal completion rates, delivered impressions, and perhaps even harder to quantify financial measures such as ROI, ROAS, and ROMI.

Sure, historic, tacit knowledge of campaign performance exists and is used by agencies or publishers.  However, there is no shared industry source that can help us answer “how has a site for display advertisement historically performed toward goals based on the reach, frequency, demographic and behavior of its audience segments?”  Interestingly, a company minting money right now, named Google, can masterfully demonstrate performance in paid search campaigning and help advertisers unify it with segmented reach, frequency, and demographics.

Outcomes based performance measurement unified with reach, frequency, demographics, and behavior is what is missing in audience measurement tools, not frequently reported externally by web analytics tools or ad serving tools, and not available in ad planning tools.  When advertisers can target display ads, or even video ads, to desired audience segments by reach, frequency, demographics, behavior in the context of known performance, media planning will be more effective.  

X Change: X Citing X Cogitation!!

Alright, I had to have fun with the title. :) We’re about 4 weeks ago from the newest and most unique analytics conference on the scene: X Change, hosted this year by Semphonic and Web Analytics Demystified

If you missed the first year in Napa, you gotta head to San Fran this year!  Allow me to explain how X Change differentiates as I see it:

  • Conversational. You don’t sit in a room and listen to people drone on in front of their powerpoints.  People sit in Socratic circles and talk about a topic of interest in “huddles.”  The huddle leader will bring up a topic, perhaps riff on some hard-learned experience or data point related to the topic, and ask for commentary from the participants.  The conversation then flows, like Jazz, until there’s a cadence, then the huddle leader phrases a few more notes and progression begins again…  Its atypical format depends on participants for success.  No one is going to sit there and read you slides and provide one-sided opinions.  You won’t just be sitting there listening (unless you want to).  The best huddles are interactive and encourage active participation in the pursuit of shared knowledge, not passive reception of an individual’s knowledge.
  • Focused.  The huddle topics are highly specific and deeply relevant to the real world practice of web analytics today - from attribution to mobile measurement to integration to privacy to team structure, the huddle leaders selected topics that interest them to share with the participants. The focused conversational format should lead to symbiotic exchanges of information directly relevant to your job.
  • Small.  100 people, 20 huddle leaders.  You get to make meet interesting people and build working relationships with them.  Cool folks like Bob Page, Rachel ScottoMarshall Sponder, John Lovett, Jared Waxman, “Bob” Dylan Lewis will be leading huddles and hanging out.  The Web Analytics Tuesday event will probably be bigger than the whole X Change conference!
  • Exclusive.  The huddle leaders were hand selected.  In attendance will be industry leaders, corporate executives, industry analysts.  All of the attendees work with analytics.  And for gosh sake, it is at the Ritz in one of America’s most beautiful and eccentric cities. 

I think X Change is a unique experience and a worthwhile event where you get to really connect, and well, exchange (!) expertise with your peers and go home with new knowledge.  At least I did last year.  I’ll be leading a couple of huddles, one of the web analytics team and one on knowing when you’ve outgrown you analytics tool, so say hello when you see me. 

Make sure you check out the official web site at Semphonic and sign up today.  The event will sell out soon.  15% discounts are available for Web Analytics Association members. 

AVG Fixes LinkScanner!!

AVG has released an updated version that corrects the LinkScanner bot issue (build 138, July 4), which we’ve all noticed slamming our servers and analytics data over the last several weeks:

We have modified the Search-Shield component of the product to
only notify users of malicious sites.Search-Shield no longer
scans each search result online for new exploits, which was
causing the spikes that web masters addressed with us. However,
it is important to note that AVG still offers full protection
against potential exploits through the Active Surf-Shield
component of our product, which checks every page for malicious
content as it is visited, but before it is opened.

As you’ve just read in the quote above, AVG has stopped scanning each page that returns in a SERP for users of their free tool.  Instead pages will be scanned by proxy after a user clicks on the link. 

For paid users, it’s a little different.  SERP’s will still be scanned but via a pure database approach (not the DDOS approach :), which means the sites listed in SERP’s will be compared to a black list of known “bad” sites.  The blacklist is based on internal AVG research and from the real-time results reported by users who have opted-into AVG’s “prevalence reporting system” (a feature of AVG 8).  This means AVG is still scanning sites, but on a very limited basis, thus the detrimental effects on analytics should be very minimal and only caused by users who participate in prevelance reporting.  Still some data pollution will occur…  

AVG hasn’t confirmed that they’ve released a fix to the “noscript” issue I mentioned.  I do know they are working on it and have fixed the problem in internal builds.  Regardless, if the LinkScanner is working in the way they say it is, the problem will be negligible (but some data pollution will still occur ;).

Kudos to AVG Corporate, Roger Thompson, Pat Bitton, Greg Mosher, and all the other engineers who listened to the community on the web and worked quickly to fix the problem.  Now let’s hope the the build 138 update works as described. Time will tell.