One of my mantras in professional life is 'you can't manage what you don't measure'.
Therefore it always worries me when I encounter organisations or individuals with a less than firm grasp on how to measure the success or failure of their online properties.
Depending on the type of web property, different metrics are most important for regular tracking and I believe it's the responsibility of top managers to understand the online metrics they use - just as they need to understand business ratios or balance sheets.
After more than twelve years of trial and error, below are the metrics I most and least prefer to use to track different types of online media.
What are the best metrics to use?
Standard websites
Visits
This tracks the total number of visits by users to a website over a period of time (month, week, day). This can include the same unique visitor returning to the site multiple times - which is the same way calls are commonly tracked for call centres.
Visits gives you an overall view of website traffic and, when divided by Unique visitors, provides a measure of 'stickiness' - how often people return to your site.
Note that for an unauthenticated site, a visitor is essentially an IP address, a computer. As multiple people can use a single PC, or a single person can use multiple PCs and it also may track search spiders and other bots, visits doesn't provide a perfect measure of human traffic but it's sufficiently good for trend analysis over time.
In addition, caching by ISPs or organisations can also influence visits - reports based on AOL from a few years ago indicate that visits reports may under report website traffic by as much as 30 percent due to caching - though this is less important today.
In comparison 'readership' is a much looser metric, but is often held in high regard in the print trade.
Unique visitors
Unique visitors tracks the individual IP addresses used to visit a website and as such provides a rough count of the number of actual users of a site, no matter how many times they visit.
This equates to 'reach' for a site - with growth in unique visitors indicating more people are coming to a website.
This is affected by the same IP versus human issue as visits, however is again still far more accurate than 'readership' figures provided by the press or 'viewer' figures provided by TV and radio - which are based on a sample rather than a population (as unique visitors is).
Pageviews
Pageviews are a more specific measure of the views of specific pages within a website, and is most useful for tactical website tracking, allowing the identification of high and low traffic pages and the impact of different navigational or promotional approaches.
Looking at pageviews also provides a psychological view of your audience's top interests - allowing you to quickly prioritise content to be expanded and which can be downplayed.
Pageviews is becoming less important as technology cocktails such as AJAX are more widely used to load part of a page's content automatically or in response to user actions. In these cases a single pageview may not track what the user views in the page.
Authenticated website (transactional services)
Active users
Active users tracks the actual use by authenticated users (real humans) in a time period.
This is the best measure of an authenticated site's success as it tells you how well you've encouraged ongoing use of a website, rather than simply how good a job you've done at getting people to sign up.
Many authenticated sites prefer to talk about Registered users as this is a much larger number, however if a user has registered but never returns, your organisation gains no value from it.
A low ratio of active users to registered users can indicate site problems, and should prompt website managers to ask the question why don't people come back?
Transaction funnels
Transaction funnels track the completion of transactions step-by-step in a service - and isn't necessarily only for authenticated sites.
This provides a website manager with tactical insights into any issues in a transactional process (or workflow), allowing them to diagnose which steps have the greatest abandonment rate and redevelop the process to improve completion.
Generally improving transaction funnels results in more transactions and more active users, which means greater utilisation of the service.
Multimedia (video/audio/flash)
Views
For any type of rich media, the number of views of the media is critical in determining success. However it has to be weighted against the Duration of views to determine if users spent long enough viewing in order to take away the message, or just viewed the first few seconds.
Duration of views
The duration of media views is a more granular measure of the effectiveness of the presentation - tracking whether the media actually communicated its message to users.
Looking at the average duration viewed, compared to the actual duration of the media (where such exists) provides a very strong effectiveness measure.
Shares
One of the keys with the success of media content is how much it is shared with others online - the word of mouth factor. For media with a 'refer to a friend' tool, tracking the use of this will provide a strong indication of how positively users view the material, and therefore how viral it will become. Media that is rarely shared is probably not getting the message across in a memorable way, whereas highly shared material is correspondingly highly memorable - at least for a short time.
Documents (pdf/rtf/docs)
Views
Often 'downloads' is used to track documents. Personally I prefer views as there are some technical issues with tracking downloads of files such as PDFs. In effect the two measures should be identically, but as PDFs, and sometimes other documents, download by segment, they can significantly overreport downloads (which becomes almost as useless as 'hits'), whereas views is a more accurate measure.
There are ways to fix this within reporting systems - which I've largely done in my Agency's system - however this is not possible in all systems.
Social media
Activity by user
Like authenticated sites, the goal of social media is to encourage participation - whether it be forum posts/replies, wiki edits or social network updates/messages.
Each of these represents activity - which may need to be tweaked by the type of social media.
The more activity by users, the more engaged they are with the site and the greater the prospects of longevity.
Views
The other useful measure is views, measuring the passive involvement of users with a social media site. Not all users will actively post, however if they return regularly to view, they are still engaged to some extent with the site.
Commonly the breakdown between active and passive participants is divided as 1/9/90 (Very active/active sometimes/passive observer), however in practice this varies by medium and community.
While that 90 percent doesn't add to the content of the site, they are vital for the other ten percent to participate.
Search
Top searches
Search is also an important area of sites, with the top searches providing another insight into what people want from your site - or what is not easily findable in other navigation.
Tracking this over time provides another perspective on the psychology of your website users. It helps you understand their terminology for navigational purposes and can help prioritise the content you should modify or add to in the site.
Zero results
Any search terms which result in zero results in your site should be looked into as a high priority.
Generally this reflects areas where your website lacks content or uses the wrong context or different language to the audience.
What are the wrong metrics?
Hits
Probably the least useful metric of all time, Hits is still the best known measurement for websites, despite having no practical business uses.
Hits measures the number of files called from a web server, with each separate file accounting for a single 'hit' (on the server).
On the surface this doesn't sound so bad - however webpages consist of multiple files, with the base page, style sheets, graphics and any database calls or text includes each accounting for a separate hit.
A webpage might consist of a single file, or it might consist of 20 or more - meaning that there is no clear relationships between hits and actual page views or user visits to a website.
To increase the number of hits to a website it simply requires the website owner to place more file calls in the page - potentially calling extremely small (1 pixel square) images, therefore hits can be easily manipulated with no effect on the actual number of website users.
So while hits figures are frequently impressive, even for small websites they can easily reach millions each month, they don't provide any useful business information whatsoever.
Read full post...
View summary...
Posts
