Discuss Home · Bootstrapped Podcast · Scribbleton Personal Wiki · HelpSpot Customer Service Software · Thermostat NPS

What Usage Metrics Mean The Most To you?


#1

I know Mr. @ian has been talking a lot about the metrics he collects with his applications.

At Cloudmanc Labs we spend tons of time with our metrics. I can’t say we are experts as to how to use our metrics but we try to live by metric driven decision making. We are always looking to refine how we use our metrics.

After posting my blog posting below (sorry linking back to my site, it seems relevant not shameless). I had a number of people reach out to me and ask about what metrics are important to measure.

Clearly what is important to measure is very different based on what you are selling. I thought it would be interesting to ask what people are measuring and how it relates to business and product decisions.

Thanks!


#2

I will kick things off…

At Cloudmanic Labs we measure almost everything. We use a combination of our own custom event software, MixPanel, Clicky, and Piwik.

Both our custom software and MixPanel are most useful for seeing how customer engage with our products. What are they using and what are they not using. Clicky and Piwik are really about measuring marketing efforts (how customers are becoming customers).

In general our approach is to measure everything. However we only look at 4 metrics per side (apps, and marketing) when making bigger decisions. When we push updates we look at how these metrics change. If we push something and our 4 core metrics go up or down we know we did something right or wrong.

On the marketing side we measure conversions to app signups, bounce rate, campaign success rate, cross product success rate.

Each one of our apps has its own core metrics. The core metrics are often around the core feature for using the app. For example with Skyclerk (our accounting application). Ledger Entries Per Month is our biggest metric. If this number does not grow exponentially we know we are doing something wrong. We keep a sharp eye on this number.

The other two things we do is feature metrics and cohort analysis.

With feature metrics we keep a sharp eye on each feature we have. If the usage is low we try a few iterations of the feature to try to rule out if the feature is a bad feature or if we did a bad job building. If the numbers stay low we know it is not an important feature. If they start to climb we know it needs more love. We also keep an eye on these feature metrics to know what users really care about and maybe careless about. The core metrics mentioned above are the final deciding metrics when making bigger decisions.

Lastly, cohort analysis are a big part of our company health measurement. It measures how sticky our applications are. We noticed about a year ago our customer retention was starting to drop fast month over month in some key areas. We guessed our competition was start to out price us. We took action. We then resumed our growth. Had we not watched this we could have fallen into a danger area. Once usage slows revenue overnight can drop fast. Usage is a forward indicator.

Would love to hear more about what others are doing in this area.


#4

I never look at my metrics (only got Google Analytics installed, and only on my landing page at that). Instead, by doing all the customer support I develop a feel for the next bottleneck in delivering what my customers want. So far just talking to my customers like this has served me well.


#5

Yeah, for early stage startups, most metrics are a waste of time, if not confusing. Talking to your customer will give you more insights than trying to make sense of Google analytics (and crying, as everyone who uses GA ultimately ends up crying, or moving to Clicky etc).