05/07/2021
“We track a lot of metrics related to progress of development and quality every sprint, like backlogs, technical debt, velocity, task status etc. What is not very evident is the ‘quality of movement’ i.e. how well done, so that we create less debt as we move. How can I get a better insight of the quality of tests done and a more objective measure of product quality?”
Extrinsic metrics are easier to measure and give visibility of direction, progress, speed and external feel of product quality. Intrinsic metrics are deeper, harder to measure but can give greater insight into the quality of work. Measuring this requires a good structure and organisation of test artefacts. The benefit - a greater insight into effectiveness of outcome and therefore lower technical debt & greater acceleration, don’t you think?
Metrics can be classified as measuring work progress, work quality, product quality and practice quality. Except for the first one on work progress where we have a lot of measures facilitated by project and test management tools, the others depend on test organisation and clarity of types of issues to uncover. ‘Quality Levels’ based on HBT (Hypothesis Based Testing - hbtcentral.org) provides a strong foundation for these, enabling you to assess potential test effectiveness, judge product quality objectively and fine tune practice quality.
If you are keen on “insightful quality metrics”, then you may find our SmartQA consulting (stagsoftware.com/smartqa) interesting, where we unshackle your practice so that you can see clearly and do far better.