Learn from the data
As a natural part of performing reviews a number of metrics are collected, covering both planning, preparing and agreeing phases of the process. The metrics and their corresponding indicators help your organization to optimize your review process.
Some of the data is presented to support the individual review, e.g. as soon as the participants have registered their individual findings, the actual defect density and defect distribution are available to support the document approval decision. Other parts of the data is made easily available as predefined graphs and tables to support analysis across multiple projects, document types, periods of time etc.
Please have a look at our examples below...
Examples of predefined indicators for analysis
Analyzing across projects |
Presentation of collected data from reviews are made easily available in the "management" part of Callis Reviewer. Different parameters can be used to narrow down the selection of data presented including defining a subset of the projects in the organization. |
|---|---|
Review time line |
So did this project perform any reviews? How many and when? To quickly answer these questions we decided to do the time line plot. In order not to overflow the indicator with text we choose just to display the types of the documents under review for the individual data point. A more detailed overview of the individual reviews can be achieved by clicking the dots. |
Accumulated reviews performed |
To bring to you a quick overview of the number of reviews performed in the organization we are plotting the accumulated number of reviews performed against time. Dig into the data by looking closer at a part of the organization or a single project within a specific time frame. It's a simple indicator, but it will help you to point to parts of the organization where people need help to get things going. |
Defect distribution |
So which types of defects do we typically find? And are they major or just minor defects? This indicator will help you understand the types of defects typically found and how they are distributed on the different severity-codes. This again helps you prioritize which improvements your organization could benefit the most from. |
Checklist effectiveness |
Do you know how often your checklists are used? And do they help identify any defects? The checklist usage and effectiveness overview table gives you the answers and knowledge to make the good checklists even better - and to get rid of the ones which is not working! |
Checklist effectiveness profile |
Do we typically find one or more defects by using checklist X? The checklist effectiveness profile supports this questions - and of course you can drill into the details by querying on specific parts of the organization - to help you understand how things around reviews are being done in reality! |
© Copyright 2007-10 Callis
