Monday, June 25, 2012

BA Practice Maturity: Speculation Does Not Substitute for Careful Study.

by Lori Lindbergh, PhD and Kitty Hass, PMP

Last week, we stumbled across an informal BA survey conducted by an IIBA chapter. The purpose of the member survey was to examine the status of business analysts and business analysis practices in organizations in the chapter’s service area. Interestingly, one of the items asked the participant to speculate and choose from one of four options that most closely described the characteristics of the BA practices in his or her organization. The four descriptions contained broad generalizations of each maturity level similar to the four levels in our BA practice maturity model. (See the February 13th entry.)

Ah, wouldn’t life be grand if assessing anything, including BA practice maturity, would be this easy? Some may say, “What’s harm in asking a simple question?” The harm may not come from asking the question, but more from the interpretation of the findings. Any time you reduce a complex phenomenon down to one question, you introduce speculation. Speculation is a conjectural consideration of a matter; a conjecture or surmise that may be impossible to verify. Such is the case in the survey we found. The BA practice maturity reported by each participant could not be verified without a full organizational assessment.

Accurately assessing BA practice maturity by simply asking one question to measure one person’s perception/opinion of his/her organization is NOT (and usually never) representative of the overall organization, unless you are an organization of one. Assessing BA practice maturity involves choosing an appropriate sample of representative projects to include in the assessment. It is more complex than one survey question and requires a multidimensional approach including a reliable and valid questionnaire, onsite interviews, focus groups, and deliverables inspections. When we conduct our assessments, we typically find that organizations are more mature in some of the nine dimensions of BA practice maturity and less mature in others. Therefore, a general blanket description of BA practice maturity is never an accurate measure.

This violates an important characteristic of a psychometrically sound measure: Validity. A valid assessment measures what it is supposed to measure and provides strong evidence to support the interpretations made from the assessment. Therefore, using one question to evaluate BA practice maturity, and thus presenting the survey findings as reflective of an organization’s actual BA practice maturity level would be similar to using a sphygmomanometer (blood pressure cuff) to speculate on the status of a person’s overall health. A sphygmomanometer is a valid measurement instrument for blood pressure only, and is simply one of a many measurements that are necessary to evaluate fully one’s health.

We don’t want to rain on anyone’s parade; there is no harm in conducting a fun, informative survey. Remember, however, your survey respondents have demonstrated interest in your topic by taking the time to complete your survey. They are looking to you as the survey provider to arm them with accurate findings and interpretations that they can use to enhance their knowledge and improve their performance. Be sure to meet their expectations.

Monday, June 11, 2012

Getting Approval for a BA Assessment - Start with a Business Case

by Kitty Hass and Lori Lindbergh, PhD

We know it can be very difficult to get approval to invest time and resources into building a mature BA Practice.  Executives often think this can be done with existing resources.  There are many reasons why this approach almost always fails:
  • Existing resources may not have the knowledge and skills to build a mature BA Practice.
  • Existing resources are often over-allocated.
  • The change is often trivialized, and therefore, no change management plan exists.
  • All BA stakeholders are not involved in planning and executing the change effort.
  • A BA capability assessment is not performed, so it is unclear which foundational practices are flawed, and therefore should be improved first.
To embark upon a BA Practice Maturity Program it is necessary for you to start with a BA Assessment to truly understand the current state and the recommended improvements for the near term.  To propose the BA Assessment, build a solid business case for the effort. Elements of the business case should include the following:

1       Executive Summary

2       Business Need
2.1     Assessment Drivers and Expectations
2.2     Business Goals and Objectives 
2.3     Stakeholders        
2.4     Opportunity Analysis      
2.4.1  Business Problem  
2.4.2  Business Opportunity     
2.4.3  Desired Outcome  

3       Capability Gaps  
3.1     Current Capabilities        
3.2     New Capabilities Required  
      
4       Solution Approach 
4.1     Potential Options  
4.2     Feasibility Analysis of Options Considered
    
5       Recommended Solution Scope  
5.1     Description 
5.2     Scope
5.3     Implementation Approach 
       
6       Business Case      
6.1     Benefits      
6.2     Costs

As with any project investment, without a strong business case, you will most likely have difficulty obtaining the support you need to achieve success. If you would like a sample business case for a BA Assessment, please send an email to kittyhass@comcast.net.