Week 3 - Launching Enterprise Architecture Initiatives (Part 2)

Why are SMART goals, so HARD?

     We all know when launching an Enterprise Architecture initiative, you want to measure your success.   There are even guides to help us remember how to create goals that are Specific, Measurable, Attainable, Realistic and Timely (SMART).  There is no shortage of books, articles, templates and examples to show you exactly how to document and measure success.

     So why is it so hard?  Because all of this assumes that you have well documented baseline metrics, which in most cases, I do not. And in Corporate America where I work, it is nearly impossible to obtain the necessary baseline metrics either because they don't know or simply don't want to share this information with you.  

     I'm not alone.  The Office of Inspectors General in July of 2014 released an audit report stating that the FAA LACKS THE METRICS AND DATA NEEDED TO ACCURATELY MEASURE THE OUTCOMES OF ITS CONTROLLER PRODUCTIVITY INITIATIVES

"FAA has been unable to demonstrate the results of its controller productivity initiatives largely because it has missed opportunities to assess their effectiveness. For example, FAA did not establish detailed baseline metrics or quantifiable cost and productivity goals for 43 (84 percent) of its 51 initiatives. A lack of baseline goals creates substantial challenges for FAA to ensure these initiatives are effective. In addition, FAA is not maximizing operational and financial data regarding its controller workforce. The Agency does not systematically collect or analyze these data to reduce cost or improve productivity due to a number of barriers. These include a lack of requirements and guidance for facility managers on analyzing existing data, FAA’s inability to reach consensus on which metrics should be used to measure controller productivity, and data control and entry weaknesses with controllers’ time recording system. As a result, FAA cannot demonstrate whether many of its initiatives have had the desired efficiency gains. However, FAA has taken steps to improve data collection by issuing guidance to clarify procedures for recording employee time and plans to make further changes to improve how it tracks and allocates controller time in the system."

    My guess is that there aren't any dedicated resources / department responsible to collect and capture metrics.  Yet it amazes me that I'm always asked at my annual performance review - What business value did you bring to the company, when they know the challenges we face measuring success.