Monday, March 14, 2011

Oxygen Rules

Laszlo Bock said: "My first reaction was, that's it?"

As recently reported, Bock was commenting on Google's "rules" on how to be a good manager, something that grew out of an internal project begun in 2009.  Bock runs 'people operations' at Google, what is HR to the rest of the corporate world.

And a glace at the rules, below--a result of data mining thousands of data items at Google about team and individual performance, and manager performance in a project named "Oxygen"--are not exactly earth-moving in their insight.  On the other hand, there is a certain elegance in their simplicity and completeness. And certainly anyone who has struggled to be a good manager, or has worked for a good manager, or has worked for a bad manager, will recognize the universal wisdom of these 'rules,.

Not that this stuff hasn't been written down before and can't otherwise be found in sources.  Indeed, there's a lot of common sense in what's written down.  But it never hurts to take a moment and review and reflect:


Delicious
 Bookmark this on Delicious  
Are you on LinkedIn?    Share this article with your network by clicking on the link.

Saturday, March 12, 2011

The Kepler project sample

Project KEPLER, a NASA project to survey the galaxies and locate new planets that could possibly sustain life, had an initial data dump from its on-orbit satellite detector-collector last month, about which it was written
.... statistical tests of a sample suggest that 80 to 95 percent of the objects on it are real, as opposed to blips in the data, [although] .... new results represent only four months’ worth of data on a three-and-a-half-year project ....

Well now: what about samples? Is 'sampling' something project managers need to know about have a bit of understanding?

I know the answer to this one: Yes, sampling is a technical practice that can translate into cost and schedule savings, and potentially reduce other risks in the project.

Here's why I think sampling belongs in many projects:
  • Often not economical to obtain and evaluate every data point in a population
  • Usually not practical to reach every member of the population.
  • Often not possible to know every member of the population.
  • May take too much time to observe, measure, or interview every member of the population
  • May result in too much data to handle even if every member of the population were readily available–to include the expense of large volume data handling, and timeliness of large volume data handling

Of course it's always good to check with the experts, and in the modern era--that is, since 1953--William G. Cochran has been at the pinacle of experts.  His book, Sampling Techniques, first published in 1953 and now in it's 3rd edition is more less the defining word on the subject.  To the reasons above, Cochran would add:
  • Greater accuracy because, he says a few people of the highest degree of training can concentrate on getting it right with only a limited amount of data to look at, and
  • Greater scope because without sampling some problems would just be too hard to tackle.  Sampling brings them within reach.

On the other hand:
Sampling introduces risk into the project:
  • Risk that the information derived from the data sample may not accurately portray the population–there may be inadvertent exclusions, clusters, strata, or other population attributes not understood and accounted for.
  • Risk that some required information in the population may not be sampled at all; thus the sample information may be deficient and may misrepresent the true condition of the population.
  • Risk that in other situations, the data in the sample may be outliers and misrepresents the true relationship to the population; the sample may not be discarded when it should be
There are two risk assessments to be made.
  1. “Margin of error”, referring to the estimated error in the measurement, observation, or calculation of statistics related to the sample data
  2. “Confidence interval”, referring to the probability that true population statistics are within the range of the estimated statistics as calculated from the sample data 
Tensions in the project
Sampling introduces a tension between the budget managers and the risk managers. Tension is another word for risk.
  • Budget managers want to limit the cost of gathering more data than is needed–in other words, avoid oversampling–and thereby limit cost risk
  • Risk managers want to limit the impact of not having enough data--risking an error of interpretation--and thereby limit functional, feature, or performance risk.
Project policies
The risk plan customarily invokes a project management policy regarding the degree of risk that is acceptable in samples:  [Nation: this not the land of Six Sigma!]
  • “Margin of error” is customarily accepted between 3 and 5%
  • “Confidence Interval” is customarily a fixed percentage between 80 and 99%, most commonly 95% or 99%
My opinion: project managers should make the investment to understand what they're getting into and what the policy implications for the project really are.

Sampling protocols:
Don't try this at home.  But, given that you have access to someone trained in statistical protocols, the project's sampling protocol is designed by the risk manager to support the project manager's policy objectives.

Photo: Jet Propulsion Laboratory of NASA
 
Are you on LinkedIn?    Share this article with your network by clicking on the link.

Thursday, March 10, 2011

Agile reality v rhetoric

Scott Ambler posted his ideas about whether agile reality is keeping up with agile rhetoric. He listed seven specific examples that he thought needed some explanation in a 'X v Y' format, with X being the rhetoric and Y being the reality as he sees it from his view of what practices should be.

Among the seven, here's the one I liked the best:
Simple designs are best BUT the architecture should be thought out early in the lifecycle. Too many developers interpret the advice to focus on simple designs to mean that they should build everything from scratch. Yet more often than not the simplest design is to take advantage of what is already there, and the best way to do that is to work closely with people who understand your existing technical infrastructure. Investing in a little bit of architectural envisioning early in the lifecycle enables your team to identify existing enterprise assets that you can leverage, to identify your architectural options, and to select what appears to be the best option available to you. The details will still emerge over time, and some decisions will be deferred until a later date when it’s more appropriate to make them, but the bottom line is that disciplined agilists think before they act.

So why do I like this one the best?

Because architecture is a part of every project deliverable schema, whether or not it's acknowledged or not. Architecture is the definitional framework that holds all the disparate pieces together and gives rise to the value of the whole over the parts.

I say that every project needs the role of architect, and every project needs to start with architecture, even if it's only called storyboarding or some such.

In another recent post here at Musing's, I discussed the management hazard of not concentrating on the bigger picture. It's all part and parcel of the same thing.


Are you on LinkedIn?    Share this article with your network by clicking on the link.

Tuesday, March 8, 2011

Throwing darts at Monte Carlo

Kailash Awati writes the blog Eight to Late; in a recent post, he makes a humorous but quite informative explanation of the Monte Carlo process by analogy with a drunk throwing darts at a target.  Entitled "A drunkard's dartboard: an intuitive explanation of Monte Carlo methods", he addresses a paradox that may have occurred to many, to wit:
.... that one can get accurate answers via random numbers. 

Permit me to comment:
'accurate' only in the sense that a Monte Carlo will provide distribution of possible outcomes [answers] weighted by the probability [strictly: the probability density.  That is, probability per unit of output], and the accuracy of this range of answers is highly dependent on the inputs provided to the simulation tool.  So, it's still a matter of guarding against "garbage in/garbage out"

Nevertheless, in his clever post, Awati uses simple geometric shapes to demonstrate the answer to that paradox. In the end, I was convinced!

Are you on LinkedIn?    Share this article with your network by clicking on the link.

Sunday, March 6, 2011

Cost-schedule v Value

Most of the time, I call myself a program manager, and if occasion demands: a project manager. In this post my mantle is 'Value Manager'.

Is there a difference?

To some, yes. Project managers put cost and schedule on the front burner, whereas value managers may turn that burner down a bit. Whether value or project, scope and performance, the other two legs of the four-legged 'iron triangle' are priorities regardless of labels.


Most of my experience over a life-long career has been managing value. Ten years ago, I wrote a book about it, just after my first ERP program--a portfolio of about 10 projects, including PeopleSoft.

Here's the way it's gone for me:

Mission first: As a DoD engineer in the Vietnam and cold war era, I was instructed that mission trumped all else.  In fact, a 2-star general once told me: "If it's not in the plan, then I will personally change the plan!".  Posted to the 'outpost of freedom', Berlin, during the cold war, I arranged for a C-5 to put a sensitive cargo down in Templehof.  C-5--the largest cargo plan in the world--into Templehof?  Wasn't that built in the '30s for the DC-3 era? If'd you've stood on the tarmac at Templehof, you know what I mean.  Was this in the plan? NO, but...

Contractual commitment: I moved on to the aeropace and defense industry.  There, I signed onto contracts pledging to meet cost-schedule-scope in about as much of an iron triangle as you can get.  And our team moved heaven and earth to meet those commitments, cost-schedule-and scope.

Cost/Benefit: Having won the cold war, I took on back-office IT with my first ERP project.  The sponsor made it clear: I could have whatever money I needed so long as it was paid for.  Cost/Benefit was the metric.  Obviously, there's no benefit if you don't deliver on the scope, the performance, and the value for the user.  It's a complex dynamic, more complex than just meeting a cost or a schedule because you hold business value in your hands.

P&L: I took on executive responsibility for a business unit having IT, application development, and business operations.  We produced documents from an electronic database under court order for discovery.  My imperative from my boss: never blow a court-mandated schedule, but make a profit--or else!  My project managers were given two orders:  never blow a schedule; keep expenses under control, but deliver all the documents.  Expense control is the secret to profit on the bottom line of a P&L.

The WEB: I managed an agile, or agile-like shop for 18 months.  Our shop reflected the sponsor's sense of value: Be quick!  Don't fall behind the competion.  And  don't let the vision of the future get in the way of the present--thus, be incremental.  And so we were.  Our backlog was constantly changing; we met and bettered the competition with quick strikes targeted to maintain our market lead, and kept ahead of customer expectation.  Fortunately, ours was a business-to-business shop, so we had very sophisticated customers who were enormously helpful.

So, is value manager different from project manager? (GoTo TOP)

Are you on LinkedIn?    Share this article with your network by clicking on the link.

Friday, March 4, 2011

More on Agile and the DoD

Close upon the heels of PMI's announcement of their embrace of Agile, the US DoD is stoking the fire as well, evidenced by the industry conference in April, to wit:













According to their marketing release:
Why Attend —The Value Proposition

Agile development and test will improve DoD’s acquisition of IT applications leveraging cloud computing and service oriented architectures used by information sharing applications such as collaboration (strategic and tactical intelligence) analysis, ISR sensor “fusion” processing, coalition and joint tactical operations, logistics and sustainment support, transportation functions, geospatial and decision support apps, medical or health care record sharing, etc.,).

The new paradigm is significantly different and should not be confused by today’s spiral development process. Agile sprints are comprised of (smaller line-of-code) projects, month not years time driven release commitments with integrated development, operational, interoperability and user acceptance testing.

Once implemented, DoD user approved requirements tailored for each sprint (vice large Requirement comprised Major Programs of Record) will create a new “partnership” relationship amongst industry and government users, developers and testers.

Yea verily, and press on!

Of course, I'm not an unbiased commentator.  I've written a book on agile in large scale organizations, and I've written papers on the topic of DoD and Agile.  I've worked as a Program Manager within DoD, and as contractor for DoD.  So, count me among those who hope their initiative succeeds.




Are you on LinkedIn?    Share this article with your network by clicking on the link.

Wednesday, March 2, 2011

When Normal isn't normal

Jurgen Appello is, by his own description, "a Dutch guy" who is somewhat of a humorist, an illustrator, and a proponent of Agile. He also writes a lot about complexity, and the effects of complexity on systems and projects.

A recent posting, "The Normal Fallacy", takes on both misconceptions and lazy thinking, and reinforces the danger of thinking everything has a 'regression to the mean'.

Before addressing whether Appello's explanation of a fallacy is itself falacious, it's worth a moment to review:
Complex systems differ from simple systems from the perspective of how we observe and measure system behaviour. 

It's generally accepted that the behaviour of complex systems can not be predicted with precision; they are not deterministic from the observer's perspective.

[I say observer's perspective, because internally, these systems work the way they are designed to work, with the exception of Complex Adaptive Systems, CAS, for which the design is self-adapting]

Thus, unlike simple systems that often have closed-form algorithmic descriptions, complex system are usually evaluated with models of one kind or another, and we accept likely patterns of behaviour as the model outcome.  ["Likely" meaning there's a probability of a particular pattern of behaviour}

Appello tells us to not have a knee jerk reaction towards the bell-shaped Normal distribution.  He's right on that one: it's not the end-all and be-all but it serves as a surrogate for the probable patterns of complex systems.

In both humorous and serious discussion he tells us that the Pareto concept is too important to be ignored. The Pareto distribution, which gives rise to the 80/20 rule, and its close cousin, the Exponential distribution, is the mathematical underpinning for understanding many project events for which there's no average with symmetrical boundaries--in other words, no central tendency.

His main example is a customer requirement. His assertion: 
The assumption people make is that, when considering change requests or feature requests from customers, they can identify the “average” size of such requests, and calculate “standard” deviations to either side. It is an assumption (and mistake)...  Customer demand is, by nature, an non-linear thing. If you assume that customer demand has an average, based on a limited sample of earlier events, you will inevitably be surprised that some future requests are outside of your expected range.

In an earlier posting, I went at this a different way, linking to a paper on the seven dangers in averages. Perhaps that's worth a re-read.

So far, so good.  BUT.....

Work package pictureThe Pareto histogram [commonly used for evaluating low frequency-high impact events in the context of many other small impact events], the Exponential Distribution [commonly used for evaluating system device failure probabilities], and the Poisson Distribution, which Apello doesn't mention, [commonly used for evaluating arrival rates, like arrival rate of new requirements] are the team leader's or work package manager's view of the next one thing to happen.


Bigger pictureBut project managers are concerned with the collective effects of dozens, or hundreds of dozens of work packages, and a longer time frame, even if practicing in an Agile environment.  Regardless of the single event distribution of the next thing down the road, the collective performance will tend towards a symmetrically distributed central value. 

For example, I've copied a picture from a statistics text I have to show how fasts the central tendency begins.  Here is just the sum of two events with Exponential distributions [see bottom left above for the single event]:

For project managers, central tendency is a 'good enough' working model  that simplifies a visualization of the project context.

The Normal curve is common surrogate for the collective performance.  Though a statistician will tell you it's rare that any practical project will have the conditions present for truly a Normal distribution, again: It's good enough to assume a bell shaped symmetric curve and press on.



Are you on LinkedIn?    Share this article with your network by clicking on the link.