• Estimation Techniques Tutorial

• Estimation Techniques Resources

Teams starting out with story points use an exercise called planning poker. At Atlassian, planning poker is a common practice across the company. The team will take an item from the backlog, discuss it briefly, and each member will mentally formulate an estimate. Then everyone holds up a card with the number that reflects their estimate. This “No Estimates” inspired approach to story estimation in PI Planning has a couple of benefits: It is faster – which comes in handy during PI Planning. It forces teams to slice into smaller stories which is better. It is naturally easier to baseline/align multiple teams around the same definition. Planning Poker, also called Scrum poker, is a consensus-based technique for estimating, mostly used to estimate effort or relative size of user stories in software development. Just tap on any number of the Fibonacci sequence. The selected number will be shown in the main area but is hidden in the first place.

Iteration Planning Meeting. The iteration planning meeting is the whopper meeting that gets the entire team on board with exactly what functionality will be worked on during the iteration. All the developers and analysts attend (QA find it comes at a very bad time in their cycle, so just a QA representative comes along). Poker planning is an estimation technique for agile teams that is used for calculating how much team resources should be allocated to complete a particular task from a product backlog. In planning poker every team member provides their own assessment of the task, and after a short discussion the team finds a consensus on the magnitude of the task.

• Selected Reading

Planning Poker Estimation

Planning Poker is a consensus-based technique for estimating, mostly used to estimate effort or relative size of user stories in Scrum.

Planning Poker combines three estimation techniques − Wideband Delphi Technique, Analogous Estimation, and Estimation using WBS.

Planning Poker was first defined and named by James Grenning in 2002 and later popularized by Mike Cohn in his book 'Agile Estimating and Planning”, whose company trade marked the term.

Planning Poker Estimation Technique

In Planning Poker Estimation Technique, estimates for the user stories are derived by playing planning poker. The entire Scrum team is involved and it results in quick but reliable estimates.

• Planning Poker is played with a deck of cards. As Fibonacci sequence is used, the cards have numbers - 1, 2, 3, 5, 8, 13, 21, 34, etc. These numbers represent the “Story Points”. Each estimator has a deck of cards. The numbers on the cards should be large enough to be visible to all the team members, when one of the team members holds up a card.

• One of the team members is selected as the Moderator. The moderator reads the description of the user story for which estimation is being made. If the estimators have any questions, product owner answers them.

• Each estimator privately selects a card representing his or her estimate. Cards are not shown until all the estimators have made a selection. At that time, all cards are simultaneously turned over and held up so that all team members can see each estimate.

• In the first round, it is very likely that the estimations vary. The high and low estimators explain the reason for their estimates. Care should be taken that all the discussions are meant for understanding only and nothing is to be taken personally. The moderator has to ensure the same.

• The team can discuss the story and their estimates for a few more minutes.

• The moderator can take notes on the discussion that will be helpful when the specific story is developed. After the discussion, each estimator re-estimates by again selecting a card. Cards are once again kept private until everyone has estimated, at which point they are turned over at the same time.

Repeat the process till the estimates converge to a single estimate that can be used for the story. The number of rounds of estimation may vary from one user story to another.

Benefits of Planning Poker Estimation

Planning poker combines three methods of estimation −

Expert Opinion − In expert opinion-based estimation approach, an expert is asked how long something will take or how big it will be. The expert provides an estimate relying on his or her experience or intuition or gut feel. Expert Opinion Estimation usually doesn’t take much time and is more accurate compared to some of the analytical methods.

Analogy − Analogy estimation uses comparison of user stories. The user story under estimation is compared with similar user stories implemented earlier, giving accurate results as the estimation is based on proven data.

Disaggregation − Disaggregation estimation is done by splitting a user story into smaller, easier-to-estimate user stories. The user stories to be included in a sprint are normally in the range of two to five days to develop. Hence, the user stories that possibly take longer duration need to be split into smaller use-Cases. This approach also ensures that there would be many stories that are comparable.

Contents

• PI Planning Goals
• SAFe Framework Overview
• SAFe Requirements Hierarchy
• SAFe Program Backlog Construction & Refinement
• PI Planning Inputs & Outputs
• PI Planning Event
  • Day 1: Teams create draft plans
  • Day 2: Finalize plans & confidence vote
• Sample PI Planning Agenda
• Epic and Feature Templates

PI Planning Goals

The primary purpose of release (PI) planning is to gain alignment between business owners and program teams on a common, committed set of Program Objectives and Team Objectives for the next release (PI) time-box.

SAFe Framework Overview

1. Portfolio Level: Epic Definition & Refinement, Portfolio Backlog Construction
2. Program Level
   • a) Feature Definition & Refinement, Program Backlog Construction
   • b) PI Planning, Construction of Team Backlogs
3. Team Level: PI Execution

Each level of the framework represents a transformation into a level of detail required for processing at the next level. Within each level, the transformation process is managed using a kanban to ensure transparency and optimal flow:

• Portfolio Level – Portfolio Management is the highest level process that starts the refinement of business strategy into epics, and from there into features that can be realized by delivery teams. A product portfolio is the collection of all the products or services offered by a company. In SAFe, portfolio items are represented as ‘epics‘, that is, they may require multiple releases (or program increments) to realize the vision and goals for that product. Epics are basically ‘containers’ for everything needed to provide a solution. Each epic should have an MVP definition (minimum feature set). Epics need to be ranked (and funded) by business value. Epics in the business portfolio are refined via an intake kanban (e.g. Funnel >> Review >> Analysis >> Ready).
• Program Level – How do we quickly and incrementally deliver meaningful subsets of each epic to the market? To do this, an epic’s MVP feature set is refined further via story mapping and story estimation. Team velocities are used to estimate the scope of what can be delivered in program increments. Program Increments (PI’s) are standardized around 5 two-week iterations, plus one ‘Planning & Innovation’ Iteration, 12 weeks in all.
• Team Level – A set of practices that support incremental feature delivery via short iterations – typically using scrum– with production-level quality. Once the feature delivery timeline and business objectives are agreed for the next PI time-box, teams work on their feature-sets, collaborating on mutual dependencies, and synchronizing the results of their work on each iteration boundary. The scrum-of-scrums event is used to track progress across the release train, and to adjust plans where necessary to ensure the most important PI objectives are achieved.

PI’s (Program Increments) and ARTs (Agile Release Trains)

• ART’s synchronize the activities of multiple development teams
• Optimized for 5-12 teams (50-125 people)
• Default PI time-box is 10 weeks (5 iterations), plus 1 Planning & Innovation sprint.
• ART delivers a Program Increment every 10-12 weeks
• PI planning is 2 days every 10-12 weeks
• All attend in person
• Product Manager (‘Chief PO’) owns feature priorities and changes
• Architects for dependencies, interfaces and enablers
• Teams own story planning and estimates
• Program backlog is mostly a list of features, but can contain other items such as milestones (e.g. trade show event), and technology ‘enablers’
• Features fit in a single PI
• Features are implemented via stories
• Stories fit in a single iteration
• User stories describe small slices of a feature
• ‘Enabler stories’ support value – exploration work, architecture, infrastructure work.

The SAFe Requirements Hierarchy

Epics represent business initiatives that typically take multiple program increments (PI’s) to fully deliver to production. Features represent product or service capabilities that solve specific problems at the user level, and can be delivered in a single PI. At the lowest level of granularity User Stories are things that deliver thin slices of functionality and can be delivered within the time-box of a single iteration.

SAFe Program Backlog Construction and Refinement

Here is a more detailed view of the basic flows:

Planning Poker Approach

Some organizations may take this a step further and map out a feature into its constituent user stories and story estimates. However in SAFe, this step is conducted during the PI planning event. Whatever approach is taken, it is most important that all features show up for release planning in a consistent state of preparation, that is, we have a definition of ready for features entering the release planning process. I’ve seen teams get very frustrated because they have story mapping and estimation complete, but are now waiting for another team to complete their analysis before they can move forward. All teams should have the same starting point. If we set up a proper kanban system to manage feature intake and refinement, then we will have explicit policies for entry and exit of each workflow state of the intake process.

PI Planning Inputs and Outputs

Inputs (Pre-Work):

• Product backlog features prioritized & ranked.
• Business review of each feature completed
• Technical analysis done, feasibility established, architecture and solution understood, enabler features identified.
• Features ranked (for example using WSJF) – single common stack for the entire program
• Features sufficiently defined to support release planning and estimation.

Process Steps:

• Story Mapping: Features elaborated into user stories
• Story Sizing: Stories estimated (to +/- 20%) via bulk estimation
• Story Scheduling: Initial allocation of stories to sprints, taking into account team velocities and dependencies.
• Feature delivery dates determined (to nearest sprint)
• Release scope set based on velocity and target release date.
• Consolidated release plan showing feature completion dates.

Outputs:

• Release scope defined for next timebox
• Team better comprehends the objectives for the whole PI.
• Shared understanding of what it takes to release
• Program risks reviewed and actions identified to solidify the plan
• Release objectives reviewed and scored by business stakeholders
• Team and program confidence vote on the plan
• Collective ownership of the plan

To summarize, the PI planning event takes as input the highest priority feature list from the program backlog, and performs sufficient analysis (story mapping, sizing and scheduling), resulting in a reasonably good commitment on what can be delivered – PI objectives plus timelines – in the next program increment:

• PI objectives may be expressed as a list of features and/or higher-level business objectives, but can contain other items such as milestones (e.g. trade show events), and significant technical ‘enablers’. BV (Business Value) – A score between 0-10, set by business stakeholders .
• The consolidated Program Wall Board shows the feature delivery timeline by team.

PI Planning Part 1: Creating Draft Plans

The assumption at this point is that we have a Program Backlog sufficiently refined to support story writing and sizing. (Some teams may actually do story writing ahead of the planning event). PI Planning is carried out in 2 basic steps (with usually 1 day devoted to each). Each team will first create draft plans. These plans include 3 basic things: a feature delivery timeline, a set of PI Objectives, and a risk assessment. In this section we will describe the sequence of activities required to accomplish each major step. We will summarize the steps and then go through each one in detail:

1. Create Stories from Features
2. Story Size Estimates
3. Story & Feature Scheduling – Assign Stories to Iterations
4. Identify Risks and Dependencies
5. Align Team Deliverables with Program Objectives
6. Leadership review & problem solving

Poker Planning Approach Examples

Teams will separate into break-out sessions to work on these steps, using their team wallboards to capture the results of their planning work. Teams will then make a presentation of their draft plans to the entire gathering of teams and stakeholders.

1. Create Stories From Features

Sometimes known as Story Mapping, this activity involves taking a set of features and breaking each one down into small slices of functionality that can be delivered in a single iteration. It is not necessary at this stage to define stories to the extent that they meet a definition of ready – that can be done closer to the iteration they will be delivered in as part of the backlog refinement process.

Story Mapping Step-By-Step:

• Create the “backbone” of the story map. These are the large activities or basic business process steps that the users need to carry out. Capture the end-to-end user process flow. Consider these as functional steps or ‘features’.
• Start defining potential actions the user will take to accomplish each function. Some of these steps may be optional. These can be considered the ‘user stories’. (They may need to be split into smaller items later during backlog refinement).
• Create the “MVP”. This is where you select a set of user stories or options that can give you the minimum end-to end value of customer experience for a viable initial solution.

2. Story Size Estimates

Since we may have a large number of stories to estimate, we need a faster method than holding a planning poker session for each individual story. One approach that can be used is estimation by linear affinity:

• • Affinity Estimating is good for generating initial estimates for large Product Backlogs, e.g. for PI Planning. Stories not necessarily fully defined (Ready)
  • Teams place stories in buckets of relative size: XS, S, M, L …, or Fibonacci: 1,2,3,5,8,13 … (Recommended).
  • SM facilitates
  • PO available to take questions and clarify stories
  • Further refinement happens via Planning Poker later when stories are ‘Ready’

  3. Story and Feature Scheduling

  We now have features broken into user stories with size estimates. The next step is to allocate stories to sprints by taking into account story size (in points) and team velocity (points per iteration). In the following example, Team Vikings has 2 features, Feature 1 has 5 user stories with a total of 16 points, and Feature 2 with 4 stories and a total of 11 points. Each team will need to set up a Team Wall Board which they will use to assign stories to sprints based on priorities, dependencies and velocity. In this example, given team Vikings’ velocity is 15 points, then we can estimate that Feature 1 will be fully delivered in Sprint 2 at the earliest.

  As the team continues to populate their iterations with stories, they will also begin to identify risks and/or dependencies. These should be captured on a separate sheet on their wall board for later discussion. Once all stories have been scheduled into iterations, the team should then be in a position to identify when each feature will be delivered (to the nearest iteration). This information will be used later to populate the overall Program Wall Board.

  What if a team does not have an established velocity? Use capacity-based estimation via the following steps:

  1. Estimate Team Capacity: (e.g. 5 Dev/QA/DA/UI * 10 days = 50). 50 staff-days of available capacity per iteration. Total PI capacity = 5 * 50 = 250 effort-days’
  2. Story Discovery: Features to Stories as described in an earlier section.
  3. Story Sizing: Stories should be 1,2,3 or 5 days of effort (split if bigger than 5 days). (Do not break stories into tasks to estimate!)
  4. Story Scheduling:
     • Assign stories to iterations based on size/capacity
     • Update iteration flip-charts, reconcile load vs. capacity
     • Determine when features are done (to nearest iteration)
  5. Update the Program Board. Once each team has completed story scheduling they should have an idea to the nearest iteration when each of their features will be completed. The Program Board is intended to show the feature delivery timelines per team. This should be updated so that the program team and stakeholders have a complete program view as input to the leadership review and problem-solving session at the conclusion of PI Planning Part 1.

  4. Risks & Dependencies

  As teams work through the process of allocating stories to sprints and reconciling feature sizes with velocity or capacity they will inevitably discover dependencies and areas where they do not have sufficient capacity. Dependencies constitute risk in that they represent items on which the team has no direct control over. Dependencies may be on teams inside the same train, on teams outside the train, and even on teams outside the company, each representing increasing levels of risk. Teams may need to consult with other teams to get commitments on dependencies and may need to adjust delivery schedules based on these commitments. Other risks may simply be that a team has insufficient capacity to delivery everything that was asked for. In this case a team may need to de-scope features or even defer entire features. The overall risk, based on a team’s ability to resolve, or mitigate these risks will play directly into their confidence vote on their PI Plans. These risks are presented to the stakeholder team as part of their overall draft plan presentation.

  5. Setting Team PI Objectives

  PI objective setting gives teams the opportunity to validate with stakeholders that they have clearly understood the intent and priorities defined for the PI in terms of business value. This step will help ensure that there is a high degree of alignment between business stakeholders and delivery teams. What we want to see here are objectives and not features. What’s the difference? Formulate objectives by thinking about the problems that are being solved for the user (Better, Faster, Cheaper, and so on). Think of features as being the solutions to those problems.

  • This step is about assigning overall business value to the PI.
  • The intent of this exercise is to summarize the PI in terms of meaningful business objectives, and to confirm alignment between teams and stakeholders. Features deliver benefits that are aligned with business goals.
  • PI objectives should be SMART: Specific, Measurable, Achievable, Realistic, Time-Bound.
  • Business stakeholders circulate and score the team’s objectives, assigning a ‘business value’ between 0-10, where 10 represents the highest business value. Each team starts with their most valuable PI Objective as a ’10’, then all remaining PI Objectives are scored relative to that first 10. BV can either scored as relative within the team, or relative to the overall train.
  • At the next PI planning event, following the PI demo’s, business stakeholders will rate objectives based on what was actually achieved – this data is the basis of the Program Predictability Metric. (Pass out a printed list of PI objectives with original rankings to the stakeholders with additional column for actuals).

  6. Leadership review & problem solving

  Once all teams have presented their draft plans, including any risks that have been identified, that basically wraps up the first day for everyone except for the leadership team. The teams will typically head out to dinner at this point, while the leadership team remains at the event venue to work on the following questions:

  • What have we learned so far?
  • Where do need to adjust: Vision, Scope, People?
  • Where are the bottlenecks?
  • What features must be de-scoped, or deferred?
  • Decisions needed before tomorrow?

  The last question is key. The leadership team must work through enough of the list of issues and risks so that teams can move forward again the next day. The overarching goal is to optimize the amount of business value that can be produced by the entire release train. This may involve scope adjustments and/or rebalancing of team capacity.

  PI Planning Part 2: Make Adjustments and Finalize Plans

  At the kickoff for part 2, usually first thing the next morning, the leadership team will announce any required changes to feature priorities and team changes. Once this is communicated the teams go into another round of breakout sessions and make any required adjustments to their plans.

  The overall agenda for the day will look like:

  • Program adjustments from leadership review – priorities, scope changes, people moves
  • Team breakout #2:
  • Teams adjust & finalize plans
  • Stretch objectives setting
  • Teams identify remaining issues needing help from outside team
  • Business stakeholders circulate to review plans and score PI Objectives
  • Team-level confidence votes.
  • Program wall-board: Feature delivery timelines by team.
  • Team plans collected to front of room, risks ROAM’ed, program confidence vote.
  • Event retrospective.

  1. Team Breakouts 2 – Plan Adjustments

  Having heard from the leadership team, teams conduct a second round of breakouts to incorporate changes in priorities, scope, people moves into their plans. This involves updating team wall boards to reflect any scope changes and with feature delivery timelines, updating the team’s list of risks, and potentially revising the teams list of program objectives. At this time, teams also identify any ‘stretch objectives’ and add them to their list of program objectives:

2. Scoring PI Objectives

Each team summarizes their overall PI in terms of objectives, and these are reviewed by the business owners. Business value is assigned to each objective (scored 1-10). Note what we want to see here is objectives and not just a list of features. What’s the difference? Formulate objectives by thinking about the problems that are being solved for the user (Better, Faster, Cheaper, and so on). Think of features as being the solutions to those problems. Features have specific benefits for the user, and these are usually traceable back to an epic ‘value statement’ and from there back to at least one of the strategic themes identified for the business. At least be able to articulate the answer to why the feature is needed in terms that a business stakeholder can understand.

At the beginning of the next PI planning event, completed objectives should be demonstrated to the business stakeholders, and each one should be re-scored based on the perceived value actually delivered. These scores are compared with the original scores. The number of completed objectives is compared with the plan and the Predictability Metric score is derived. This can be displayed using a control chart: (See below).

3. Program Risk Review

Teams will conduct a ROAM’ing exercise on their list of risks, that is, they will review each risk and assign them to one of 4 categories:

• R: Resolved. The team has resolved (or knows how to resolve) the risk.
• O: Owned. The teams decides to ‘own’ the risk, that is, they will take responsibility to work to resolve the risk on their own without needing to escalate for help.
• A: Accepted: The team accepts the risk as something that is ‘part of life’, or part of the cost of doing business.
• M: Mitigated: The team believes they can take specific actions to reduce the impact of the risk.

Those remaining risks that each team feels they need help with are consolidated in a single list at the front of the room, and are reviewed by the program team and stakeholders. Further attempts will be made to resolve or at least mitigate these risks, else they will be carried outside the event (by the RTE) to be worked on further.

4. Program Wall Board Update

The Program Wall Board represents the consolidated feature delivery timeline from all teams. It is used to provide a consolidated summary of features completion dates, enabler items, dependencies and major program milestones.

Here is an example:

In this example we have a program board with 8 teams (Vikings, Gauls, Celts, …) and 5 iterations, and a program board that shows the planned completion dates for each feature included in the PI. Red string is used to show dependencies between features or between features and enablers. Also included are any major milestones planned during the PI. Some teams make the mistake of placing user stories on the board. This is not necessary and only serves to clutter up the board. Once PI Planning is over, the program board can be a key information radiator for use at Scrum-Of-Scrums.

5. Program Confidence Vote

The Program confidence vote is a Fist-of-Five vote from all team members. Any vote less than 3 should be explored and commitments potentially re-worked until all team members vote at least a 3.

6. PI Planning Event Retrospective

The final step before wrapping up the event is to conduct a retrospective of the event itself. It can be as simple as a 2-column table drawn on a whiteboard or flip-chart with a column for ‘what went well’ and another for ‘needs improving’. Participants invited to add their comments via post-its. Once all comments have been posted, a dot-voting exercise can be done to identify the issues most important to the gathered teams. This is to generate feedback and identify improvement actions for the next event. This exercise can be done fairly quickly with the RTE facilitating.

Room Layout for Optimal Collaboration

• Everyone in 1 room
• Dependent teams in the center (Architects, Program Team, Stakeholders)
• Visual Aids for Planning:
  • Ranked feature list
  • Team wall boards
  • Program wall board
  • Program Objectives List