So far, so good

It has only been a few weeks into the new year but I think we are off to a good start here at recipeforIT.com. Given the significant number of new readers, I thought I would touch again on the key goals for this site and also give you a preview of upcoming posts and pages.

As many of you know, delivering IT today, with all of the cost reduction demands, the rapidly changing technology, the impact of IT consumerization, and security and risk demands, is, simply put, tough work. It is complicated and hard work to get the complex IT mechanism, with all the usual legacy systems issues, to perform as well as the business requires. So to help those IT leaders out, I have started this site to provide recipes and ideas on how to tackle the tough but solvable problems they face. And in addition to providing best practices, we will give you a solid and sensible perspective on the latest trends and technologies.

So what is upcoming? First, I have two esteemed former colleagues who have run top notch service desks that will be authoring material on best practices and how to deliver an outstanding customer experience through this critical interface. Look for their posts on the ‘face of IT’ over the next several weeks. Second, I want to touch on innovation and the increasingly common business fascination with innovation as a solution to all manner of business ills. I hope to also explore leadership further in February. And lastly, I have a number of incremental but hopefully material improvements to the site pages that will provide further details on best practices in a comprehensive manner.

I think it is a good lineup for the next month! I continue to receive strong feedback from many of you on the usefulness and actionability of the material. I will definitely work to ensure we maintain that relevance.

Don’t forget you can subscribe to the site so you get an email when there’s a new post (subscribing is on the rightmost bar, halfway down the page). And feel free to provide comments or suggestions — the feedback really helps!

If you are new to the site, I recommend a few posts for relevance and fundamentals:

There’s lots more to come and have a great week!

Best, Jim

A Continued Surge in IT Investment

In recent posts, I have noted previous articles on how the recovery in the US has been a ‘jobless’ recovery yet one with stronger investment in equipment and IT. This peculiar effect in the latest reporting appears to be even more pronounced, perhaps even running in ‘overdrive’. According to yesterday’s Wall Street Journal article, the investment in labor savings in the US stepped up at the beginning of the decade, but with the recession, companies found bigger opportunities to automate even more with machinery and software.  Timothy Aeppel, the author notes, this investment and spending level has continued broadly through the fourth quarter. And while certainly investment in technology will cause employment subsequently to rise, I think it appears that CEOs are investing in technology far more than adding staff as in previous recoveries. And they are doing this for a reason — they can get better returns from the machinery and robotics and software than before. Part of this is due to low interest rates and unique tax breaks, but I believe that technology is enabling greater returns on reducing costs and improving productivity than previously. Further, I think fundamental changes in IT capabilities and robotics are fueling improved returns from automation even more than has occurred in the past, spurring even greater investment in IT.

Historically, IT applications and systems were applied to domains with large amounts of the routine work, often done by hundreds if not thousands of staff. These were the areas that justified the cost of IT and provided the greatest return. Improvements in application and database technology enabled technology to tackle tougher and more complex problems. It also enabled leverage of technology on medium scale processes. Basic toolsets like email and Sharepoint tackled the least complex and departmental processes. This progress is represented in the diagram below.

The introduction of client server platforms allowed solutions to be applied to routine work on a smaller scale, to large departments and medium sized companies rather than just divisions and large corporations. This accelerated with the internet and the advent of virtualization.

But the cumulative and accelerating effect of new development technologies and methods, new toolsets, new client devices, cloud infrastructure, and advancing data and analytics capabilities has enabled a far broader range of solutions to be applied easily and effectively across a wide range of institutions and problem sets. Small and medium sized companies through cloud services can now leverage similar infrastructure capabilities that previously could only be implemented and afforded by the largest corporations. This step change in progression is represented by the chart below.

The increase of automation scope with new Tech toolsets

The new lightweight workflow tools like IBM’s Lombardi toolset and many others open up almost any departmental process to be easily and rapidly automated and achieve a decent ROI.  The proliferation of client interfaces through the internet and mobile allow customers to self serve intelligently for almost any product and service, enabling the elimination of large amounts of front office and back office work. This cumulative and compounding effect is truly a step change in what can be done by IT to automate the work within medium and large companies. And yet, despite this sea change in capabilities, you still find many IT departments focused almost wholely on their traditional scope. The projection initiation and selection process is laborious and even arduous, oriented towards doing large (and fewer) projects. The amount of overhead required to execute almost any typical project would overwhelm lightweight automation for departmental-sized efforts. And yet, there are huge new areas of scope and automation that are possible now in almost every company. And so how do you start to prove out these new areas and adapt your processes to enable them to get done?

I think there are several ways to get started here, some of which I mentioned briefly in my December post on  ‘A few things to add to your technology plans’.

1. Improve customer signup or account opening: Unless your company has redone these functions within the past 24 months, it is doubtful that this area is up to the latest expectations of customers.  Enable account opening from the web and mobile devices, leverage the app stores to provide mobile clients that have additional, useful and cool functions (nearest store, nearest ATM, or if you are a climbing gear company, the current temperature and weather at base camp on Mount Everest). Make them easy to navigate and progress through the application with  progress bar and associated menu. Ensure the physical process at the store or branch is as easy as the internet version (i.e., not twenty pages of forms). And tighten up the security with strong passwords (many sites today have a strength indicator as you type in the new password) and two factor security on critical transactions (e.g. wire transfers or bill payments). Remember you can now deliver the two factor security through the customer’s mobile device and not a separate token.

2. Fix two or three process issues that are basic transactions for customers: Just as you need to continually cycle back through your customer interfaces to keep them fresh and take advantage of the latest consumer technology, you should also need to revisit some of the basic transactions that business typically fail to put on their list to invest and yet become problematic service areas for customers. These would be areas like change of address or statement reprints or getting a replacement card. Because they are never on the project list, these services remain backwaters of process and automation with predictable frustration for the customers, high error rates, and disproportionate manual effort to complete. Work with a strong business partner (perhaps the COO or someone close to the customer experience) to tee these up. Use the latest workflow tools to tackle the process piece. Leverage the latest data warehouse and ETL capabilities to integrate the customer data across business units and applications so that the process can be once and done. If you are not sure on what basic customer process to start, then talk to the unit handling customer complaints and look for those processes that have the highest number of issues yet the customer is trying to do something quite basic. Remember, every customer complaint requires expensive responses that by eliminating, you drive material improvements in productivity and cost.

3. Implement more self-service: An oft-neglected area is the improvement of corporate support functions and their productivity and service. In a typical corporation almost every employee is touched by the HR and Fiance processes, which can be heavily manual and archaic (again they rarely show up on the project list) By working with your Finance and HR functions you can reduce their costs and improve their delivery to their users through implementation of automation and self-service. The advanced workflow toolsets (IBM’s BPM) mean you can do far more with incremental, small tiger team efforts than ever before. Your scope to automate and move to self service on your intranet is much greater. More and more minor business processes than ever before can be automated at far less cost and effort. The end results are higher productivity for your business, lower operations costs in HR and Finance, a more satisfied user base, and a better perception of IT.

4. Get to a modern production and service toolset for IT: For the past twenty years, there have been two traditional toolsets that most companies leveraged for production processes and service requests (Remedy and Peregrine). And most of us have implemented (with some struggle) reasonable implementations that met the bulk of our needs. But the latest generation of these toolsets (e.g., ServiceNow) make our previous implementations look like dinosaurs. And when you consider the 60 or 70% of your staff and service desk are using these tools every day, and you can make them far more productive with a new toolset, it is worth taking a look at. Further, your business users, will love the new IT ordering facilities on the intranet that are better than ordering a book from Amazon. By the way, the all-in operating cost of the new tools should be substantially less than your current costs for Remedy or Peregrine. And your team will be operating at a step level improvement in efficiency and productivity.

5. Get Going in Business intelligence: One last item to make sure your company is capitalizing on is leveraging the data you already have to know your customer better, improve your products or services, and reduce your costs. Why have advertising for customers who never click through or buy? Why do customers call your call center when they should be able to do it easier online? Wade through all the unstructured data being generated on social about your company to figure out how to improve your brand. Knowing the mood of the market, understanding your customers and the perspectives on your products and services requires IT to partner with the business to leverage the data you have to obtain intelligence. Investing in this area can now be tackled with the new big data tools on the market. If you are not doing much here, then I recommend finding out what your competitors are doing and sitting down with your business partners to sort through what you must do.

So, there’s 5 things that five years ago, would have never made any list. Yet if you make real progress in 3 of the 5, you can hit home runs in customer satisfaction, service quality, and a much better view of IT. And most important, you can ensure your company stays ahead of the game to achieve greater productivity and lower costs.

Any views or alternate perspectives on the progression of IT tools and solutions? Do you see the same sea change that I am calling out here for us to take advantage of?

Let me know. Best, Jim

Delivering More by Leveraging the ‘Flow of Work’

As you start out this year as an IT leader and you are trying to meet both project demand on one hand and savings goals on the other, remember to leverage what I term the IT ‘Flow of Work‘. Too often, once work comes into an organization, either through a new project going into production or through the original structure of the work, it is static. The work, whether it is server administration, batch job execution, or routine fixes, continues to be done by the same team that often developed it in the project cycle. Or at best, the system and its support are handed off to a dedicated run team, that continues to treat it as ‘custom’ work. In other words, once the system has been crafted by the project team, the regular work to run, maintain, and fix the system continues to be custom-crafted work.

This situation, where the work is static and continues to be executed by the initial, higher cost resources, would be analogous to a car company crafting a prototype or concept car, and then using that same team to produce every single subsequent car of that model with the same ‘craft’ approach. This of course does not happen as the car company moves the prototype to a production factory where the work is standardized and automated and leaned, and far lower cost resources execute the work. Yet in the IT industry we often fail to leverage this ‘flow of work’. We use senior server engineers to do basic server administration tasks (thus making it custom work). We fail to ‘package’ or productionalize or automate the tasks thus requiring exorbitant amounts of manual work because the project focused on delivering the feature and there was not optimization step to get it into the IT ‘factory’.

Below is a diagram that represents the flow of work that should occur in your IT organization.

Moving work to where it is most efficiently executed

The custom work, work done for new design, or complex analysis or maintenance, is the work done by your most capable and expensive resources. Yet, many IT organization waste these resources by doing custom work where it doesn’t matter. A case in point would be anywhere that you have IT projects leveraging custom designed and built servers/storage/middleware (custom work) instead of standardized templates (common work). And rarely do you see those tasks documented and automated such that they can be executed by the IT Operations team (routine work). And not only do you then waste your best resources on design that adds minimal business value, you then do not have those best resources available to do the new projects and initiatives the business needs to have done. Or similarly, your senior and high cost engineers are doing routine administrative work because that is how the work was implemented in production. Later, no investment has been made to document or package up this routine work so it can easily be done by your junior or mid-level engineering resources.

Further, I would suggest that you often find the common or routine engineering work stays in that domain. Investment is infrequently made to further shrinkwrap and automate and document the routine administrative tasks your mid-level engineers so that you can hand it off to the IT Operations staff to execute as part of their regular routine (and by the way, the Ops team typically executes these tasks with much greater precision than the engineering teams).

So, rather than fall into the traps of having static pools of work within your organization, drive and investment so that the work can be continually packaged and executed at a more optimal level and free up your specialty resources to tackle more business problems.  Set a bar for each of your teams for productivity improvements. Enable them the time and investment to package the work and send it to the optimal pool. Encourage your teams to partner with the group that will receive their work on the next step of the flow. And make sure they understand that for every bit of more routine work that they can transition to their partner team, they will receive more rewarding custom work.

After a few cycles of executing the flow of work within your organization, you will find you have gained significant capacity and reduced your cost to execute routine work substantially. This enables you to achieve a much improved ratio of run cost versus build costs by continually compressing the run costs.

I have seen this approach executed with great effect in both large and mid-sized organizations. Have you been part of or lead similar exercises? What results did you see?

Best, Jim

 

IT Project Delivery – Dismal Government Projects Track Record

In the past several weeks, I have posted on project management best practices. And we talked about the track record of the IT industry as being, at best, a mixed bag. It turns out  for the UK government, that would be putting a very positive spin on their IT projects. The Times recently ran an article* detailing the eight worst areas in the government which have cost the taxpayers dearly. IT projects had 3 blatant failures of the eight and had a major hand in 2 of the remaining. How did it come to this? Why is practice of IT reasonable for more than half of the UK government wasteful initiatives? And these are not minor blowups. The Fire and Rescue Plan, which started out as a 120 million pound effort to consolidate 46 control rooms to 9 regional centres was finally axed after it cost 469 million pounds! A straightforward project (how many of us have consolidated call centres, trading floors or command centres in the past 10 years? I would venture 50% of your firms have done this) that cost 4 times the estimate and never even delivered! And that is not the worst one: the NHS records project has cost 6.4 billion pounds to date with at least 2.7 billion of that wasted. While there are 60 million citizens in the UK, many of us in industry have customer bases in the tens of millions where we keep critical financial data safe and accessible for our customers. So while I would agree the health records breaks new ground in some areas, it is not the Manhattan project. This is a very doable project where given the monies spent, it should have already delivered significant benefit and capability. And yet very little has been delivered and there is low confidence this will change in the near future for the program. Overall, how can IT projects have 3 of the 8 slots of government failure areas when the defense industry only has 1 (and you could argue IT projects contributed heavily to that one)?

I think this dismal track record in government for IT projects is  due to some common issues and a few unique ones. First, typically there is poor and ambiguous sponsorship. And it is compounded by very weak and changing requirements. Too many parties and groups in government with a stake and a reason to argue and change the project. Applying the methods of  political processes of lengthy debate, consensus and influence to defining and running a project are a recipe for disaster. And I suspect the contractors doing the work likely encouraged changes and debate as this was then an opportunity to grow scope with much higher margin work (change orders are always much more profitable than the original bid). Second, the approach undoubtably used a waterfall method. And given the size and scope and vast array of stakeholders, each step (e.g. requirements definition, etc)  took an extremely elongated time. An elongated schedule with a cumbersome and bloated program structure to match the stakeholder complexity would certainly have multiplied the costs. Still, it takes even more to cause such spectacular blowups.

There is an excellent book, Software Runaways, available that documents such ‘death march’ projects. ‘Death march’ projects are the kind of massive program that everyone knows is doomed to failure and yet everyone is still lashed to the ship on this voyage to failure. It is a fascinating read and some ways like watching a traffic accident unfold — it’s pretty awful but you can’t tear yourself away. Of course, the UK government and its contractors do not have a monopoly on such spectacular program failures (though they certainly seem to be doing their best to enable additional chapters to be written). What is relevant here though is that the book does an excellent job of reviewing about a dozen of the more interesting past IT program failures and identifying the root causes. These rot cause include the poor sponsorship and ill-defined requirements we discussed above. But it also describes the mentality that sets into a large program team on their ‘death march’. In essence, even though the members of the team know there are massive flaws in the program, because of the complexities and different agendas and influences of a large complex program team, they are often unable to repair them from within. Even worse, when an external party identifies the flaws, the program team then bands together to defend from such external attacks at all costs.  Their identity has become so caught up in the program that they would create a Potemkin village to demonstrate that there are no flaws.

So, it is the instinct of these large program organizations that assume a life of their own with all the members now vested in its survival (not its delivery but its survival)  that when combined with major flaws (such as ill-defined requirements or the wrong methodology) creates the spectacular failures. Or, put another way, it is how humans work together within large programs that if based on poor practices, can be multiplied to raise the negative results to such an irrational level.

With that in mind, what are some approaches to prevent this from occurring? I would suggest the basic ones of ensuring there is clear sponsorship, proper steering committees should help, but more radical changes to the approach would be better. Let’s take the command centre consolidation. Why do all 46 into 9 in one waterfall or ‘big bang’ approach? Instead take two regions of the 9 and do two pilots, each constructed with their separate sponsors, steering committees and contractors. Set an overall schedule for them to deliver to a well-defined, but high level set of requirements or outcomes. The team that completes their work on time and meets the requirements will have an opportunity to bid on the next two regions to be consolidated. And the one that does not meet the bar will result in the contractor being barred from the next round of work and a negative performance mark will go on the sponsors and government leads. Now, the payoff for contractor encouraging endless changes by government is gone. Further, you are breaking up the work into more doable components that can then be improved in the next regional implementation. Smaller problems sets are eminently more doable then massive ones. By changing the approach to more incremental work with short cycles and aligning program structure and incentives to getting real results, I think you would find a dramatic difference in the delivery of the project.

While these changes would certainly improve project delivery, I am sure there are several other elements that have caused impact and problems. What would you change? How do we get IT projects to not be a huge portion of wasted taxpayer funds?

I look forward to your comments.

Best, Jim

* The Times, which is a very good newspaper, unfortunately does not provide access to its articles via the internet without a subscription. If you have a subscription, the article title is ‘Scandal of the big spenders who have cost taxpayers dear’ published on January 9, 2012.

Ensuring Project Success II: Best Practices in Project Delivery

I hope that you are back from holidays well-rested and ready to go for the new year. My previous post provided some tips on how to get off to great start of the new year, today’s post will focus on some additional best practices for Project Delivery (I covered project initiation and project reporting and communication practices in my December post on project delivery). Today, I will cover project management best practices. I expect to also extend these posts with a project delivery best practices pages that will cover more details over the next month.

As I previously mentioned, project delivery is one of the critical services that IT provides. And yet our track record as industry of project delivery is at best a mixed bag. Many of  our business partners do not have confidence in predictable and successful IT project delivery. And the evidence supports their lack of confidence as a number of different studies over the past five years put the industry success rate below 70% or even 50%. A good reference in fact is the Dr. Dobbs site where a 2010 survey found project success rates to be:

  • Ad-hoc projects: 49% are successful, 37% are challenged, and 14% are failures.
  • Iterative projects: 61% are successful, 28% are challenged, and 11% are failures.
  • Agile projects: 60% are successful, 28% are challenged, and 12% are failures.
  • Traditional projects: 47% are successful, 36% are challenged, and 17% are failures.

So, obviously not a stellar track record in the industry. And while you may feel that you a doing a good job of project delivery, typically this means the most visible projects are doing okay or even well, but there are issues elsewhere in less visible or lower priority projects.

There are also a few critical techniques to overcome obstacles including how to get the right resource mix, doing the tough stuff first, and when to use a waterfall approach versus incremental or agile. I will cover the first two areas today and the rest over the few weeks.

Project Management – I think one of the key positive trends in the past decade has been the rise of certified project managers (PMP) and the leverage of a PMI education and structure for project activities. These learnings and structure have substantially raised the level of discipline and knowledge of the project management process. But, like many templates, if used without adjustment and with minimal understanding of the drivers of project failures, you can have a well-run project that is not going to deliver what was required.

First, though I would reinforce the vlaue of ensuring your project manager have a clear understanding of the latest industry PMI templates and structure (PMBOK) and your organization should have a formalized project methodology that is fully utilized. You should have at least 50% of your project managers (PMs) within your organization be PMP certified. If you have low proportion of PMs with certification today, set a goal for the team to achieve step improvement through a robust training and certification program to move the needle. This will imbue an overall level of professionalism and technique within your PM organization that will be beneficial. The first foundational attributes of good PMs are discipline and structure. Having most, if not all, of your PM team familiar with the PMI will establish a common PM discipline and structure for your organization.

So, assuming you have in place a qualified PM team and a defined project methodology primarily based on the PMI structure, then we can focus on three key project management best practice areas. Note these best practice areas help mitigate the most common causes of project failures which include:

  • lack of sponsorship
  • inadequate team resources or skills
  • poor or ambiguous requirements or scope
  • new technology
  • incorrect development or integration approaches for the scope, scale, timeframe or type of project
  • inadequate testing or implementation preparation
  • poor design

As I mentioned in the Project Initiation best practices post, there is a key early gate that must be in place to ensure effective sponsorship, adequate resources, and proper project scope and definition.  Most projects that fail (and remember, this is probably half of the projects you do), started to fail at the beginning. They were started without clear business ownership or decision-makers, or with a very broad or ambiguous description of delivery. or they were started when you were already over-committed, without senior business analysts or technology designers.  Use this entry gate to ensure the effort is not just a waste of money, resource time, and business opportunity.

So assuming you have executed project initiation well, you should then leverage the following project management best practice techniques.

Effective definition, design and implementation approaches:  Failure in these areas is often due to what I would call ‘beating around the bush’. In many projects, getting the real work done — well-defined requirements, the core engineering work, thorough testing is hard and takes real talent. Many teams just work on the edges and don’t tackle the tough stuff. I recommend ensuring that your project managers and design leads are up for tackling the tough stuff in a project and doing it as early as possible (not late in the cycle). And when it is done, it should be done fully. So, some examples:

  • if requirements are complex and ambiguous at the start, a good project manager will schedule rigorous project definition sessions. The PM will ensure broad participation, and good attendance and engagement at the meetings. Perhaps even a form of Rapid Requirements is used to quickly elicit the definitions needed. Or, the project team will use an agile or highly iterative incremental approach to take back to the user interfaces and outputs for early clarification and verification.
  • if new technology is being used, or there is a critical component or algorithm that must be engineered and implemented, then work begins early on these core sections. A good PM knows you do not leave the tough stuff to be done last. In particular, these means you do not wait for the final weeks of the project to do complex integration. Instead you develop and test the integration early with stubbed out pieces. Pilot and test, if necessary in parallel, the tough stuff. And if there are major hurdles not anticipated, then you will find them out early and you can kill or alter the project much earlier with far less sunk costs.
  • as CIO, make sure that major IT initiatives that your company is investing in make a difference where the rubber meets the road. The system must be easier to do the most common tasks, not just lots of features and cool. You want to make sure the front line staff will want to use the new system (not be forced to convert).
  • in sum, the approach for the design and implementation work should be incremental, parallelized and iterative rather than serial, waterfall, or as I like to call it, ‘ big bang theory’.  Waterfall can be used for well known domains, well understood engineering, and short or mid-range timelines. Otherwise, it should be avoided.

Project checklists, inspections and assessment: Use lightweight project and deliverable review approaches to identify issues early and enable correction. Given the failure rate on projects is typically 50% or more, and given the over-demand on most IT shops, nearly every project will have issues. The key is to detect the issues early enough so they can be remedied and the project can be brought back on track. I have always been stunned at how many projects, especially large ones, go off track, continue to be reported green while everyone on the project team thinks things are going wrong, and only at the very last minute do they go from green to red.  Good quick assessments of projects can be done frequently and easily and enable critical early identification of issues. These assessments will only work if there is an environment where it is okay to point out issues that must be addressed. (By the way, if 90%+ of your projects are green, that means either no one can report issues or you have an extremely good project team). The assessments can be a checklist or a quick but thorough review by experienced PMs, issues should be noted as potential problems, and they are compiled and left with the PM and the sponsors to sort through and decide if and how to address them. Your senior manager in charge of your PMs and you should get a monthly summary of the assessments done. Often you will find the same common issues across projects (e.g. resource constraints or late sponsor sign off on requirements) and you can use this to remedy the root cause.

Another key technique to use in addition to project assessments is inspections.  Just about any deliverable for a project, requirements, high level design configurations, test plans, can be inspected — not just code. And inspections are an under-utilised yet typically, the most effective way to find defects (other than production). Have your project teams use inspections for critical deliverables. They work. And augment inspections with a few deep dives (not inspections) of your own of both in flight and completed projects to ensure you have a pulse on how the work is getting done and what issues your teams are facing.

I hope to add some Project Assessment Checklists to the best practice pages in the coming month. Anything you would add to the list?

Next week I hope to tackle Program Management and Release Management and key best practices in those areas.

Any good project stories you would like to share? Anything you would change in what I recommended? Let me know.

Best, Jim

 

Your Start of the Year Leadership Checklist

Just as I published a quick checklist for you to use as the year was closing, here is a checklist for your first week back to help you get off to a great start of the new year.  Plus, this is a lot more fun than taking down those outdoor Christmas decorations or doing returns of the unwanted gifts. So before the office gets busy, use your first few weeks to get a jump on outstanding results in 2012 with this list:

1. Remember to get the things done we planned in December. You have booked time in January with your team to do the detailed planning to ensure you have the IT goals for 2012 clearly defined with the key steps to get there. Knock it out with your team.

2. Set your 1st and 2nd quarter virtualization goals for your server and storage and sit down with them and ensure they are mapping out how to get it done. Get them off to a quick start.

3. Pick one or two major contracts to renegotiate in your favor this quarter. A quick hint: Oracle missed expectations last quarter so you may have an opportunity. Remember to hold tight, put something new on the table to get the most out of a deal, and insist on your terms and conditions (and if your company does not have an up-to-date contract template, put that on the plate with your Chief Procurement Officer to get it done).

4. Take those new insights that you gained from your holiday vacation (remember you were going to spend part of your vacation time reading a good management or IT book) and ensure you bring the view to your planning meeting.

5. Review your January schedule and ensure you have time with your customers fully scheduled. Invite one of them to kick off your planning meeting.

6. Also review the planning meeting agenda with your boss and ensure you capture any ‘messages’ he/she wants to make sure come across.

7. Sit down with the intranet team and ensure they are adding 1 or 2 helpful ‘widgets’ a quarter to your intranet site. Start with a ‘How do I …’ list button or improved search tool, or a wikipedia for corporate terms and abbreviations. The little helpful things mean a lot to the productivity of your company’s employees.

8. If you don’t have BYOD yet, sit down with your client device team and review the plans to pilot and then implement it this year.

9. Schedule a visit for you and several of your team to review either a customer facing site (call center or retail store) or a key operations facility for your company. Ask questions and see how IT is working where the rubber meets the road in your firm. I am certain you will learn plenty.

10. Review and report on your performance for the past year – do it with thought and be provocative. Challenge yourself and your team where you have not delivered well. Then follow up with a high level and positive note to your entire team talking in broad strokes about the goals for the year. Strong communication at the start of the year will help ensure you and your team are lined up for success throughout the year.

Many of these items are reconnecting activities: with your business, with your customers, with your boss, and with your team. Before you start off on any major endeavor, it is critical to recheck the plan and the communication lines — that is in essence what we are doing. And with it you will be much more likely to have a successful and rewarding 2012.

All the best, and roger on those plans! Jim

Evaluating and Selecting Senior Talent – Perhaps the Google Way?

There was an interesting article earlier this week on the interview approach that Google has used as part of their talent selection in the Wall Street Journal by William Poundstone. My preceding post reviewed the Google approach and what best practices there are for more junior IT talent. In this post, I cover the best techniques for evaluating and selecting senior IT talent.

As mentioned, according the the WSJ article, currently Google gets over a million applications per year, and from this only about 1 in 130 applicants are hired. Yet getting this flood of applicants and having ratios of candidates to hires close to 1 to 100 is not unusual. At the last two large companies I have held senior positions in, we received hundreds of thousands of applications per year, and the end ratio to the hire was close to 1 to 100. And, as an IT leader making sure your HR department can handle these ever-growing volumes effectively is an important service you should provide, especially if you are a retail company. Remember every potential applicant who has a poor experience on your web job site and process is a potential customer who is now turned off on your company. Again, the preceding post covers how to filter and handle this flood today, we will cover the senior end of the spectrum.

For recruiting senior staff, I think it is important to understand two key facts:

  • They already know the buzzwords and techspeak and political positioning and that you are unlikely to catch them out in an interview with traditional questions (e.g., ‘What was your best project experience and why?’ or ‘When have you failed and what did you learn?’ or ‘What weaknesses do you have?’)
  • Fully one third of all senior hires through traditional methods are duds and only one third are outstanding hires or A players

So how do you effectively sort through a knowledgeable field of seemingly qualified applicants and make the right hire and avoid the duds?

The Google approach, and apparently a growing approach elsewhere is to include brain teasers in the interview process such as:

You are shrunk to the height of a nickel and thrown into a blender. Your mass is reduced so that your density is the same as usual. The blades start moving in 60 seconds. What do you do?’

Hopefully, these brain teasers will enlighten the interviewer about the intellect and creativity of the candidate, and also provide how they might respond in a tough situation. While I think this can be better than the stock interview questions that the candidates are already prepared to answer, I think there are a number of better techniques to sort out the best candidates from those who are just adequate or worse, the duds. And again, I think you must start much earlier in the process than the interview.

You should have a dedicated process just for senior candidates staffed with your best recruiters. And these recruiters are good at three things:

  • Being good at cold calling and getting hold of A players who are busy and not looking for a job (we’ll talk later about the source of the names, but this is the entry step)
  • Checking references – really finding out how well and in what manner this person has delivered
  • Recognizing critical cues about the candidate based on the candidates behavior throughout the selection process

In your selection process for senior talent, the first step is the candidate sourcing, or where you get the names of potential top talent that would fill one of your senior positions. This is actually probably the most important step of the process, because if done well, you will have a ready source of mostly ‘A’ caliber talent and you will avoid most of the duds ever getting into your recruiting process. For reliable sources of good talent I would rely on the following:

  • your own personal ‘virtual’ bench – you should cultivate and maintain a virtual bench throughout your career. Those outstanding performers who worked for you or with you and would come and work for you again.
  • thoughtful referrals from your current ‘A’ players – use their virtual bench and their knowledge of other strong performers to reach the A players that you might otherwise not find.
  • industry referenced talent based on either:
    • strong results at top firms or progression working under a well-known strong leader – that’s where quality results, leadership, and excellent approaches are forged.
    • strong recommendations from previous colleagues now working with the candidate – get a real-life view from a reliable perspective.
    • balanced recommendations coming from an established vendor – while taking care to understand their potential bias of course, could point out talents from someone who has a the perspective to measure and benchmark.
  • top recruiters or search firms known for their quality (this must be used in a cautious manner though) – also can have great perspective and if they know you well, and are focused on your needs can get you the right talent. Don’t forget often talent is off the table because of agreements with other clients.

Once you have the right list of candidates then you move into the evaluation and selection process. I have successfully implemented top-grading approaches to interviewing but I would suggest I am an 80% adherent of this method. The top-grading approach can be lengthy and exhaustive but I think you can trim it substantially and achieve the same effect (though I am sure Brad Smart would disagree). And you can improve it by adding and emphasizing behavioral and team interviews. Given that many senior hires do not work out due to culture misalignment, leadership style, or poor teamwork; a behavioral interview focused on these aspects will reveal potential issues. I recommend doing a team type interview where at least one, if not both of the interviewers are skilled in behavioral interviewing and non-verbal cues. Ensure you explore their flexibility and adaptability for   different environments and cultures. Someone who has been highly successful in one environment for 10 or 15 years may be a fish out of water in your firm.

As for those key questions to help sort a great fit from an okay fit, I recommend that you will get a clearer response if you ask a ‘reflective’ question versus a direct question. For example, if you want to understand their personal attributes, rather than ask them a question like “Do you work hard’ or ‘Do you consider yourself innovative’, etc, instead ask them to reflect their own image with questions such as ‘When you are building a team, on what attributes do you select the team members?’  They will not typically have a stock response for a reflective question, and they will be less guarded in their response because they would not perceive that they are talking about themselves, merely their approach. But their answers can be illuminating, it will show what they value. Someone who builds a team based on loyalty and experience attributes is very different than someone who builds a team based on initiative, intelligence, and ability to work through problems. Reflective questions can provide these insights.

Another reflective approach is to simulate leadership approaches and decisions with broad scenarios. Suggest they have inherited a poor performing team. Ask them what they would do. Again, you will get very different answers — some might delegate the problem to a trusted expert, others will apply an improvement approach that has worked for them previously, or they may form a committee to investigate. These are all illuminating. You can also try ‘off-guard’ questions to test their resilience or knowledge. You can even be slightly confrontational to see how they react to such situations. Do they constructively defend their positions or do they just fold and seek full consensus.  I recommend building a developing your own scripts that enable further insights into your senior candidates.

As you narrow down the choices, ensure you check the reference before you have made up your mind. I have seen many poor senior hires where one or two well-placed phone calls would have steered the company clear of the choice. And, if you do make the wrong hire, don’t wait to fix it. The single biggest regret that most senior managers have is not moving fast enough to replace a poor performer. If they are not doing well in the honeymoon period, they will not get going when things get tough. Spare them and you and make a quick and respectful break. Plus, you will likely still have the #2 or #3 candidate available.

The last recommendation I have for senior hires is: don’t forget about the ones on your current team with potential. For senior roles, I think large organizations often ‘pigeon-hole’ current talent and never see the potential they truly have. Someone who is successful in their current role, is smart, capable, coachable, works hard, and gets outstanding results is someone who likely can step up to the next level with assistance. Don’t overlook them.

If you deploy these techniques with senior hires, you should be able to reduce the ‘duds’ rate to 10% and increase the ‘A’ player rate to 60 or 70%. This is a huge improvement that will make a major difference in your organization. So, what techniques or ‘key questions’ have you used to make the right senior hires? Let me know, I am very interested in your approach as this is a tough area to be consistently successful in.

And if you were wondering about the brainteasers, WSJ and Mr. Poundstone also provided the answers to those Google interview questions. I did not provide the ‘right’ answers to the ‘reflective’ questions though.

Best, Jim

Evaluating and Selecting Talent – perhaps the Google Way?

There was an interesting article today on the interview approach that Google has used as part of their talent selection in the Wall Street Journal by William Poundstone. According the the WSJ article, currently Google gets over a million applications per year, and from this only about 1 in 130 applicants are hired. Getting a flood of applicants and having ratios of candidates to hires close to 1 to 100 is not unusual. At the last two large companies I have held senior positions in, we received hundreds of thousands of applications per year, and the end ratio to the hire was close to 1 to 100. Since the advent of the internet job boards and social networking, most large companies are now dealing with a flood of applicants. In fact, enabling your HR department to handle effectively these ever-growing volumes is an important service you should provide, especially if you are a retail company. In other words, every potential applicant who has a poor experience on your web job site and process is a potential customer who is now turned off on your company.

So how do you effectively sort through the flood of applicants effectively, select only the best and leave the rest with a positive experience?

The Google approach, and apparently a growing approach elsewhere is to include brain teasers in the interview process such as:

You are shrunk to the height of a nickel and thrown into a blender. Your mass is reduced so that your density is the same as usual. The blades start moving in 60 seconds. What do you do?’

Hopefully, these brain teasers will enlighten the interviewer about the intellect and creativity of the candidate, and also provide how they might respond in a tough situation. While I think just about any off-the-wall puzzle question could do that, I think there are a number of better techniques to sort out the best candidates from those who are just adequate. And I think you must start much earlier in the process than the interview.

First, you should have two processes: one for senior candidates and one for everyone else (entry, junior, and mid-level). Let’s take the more junior roles first in today’s post. You should note that the source of the candidate has very different yields in terms of strong hires. Thus, you should treat candidates differently based on the recruiting method. And you should greatly prime those recruiting methods that are proven. For the more junior roles, your best sources for ‘A’ caliber staff are graduate and intern programs and referrals from current ‘A’ staff. In fact, I would venture these are 2 to 3 times more effective at getting top staff than all your other methods. So, assuming you have invested as much as possible in these two methods (you have referral awards in place, you have an extensive and well-supported intern and graduate program with appropriate universities), how best to handle and sort the flood of applicants from your other sources and fill the remaining shortfalls?

Consider the process from applicant to new hire as a giant funnel. And one where your internet interface must be top-notch to be appealing to your top candidates and thoughtful yet efficient at filtering and still providing a considerate experience for those you will not hire but could be your customers. To ensure you are getting the right candidates at the end of the process, and yet prevent your costs from soaring given the number of applicants, you must have efficient and effective early steps in the selection process. I recommend having a subject area test that an applicant takes via the internet for the vast majority of the junior positions. Your technical team can compile the test (say 200  questions) for the HR recruiting team and keep it up to date. Rotate a different 40 or 50 questions to each applicant that they can take the test over the internet in a set period of time. This will then filter out 80% of the applicants that are often not qualified and just applying. Your company can then send a thoughtful letter explaining they did not score high enough to be considered further but you appreciate that they applied.

Next, make it very clear throughout the process, that you will check references. This will cause the poor performers to think twice about applying to your company. As you move to the next step of identifying the candidates to interview from those who passed the test, I recommend setting a high bar where the candidates must be qualified but then have one additional outstanding experience or quality (e.g., won an award at their previous company or school, showed initiative in gaining additional certifications or knowledge of your company, etc). Now you have optimized the pool that you will interview — not too big to make it too time-consuming and expensive, and not too small to gain diversity and ensure you don’t miss great candidates. Again, I recommend two additional methods for the junior candidate process to achieve a better screen: a problem or work simulation; and a team interview.

The problem or work simulation (not a brain teaser), would be a 1 or 2 hour session where you give the candidate an exercise similar to the work that they will be doing. If a Unix administrator, give them Unix scripts to write. If a developer, ask them to design or or outline how they code an interface, etc.  This will give you real insight into their capabilities.

The team interview is critical. Often, organizations make the mistake of having only management interview a candidate when in reality, those who are more familiar with the work, and who often will hold a higher bar on the selection, are the teammates and peer staff that this person would work with. In fact, they don’t want someone who is incompetent or would be a poor fit because then they have to carry the load. So include in them in the process. Have one of the more outgoing and senior individuals lead the interview with one or two others participating. And ask the HR person or someone skilled at nonverbal communication to join. Then, when the lead person is asking the questions, the others can observe the body language and other signals that this candidate is giving off that most interviewers miss because they are so focused on the next question. They can ask questions as well of course but should focus on what is not said. Given the importance of team in IT, this is a critical filter to ensure you get people who not only know what must be done, but can do it in the team and culture setting that you have at your company. I have employed the team interview process to ensure you set a consistently high bar, eliminate those who would be detrimental to the team, and importantly, avoid the manager picking only their favorites. And don’t neglect checking the references. And the more senior a person is, the more important it is for you to check the references.

Have established the key selection steps above, the tougher part can be getting the candidates in the first place. Often, the best candidates, the ‘A’ players are not in the applicant pool but are busy working somewhere else. This is where your referrals from your ‘A’ players come in. Your top engineers often know the other good engineers at other companies or elsewhere in the industry. Ensure you have recruiters willing to follow up on the referrals and if necessary, cold call. And make sure, once the candidate is past the initial filters, you move them quickly through the process — otherwise you will lose out on the best candidates to other companies who moved quicker.

Every now and then you will come across other approaches that allow you to identify the top performers. I recall when working for a company in the Midwest that we had a critical need for MUMPS (or Cache) developers (we had a major financial services legacy system developed on a tool primarily used in hospital applications).  We had enormous difficulty finding anyone who had the experience much less developers who were top-notch until, in talking to one of the senior engineers, I found out he had just received a certification and he had not scored as as high as some others nationally. When he showed me the website with the scores listed of those who had taken the test nationally, there was the gold mine of all the top developers in that field. By the next day, we had our best recruiters calling those developers to see if they were interested in a new job at a new company. In fact, I think we ended up hiring 7 of engineers who scored in the top ten on that list.

So you may not have a list of the best fall into your lap like I did at that time, but you can get the best by always having your door open. In other words, for most shops of any size, you will always need project managers, network engineers, server engineers and developers and designers. By taking a ‘pipeline’ approach, where you always have a ‘proxy’ opening for these positions, you can be choosier (you are not under a deadline to fill a position) and when the ‘A’ player who is working at another company gets frustrated one day and decides to post his resume or look, you will come in contact. And with a tuned process using the steps above, you will likely land the best candidates.

Doing a robust intern and graduate program is another form of a pipeline. If you do not have these in place, establish strong intern and graduate programs with the universities near your key sites. It will be a good source for as much as 20% of the new and replacement staff you need. View the intern assignment as one long interview and be sure to have a job placement offer ready at the end of the internship to assure the best interns of a place at your shop when they graduate the following year.

If you deploy these techniques, and ensure your managers place recruiting tasks as important and urgent, and review regularly the operational metrics around recruiting (not just time to hire but more importantly quality of hire by vintage and by source) you will build a strong pipeline of talent that enables you to build sustainably a high performing team. In my next post, I will talk about the different approaches to use for more senior positions as well as top-grading, a very good technique to filter at senior levels.

And by the way, WSJ and Mr. Poundstone also provided the answers to those Google interview questions. Enjoy!

What techniques or best practices have you used to recruit? Any particular pitfalls or issues to avoid? What companies do you admire for their recruiting processes?

Best, Jim

 

 

 

 

Ensuring Project Success: Best practices in Project Delivery

Project delivery is one of the critical services that IT provides. Unfortunately, in the industry, the track record of project delivery for IT is at best a mixed bag. A number of different studies over the past five years put the industry success rate below 50%. A good reference in fact is the Dr. Dobbs site where a 2010 survey found project success rates to be:

  • Ad-hoc projects: 49% are successful, 37% are challenged, and 14% are failures.
  • Iterative projects: 61% are successful, 28% are challenged, and 11% are failures.
  • Agile projects: 60% are successful, 28% are challenged, and 12% are failures.
  • Traditional projects: 47% are successful, 36% are challenged, and 17% are failures.

So, obviously not a stellar track record in the industry. And while you may feel that you a doing a good job of project delivery, typically this means the most visible projects are doing okay or even good, but there are issues elsewhere. In this post and in the next few I will provide a quick primer to check and ensure you are leveraging the key project delivery best practices that enable more successful track record.

Key project delivery practice areas: These areas are project initiation, project communications and reporting, project management, release management, and program management. There are also a few critical techniques to overcome obstacles including how to get the right resource mix, doing the tough stuff first, and when to use a waterfall approach versus incremental or agile. I will cover the first two areas today and the rest over the few weeks.

Project Initiation – I have rarely, and I suspect similarly for you, been part of an organization where the demand for IT to deliver projects is less than the supply of IT resources to execute those projects. In fact, this over-demand is often chronic and our IT response sometimes exacerbates the situation. Because of our desire to meet the business’s wishes, and to show progress, we make the mistake of initiating projects before they or our teams are ready to start. It is critical to ensure that you have effective sponsorship, a good bead on requirements and adequate resources before you initiate the project. There is no issue with doing concept or project exploration, initial requirements and designs, high level planning or estimation, but these must all be divided from the formal project effort with a strong entry gate that ensures you have the sponsorship, understanding of the deliverable, and adequate resources. Most projects that fail (and remember, this is probably half of the projects you do), started to fail at the beginning. They were started without clear business ownership or decision-makers, or with a very broad or ambiguous description of delivery. or they were started when you were already over-committed, without senior business analysts or technology designers.  This is just a waste of money, resource time, and business opportunity.

Address this by setting a robust entry gate and be disciplined about when to start a project. If the business sponsors aren’t there, this is a discussion for you to have with that business leader. If the project is defined as overly broad or is ambiguous, don’t fall into that trap. Take the two or three most well-defined needs and split off or chunk the project into starting with just that piece. The rest will fall into place as the work is done and everyone understands better the situation. You and the business may decide not to progress further, If you decide to proceed then start up the next chunk as a separate project. And, as much as you want to get more done, don’t start the project before you have resources. As you operate your project ‘factory’ at extremely high utilization levels, each additional piece of work you add makes you less efficient and more costly. You must use higher priced contractors rather than internal resources. And your key experts that must do the work, now have to juggle one more thing and will be less effective. It would be far better for your 500 resource team to do say, 80 projects effectively, rather than 110 projects ineffectively. It is like a server that has not enough memory for the applications active on the system. More and more time is spent on overhead, paging things in and out rather than on real work. The end result is less work done in total even though more projects are active. This is a common trap that is overcome by knowing you effectiveness range and then simply prioritizing with the business. If something critical has come up then for it to be started you must ice and take off the table other projects. Make these choices with your business partners. If you maintain this balance, then you will get more projects done in the year — and that should be the true measure of delivery (not how man projects you started).

Project reporting and communication – Doing a project is a team effort. You have many staff with different backgrounds and skills from different organizations that must come together to deliver on a single blueprint to a common goal. With such a diverse team, effective communications are paramount. And yet, often, the only formal communications are those that a directed towards senior management. There are three primary audiences that a project manager should communicate formally: senior management, the business customer, and the project team. Further, the project manager should leverage the same detailed reporting and advanced analysis that they are doing to manage the project to quickly reformat into a digestible report for their audience.

Oftentimes, you find the project managers are burdened by multiple reporting systems where they are manually entering the same information two or three times. And then middle management for both IT and the business demand additional reports on metrics that are not useful and forms for approval that are bureaucratic and repetitive. Meanwhile, the critical data (e.g. risk items, resource utilization, critical path delays) are not reported broadly if at all. And the project manager is overwhelmed with the busy work versus the real task at hand.

So streamline the reporting process. Ensure your team a single, effective project reporting tool and invest in one if not. I recommend that all the but the smallest projects produce a weekly ‘4-Box’ report. This one pager can be used for all three primary audiences and ensures the project manager, the sponsor and the key stakeholders are paying attention to the important aspects of the project.

I will be placing a 4-Box sample on the reference page for your use later this month. But they key components are simple:

  • a landscape page with 4 quadrants, a left margin column and a header section
  • the header consists of the Project Title centered and Project Status in color boxes on the far right upper corner, and the project mission in small font (it always amazing how many people work on a project and do not know what it is intended to do — thus the mission on every communication)
  • the left margin contains the names and phone numbers of the project manager, sponsor, and all key participants and stakeholders. Thus everyone knows who to call if there is an issue or question
  • The upper left quadrant contains a brief description and the key milestones for the project with dates and a status indicator (e.g. completed, underway, etc)
  • The lower left quadrant box contains accomplishments and progress for the past week (or time period). There should be a brief description of progress and a listing of the key milestones or tasks completed.
  • The upper right quadrant is a listing of the key risks and issues the project faces. They should be catalogued and a status indicated (e.g. Mitigated, Underway, Open) with a color status as well.
  • The bottom right quadrant should provide what will will get done this next week or time period by milestone or significant task with dates and with owners.

Additional information can be used to augment the report, but they key is now you can use the same one page to communicate effectively with all your audiences. This ensures everyone is one the same page (literally) at a minimum of effort. Note also that we avoid the ‘ creative writing’ of project status reports that some many organizations waste time and use to put an optimistic spin on the project progress. Instead, just the facts.

By aligning your project process and teams to these two best practice approaches, you will find:

  • you are not starting projects before they are ready to be started
  • you will run your project factory at optimal output and effectiveness
  • you will lighten the overhead load on your project managers, so they can do more real work
  • your project teams will be on the same page (and thus more effective)
  • you and your businesses will know what is going on and can identify issues much earlier and solve them more quickly

In essence, you will deliver projects more successfully.

What are the variations on these approaches that you have used with success? What would you do differently? What other areas of project delivery are problematic that you have solutions for? Have a wonderful holiday and I look forward to your perspectives.

Best, Jim

 

Your Year End IT Leadership Checklist

I think we can all feel the holiday and yearend swooping in and things winding down where we work. The Christmas parties are in full swing and everyone is focused on making sure they get everything on their Christmas gift list. Next week is certain to be quiet in the office. For senior IT managers, here is a quick list of things to do as the year-end approaches:

1. Vacation overlaps: Re-check that you and your senior team are not all out on vacation and no one is left to mind the shop. If there’s a gap, given the timing, you need to be the one to fill it (besides, this way you’ll have an excuse when your spouse asks you to go to the store with return items).

2. Batch Cycles: With the upsurge in retail sales and other peaks this time of year, ask the production batch team to re-calibrate the peak processing time for batch runs in December, month-end and year end. It’s better to find out now you need to address capacity than at 3 am Sunday morning in the New Year and your company can’t close the books on time.

3. Feedback for your team: Spend some of your vacation time writing thoughtful performance reviews for your team. Start with your best and worst performers, they will get the biggest positive impact from a better writeup this year. For outstanding insight on competencies and how to coach, check out FYI: For Your Improvement by Lombardo and Eichinger.

4. Gain new insights: Spend another part of your vacation time reading a good management or IT book. The new perspectives experienced will help your fresh thinking in the new year. If you are looking for ideas then perhaps Magical Mathematics or The Rare Find or perhaps Great by Choice.

5. Start out proactively: Book time in January with your planning team to ensure you have the IT goals for 2012 clearly defined and map out the steps you will be taking to communicate it broadly. Otherwise you can get caught up on the first assignments that come in the door in 2012 and remain reactive the entire year.

6. Allocate the time for your customers: Ask your admin to ensure you have regular meetings scheduled every month with all of your business partners. You may already be doing this, but regular sessions are key to keeping in touch and providing great service.

7. Thank the team: Take your team out for a drink and thank them for the accomplishments for the year. Keep the evening clear of any assignments or negatives on missed deliveries. Everyone needs to be thanked and appreciated, and you’re likely to do enough ‘coaching’ of them the rest of the time.

8. Thank your admin: Your admin is the primary interface by which most people interact with you. If she or he has done well, make sure you thank them. And a nice gift is very reasonable — and ensure they do not get you one either. This would be on top of any formal bonus.

9. Thank your sponsors: Spend some quality time with your boss and whatever the challenges for the year have been, thank them for their support and the opportunities they have given you. Let them know you will be refreshed and ready to go for the new year.

10. Take time for yourself and your family: Make sure you take the time to decompress and reflect. Do whatever you need to do to relax and recharge. Focus on your family. Think about what went well and not so well. Identify the key things about you that you want to change in the new year. Save the how for another reflecting session. Make sure you walk into January with renewed strength and vigor and a focus and game plan on the new you.

For some of you, you have already either completed or will knock off all 10 items. For others, perhaps you have nearly all of them, but there is one or two items you can add to your list. If you are doing less than 5 of them, you need to make sure you do #10 so that you personally are ready for next year.

I hope your year has been successful and rewarding. And I trust that this blog has provided some insight for the last part of the year. Next year, I plan to make to continue to provide the regular posts and insights but have the best practices sections well-developed to enable a quick reference guide for IT management for you and your team.

All the best, and have a great holiday, Jim