The Seven Deadly Data Center Sins

Interruptions to vital data center operations are disastrous. Fortunately, most interruptions are preventable, provided that the Seven Deadly Data Center Sins are not committed during the locating, designing, building, commissioning, loading, operating, or maintaining phases. Recognize these transgressions, and avoid contributing to the tradition of overheated, undersized data centers.

Sin #1: Thou shall not select a structure in need of renovations, located near a chemical plant, in a restrictive municipality…
Select a site based on structure, location, and jurisdiction.  Avoid structures requiring extensive renovations, which can become more costly than new construction.  When selecting a location, review natural risks (severe weather and seismic activity) and proximity to risk-prone neighbors (chemical plants, airports, political structures, and harbors).  A good location offers reliable, diversified utilities and fiber-based carriers, with current availability and room for future scale adjustments.  Finally, research the applicable municipal fees and building permits.  Locating in a highly-restrictive municipality results in cost increases and construction delays.  Location and structure are fundamental to the success of the data center; an inappropriate selection greatly limits design and operation options.  Know when to walk away and continue searching for an ideal site.

Sin #2: Thou shall not design for the moment…
Design for the present, the future, and the unexpected, using the principles of simplicity, cost sustainability, and reliability.  Allow for an increase in the originally anticipated load; more often than not, data center use exceeds initial design expectations.  Ask and answer simple questions to reduce construction and operating expenses.  (Does the design allow for modular growth?  Is the site really high density?  Is the data center envelope efficient?)  Something as simple as the type of paint applied to demising walls can return tens of thousands of dollars to the operating budget.  Also, compare lifetime ownership costs and opt for efficient network equipment.  Consider built-in configurations, such as hot and cold isles, to further reduce operating expenses.  The goal is to contain the operating environment within the space.  When this is accomplished, it reduces dependence on mechanical equipment to satisfy the internal environment, thus limiting maintenance and energy costs.

To determine critical load for the data center design:
1.) Divide the load into three categories: vital, essential, and non-essential.

• Vital load supports 24/7 vital data processing equipment, service providers, and imperative call services that cannot be interrupted.
• Essential load supports mechanical units, motors and pumps, refrigeration units, and lighting that can be momentarily interrupted.
• Non-essential load supports work stations, supplementary equipment, and general area mechanical support that can be interrupted without significant detriment.

2.) Covert the vital, essential, and non-essential loads into watts, and apply the following formulas for:

• The UPS
  • (Vital Load + Projected Growth) * 25% = UPS kW

• The Mechanical Load
  • (Vital Load + Essential Load + (20% of the UPS kW)) * 25% = X     
  • X * 3.414 = BTU/h
  • BTU/h/12,000 = Tons (12,000 is based on an ambient outside air temperature of 95 degrees F)

• The Total Generator Supported Load
  • UPS * 1.65 = Load A
  • Essential Load + (Tons * 3.54 kW) = Load B

• The Generator
  • (Load A + Load B) + 20% De-Rating Factor = Generator Size

These general rules do not account for altitude, skin load, outside air temperature, raised floor height, or other site-specific factors.

Sin #3: Thou shall not construct an IT fortress, overnight, on a $10 budget…
Avoid unrealistic expectations, and build it right the first time.  During the initial design and budget phases, do not “plan to fail.”  Prepare a cost versus reliability checklist to understand the consequences of budgeting decisions.  While it is difficult to calculate the monetary damages of unplanned data center downtime, it can be necessary to illustrate the advantages of solid construction.  Steer clear of contractors and consultants that promise miracles.

Realize that building officials do not care if construction is completed on time or on budget.  When developing the construction schedule, allow additional time for plan check and permitting.  Consider meeting with the building officials to understand potential road blocks and local issues.      

Sin #4: Thou shall not assume that an engine runs because its components function…
Push the envelope when the time is right, and test the data center as a complete system.  Commissioning ensures that all equipment interacts simultaneously, per the engineered design.  Although commissioning is intrusive, it does not damage the system.   Simulate and overcome worst-case scenarios to ensure proper operation once the system is in service.  This is the one opportunity to exercise, test, and train personnel before applying the critical load. 

Sin #5: Thou shall not create hot spots or dismiss PDU/panel placement…
Loading creates data center symmetry, balance, and efficiency.  As needs and technology change, the ability to scale operations in real-time depends largely on the loading strategy.   

Hindsight is 20/20, especially when it comes to air flow and bypass cooling problems.  Hot spots usually result from streamlining the networking and cabling connectivity design.  Just because equipment fits into a single rack does not mean it should be used; stacking servers to fill a rack leads to severe heat accumulation.  Floor space is becoming rapidly more affordable than the combined equipment and operating expenses associated with a “high density” footprint.  While a network diagram may be aesthetically pleasing, consider the distance between the mechanical systems and the equipment that generates the greatest amount of heat. 

Practical circuit distribution can eliminate under floor congestion, and legacy cables can be avoided by instituting documenting and labeling procedures.  Proper PDU and panel placement is imperative; unfortunately, this task is often delegated to the electrical contractor.  Panels should be sized and installed to accommodate sub-fed panels to avoid immediate expansion pangs. 

Sin #6: Thou shall not neglect standard operating procedures and training…
Have faith in simple procedures and basic training.  Most data center outages are caused by human interference; responding inappropriately to an initial alarm or failure can lead to complete facility failure.  Institute standard operating procedures for all departments, and cross-train security, facilities, and NOC staff to respond to basic alarms.  Integrated methods of procedure (MOPs) are also crucial to preventing load loss; review MOPs with all vendors and contractors that will be working in the data center. 

Sin #7: Thou shall not fail to maintain vital systems…
Maintain and exercise vital systems on a regular basis.  Retain service and procedure documents for site systems so that maintenance tasks are not confusing for facility managers, and ensure that staff is trained and regularly updated.  Employ available monitoring equipment; many systems automatically alert staff, from the factory to facilities, when there is an issue.  Annually test diverse/redundant systems or simulate a utility power outage (on one-half of the site).  Failure to maintain vital systems guarantees devastating interruptions to vital operations.

Committing one of the Seven Deadly Data Center Sins condemns a business to legacy of interruptions and losses.  Exercise caution and judgment while locating, designing, building, commissioning, loading, operating, or maintaining phases.  Apply real-world experience and embrace simplicity to achieve reliability.  

About JT Packard
JT Packard provides Data Center engineering and construction services nationwide.

The Data Center Services division of JT Packard is responsible for conducting site audits,3rd party commissioning and reporting as well as complete design/build
Support and construction budgeting and management.

Jt Packard is also the Nation’s largest supplier of UPS and Battery maintenance with over 132 directly employed field engineers.
Gary Cudmore ,Vice President of Data Center services is a 22 year veteran of the data center engineering and construction industry.Mr Cudmore has extensive experience solving todays challenging data center enviroments.

Contact Jt Packard at www.jtpackard.com.Gary Cudmore can reached at gcudmore@jtpackard.com