Infrastructure and services of the Tier1 2016.

  • 100 64-bit machines: 2 x CPU (Xeon X5675 @ 3.07GHz, 6 cores per processor); 48GB RAM, 2x1000GB SATA-II; 2x1GbE.
  • 120 64-bit machines: 2 x CPU (Xeon E5-2680 v2 @ 2.80GHz, 10 cores per processor), 64GB RAM; 2x1000GB SATA-II; 2x1GbE.

Total:
220 working nodes
3600 cores
55164 HS06
13791 HEP-kSI2k

Base software:

CentOS release 6.4 (Final)/Scientific Linux release 6.4/6.7
GCC: gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-3)
C++: g++ (GCC) 4.4.7 20120313 (Red Hat 4.4.7-3)
FC: GNU Fortran (GCC) 4.4.7 20120313 (Red Hat 4.4.7-3) *FLAGS: -O2 -pthread -fPIC -m3
WLCG services: UMD4 sl6 x86_64.
Batch system: Torque 4.2.10 (home made) and Maui 3.3.2 (home made)
Storage System: dCache-2.10, Enstore 4.2.2 for tape robot.

2016:

Storage System (SE) :

1 — Disk Only:

  • 30 disk servers: 2 x CPU (Xeon E5-2650 @ 2.00GHz); 128GB RAM; 63TB h/w RAID6 (24x3000GB NL SAS); 2x10G.
  • 12 disk servers: 2 x CPU (Xeon E5-2660 v3 @ 2.60GHz); 128GB RAM; 76TB ZFS (16x6000GB NL SAS); 2x10G.

Total space: 2.8PB

  • 3 head node machines: 2 x CPU (Xeon E5-2683 v3 @ 2.00GHz); 128GB RAM; 4x1000GB SAS h/w RAID10; 2x10G.
  • 8 KVM (Kernel-based Virtual Machine) for access protocols support.

2- support Mass Storage System:

  • 8 disk servers: 2 x CPU (Xeon X5650 @2.67GHz); 96GB RAM; 63TB h/w RAID6 (24x3000GB SATAIII); 2x10G; Qlogic Dual 8Gb FC.

Total disk buffer space: 0.5PB

  • 1 tape robot: IBM TS3500, 2000xLTO Ultrium-6 data cartridges; 12xLTO Ultrium-6 tape drives FC8; 5400TB.
  • 3 head node machines: 2 x CPU (Xeon E5-2683 v3 @ 2.00GHz); 128GB RAM; 4x1000GB SAS h/w RAID10; 2x10G.
  • 6 KVM machines for access protocols support

WLCG Services:

  • 2 x VOBox (CMS PheDEx: CPU E3-1281 v3 @ 3.70GHz, 8 cores (HT on); 16G RAM; 2x1GbE.

  • 7 virtual machines (KVM).

    Infrastructure Servers:

  • 4 machines: 2 x CPU (Xeon X5650 @ 2.67GHz); 48GB RAM; 2x1000GBGB SATA-II; 2x1GbE.

  • 10 machines: 2 x CPU (Xeon E5-2683 v3 @ 2.00GHz); 128GB RAM; 4x1000GB SAS h/w RAID10; 2x10G.