Infrastructure of the Tier1 (T1_RU_JINR) 2023

The service support system provides the following:

  • computing service,
  • storage services,
  • GRID systems,
  • data transfer services ,
  • information service (monitoring services:  servers, storage, data transfer, information sites).

Tier1 farm configuration (T1_RU_JINR):

The CMS experiment data processing jobs are launched by 16 core pilots and all computing resources are available to them.

Computing farm (CE)

2023

Sum 2023Q4:
323820.54 HEP-SPEC06 
20096 cores 
468 Wns
Average per Core = 16.11 

Storage Systems (SE)

Data storage is provided for the dCache system, robotic tape storage using Enstore software and the EOS system.

2023:

dCache:  SE disks:
        2023Q1=11.02 PB;  
        2023Q2=11.76 PB; 
        2023Q4=12.44749 PB;
         
2023Q4: 
         CMS @ dsk:       12439.87 TB +
         dteam+ops @ dsk:     7.62 TB +
         CMS @ dcache mss: 2657.20 TB + 
         Tapes@Enstore:   35562.00 TB +
                          = 50666,69 TB      
         tape robot: allocated capacity for T1 CMS logic library:
         51.5PB, IBM TS3500(11.5PB) + IBM T4500(40PB) 
         
EOS:    2023Q3=23350 TB;   
        2023Q2=21829.01 TB;   
        2023Q1=16582.35 TBEOSCTA: 10000 TB;

CVMFS:   capacity is 140TB
         4 squid servers cache CVMFS
         1  server stratum 0
         2 servers stratum 2
Total: EOS(23328.10 TB) + dcache_disk(12439.87 TB) + tapes(51500 TB) + CVMFS(140 TB) = 87407,97 TB

2023Q2: dCache – added 6 servers (Qtech QSRV-462402_4) = ~2.3 PB ; decommissioned – 15 servers (Supermicro rda017-rda031~2017) = ~1.719 PB

Software :

2023Q1

ОС: Scientific Linux release 7.9.

EOS 5.1.23 (constantly changing),

dCache 8.2, 

Enstore 6.3.

Slurm 20.11.

grid UMD4 + EPEL (current versions)

Batch Slurm 20.11

grid UMD4 + EPEL, актуальные версии
ARC-CE