Structure CICC Cluster (JINR-LCG2) 2020

2020.

Tier2 farm configuration (JINR-LCG2):

1) Changed batch server to Slurm type. Works and is used by CE.

2) Changed Computing Element (CE) for WLCG type – ARC6. (CREAM-CE is no longer supported by the central service launching tasks).

3) the farm is transferred to Scientific Linux release 7

4) Added new tape robot (IBM TS4500).

5) PhEDEx replaced by RUCIO.

6) New EOS servers.

7) User  interface lxui[01-04].jinr.ru as a gateway for external connections.

8) Увеличено пространство для пользователей /scrc

 

Storage Systems (SE)

dCache:

-disk servers 9.7 PB

-tape robots: IBM TS3500(1.6PB) + IBM T45500(1.6PB)

EOS:  7.198 PB

CVMFS: 2 machines: 2×70 TB h / w RAID1 (VOs: NICA (MPD, B@MN, SPD).

AFS      ~12.5 TB

NFS       ~ 11 TB ; 5 NFS servers 

xrootd    40GB  ;

 

Clusters:

interactive cluster (lxpub[01-05].jinr.ru)

several computing farms :

— common farm:

— LHC experiments dedicated farm

— Parallel processing farm

— NICA, MPD, BM@N  cluster

Total:

248 computing nodes (WNs) ,

4128 cores/slots,

55.489 kHS06

 

Auxiliary servers

  • e-mail
  • home WWW pages
  • databases MySQL , Postgres,  Oracle
  • DNS
  • мониторинг Nagios
  • ftp

These services usually function “transparently” from a user viewpoint, i.e. need no additional settings. One part of them support LIT and JINR services (WWW, ftp, MySQL), while the other is mainly for JINR users servicing (mail).

WLCG.

To service the WLCG site at JINR (the site is a separate cluster in the distributed environment of the WLCG) and other international collaborations, 22 servers with the gLite system (WLCG intermediate level software) are installed. In addition to the support functions of the JINR-LCG2 site itself, some of the servers implement important services and support functions for the Russian segment of the WLCG project.

Virtual organizations has been added to the JINR Tier2 :
ILC (WLCG http://www.linearcollider.org/),

MPD (JINR NICA), BM @ N (JINR NICA), COMPASS (WLCG CERN).

For VO JUNO, several services will be installed and configured at Tier2:

CE JUNO – will be allowed to run tasks at the JINR Tier2 farm
VOMS server, a mirror of the main VOMS in China;
CVMSF stratum-1 server, to support access to the JUNO software repositories in China.

 

Network and telecommunications.

Currently in CICC:
Local Area Nertwork (LAN) 100Gbps
Wide Area Network (WAN) 100Gbps, 2x100Gbps,

upgrade scheduled :

LAN  to  2×100 Gbps.

WAN   to 3x100 Gbps.

 Software :

CentOS Scientific Linux release 7.9

GCC: gcc (GCC) 4.4.7

C ++: g ++ (GCC) 4.4.7

FC: GNU Fortran (GCC) 4.4.7  * FLAGS: -O2 -pthread -fPIC -m32

BATCH: SLURM with adaptation to kerberos and AFS

dCache-5.2

Enstore 6.3 for tape robots SPECall_cpp2006 with 32-bit binaries SPEC2006 version 1.1

WLCG

FTS

FairSoft

FairRoot

MPDroot

 

Structure CICC Cluster (JINR-LCG2) 2019