CICC 2023

 2023 :  

CICC computing resources

CICC computing resources are represented by CICC computing clusters:

  • Interactive cluster: lxpub [01-05].jinr.ru
  • User interface lxui[01-04].jinr.ru (gateway for external connections)
  • Compute farm Computing

Hosts: 485;  Cores: 10356;

Performance:  166788.4 HEP-SPEC06

                         16.11 HEP-SPEC06 average per core.

Read more about CICC clusters here.

Monitoring  LIT   common resources (Tier1, Tier2, SE, Cloud, Govorun):  here    and   Tier2 resources  here   .

Interactive cluster is the main and only place for all of users interactive activity:  software debugging, performing tasks in a batch system, etc. Users are not allowed to run tasks that last longer than 30 minutes in interactive mode.

The computing farm is intended both for local CICC users and for international projects.  Launching tasks on an account, managing task execution and sending results to the user are carried out using the SLURM system. To debug a task, you can use the interactive launch mode.

Storage Resource

CICC   users are provided with the following data storage systems and software:

2023:

8 old disk servers were removed, 4 new DELL R740 of 300 TB each were added. SE disk has 4 servers; in EOS – 28. Added: 2 servers (Qtech QSRV-462402_3) = 681.1 TB.  EOS Added: 20 servers (Qtech QSRV-462402_4)

As a result, we currently have:

  • EOS:  2023Q4=23328.10 TB ;  2023Q3=22203.82 TB; 2023Q2=21829.01 TB; 2023Q1=16582.35 TB; 

ALICE @ EOS:  1653.24 TB;

EOSCTA: 11.5 PB  2023Q3

  • dCache:

2023Q2:   3753.694341 TB 

CMS=1903.269531TB;  busy 422.708210 / free 1480.230266

ATLAS=1850.424810TB;  busy 1087.250671 / free 715.476494

2023Q4: 3933.47 TB  ( CMS 1994.22TB  ;  Atlas  1939.25 TB)

Local & EGI @ dcache2  199.74 TB

tape robot : 3003TB

  • CVMFS:  capacity is 140 TB   (2 squid servers cache CVMFS ); 1 server stratum-0, 2 servers stratum-1,  4 servers  squid.

VOs: NICA (MPD, B @ MN, SPD), dstau, er, jjnano, juno, baikalgvd….  

  • AFS:  ~ 12.5 TB (user home directories, workspaces)
CICC Software.

2023Q1:

ОС: Scientific Linux release 7.9

EOS 5.1.9 (constantly changing: 5.1.26 – 2023.08.01))

dCache 8.2

Enstore 6.3  for tape robots SPECall_cpp2006 with 32-bit binaries SPEC2006 version 1.1

BATCH:  SLURM with adaptation to kerberos and AFS

CVMFS

AFS

ALICE VObox

grid UMD4 + EPEL (current versions)

VOMS

 

Auxiliary servers

  • e-mail
  • home WWW pages
  • databases MySQL , Postgres,  Oracle
  • DNS
  • мониторинг Nagios
  • ftp

These services usually function “transparently” from a user viewpoint, i.e. need no additional settings. One part of them support LIT and JINR services (WWW, ftp, MySQL), while the other is mainly for JINR users servicing (mail).

WLCG.

To service the WLCG site at JINR (the site is a separate cluster in the distributed environment of the WLCG) and other international collaborations, 22 servers with the gLite system (WLCG intermediate level software) are installed. In addition to the support functions of the JINR-LCG2 site itself, some of the servers implement important services and support functions for the Russian segment of the WLCG project.