CCIC architecture and facilities.

2019  :

Computing .

CICC data-processing farm is composed of  248  64-bit models SuperMicro Blade, SuperMicroTwin2, Dell FX. Since   multi-core processors are independent processors on a single chip, we have in total:

4128 cores 

55488.92 HEP-SPEC06 

13872.23 HEP-kSI2k

Five 64-bit PCs with an interactive user acces are provided for own software development and for other tasks.

Storage System.

  • dCache

is the main software and harware system used for big data storage in JINR CICC.  We support the following dCache settings:

1st disk for 2 virtual organizations LHC CMS and ATLAS
(Typically Supermicro and DELL).   
Total space:  2PB  

2nd disk for ALICE EOS. Total space:  712TB   

3rd disk for EGI Vos & local users. Total space: 147TB  

 

  •  EOS  4PB.
EOS at  JINR CICC  is used by the experiments NICA, BM@N, MPD. 
Space: BM@N  raw data 81TB,  MPD simulated data 84GB

  • CVMFS (/cvmfs)  9.5 ГБ

The CICC site is equipped with a support system for another global file system – CVMFS.
The CVMFS  is used to deploy large software packages of collaborations WLCG.  Used to run experimental data processing applications. Files and directories are placed on standard web servers and mounted on the universal / cvmfs namespace.

At present, we already have versions of the NICA, BM @ N, MPD software (/ cvmfs / nica, / cvmfs / …) and occupy 9.5 GB.

The CICC  repository  stores several software versions and changes on the CVMFS server responsible for the software.  Read access to the repository is organized on all CICC  machines and is possible worldwide by installing and configuring the CVMFS client.

  • AFS (Andrew File System).

The AFS (Andrew File System) Service provides networked file storage for users, in particular home directories, work spaces and project spaces.

The AFS Service is based on OpenAFS, an open-source distributed filesystem which provides a client-server architecture for location-independent, scalable, and secure file sharing.

7 AFS servers are installed at the JINR CICC. 

The total space of AFS at JINR is ~ 12.5TB

  • Network and telecommunication channels.
Local Area Nertwork (LAN) 100Gbps
Wide Area Network (WAN100Gbps, 2x10Gbps, 
upgrade WAN to 2x100Gbps planned

 

  • CICC compises several servers for JINR users and services:
batch, 

WWW,

mySQL DB and Oracle; 

e-mail; 

DNS , 

Nagios monitoring and other.

These servers operate mainly with 64-bit Xeon and Opteron on board.

 

CCIC architecture and facilities 2018.