Global Ring Network for Advanced Applications Development

Description of High Energy Physics applications in Russia

V.A. Ilyin
coordinator of Russia in LCG and EGEE projects,
Vice-Director,
Skobeltsyn Institute of Nuclear Physics
Moscow State University
119992 Moscow, Russia
tel: +7 095 939-50-77, fax: +7 095 939-03-97
e-mail: ilyin@sinp.msu.ru

High Energy Physics (HEP) has long-term history if speak about international scientific cooperation of Russia with USA, Europe and Japan. In 90’s, when an international collaboration has became to be major format for research in this field, Russian HEP laboratories contributed in (practically) all experiments (see Table below, where incomplete list of international collaborations is indicated for major Russia institutions).

High Energy Physics science and education in Russia is mainly centred in the regions of Moscow, St-Petersburg and Novosibirsk. The main centres are:

1. Moscow:
   • Institute for Theoretical and Experimental Physics (ITEP, http://www.itep.ru);
   • Russian Research Center “Kurchatov Institute” (RRC KI, http://www.kiae.ru);
   • Skobeltsyn Institute of Nuclear Physics of Moscow State University (SINP MSU, http://www.sinp.msu.ru/eng/sinp.php3) ;

     Lebedev Physical Institute of Russian Academy of Ssciences (LPI RAS, http://www. lebedev.ru/index.html.en);

     Moscow State Engineering Physics Institute (MEPhI, http://intraserv. mephi.ru/eng/second.html);

2. Moscow region:
   • Joint Institute for Nuclear Research (JINR, http://www.jinr.ru), situated in Dubna, about 120 km to the North of Moscow. JINR has status of an Inter-national Center. The member states are Russia and NIS, as well some states from Central and East-South Europe participated as member states or as an observers (e.g. Germany, Poland, Czech and Slovak Republics, Bulgaria);
   • Institute for High Energy Physics (IHEP, http://www.ihep.su), situated in Protvino, about 120 km to the South of Moscow;
   • Institute for Nuclear Research of Russian Academy of Science (INR RAS, http://www.inr.troitsk.ru), situated in Troitsk, about 40 km to the South of Moscow;

3. St-Petersburg region:

   Petersburg Nuclear Physics Institute of RAS (PNPI, http://www.pnpi.spb.ru), situated in Gatchina, about 40 km to the South of St. Petersburg;

4. Novosibirsk region:
   • Budker Institutue of Nuclear physics of Siberian Branch of RAS (BINP SB RAS, http://www.inp.nsk.su), situated in Academgorodok, about 20 km from Novosibirsk.

Fig.1.Three regions indicated on the map, where HEP centers are located: Moscow, St-Petersburg and Novosibirsk

Participation in LCG and EGEE projects

A Russian regional centre is planned to be a coherent component of the international distributed infrastructure known as the LHC Computing Grid (LCG, http://www.cern.ch/lcg). It is designed as a cluster with the functionality of a Tier2 centre. The total resources will reach 70% of a canonical Tier1 centre for each of LHC Experiments. The architecture is based on the coherent interaction among the institute-based computing centres, through the use of Grid technologies. It means, in particular, that the connectivity between basic HEP institutes in Russia should be at the same level, in the Gbps range by 2006, as the international links.

The annual volume of data, produced by Russian HEP institutes in the framework of the program of Data Challenges, is estimated to be 25-30 Terabytes (TB) in 2003 and 50-70 TB in 2004. This is under the assumption that the Russian participation will be at the level of 5%. Each year these data have to be transmitted to CERN and other LCG partners in Europe and the USA. A similar volume of data should be copied back. It will be also necessary to take into account that some part of the data will need updating a few times per year (after detecting errors in the modelling programs or after their modifications). According to our plans, in 2004 we need in 155-300 Mbps connectivity with European and US collaborators, and 300-622 Mbps in 2005, while in the beginning of 2006 the bandwidth of 1-2.5 Gbps should be provided.

In 2001-2003 the Russian institutes (JINR, IHEP, ITEP, SINP MSU, LPI RAS) were already actively participating in the CMS Monte Carlo simulation runs for the LHC, as well as in ALICE, ATLAS and LHCb Data Challenges (see below the diagram for contribution of different sites around the world to ATLAS DataChallenge in 2002-2003). In addition, the Russian institutes were involved in development and testing of the EU DataGrid Testbeds. For international connectivity the NaukaNet link (with US laboratories) and link to GEANT (for connectivity with CERN and European partners) were used.

Fig.4. LHC ATLAS DataChallenge1. Phase2: Nov.2002-Jan.2003

Russian HEP institutes also are participating in the new EGEE initiative (creating the a Europe-wide Grid infrastructure, http://www.cern.ch/egee, and where take part three American Universities) that has started in April 2004. For list of participating Russian institutes, including names of the project managers in Russia teams (where HEP institutions are major LCG sites in Russia) one can check the site http://www.regee-rdig.ru.

In September 2003 the first LCG infrastructure has been started with 14 sites in Europe, USA, Japan, Taiwan and Russia (see LCG-2 monitoring Web pages on http://www.grid-support.ac.uk/GOC/Monitoring/). This successful start will go to next step in February 2004, when the LCG-2 infrastructure should start to operate with a goal to serve the Data Challenge programmes of LHC Experiments in 2004 (so called DC04 Data Challenges). Russian HEP centres are planning to take active participation in this important development of the LCG infrastructure. In addition, the Russian institutes are involved in the development and testing the LCG Testbeds. Particular and important example in 2003 was a testbed ‘Beryllium’ within the LCG “ARDA” project (http://lcg.web.cern.ch/LCG/PEB/GTA/LCG_GTA_OGSA.htm), where OCSA/OGSI/GT3 middleware was evaluated for future applications in HEP (CERN-Russia-USA joint work). For 2004, as a continuation of this cooperation, new testbed within the ARDA project is planned (CERN-Russia-Taiwan-USA collaboration) for evaluation and testing of new middleware (Web services based) being developed within the EGEE project by USA and Europeam teams.

Fig.5. The map for LCG-2 sites in the world (April 2004)

The Network Status of Russian HEP Institutes

Moscow HEP institutions use fiber-optic cables of different backbone infrastructures. Basically, Moscow institutions have 100-155 Mbps connectivity now, and 1Gbps (GigaEthernet) links are now available as a regular case.

In the end of December 2001, JINR (Dubna) got the ATM 30 Mbps connectivity to Moscow using the fiber optic cable, now this link is 4 Mbps, and to the end of year will be 1 Gbps.

IHEP (Protvino) uses now microwave 8 Mbps link Protvino-Moscow. There is a project under realization of a new fiber optic link Protvino-Moscow (M9-IX). This project assumes to create new fiber optic segment on the Protvino-Moscow distance. The link should start the operation in the summer 2004 with 100 Mbps bandwidth for IHEP.

Institute for Nuclear Research (INR RAS), together with other institutes situated in Troitsk (Moscow region), uses a 2 Mbps fiberoptic RAS link to M9-IX in Moscow, and two 8.4 Mbps microwave links between Troitsk and Moscow.

Petersburg Nuclear Physics Institute (PNPI, Gatchina) now has a fiberoptic link to the St-Petersburg Internet Exchange Poin, potentially of 34 Mbps. However, the current budget only is enough to pay for 2 Mbps of bandwidth. Then, PNPI uses a 512 kbps terrestrial link for commodity Internet traffic.

Budker Institute of Nuclear Physics of Siberian Branch of RAS (BINP SB RAS, Novosibirsk) uses a 1 Mbps link to Moscow and has 100 Mbps to the Novosibirsk (NSK-IX). In 2004 BINP is planning to use the link Moscow-Novosibirsk of 45 Mbps, which can be updated soon up to 155 Mbps within the LittleGLORIAD project.

International Links (current status)

In summer 2001, the capacity of the international link for science in Russia was only 16 Mbps. There was also a project MIRnet (finished in 2001) that was supported by MoIST and NSF, with a 6 Mbps link to STAR-TAP (managed by Moscow State University and the University of Tennessee), which peered with ESnet in June 2000 to provide to the US HEP Labs. There was also a 16-32 Mbps link with NORDUNet.

In summer 2001, a project named FASTNet started, with the goal of establishing a 155 Mbps i nternational link. Russia and NSF fund this project jointly. Recently the title of this project has been changed on NaukaNet. NaukaNet aims to provide high-performance and highly reliable connectivity between NSF laboratories and their counterparts in Russia. NaukaNet link RBNet-STARLIGHT now has an intermediate PoP in Stockholm and it’s capacity is 155 Mbps (STM1). From summer 2002 another 155 Mbps link Moscow-Stockholm started, for commodity Internet traffic. In total this link has now four STM1’s Moscow-Stockholm, thus 622 Mbps of total bandwidth.

From 2002 there was established a Russia-GEANT link at 155 Mbps.

The bandwidth of the Russia-NORDUNet (Moscow-Petersburg-Helsinki) link is now 622 Mbps, what is not used by HEP community (it is to serve Education organization mainly).

Connectivity to KEK (Japan) for Russian HEP institutes is provided by a 512 Kbps terrestrial link between Novosibirsk (BINP) and Tsukuba. The NaukaNet link is used also for connectivity with Japan via STARLight.