User Tools

Site Tools


software:topical:physics:atlas

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

software:topical:physics:atlas [2019/10/17 21:11] (current)
meesters created
Line 1: Line 1:
 +====== Blacklisting of sites ======
 +
 +**Your action:** You have to blacklist the sites in the table below for all GRID actions (DaTRI, pathena, prun, dq2) !
 +
 +**Background:​** At the moment there is no conectivity from 2 ATLAS grid sites to our mogon cluster. This is causing serious problems. DaTRI requests or finished JEDI/PANDA jobs from these sites will not succeed but will stay in the queue of active transfers forever. They have to be removed by hand by grid administrators. We already received several "​tickets"​ to solve this problem but it can not be solved. The University is not connected to a network with a route "​from"​ these two sites (sendig to these sites works, receiving does not work). ​ The following sites are affacted:
 +
 +  * Australia-ATLAS
 +  * TRIUMF-LCG2
 +
 +In detail, these have to be blacklisted:​
 +
 +===== Australia-ATLAS =====
 +
 +==== DDM Endpoints ====
 +
 +  * AUSTRALIA-ATLAS_DATADISK
 +  * AUSTRALIA-ATLAS_HOTDISK
 +  * AUSTRALIA-ATLAS_LOCALGROUPDISK
 +  * AUSTRALIA-ATLAS_PHYS-SM
 +  * AUSTRALIA-ATLAS_PRODDISK
 +  * AUSTRALIA-ATLAS_SCRATCHDISK
 +  * AUSTRALIA-ATLAS_SOFT-TEST
 +  * AUSTRALIA-ATLAS_T2ATLASLOCALGROUPDISK
 +
 +==== PANDA Australia-ATLAS ====
 +
 +  * ANALY_AUSTRALIA
 +  * ANALY_AUSTRALIA_GLEXEC
 +  * ANALY_AUSTRALIA_TEST
 +  * Australia-ATLAS
 +  * Australia-ATLAS_MCORE
 +  * Australia-ATLAS_VIRTUAL
 +
 +
 +===== TRIUMF-LCG2 =====
 +
 +==== DDM Endpoints ====
 +
 +  * TRIUMF-LCG2-MWTEST_DATADISK
 +  * TRIUMF-LCG2-MWTEST_SCRATCHDISK
 +  * TRIUMF-LCG2_DATADISK
 +  * TRIUMF-LCG2_DATATAPE
 +  * TRIUMF-LCG2_GROUPTAPE_PHYS-SUSY
 +  * TRIUMF-LCG2_HOTDISK
 +  * TRIUMF-LCG2_LOCALGROUPDISK
 +  * TRIUMF-LCG2_MCTAPE
 +  * TRIUMF-LCG2_PERF-JETS
 +  * TRIUMF-LCG2_PERF-TAU
 +  * TRIUMF-LCG2_PRODDISK
 +  * TRIUMF-LCG2_SCRATCHDISK
 +  * TRIUMF-LCG2_SOFT-TEST
 +
 +==== PANDA: TRIUMF ====
 +
 +  * ANALY_TEST
 +  * ANALY_TRIUMF
 +  * ANALY_TRIUMF_GLEXEC
 +  * ANALY_TRIUMF_HIMEM
 +  * ANALY_TRIUMF_PPS
 +  * TRIUMF
 +  * TRIUMF_HIMEM
 +  * TRIUMF_MCORE
 +  * TRIUMF_PPS
 +  * TRIUMF_VIRTUAL
 +
 +====== Dataset management ======
 +
 +===== pathena, prun, dq2-get, ... =====
 +
 +But for the most GRID actions (pathena, prun, dq2) it is sufficient to add these parameters:
 +
 +''​pathena --excludedSite=ANALY_TRIUMF,​ANALY_AUSTRALIA''​
 +
 +''​prun --excludedSite=ANALY_TRIUMF,​ANALY_AUSTRALIA''​
 +
 +''​dq2-get --exclude-site=TRIUMF-LCG2_LOCALGROUPDISK,​AUSTRALIA-ATLAS_LOCALGROUPDISK''​
 +
 +DaTRI requests (on panda web interface) will inform you (with green text at the bottom of the request summary before you submit) that it will not work. If this occurs, please do not submit the request! It might in the end lead to an exclusion of our Mainz site from the grid! (It is causing big trouble in the system)
 +
 +===== Transfer to FZK =====
 +
 +If your datasets are only at one of these sites, please request a replica (DaTRI user request in PANDA web interface) to Karlsruhe **FZK-LCG2_SCRATCHDISK**. When the replica is complete the exclusion should work.
 +
 +===== Cancellation of data transfers =====
 +
 +Firstly, you have to identify the dataset'​s name. Go to [[http://​panda.cern.ch/​server/​pandamon/​query?​mode=ddm_pathenareq&​action=List|Panda]] and fill in the "Data Pattern"​ with the name of the dataset (e.g., user.tlin*). Choose "​Request status"​ as "​transfer"​ and click the button "​list"​ to get all your dataset which are transferring now.
 +
 +Second, click on the dataset name you would like to stop transferring;​ this will lead you to a page with details on the transfer. Check the "​Status"​ and change it to "​Stop"​. The transfer should no  be stopped. ​
 +You can check the status again like detailed in the first step. It should be have the status "​stopped"​.
 +
 +====== CvmFS ======
 +
 +
 +CvmFS is installed on the user interfaces as well as on the worker nodes. It is a (read only) network file system designed to distribute software from CERN.
 +
 +===== Setup =====
 +
 +Put this in your .bashrc:
 +
 +<code bash>
 +export ATLAS_LOCAL_ROOT_BASE=/​cvmfs/​atlas.cern.ch/​repo/​ATLASLocalRootBase
 +alias setupATLAS='​source ${ATLAS_LOCAL_ROOT_BASE}/​user/​atlasLocalSetup.sh'​
 +</​code>​
 +
 +Then, you can enable the ATLAS environment with:
 +
 +<code bash>
 +setupATLAS
 +</​code>​
 +
 +===== Root =====
 +
 +In order to make root-scripts run properly, use have to use (in addition to the standard setup):
 +<code bash>
 +localSetupROOT
 +localSetupGcc --gccVersion=gcc462_x86_64_slc6
 +</​code>​
 +
 +====== Monitoring ======
 +Some links to check the status of ''​mainz''​.
 +===== Grid =====
 +
 +==== EGI ====
 +  * [[https://​midmon.egi.eu/​nagios/​cgi-bin/​status.cgi?​hostgroup=site-mainzgrid&​style=overview|Nagios]]
 +  * [[https://​operations-portal.egi.eu/​rodDashboard/​site/​any/​tab/​list/​filter/​monitoring/​page/​list/​vo?​tsid=4|Central Operations Portal - Master Instance]]
 +  * [[https://​operations-portal.egi.eu/​availability/​siteAvailabilities/​type/​Zoomline/​site/​mainzgrid|Availabilities & Reliabilities,​ Last 30 days]]
 +  * [[http://​ngi-de-nagios.gridka.de/​myegi/​gridmap/​|MyEGI Service Availability Monitoring Portal]]
 +  * [[https://​ggus.eu/​ws/​ticket_search.php?​show_columns_check%5B%5D=REQUEST_ID&​show_columns_check%5B%5D=TICKET_TYPE&​show_columns_check%5B%5D=AFFECTED_VO&​show_columns_check%5B%5D=AFFECTED_SITE&​show_columns_check%5B%5D=PRIORITY&​show_columns_check%5B%5D=RESPONSIBLE_UNIT&​show_columns_check%5B%5D=STATUS&​show_columns_check%5B%5D=DATE_OF_CREATION&​show_columns_check%5B%5D=LAST_UPDATE&​show_columns_check%5B%5D=TYPE_OF_PROBLEM&​show_columns_check%5B%5D=SUBJECT&​ticket=&​supportunit=all&​su_hierarchy=all&​vo=all&​user=&​keyword=mainzgrid&​involvedsupporter=&​assignto=&​affectedsite=&​specattrib=0&​status=all&​priority=all&​typeofproblem=all&​ticketcategory=&​mouarea=&​date_type=creation+date&​radiotf=1&​timeframe=lastyear&​from_date=17+Oct+2013&​to_date=18+Oct+2013&​untouched_date=&​orderticketsby=GHD_INT_REQUEST_ID&​orderhow=descending|All Tickets]]
 +  * [[https://​wiki.egi.eu/​wiki/​Main_Page|Wiki]],​ [[https://​wiki.egi.eu/​wiki/​SAM_Instances|SAM Instances]], ​ [[https://​wiki.egi.eu/​wiki/​EGI_IGTF_Release|IGTF]],​ [[https://​wiki.egi.eu/​wiki/​Tools/​Manuals/​TS190|Benchmark values]], [[https://​wiki.egi.eu/​wiki/​NGI_DE:​Regional_Tools|NGI_DE regional tools]], [[https://​wiki.egi.eu/​wiki/​GOCDB/​Input_System_User_Documentation|GOCDB]],​[[https://​wiki.egi.eu/​wiki/​NGI_DE_CH_Operations_Center:​NGI_DE_CH_Operations_Center|NGI_DE Operations Center]], [[https://​wiki.egi.eu/​wiki/​PROC11|Decommissioning]]
 +  * [[http://​accounting.egi.eu/​egi.php?​ExecutingSite=mainzgrid|Accounting Portal]], [[http://​goc-accounting.grid-support.ac.uk/​rss/​mainzgrid_Pub.html|APEL Publication Test]], [[http://​goc-accounting.grid-support.ac.uk/​rss/​mainzgrid_Sync.html|APEL Synchronisation Test]]
 +
 +===== Atlas =====
 +  * [[http://​adc-monitoring.cern.ch/​|ADC Monitoring]]
 +  * Panda Monitor BigPanda: [[https://​bigpanda.cern.ch/​]]
 +  * [[https://​rucio-ui.cern.ch/​rse_usage?​rses=MAINZ_LOCALGROUPDISK|RSE (Rucia SE)]]
 +  * [[http://​atlas-agis.cern.ch/​agis/​ddmblacklisting/​list/​|Blacklisted Sites]]
 +  * [[http://​atlas-agis.cern.ch/​agis/​atlassite/​main/​961/​|AGIS]]
 +  * [[http://​dashb-atlas-ssb.cern.ch/​dashboard/​request.py/​siteviewhistory?​columnid=10003#​time=24&​start_date=&​end_date=&​values=false&​spline=false&​debug=false&​resample=false&​sites=all&​clouds=DE|Status of LGD #sub]]
 +  * [[https://​twiki.cern.ch/​twiki/​bin/​view/​AtlasComputing/​GridKaCloud|GridKa Cloud]]
 +  * [[https://​atlas-install.roma1.infn.it/​atlas_install/​|Atlas Installation System 2]]
 +  * [[https://​localgroupdisk.pleiades.uni-wuppertal.de/​disks/​MAINZ_LOCALGROUPDISK/​index.html|Dataset Accounting]]
 +
 +====== In case of problems ======
 +
 +  * DaTri, grid certficates,​ grid writes: hn-atlas-dist-analysis-help (Distributed Analysis Help) <​hn-atlas-dist-analysis-help@cern.ch>​
  
software/topical/physics/atlas.txt · Last modified: 2019/10/17 21:11 by meesters