Release Announcement for NorduGrid ARC 13.11 update 1

April 29, 2014

This is a minor release, fixing a number of bugs and introducing several new features. Some old components are getting deprecated and are to be replaced by new code.

New features are:

• Rucio DMC
• ACIX DMC
• BOINC backend
• Per-VO record handling in JURA

Deprecated components are:

• arc-ur-logger (replaced by JURA, see migration notes)
• GACL-related components (obsolete)
• DQ2 DMC (obsoleted with DQ2 being decommissioned)

NorduGrid ARC 13.11 has received an update to:

• core, clients, CE, Infosys and gridftp - from version 4.0.0 to 4.1.0
• documents - from 1.3.4 to 1.4.0
• Nagios plugins - from 1.7.0 to 1.8.0
• CAnL C++ - from 1.0.1 to 1.1.0

Metapackages are unchanged.

Detailed notes

ARC Core

Two new features were added to the ARC core:

• A new ACIX DMC to allow discovery of locations of cached copies of data.
• A new Rucio DMC for access to new ATLAS data management system.

In addition, many bugs were fixed, see the list below.

ARC Compute Element

A new back-end was added for running ARC jobs through BOINC. In addition, many bugs were fixed, see the list below.

Other components

VO filtering was added to the JURA jobreporter, so that JURA now matches all features of arc-ur-logger. In addition, many bugs were fixed, see the list below.

Fixed bugs:

Since ARC 13.11, the following bugs were fixed:

• 1673 arcstat slows down with large job history
• 2352 fix the real number parsing problem in the JSDL parser
• 2946 arcget lost task during downloading
• 2947 Add more informative messages to arctest
• 3136 GGUS-Ticket-ID: #92862 ARC job manager (2.0.1-1.el5) stops when data transfers fail
• 3145 arcstat -a should print a better summary
• 3150 ARC CE not being registered to EGIIS
• 3178 arcstat should denote internal job states as such
• 3216 ARC BES information shows EMI ES endpoints when not configured
• 3240 Let arcstat report inaccessible jobs
• 3267 Add support for EMI-ES in arcrenew
• 3270 Nordugridmap can not handle VOs with no members
• 3292 Correction to Condor backends for APEL (req for sites with multiple CEs)
• 3299 Support for setting x509userproxy in condor submit file
• 3302 VO filter in the JURA
• 3308 HTTP MCC tries to read body of HEAD response
• 3310 Number of cores used is not written to .diag files (Condor)
• 3312 arcls fails to list anonymous ftp servers
• 3320 Syntax error in /usr/share/arc/create-slapd-config
• 3321 arcsub -b Benchmark
• 3323 SSM update to 2.1.1
• 3324 arcls of non-existent file on http server reports success
• 3325 scan-condor-job sometimes far too slow
• 3326 GlueHostMainMemoryRAMSize is always zero
• 3327 Problems when HTCondor-G submits to ARC with HTCondor as LRMS
• 3328 transfer fails if LFC checksum is upper case
• 3329 Condor backend gives incorrect information when partitionable slots are used
• 3330 Default path to up- and downloaders in submit scripts are incorrect
• 3333 configure script flags GridFTP as enabled even though Globus libraries are missing
• 3334 When input file name contains only digits it is confused with size
• 3337 empty executable script / input files when submitting a job via EMI-ES
• 3338 cannot upload big binary file when using EMI-ES
• 3339 no email sent and weird errors in gmlog/errors if jobname is more than just a string
• 3340 Unable to find BDB job list when specified relatively
• 3348 Migrating submit-condor-job to a shell script
• 3350 countpernode in SLURM submit backend requests too many cpus
• 3352 When trying to submit a job with empty input files the job submission repeats continuously "INFO: Failed to shut down SSL"

API changes

API changes from libraries version 4.0.0 to 4.1.0 are documented at NorduGrid Wiki.

Known issues

• There is a memory leak when using Java API for multiple job submission with files to BES interface.
• The CPU time is not measured correctly for jobs that kill the parent process, such as some agent-based/pilot (e.g., ALICE)
• JURA will not publish records to the APEL on a standard Debian/Ubuntu system, because the python-dirq package is not available for them. The workaround is to build this package from source.
• arcmigrate is currently non-functional
• Jobs submitted through EMI ES cannot be renewed
• When using ARC client tools to submit jobs to CREAM, only JSDL can be used to describe jobs, and the broker type must be set to Null in the client.conf file
• ARC GUI (arcjobtool) is not available yet, pending implementation of client library changes.
• Standalone client tar-balls for Linux are not yet available.
• Bug 2905 is solved using workaround. Source of problem is not yet identified.

Availability

Source

ARC release 13.11u1 consists of the following source packages:

• NorduGrid ARC, version 4.1.0 (main components)
• NorduGrid ARC Documents version 1.4.0
• metapackages for client tools, computing element and information index, version 1.0.7
• Nagios probes for ARC CE, version 1.8.0
• Common authentication library caNl++, version 1.1.0

Source code for main components is available from:
http://svn.nordugrid.org/repos/nordugrid/arc1/tags/4.1.0

Documentation source (mostly LaTeX) is available from:
http://svn.nordugrid.org/repos/nordugrid/doc/tags/1.4.0

Source for metapackages is available from:
http://svn.nordugrid.org/repos/packaging/{fedora,debian}/nordugrid-arc-meta/tags/1.0.7

Source for Nagios probes is available from:
http://svn.nordugrid.org/repos/nordugrid/nagios/tags/release-1.8.0

Source for the common authentication library caNl++ is available from:
http://svn.nordugrid.org/repos/workarea/caNl++/tags/1.1.0

Repositories

See detailed description at NorduGrid downloads

These repositories provide binary packages for:

• Debian: 5.0, 6.0 and 7.0 (i386 and amd64)
• Fedora: from 5 to 20 (i386 and x86_64)
• RedHat: EL5 and EL6 (i386 and x86_64)
• Ubuntu: 8.04, 8.10, 9.04, 9.10, 10.04, 10.10, 11.04, 11.10, 12.04, 12.10, 13.04, 13.10 and 14.04 (i386 and amd64)

Scientific Linux and CentOS are implicitly supported through corresponding RedHat repositories.