ARC v13.02 update 1 Release Notes

April 29, 2013

This is a bug fix release, addressing several critical issues. The update includes improved JURA reporting to APEL and improved Nagios probes. Authorship and license information is cleaned-up and synchronised across different components.

NorduGrid ARC 13.02 has received an update to:

• core, clients, CE, Infosys and gridftp - from version 3.0.0 to 3.0.1
• documents - from 1.3.0 to 1.3.1
• Nagios plugins - from 1.5.0 to 1.6.0

CAnL C++ and metapackages are unchanged.

ARC components in 13.02 update 1:

• ARC Core 3.0.1 (includes nordugrid-arc-doc v1.3.1)
• ARC Clients 3.0.1
• ARC CE 3.0.1 (includes nordugrid-arc-nagios-plugins v1.6.0)
• ARC Infosys 3.0.1
• ARC gridftp server 3.0.1
• canl++ 1.0.0

ARC Core

API documentation has improved. Few bugs were fixed, see the list below.

ARC Clients

Improvements in error and help messages, some bug fixes, see the list below.

ARC Compute Element

Compound executable instructions are now intercepted, and a proper error is thrown. Some major bug fixes, see the list below.

JURA reporting to APEL has significantly improved.

ARC Information System

Several bug fixes, see the list below.

ARC gridftp server

Code clean-up and improvements.

Common authentication library CaNL++

No changes.

Nagios plugins

Nagios plugins have been significantly improved. Please consult release notes for ARC 13.02 for details about changes between v1.3.11 and v1.5. Changes between v1.5 and v1.6 are:

• Several bugs and GGUS tickets are resolved, see the list below.
• Files used for input-staging tests are now automantically uploaded if they are missing when the job is submitted.
• An option was added to import Python modules on probe startup. This allows the registration of custom job tests and substitution methods.
• Various additions and updates to the manual: How to run Nagios probes from the command-line, the new substitution mechanism, the splitting of the entry points, the previously undocumented check_arcstatus.
• Intercept some exceptions caused by configuration errors, so that they are not flagged as bugs.

Fixed bugs

Since ARC 13.02, the following bugs were fixed:

• 2716 SGE: job in error state mapped to INLRMS:O
• 2926 nordugrid-arc-bdii does not start properly on Ubuntu Precise, apparmor configuration needed
• 3008 bdii-update crashes at system startup on ubuntu 12.04
• 3049 nordugrid-arc-inforeg status does not provide any information
• 3059 only XML configuration examples are packaged with A-REX
• 3065 big file infoprovider.log
• 3072 the out-of-box config file for arc infosys does not provide correct information about how to start service
• 3073 arcsub crashes when submitting a job using adl (witn 3.0.0rc3)
• 3084 nordugrid-arc-inforeg has no pid-file [FAILED]
• 3087 Unable to start nordugrid-arc-slapd when installed on Debian 6
• 3091 Jobs in PREPARING give warning about no local ID in infoprovider.log
• 3093 Lowering case of InterfaceName is missing in LDAP GLUE2 TargetInformationRetriever that blocks submission to CREAM CE
• 3100 Inconsistent authorship in man pages
• 3101 arcsync does not detect EMI-ES jobs
• 3103 arcproxy -r does not work if the certificate and key files are not present
• 3104 Failed (terminal:client-stageout-possible,processing-failure)
• 3107 LoadLeveler information system problem with jobs running longer than 1 day
• 3109 Jobs with parallel environment fail
• 3110 GLUE2 schema check reports "Bug in Nagios probe."
• 3112 Cache cleaning not working
• 3113 Check syntax of information system scripts as part of make check
• 3114 arex segfaults in rev. no. 27146
• 3115 update to SLC6.4 breaks infoproviders if opsys="adotf" is set
• 3116 Missing nagios doc subpackage on .deb platforms
• 3117 Output files not staged correctly by check_arcce
• 3120 Job cancelled in PREPARING still get submitted to LRMS
• 3121 Change argument parsing of check_arcce and check_arcinfosys to be compatible with NCG
• 3124 Remove dbxml from svn, distribution and packaging
• 3125 Init scripts too early
• 3126 JURA is not able to report GOCBD site name to APEL
• 3128 ARC CE probe should automatically select good SEs
• 3129 arccp -T requires -L
• 3130 Missing proxy in control dir causes a-rex to get stuck and increase memory consumption until killed
• 3131 arcget with specific downloaddir makes files disappear
• 3132 Client configuration example for [registry/...] block is incomplete
• 3134 check_arcce_submit should set memory limit
• 3138 GGUS-Ticket-ID: #91763 Some records contains empty LocalJobId element.
• 3144 arcsync segfaults on Precise and Fedora 18
• 3148 Inconsistent treatment of verbosity in configuration by arcls
• 3155 missing "shebang" line in /var/tmp/arc/bdii/provider/arc-nordugrid-bdii-ldif
• 3156 /usr/share/arc/cluster.pl aborts with compilation errors
• 3157 qju.pl aborts due to compilation errors in 13.02 on Ubuntu 12.04 LTS
• 3158 inconsistent error message from `/usr/share/arc/cluster.pl`
• 3159 multiple errors in `/usr/share/arc/configure-SLURM-env.sh`
• 3160 submit-SLURM-job fails with syntax error and exit code 2

GGUS tickets solved:

• 91900 nordugrid-arc-nagios-plugins should depend on package glue-schema
• 91904 Bug in check_arcinfosys when using -t argument
• 92869 ARC probes should not use positional arguments
• 92870 Provide arcnagios.ini configuration

Known issues

• JURA will not publish records to the APEL on a standard Debian/Ubuntu system, because the python-dirq package is not available for them. The workaround is to build this package from source.
• arcmigrate is currently non-functional
• Jobs submitted through EMI ES cannot be renewed or resumed
• When using ARC client tools to submit jobs to CREAM, only JSDL can be used to describe jobs, and the broker type must be set to Null in the client.conf file
• ARC GUI (arcjobtool) is not available yet, pending implementation of client library changes.
• Standalone client tar-balls for Linux are not yet available.
• Bug 2905 is solved using workaround. Source of problem is not yet identified.

Availability

Source

ARC release 13.02 consists of the following source packages:

• NorduGrid ARC, version 3.0.1 (main components)
• NorduGrid ARC "compat", version 1.0.1 (old client)
• NorduGrid ARC Documents version 1.3.1
• metapackages for client tools, computing element and information index, version 1.0.2
• Nagios probes for ARC CE, version 1.6.0

Source code for main components is available from:
http://svn.nordugrid.org/repos/nordugrid/arc1/tags/3.0.1

Documentation source (mostly LaTeX) is available from:
http://svn.nordugrid.org/repos/nordugrid/doc/tags/1.3.1

Source for metapackages is available from:
http://svn.nordugrid.org/repos/packaging/{fedora,debian}/nordugrid-arc-meta/tags/1.0.6

Source for Nagios probes is available from:
http://svn.nordugrid.org/repos/nordugrid/nagios/tags/release-1.6.0

Source for the common authentication library caNl++ is available from:
http://svn.nordugrid.org/repos/workarea/caNl++/tags/1.0.0

Repositories

See detailed description at NorduGrid downloads

These repositories provide binary packages for:

• Debian: 4.0, 5.0 and 6.0 (i386 and amd64)
• Fedora: from 3 to 18 (i386 and x86_64)
• RedHat: EL4, EL5 and EL6 (i386 and x86_64)
• Ubuntu: 8.04, 8.10, 9.04, 9.10, 10.04, 10.10, 11.04, 11.10, 12.04, 12.10 and 13.04 (i386 and amd64)

Scientific Linux and CentOS are implicitly supported through corresponding RedHat repositories.

Microsoft Windows and Mac OS X versions are available from same repositories for clients and some services.