Highlights

webdav.redirect.allow-https and pool.enable.encrypted-transfers are now set by default to true. It is important to note, that if the lower versions of dCache for pools this properties should be manually set to true.

Incompatibilities

  • the org.dcache.net.localaddresses accepts host names
  • NFS transfers will fail with EIO for broken files
  • The TLS mode of xroot is set to OPTIONAL, which requires host certificates on pool to be present

Release 8.1.10

nearline-storage

A NPE on error path has been fixed.

The race condition when flushing removed file is fixed now.

Changelog 8.1.9..8.1.10

40af9af501
[maven-release-plugin] prepare release 8.1.10
3f953b281e
nearline-storage: fix race in flushing removed file
189ba319d1
nearline-storage: fix NPE on error path
b6cd033067
[maven-release-plugin] prepare for next development iteration

Release 8.1.9

dcache-qos

A minor regressions in handling of pool info diffs has been fixed.

Full scan of pool info diff behavior is available.

frontend

The current release fixed type default of RESTful pool/nearline/queues resource

Changelog 8.1.8..8.1.9

b22f17da2d
[maven-release-plugin] prepare release 8.1.9
49de71caa6
dcache-qos: fix minor regressions in handling of pool info diffs
6868428e1d
dcache-frontend: fix type default of RESTful pool/nearline/queues resource
2d691fcf0e
pom.xml: bump xrootd4j to 4.3.4
ea1945f5c6
dcache-qos: fix two more regressions in the PoolOpChangeHandler
2f338dadce
dcache-qos: add missing pool tag comparison in PoolOpChangeHandler
c778b23d09
[maven-release-plugin] prepare for next development iteration

Release 8.1.8

chimera

Pools that are no longer actively being cleaned were previously falsely still listed as active in the admin interface when the cleaning attempt ended due to an exception. This has been fixed.

core

If a pin is unpinned while a pin request for that same pin is still ongoing in pinmanager, pinning will not be retried.

Changelog 8.1.7..8.1.8

ac8dfe894c
[maven-release-plugin] prepare release 8.1.8
5acb194cd4
dcache-core: let pinmanager stop retrying pinning upon unpin state
ef702716e6
dcache-chimera: disk-cleaner, error handling in parallel pool deletes
e17cf2cb4d
[maven-release-plugin] prepare for next development iteration

Release 8.1.7

gplazma2-grid

An empty requires field in IGTF policy is now accepted. Files with invalid or unexpected policies are ignored.

webdav

A bug was fixed that caused a NullPointerException while sending Kafka messages.

jquery was updated to version 3.6.1 and bootstrap was updated to version 5.2.1

Changelog 8.1.6..8.1.7

ec98e3c559
[maven-release-plugin] prepare release 8.1.7
cc6fa83787
dcache: NPE on removal via WebDAV and token
61e3d13b04
webdav: update 3rd party js libraries
e593318904
doc: add recipe to cookbook for migration/draining of resilient pools
a5960187a9
qos-engine: prevent NPE if pool monitor not available
b7bb56aecc
gplazma2-grid: invalid IGTF policy file should fail with ParserException
e090af92b9
[maven-release-plugin] prepare for next development iteration

Release 8.1.6

common

dCache now reports RemoteTransferManager as being replicable.

dcache-xroot

A possible thread starvation and inability to allow more clients to connect has been fixed.

webdav

Fix a bug where the WebDAV door will continue attempting to kill a cancelled HTTP-TPC transfer indefinitely if the corresponding RemoteTransferManager cell has been switched off.

The current release fixed a NullPointerException when reporting on active transfers if the client has disconnected but the door has not yet cancelled the transfer.

xroot

Documentation now offers some explicit guidance as to pool configuration for xrootd reqarding memory.

xrootd4j

A potential for DOS in xrootd write was fixed.

Changelog 8.1.5..8.1.6

195c921ce2
[maven-release-plugin] prepare release 8.1.6
13040398d9
Update dcache-minimal-installation.md
83240cf253
Update dcache-minimal-installation.md
93df95e785
Update dcache-minimal-installation.md
e6b63e67b8
dcache-xroot: interrupt doOnOpen thread in the event of channel inactive
071119e63e
Update dcache-minimal-installation.md
683bf1b558
webdav: http-tpc do not keep retrying to cancel transfer
0bb2b44085
Update dcache-minimal-installation.md
bc4726759e
Update dcache-minimal-installation.md
281fce96cf
Create dcache-minimal-installation.md
9a0cf9d7cb
webdav: fix NPE if client aborts transfer
8b611559db
dcache-xroot: add Book section on direct memory requirements for pools*
6f10d17ca9
pom.xml: update to latest xrootd4j bugfix
d3bf904d37
[maven-release-plugin] prepare for next development iteration
0704524aa5
properties: report that remote transfer manager is replicable

Release 8.1.5

dcache

A clarification on authorized keys format has been added.

Changelog 8.1.4..8.1.5

0bd81d6b58
[maven-release-plugin] prepare release 8.1.5
49a91502f0
Add clarification on authorized keys format
c0ae075aef
[maven-release-plugin] prepare for next development iteration

Release 8.1.4

dcache-bulk

Runtime exceptions do not kill the queue thread now and do not leave the request in a stalled state.

webdav

Existing monitoring information does not show HTTP-TPC transfers, which may result in admins being unaware of dCache activity.

This is now fixed and The Active Transfers page (from httpd) and the transfers resource (from frontend) now include HTTP-TPC transfers.

WebDAV HTTP-TPC now supports multiple RemoteTransferManager services, which allows for high-availability deployments. The WebDAV door and all RemoteTransferManager services must be upgraded to support this new feature.

Changelog 8.1.3..8.1.4

cf355e6147
[maven-release-plugin] prepare release 8.1.4
3edec324a6
dcache-bulk: (version 1) handle unexpected exceptions in queue
61e98372ef
webdav/httpd/frontend: add HTTP-TPC transfers to transfer list
81473acfe1
webdav/transfermanager: support multiple RemoteTransferManager
6e0aabceba
[maven-release-plugin] prepare for next development iteration

Release 8.1.4

dcache-bulk

Runtime exceptions do not kill the queue thread now and do not leave the request in a stalled state.

webdav

Existing monitoring information does not show HTTP-TPC transfers, which may result in admins being unaware of dCache activity.

This is now fixed and The Active Transfers page (from httpd) and the transfers resource (from frontend) now include HTTP-TPC transfers.

WebDAV HTTP-TPC now supports multiple RemoteTransferManager services, which allows for high-availability deployments. The WebDAV door and all RemoteTransferManager services must be upgraded to support this new feature.

Changelog 8.1.3..8.1.4

cf355e6147
[maven-release-plugin] prepare release 8.1.4
3edec324a6
dcache-bulk: (version 1) handle unexpected exceptions in queue
61e98372ef
webdav/httpd/frontend: add HTTP-TPC transfers to transfer list
81473acfe1
webdav/transfermanager: support multiple RemoteTransferManager
6e0aabceba
[maven-release-plugin] prepare for next development iteration

Release 8.1.3

frontend, bulk

Both numeric and string values for PIN lifetime are valid now. Also, skipDirs for DELETE can be both boolean and string. All other current arguments are required to be strings, as before.

Changelog 8.1.2..8.1.3

556783be03
[maven-release-plugin] prepare release 8.1.3
f1e3a88608
dcache-frontend,bulk: fix typing of argument values
8fc3eefc5a
[maven-release-plugin] prepare for next development iteration

Release 8.1.2

frontend

Anonymous access receives a 401 error and doesn’t trigger a stack-trace when unlimitedVisibility is set to false.

clearOnSuccess, clearOnFailure and cancelOnFailure can have boolean and string values now.

pool

A bug is fixed where the checksum calculation would fail for empty files.

Changelog 8.1.1..8.1.2

2f444d9da7
[maven-release-plugin] prepare release 8.1.2
a6071e2e52
dcache-frontend: protect against RuntimeError in case of denied anonymous access
09af00232d
restore inadvertently removed ‘target’ extraction in toBulkRequest()
48e05d777b
dcache-frontend: bulk-requests POST, allow either string or boolean for boolean values
c1c1342269
pool: don’t treat an empty file as a sparse file
1ffa039957
[maven-release-plugin] prepare for next development iteration

Release 8.1.1

ChimeraVfs

This release restores the ability to modify file levels.

info

The delay between messages sent by info was increased to reduce log messages of “DGA {…} triggering too quickly”.

pool

If the scrubber state file is empty, scrubber will now log a more helpful error message and proceed scrubbing the pool.

Changelog 8.1.0..8.1.1

44946bfd98
[maven-release-plugin] prepare release 8.1.1
5410f1ec20
pool: improve handling empty saved state by scrubber
3cfde5b650
dcache-xroot,pom.xml: bump xrootd4j to 4.3.1
4f2a6d0523
dcache-xroot: flesh out channel inactive and exception caught
6910042ebd
info: increase delay between messages
d6c908c7ef
ChimeraVfs: Check file level in addition to inode type when disallowing file size change
a0e1423066
[maven-release-plugin] prepare for next development iteration

Release 8.1.0

Cells

If dCache runs in NAT environment then login broker and pools should publish externally published addresses and names. The

org.dcache.net.localaddresses

property allows to specify the desired IP address. However, in dynamic environments, like kubernetes the ip address is not known in advance, but the exposed service name.

To support operation in such environemnts the property handling is update to support host names.

NFS

If requested files has in a BROKEN state, then NFS door will tell client to try later. Though, some BROKEN files can be fixed by sysadmins, typically nfs client will block and bekome inresponceive. To avoid hanging nfs clients, startng with this release NFS door will fail request to broken files and return EIO error to a client application

Plugin

Plugins can use admin commands now if they implement CellDynamicCommandProvider. If an instance of the plugin is created in a pool, its annotated commands are added with the instance name as a prefix. By deleting the plugin instance, the added commands are also removed.

PNFS Manager

Fixes file attribute change time update on modification of extended attributes for PostgreSQL backend.

WebDAV

webdav.redirect.allow-https and pool.enable.encrypted-transfers are now set by default to true. The reason is that HTTPS redirects from HTTP are dangerous and are going to be blocked soon (or already blocked ) by all browsers due to abuse. The original HTTPS link should be now redirected to HTTPS and not to HTTP.

webdav.redirect.allow-https and pool.enable.encrypted-transfers are now set by default to true.

Changelog from 8.0.0 to 8.1.0

09e692e41a
nfs: re-send kill only for write movers
eb5864149d
frontend: fix NPE in SRR when space information is not available yet.
577cbd9abb
[maven-release-plugin] prepare branch 8.1
4a05dddfaf
Revert “[maven-release-plugin] prepare for next development iteration”
0c3417b3ea
[maven-release-plugin] prepare for next development iteration
765e5ed06d
[maven-release-plugin] prepare branch 8.2
695bd193b9
dcache-qos: completed verifier, configuration and frontend changes
f1de7dab2f
dcache-core: improve error message for inexistent statistics path
4b0e5ec8bb
Revert “dcache-core: improve error message for inexistent statistics path”
e22c49e391
chimera: fix creation time attribute for tags
07395c66e8
dcache-xroot: modify xrootd.plugin defaults and update documentation
8414c3acae
dcache-xroot: support multiple protocol door
6d8da2c902
dcache-xrootd: fix TPC rendezvous to work with token authorization
2f33524268
dcache-xroot: update master xrootd4j to 4.3.0, and stable branches to next minor version
8f1c2348c2
dcache-core: improve error message for inexistent statistics path
0d5779e5ba
gplazma: inject gPlazma as a bean
0552410450
dcahce: set https redirect to true by default
6fe8767c04
dcache-nearline-plugin: set API jar scope to provided
f576cc856c
info: fix broken unit-test, remove redundant one
315e8321f9
dcache script: redirect deprecation warning to stderr
5829498dc9
chimera: fix ctime change on xattr update for postgresql
4e9b323cdb
configuration: enable quota, set quota update interval to 12 hours and disable pinning of online files
4c3a7ffc66
nfs: add client IP into layout error logs
7f6331e421
pool: remove dead code to set buffer IO sizes
8269a85c7a
nfs: expose files creation time over NFS
f07a947d78
dcap: drop magic way to set IO buffer sizes
ca1254d42e
docker: fix version number in pom
41c331d334
pom: update spring libs to 5.2.20
9187b08fb5
pool: describe why migration job was cancelled
6af465f4a7
pnfsmanager: avoid leaking whether or not file exists
56d53d3ddb
pool: fix javadoc, remove unused code
013f2a49ea
docs: UserGuide add picture of tape silo
234f6597a1
docs: UserGuide add chapter on tertiary storage
fb6f283dc0
dcache-xroot: Allow ZTN authentication to function as fallback authorization
c33f75b45e
srr: don’t publish link local addresses (v2)
a713663443
UderGuide: describe supported checksums, add example including sha
5001ee852b
frontend: fix problem with making SRR resources public
71c8dfbbba
dcache-chimera: add sha checksum commands to chimera shell
3d53086c84
dcache-core,common: fix user having to request sha-1, not sha
b5975f050c
nfs: enforce subject propagation on RPC level
1dbf30759b
nearline-storage: fix request count on error path in AbstractRequest#failed
9a2cd70e1b
nearline-storage: fix queued count when request initialization falied
fe7116ae98
pool: add javadoc to StorageClassContainer#flushAll method
c7d9b20a6b
qos-verifier: (3 of 9) operation filters and interfaces
b08b32fefc
dcache-info: fix javadocs, remove explicit time calculation
edb81b0cc1
Fix typo
a8df0f2145
dcache-core: prevent ocasional message ttl test failure
0830782114
dcache-chimera: fix cleaner batch delete exception
a88bade0dc
pool, plugin: Add admin commands for plugins
2f9b5d39d5
dcache-core: remove unused code
5c16473dce
dcache-core: simplify stream operations
3351df28ab
frontend: make srr resources public
eaa7811d19
chimera: harmonise FileNotFoundChimeraFsException message
e9cc80f47e
webdav/frontend/srm/gplazma: log OIDC ‘sub’ and ‘jti’ claims
025f579eb1
ftp: kill cell asynchronously
da994201f1
scripts: configure JVM to use OS-supplied IP address order
755ee365e5
pool: http-tpc prefer IPv6 address
c5b35bf48e
book: mention ZooKeeper-side config format changes
1046ba5dd0
skel: added example configuration for needrestart
d5ee2eac69
cells: publish fake local addresses to lm
4d33fbc576
common-security: add test for server cred reload
49b0ec33e5
pool: add bunch of unit tests for NearlineStorageHandlerTest
03ad2301b3
Update macaroons.md
f8a5fdb429
Update macaroons.md
cb0482bf88
Update macaroons.md
d977eba72a
Update macaroons.md
3a739b80f9
Update macaroons.md
ac63c4a5ee
Update macaroons.md
842db493c4
Update macaroons.md
b17fbc2be8
Update macaroons.md
adaa8bc47e
util: treat broken file as unrecoverable error in Trnasfer class
0d97495de3
pool: handle multiple shutdowns of a nfs mover
66f188fabb
gplazma: oidc further simplify by removing HttpJsonNode
f4b492170d
gplazma2: fix junit assert deprecation warnings
53674527ca
build(deps): bump postgresql from 42.2.25 to 42.3.3
fb67d1e86e
dcache-bulk: aborted request gets stuck in the STARTED state
2f10e66861
dcache-bulk: pin by request id and unpin optionally by request
5bfd812c6d
gplazma: oidc use single discover document cache
5b74c10b0e
gplazma: oidc support authz and non-authz identities
982f89b0ff
pool: try to forcefully kill HSM process if needed
11a12b457d
gplazma: drop gplazma.scitoken.dcache-supports-exempt-principal
dfa548cbba
systemtest: fix two issues with oidc support
b55910af5c
admin shell: fix line termination in SshOutputStream
8502a2034e
dcache-xroot: set default TLS to OPTIONAL for pools
7c4a5103f6
bulk, frontend-rest: return 404, not 403, when request id does not exist
1869af4faf
vehicles: fix regression in GenericStorageInfo
0c4a4c15ce
webdav: fix NPE if ‘webdav.authz.allowed-paths’ disallows a request
764bce1011
chimera: fix error when adding new label to a file
363757a62c
book: fix typo in config-nfs
6b2d4a5e14
book: describe secure/insecure export options by nfs.
330c90b84c
common: simplify Callables#getLastModifiedTime
07f325899d
gplazma: oidc add support for SciTokens and AuthZ-WG profile tokens
5d603029b2
vehicles - clarify semantics of the StorageInfo#locations method.
f8533a3b58
09e692e41a
nfs: re-send kill only for write movers
eb5864149d
frontend: fix NPE in SRR when space information is not available yet.
577cbd9abb
[maven-release-plugin] prepare branch 8.1
4a05dddfaf
Revert “[maven-release-plugin] prepare for next development iteration”
0c3417b3ea
[maven-release-plugin] prepare for next development iteration
765e5ed06d
[maven-release-plugin] prepare branch 8.2
695bd193b9
dcache-qos: completed verifier, configuration and frontend changes
f1de7dab2f
dcache-core: improve error message for inexistent statistics path
4b0e5ec8bb
Revert “dcache-core: improve error message for inexistent statistics path”
e22c49e391
chimera: fix creation time attribute for tags
07395c66e8
dcache-xroot: modify xrootd.plugin defaults and update documentation
8414c3acae
dcache-xroot: support multiple protocol door
6d8da2c902
dcache-xrootd: fix TPC rendezvous to work with token authorization
2f33524268
dcache-xroot: update master xrootd4j to 4.3.0, and stable branches to next minor version
8f1c2348c2
dcache-core: improve error message for inexistent statistics path
0d5779e5ba
gplazma: inject gPlazma as a bean
0552410450
dcahce: set https redirect to true by default
6fe8767c04
dcache-nearline-plugin: set API jar scope to provided
f576cc856c
info: fix broken unit-test, remove redundant one