additional nordugrid storage use cases

hi, I've collected requirements on storage related information our users would like to be able to find in glue2. Some of them i myself don't support (e.g. individual storage space info), nevertheless i forward all of them. These requirements basically ask for detailed storage usage information, load-like information on the storage service and introduction of storage activity describing a transfer process a storage service is participating in. see the details below. Balazs ps: please apologize for the last minute post (we are having a storage phone call in half an hour) --------------------------------------------------------- Use cases for storage information in glue2 1. Find out how much disk space is used by User A, Same for a group B of VO C. Same for tapes or other media 2. Find how much disk space is available at this moment for VO D. Same for tapes or other media 3. Find storages that can keep files online for at least 7 days 4. Find storages that can bring a file from tape in 10 minutes 5. Find storages that support SRM2.2 6. Find storages that have regular tape backups 7. Provide transfer progress (storage activities) and related load information. In a complete analogy to jobs at computing elements: I can currently monitor the total number of grid/nongrid jobs, and each grid job status (owner, duration, resource consumption, submission client, everything). In the very same manner, I'd like to see a number of active transfers (uploads and downloads), with all the relevant information per transfer: file name, owner, source, destination, total size, progress (MB transferred), and probably some information about storage media (disk/tape), and whatever else I forgot. ATLAS DDM (Distributed Data Management) suffers enormously from the lack of transparency of the file and dataset transfer processes, the actual load imposed on a storage service due to active transfer processes. General statistics such as number of ongoing transfers and transfer rate seen at each storage service would be useful to be published somewhere.
participants (1)
-
Balazs Konya