July 2013 - ur-wg - lists.ogf.org

Fwd: [wg-all] Call for Session Proposals: OGF 39 and corresponding joint activities with EGI Technical Forum 2013 / Cloud Interoperability Week
by Andrea Cristofori 09 Aug '13

09 Aug '13

Dear all, As you probably know OGF 39 will be held in Madrid. In the same venue is planned EGI Technical Forum 2013. It is a while since we had a phone meeting. Do you think we can take this chance to speak and it is worth to book a room for an accounting session? Or we should first re start the phone meeting or the discussion on the list? Cheers, Andrea -------- Original Message -------- Subject: [wg-all] Call for Session Proposals: OGF 39 and corresponding joint activities with EGI Technical Forum 2013 / Cloud Interoperability Week Date: Tue, 16 Jul 2013 13:02:06 +0000 From: Sill, Alan <alan.sill(a)ttu.edu> To: OGF Work Groups <wg-all(a)ogf.org> Dear OGF colleagues, OGF 38b is almost upon us, completing the second of our two-part OGF 38 OGF gathering, the second of these gatherings for the year. OGF's third major event of 2013 will be *OGF 39*, which will take place in Madrid, Spain co-located with the EGI Technical Forum (http://tf2013.egi.eu) *Please note that the early bird registration fees are already available and will rise to regular registration rates July 31 <http://tf2013.egi.eu/registration/index.html>!* The OGF 39 sessions will be followed by a Cloud Interoperability Workshop and Cloud Plugfest (http://cloudplugfest.org/cloud-interoperability-week) which are co-sponsored by OGF in cooperation with several other important cloud standards organizations. This is an exciting event that is already filling up with workshop talks and tutorials by many different projects and organizations. We are looking forward to co-hosting this important event. These activities comprise part of a Cloud Interoperability Week joint with several organizations focused entirely on this important topic. The OGF-39 program committee seeks active participation from the entire distributed computing community in all of these events, and encourages the submission of proposals that may include (but are not limited to) the following topics for the OGF 39 sessions. These topics can and should include regular meetings of OGF work groups where appropriate. * OGF Chartered Group Sessions * Birds of a Feather (BoF) Sessions * Tutorials * Interop / plugfest sessions * Federated Identity and Delegation * Data/Storage * Identity Management and Virtual Organizations * Production Infrastructure Interoperability * Software Sustainability for Grids and Clouds * Green IT, Energy Efficiency * Inter-cloud interoperability and SLA management * Networking for Distributed Computing Infrastructures * Performance measurement of Grids and Clouds * Science Clouds at large scales * Grid and Cloud Security * Distributed Desktop Grid and Volunteer Computing * Emerging Distributed Infrastructure * Campus Grids and Clouds * Data Management in Grids and Clouds * Federated Infrastructure Sessions can be requested a <http://redmine.ogf.org/projects/ogf39/issues/new>t this link: http://redmine.ogf.org/projects/ogf39/issues/new and will be scheduled primarily in the OGF session times Monday through Wednesday September 16-18, with tutorials and cooperative Cloud Interoperability Week events scheduled also primarily Wednesday through Friday Sep. 18-20. Where possible within the rooms available, we will try to schedule OGF sessions cooperatively with (or so as not to conflict with) other corresponding activities. Please also check the rest of the EGI TF 2013 schedule linked below. Further information on OGF 39 can be found at the event link at http://www.ogf.org/dokuwiki/doku.php/events/ogf-39 and at the EGI TF 2013 site and Cloud Interoperability Week links above. A preliminary schedule for the week's events in Madrid is available for your convenience at the link below. https://indico.egi.eu/indico/conferenceProgram.py?confId=1417 Send any further questions you may have to events(a)ogf.org <mailto:events@ogf.org> - Your OGF event planning team

3 4

Re: [UR-WG] Usage Record feedback
by Andrea Cristofori 24 Jul '13

24 Jul '13

Dear Fotis, Sorry for the late answer but your email got lost in the wrong folder... On line some answer. On 05/10/2013 04:37 AM, Fotis Georgatos wrote: > > Dear Usage Record working group, > > First, I would like to ask you, according to your experience, which > known technologies are closer to implementing the described v2.0 Usage > Record; > (the question regards both cloud and scheduling systems and an answer > would be nice if it is of the type "we are using X with open source > lib Y, > yields 80% of the standard, while we do billing based on A & B procedures) > ie. if someone holds a working prototype knowing about it would be great. > The work done for UR2.0 take in account work done separately in other projects especially within EMI where other, more specific standards were defined (CAR for computing and StAR for storage). There is also another definition from EGI (fedcloud task force for cloud accounting). As you can see from the Attribute Matrix at the end of the UR2.0 document, the attributes of the other definition have a correspondence in this document. At the moment I do not know any implementation of UR2.0 but it should be quite straightforward to support it in products that support one of the other definitions mentioned. The other definition are indeed already being supported in several different products (for example CAR for DGAS and APEL, StAR and the EGI cloud definition in the new sensors that are in development for the storage and cloud). > > As regards the standard itself 2 comments follow, for potential > OPTIONAL elements: > * It would be good to provide a field somewhere for the so-called > "xfactor"; > it is being used across a few HPC sites as a post-processing metric > for jobs: > http://docs.adaptivecomputing.com/maui/5.1.2priorityfactors.php#xfactorsub > Typically its value is in the 1..2 range and centers track the > histogram closely. I had a look at the link and I do not understand exactly why you would need this value after the job is finished. And what is its purpose in the accounting? Maybe it could be useful for future submission of job of the same kind but this looks like more monitoring to me. > > * You may wish to provide the ability to report "container job ID", ref. > http://oar.imag.fr/sources/2.5/docs/documentation/OAR-DOCUMENTATION-USER/#c… > As name suggests it permits to first make a reservation there run > your jobs in it; > it can be a useful feature for billing, eg. if you organize an HPC > school > and, would rather wish to avoid charging twice, for trainee jobs > within trainer's job. > (just an example, they have many more uses) I am not sure why this would be necessary. If the accounting takes is based only on the CPU time then there should be no problem on how many processes are or jobs are run. But maybe I am missing something here. > > kind regards, > Fotis > > ps. I am not receiving the m-list traffic, kindly keep me in cc for > feedback. In the last weeks there were not many emails on the list but, if you wish, you can register on the OGF web site: http://redmine.ogf.org/ After registration just click on "Projects" on the top left and look for "Standards" -> "Management Area" -> "UR WG". In the page of the group you can join by clicking on the right side of the page. Kind regards, Andrea > > -- > Drs./Eng. Fotis Georgatos <Fotis.Georgatos(a)uni.lu > <mailto:Fotis.Georgatos@uni.lu>> > HPC Systems Engineer, LCSB (University of Luxembourg) > L-4362 Esch-sur-Alzette, Campus Belval, avenue des Hauts-Fourneaux 7 > Phone: +352 466644 5609 > > > > -- Andrea Cristofori INFN-CNAF Viale Berti Pichat 6/2 40127 Bologna Italy Tel. : +39-051-6092920 Skype: andrea-cnaf

2 2

Fwd: [wg-all] New document published: Usage Record - Format Recommendation [Obsoletes GFD.98]
by Andrea Cristofori 19 Jul '13

19 Jul '13

Dear all, As you might already know our document has reached the status of Format Recommendation. I wish to thank you all for the work. Maybe it is time to think if we want to proceed further on the work and maybe advance to UR2.1. Several weeks ago I posted some thought on GPU accounting. What do you think? As John G. also asked: is there any implementation already available that uses UR2.0? Or plan to have it implemented? Cheers, Andrea -------- Original Message -------- Subject: [wg-all] New document published: Usage Record - Format Recommendation [Obsoletes GFD.98] Date: Mon, 8 Jul 2013 09:52:22 -0800 From: Greg Newby <gbnewby(a)alaska.edu> To: All WG <wg-all(a)ogf.org> OGF Community: A new document has been published in the OGF series. All OGF documents (including any that are open for public comment) may be found here: www.ogf.org/gf/docs/ * GFD-R-P.204 " Usage Record - Format Recommendation." A. Cristofori, J. K. Nilsen, J. Gordon, M. Jones, J. A. Kennedy, R. Müller-Pfefferkorn. Via UR-WG. This document obsoletes #GFD.98 Abstract: For resources to be shared, sites must be able to exchange basic accounting and usage data in a common format. This document describes a common format which enables the exchange of basic accounting and usage data from different resources. This record format is intended to facilitate the sharing of usage information, particularly in the area of the accounting of jobs, computing, memory, storage and cloud usage but with a structure that allows an easy extension to other resources. This document describes the Usage Record components both in natural language form and annotated XML. This document does not address how these records should be used, nor does it attempt to dictate the format in which the accounting records are stored. Instead, it defines a common exchange format. Furthermore, nothing is said regarding the communication mechanisms employed to exchange the records, i.e. transport layer, framing, authentication, integrity, etc. -- Greg Newby, OGF Editor Dr. Gregory Newby, Director of the Arctic Region Supercomputing Center Univ of Alaska Fairbanks-909 Koyukuk Dr-PO Box 756020-Fairbanks-AK 99775-6020 e: gbnewby(a)alaska.edu v: 907-450-8663 f: 907-450-8603 w: people.arsc.edu/~newby -- The wg-all mailing list is an umbrella list for all OGF mailing lists. If you are subscribed to any OGF mailing list, you will receive mails to wg-all. wg-all mailing list wg-all(a)ogf.org https://www.ogf.org/mailman/listinfo/wg-all

2 2

UR V2 Implementations?
by john.gordon＠stfc.ac.uk 01 Jul '13

01 Jul '13

Has anyone attempted an implementation of UR v2? Someone told Tiziana Ferrari of EGI that CAR and StAR were v2 implementations. While I know we carried some features from them forward into the v2 draft, can we call them v2? Regards, John -- Scanned by iCritical.

2 1