April 2009 - pgi-wg - lists.ogf.org

No security teleconference tomorrow, friday may 1st
by Moreno Marzolla 30 Apr '09

30 Apr '09

Hi all, this is a reminder that there will be no PGI security teleconference tomorrow, friday may 1st. The next PGI (job management) teleconference will be next wednesday, may 6, at the usual time. An official reminder will be sent through the list as usual. Moreno. (for the PGI co-chairs) -- Moreno Marzolla INFN Sezione di Padova, via Marzolo 8, 35131 PADOVA, Italy EMail: moreno.marzolla(a)pd.infn.it Phone: +39 049 8277103 WWW : http://www.dsi.unive.it/~marzolla Fax : +39 049 8756233

1 0

Minutes online in discussion section
by Morris Riedel 29 Apr '09

29 Apr '09

Hi PGI team, thanks for joining today - I tried to catch the most of the points in the minutes that are located on GridForge in the discussion section now. Feel free to add/change them. Take care, Morris ------------------------------------------------------------ Morris Riedel SW - Engineer Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Forschungszentrum Juelich Wilhelm-Johnen-Str. 1 D - 52425 Juelich Germany Email: m.riedel(a)fz-juelich.de Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel Phone: +49 2461 61 - 3651 Fax: +49 2461 61 - 6656 Skype: MorrisRiedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender)

1 0

PGI TelCon 2009-04-17 Notes online
by Morris Riedel 29 Apr '09

29 Apr '09

Hi PGI team, sorry for the delay - the minutes of the last telcon are available online as usual: http://forge.gridforum.org/sf/discussion/do/listPosts/projects.pgi-wg/discus sion.meetings.topc4268 Take care, Morris ------------------------------------------------------------ Morris Riedel SW - Engineer Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Forschungszentrum Juelich Wilhelm-Johnen-Str. 1 D - 52425 Juelich Germany Email: m.riedel(a)fz-juelich.de Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel Phone: +49 2461 61 - 3651 Fax: +49 2461 61 - 6656 Skype: MorrisRiedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender)

1 0

Next teleconference tomorrow, wednesday april 29th
by Moreno Marzolla 29 Apr '09

29 Apr '09

Dear all, the next PGI teleconference will be held tomorrow, wednesday april 29th at 16:00 CET (duration: 1 hour). Call-in details as follow: via Skype call +9900827049931906 (free of charge) ordinary phone numbers (local rates) with the 9931906 conference number: Austria 0820 401 15470 Belgium 0703 57 134 France 0826 109 071 Germany +49 (0) 180 500 9527 Switzerland 0848 560 397 Agenda (please feel free to suggest additional items for discussion): 1) Any final comment/additional requirement to be included in the "GES strawman"; would it be appropriate to transform the "GES strawman" into a GFD-I (informative?) document containing "PGI requirements for execution services" ? 2) How can the requirements be actually implemented? (this item is likely to take most of our effort from now to the end of the WG activity) Moreno. -- Moreno Marzolla INFN Sezione di Padova, via Marzolo 8, 35131 PADOVA, Italy EMail: moreno.marzolla(a)pd.infn.it Phone: +39 049 8277103 WWW : http://www.dsi.unive.it/~marzolla Fax : +39 049 8756233

4 3

OGF PGI - Execution Service Strawman - Data Staging
by Etienne URBAH 23 Apr '09

23 Apr '09

To All, Concerning the 'Execution Service Strawman' : - Can Morris publish the notes of the telephone conference held on 17 February 2009 inside 'Discussions / Meetings' ? - Data Staging : While browsing the list of published OGF documents at http://www.ogf.org/gf/docs/?final&all : I have found an 'HPC File Staging Profile, Version 1.0' document at http://www.ogf.org/documents/GFD.135.pdf which is short and easy to read. I have created a link to it inside 'Input Documents / Execution Service', and I suggest to check if we can include it partially or totally in our 'Execution Service Strawman'. Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr -----------------------------------------------------

1 0

Reminder: no teleconferences this week
by Moreno Marzolla 20 Apr '09

20 Apr '09

Dear all, this is a remind that we will not have the usual PGI teleconferences this week, due to many of the key people being at the UMD meeting at CERN. Of course the discussions can go on via the mailing list. Moreno (for the PGI co-chairs) -- Moreno Marzolla INFN Sezione di Padova, via Marzolo 8, 35131 PADOVA, Italy EMail: moreno.marzolla(a)pd.infn.it Phone: +39 049 8277103 WWW : http://www.dsi.unive.it/~marzolla Fax : +39 049 8756233

1 0

Dropped off
by Moreno Marzolla 17 Apr '09

17 Apr '09

Hi all, sorry, but I have been dropped off the call and cannot rejoin even after restarting the client. It is definitely not a client issue, as this morning everything worked fine (I used the exact same teleconference number we are using now, and stayed connected far more than one hour...). The same thing happened last time, I was dropped off after exactly one hour... Moreno. -- Moreno Marzolla INFN Sezione di Padova, via Marzolo 8, 35131 PADOVA, Italy EMail: moreno.marzolla(a)pd.infn.it Phone: +39 049 8277103 WWW : http://www.dsi.unive.it/~marzolla Fax : +39 049 8756233

1 0

Pointers to interesting options in older BES specs
by Andrew Grimshaw 17 Apr '09

17 Apr '09

All, In v32 of the BES there were two things that did not make the final cut: BES_Activity porttype and particular sub-state models for staging, suspend resume. Further the base state model had an initial pending state, and there were portypes to trigger a state change to running. BES_Activity porttype. P. 6, 22 The idea was that the EPR returned from create activity would support the BES_ACTIVITY porttype. What ended up in the document was pretty weak. The idea is that there would be additional porttypes to interact with the running job, change state, etc. For example, there might be a portype that returned an EPR to an RNS directory that proxied access to the "session directory" of the running job. Clients could then read/write files using the ByteIO functions. For example, we are implementing the activity EPR to implement the RNS porttype, with several pseudo directories and files under it, one for the "session" directory that can then be read and written to directly, Activity Session_dir Files Stderr - a streamable byteio Stdout - a streamable byteio Stdin - a streamable byteio Status - a byteio file that can be read Control-file - a byteio that can be used to send signals to the job Proc-mem - a byteio file that provides access to the memory of sequential processes, so that debuggers can be attached If you wanted other file transfer mechanisms, then put the URI's in degenerate EPR's and put them in the RNS directory with some other name. As an aside, when you combine this with a FUSE driver (as we have done), grid un-aware clients can directly manipulate these files and directories from unix programs and shell scripts as standard files. As to state models. See pages 8-13, section 4.1 I recommend minimal changes to the base state model - adding the pending and some way to kick it to running. That way the client could state data in during the pending stage. Also, we would need a minor mod to the JSDL to indicate whether we want the job to "start" in pending or running. While we're on that topic, at one stage (no pun intended) BES had the ability to send notifications to clients when jobs changed state. It was ultimately removed because of a MS/IBM-Globus battle over which notification scheme to use. I think we might want to consider putting it back in. A

1 0

Bad formatting for the "GES strawman"
by Moreno Marzolla 17 Apr '09

17 Apr '09

Dear all, as we are having troubles reformatting the "GES strawman" document, I put a PDF version here: http://www.pd.infn.it/~marzolla/GES_strawman.pdf At least this version is readable, so for the teleconference starting now please refer to the pdf. We will try to fix the Word version ASAP. Moreno. -- Moreno Marzolla INFN Sezione di Padova, via Marzolo 8, 35131 PADOVA, Italy EMail: moreno.marzolla(a)pd.infn.it Phone: +39 049 8277103 WWW : http://www.dsi.unive.it/~marzolla Fax : +39 049 8756233

2 1

Re: [Pgi-wg] Job Management teleconference rescheduled on Friday 17 April
by Balazs Konya 17 Apr '09

17 Apr '09

Dear Etienne, Etienne URBAH wrote: > Balazs, > > Concerning Data Staging : > > Readability of the 'Execution Service Strawman' document > -------------------------------------------------------- > In the MS-Word version of this document, the numbers and titles of the > chapters about Data Staging do NOT correctly appear in the text. > > That is why I did NOT refer to them in my mail dated 11 April 2009. you are right, and i apologize for forgetting this readability issue :( as an editor of the strawman i have a copy where the data staging part was still correctly structured. > Data Staging scenarios NOT covered by the 'Execution Service Strawman' > ---------------------------------------------------------------------- > In fact, the destination of stage-in (and writing by the job) can also be : > - a disk on a (possibly remote) grid Storage Resource (Stage-in from > tape), > - a disk on a close grid Storage Resource (Stage-in from tape or remote > Storage Resource, Writing by the job). > > So, following scenarios are NOT covered by the 'Execution Service > Strawman' : > - Pre and Post Staging by the Client (EGEE standard scenario) > - Pre and Post Staging in a STORAGE Resource by the Execution Service we'll definitely discuss the above scenarios at a call. cheers, Balazs

1 0