January 2010 - pgi-wg - lists.ogf.org

CFP: CLADE 2010 @ HPDC 2010
by Riedel, Morris 23 Feb '10

23 Feb '10

FYI: A good CFP to write about GIN (and PGI) efforts: Challenges of Large Applications in Distributed Environments (CLADE) 2010 http://sites.google.com/site/clade2010/ To be held in conjunction with HPDC-2010, 22 June 2010, Chicago, IL There is an ongoing set of unsolved large-scale problems, requiring novel, large-scale, distributed applications that need to use advanced distributed cyberinfrastructure. This workshop focuses on the complex issues, such as adapting to heterogeneity and being dynamic in space and time, that arise in developing, deploying, and executing large-scale distributed computing applications in science, engineering, medicine, business, economics, education, and other disciplines. This includes recent results on large scale and/or innovative applications that effectively use distributed heterogeneous and dynamic computing environments. Topics of interest to this workshop include (but are not limited to) applications that illustrate advances in the following areas: * Large-scale distributed applications, both computation- and data-centric * Application-specific portals in distributed environments * Distributed problem-solving environments * Distributed, collaborative science applications * Large, distributed data analysis * Applications with heterogeneous spatial and temporal characteristics * Distributed, multidimensional, dynamically adaptive applications * Applications of new theories and tools for constructing adaptive software systems * Enterprise/data-center applications * Applications on emerging distributed environments such as clouds * Examples of distributed applications benefiting from advances in * Workflow tools in distributed environments * Application hosting frameworks for distributed environments * Runtime support for intelligent, adaptive systems * Programming models for heterogeneous and dynamic computation * Portability, quality of service, or fault-tolerance in cluster and grid computation * Resource management, dynamic scheduling or load balancing in heterogeneous environments To submit a paper for CLADE, please use the EasyChair submission site: http://www.easychair.org/conferences/?conf=clade2010 Submission Requirements: * PDF format * No more than 8 pages * No less than 11 point format * Single spacing, no more than 6 lines per inch (2.54 cm) Important Dates: Submissions Due: 1 March 2010 Paper Decisions Announced: 7 April 2010 Final Camera-Ready Papers Due: 23 April 2010 Workshop Date: 22 June 2010 (all dates are firm) ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------ Forschungszentrum Juelich GmbH 52425 Juelich Sitz der Gesellschaft: Juelich Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDir'in Baerbel Brumme-Bothe Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt, Prof. Dr. Sebastian M. Schmidt ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------

3 2

action list
by Johannes Watzl 15 Feb '10

15 Feb '10

----------------- New actions ----------------- action (all): nail down validation steps in ppt, we have to write it down and agree on it ----------------- Previous actions ----------------- action (Morris): GIN list set of DEMOS and call for more demos Ilia and Emannouil are in GIN mailinglist now ----------------- COMPLETED action (Emmanouil): get in touch with Ilia ------------------ action (Johannes): ask Nils about the date of the interoperability day changed to Johannes try to arrange GIN1 GIN2 PGI1 -- PGI2 PGI3 PGI not overlapping with GLUE ----------------- COMPLETED action (Morris): session proposals -> call for sessions As we discussed the 3 PGI working sessions should be part of the interoperability day that was already agreed with the local chair man (Nils) and therefore I requested no official sessions yet. However, I contacted Nils to clarify things. ----------------- COMPLETED action (Morris): should arrange that someone from gLite is there ----------------- COMPLETED action (Morris): check if there is a BES session, discuss with Andrew ----------------- action (Aleksander): security aspects for credentials in data staging will be done by Aleksander ----------------- COMPLETED action (Morris): copy strawman rendering doc (latest version from Aleksander) to drafts The actual draft specification (version 0.37) is now accessible in GridForge via: Doucments - Root Folder - Drafts - Specification Direct link: http://forge.gridforum.org/sf/docman/do/downloadDocument/projects.pgi-wg/do… So far, I kept a copy within the Input Document Section since I propose a renaming of the document within drafts to: "Draft PGI Specification" It is neither a strawman document nor a concrete rendering - it's just a draft specification from PGI. ----------------- COMPLETED action (Morris, all): strengthen gLite participation ----------------- Am 18.01.2010 15:49, schrieb Johannes Watzl: > ----------------- > New actions > ----------------- > > action (Morris): GIN list set of DEMOS and call for more demos > > action (Emmanouil): get in touch with Ilia > > action (Morris): ask Nils about the date of the interoperability day > > > > ----------------- > Previous actions > ----------------- > > COMPLETED > action (Morris): session proposals -> call for sessions > As we discussed the 3 PGI working sessions should be part of the > interoperability day that was already agreed with the local chair man > (Nils) and therefore I requested no official sessions yet. However, I > contacted Nils to clarify things. > ----------------- > > COMPLETED > action (Morris): should arrange that someone from gLite is there > ----------------- > > COMPLETED > action (Morris): check if there is a BES session, discuss with Andrew > ----------------- > > action (Aleksander): security aspects for credentials in data staging > will be done by Aleksander > ----------------- > > COMPLETED > action (Morris): copy strawman rendering doc (latest version from > Aleksander) to drafts > The actual draft specification (version 0.37) is now accessible in > GridForge via: > Doucments - Root Folder - Drafts - Specification > Direct link: > http://forge.gridforum.org/sf/docman/do/downloadDocument/projects.pgi-wg/do… > So far, I kept a copy within the Input Document Section since I propose > a renaming of the document within drafts to: > "Draft PGI Specification" > It is neither a strawman document nor a concrete rendering - it's just a > draft specification from PGI. > ----------------- > > COMPLETED > action (Morris, all): strengthen gLite participation > ----------------- > > > -- _ _ _ _ _ _ Johannes Watzl |\/| |\ | |\/| Institut für Informatik / Dept. of CS | | | \| | | Ludwig-Maximilians-Universität München ======= TEAM ======= Oettingenstr. 67, 80538 Munich, Germany Room E 005, Phone +49-89-2180-9162 Munich Network Management Team Email: watzl(a)nm.ifi.lmu.de Münchner Netz-Management Team http://www.nm.ifi.lmu.de/~watzl -- _ _ _ _ _ _ Johannes Watzl |\/| |\ | |\/| Institut für Informatik / Dept. of CS | | | \| | | Ludwig-Maximilians-Universität München ======= TEAM ======= Oettingenstr. 67, 80538 Munich, Germany Room E 005, Phone +49-89-2180-9162 Munich Network Management Team Email: watzl(a)nm.ifi.lmu.de Münchner Netz-Management Team http://www.nm.ifi.lmu.de/~watzl

1 1

PGI Telcon on Friday 2009-12-18; 4 pm CET
by Riedel, Morris 04 Feb '10

04 Feb '10

Hi team, some pieces of information about the telcon today at 4 p.m. (CET) with confirmed presence of gLite, ARC, UNICORE and EDGES. (1) Numbers: To join the PGI teleconference at 4 p.m. CET (UTC+1), please use this calling information: via Skype call +9900827049931906 (free of charge), ordinary phone numbers (local rates) with the 9931906 conference number: Austria 0820 401 15470 Belgium 0703 57 134 France 0826 109 071 Germany +49 (0) 180 500 9527 Switzerland 0848 560 397 (2) Agenda: (i) Debrief minutes of last PGI TelCon (ii) Debrief some PGI actions (iii) Discuss middleware presence as important aspect in PGI and at OGF28 (iv) Discuss animation ppt of PGI operation & state model (v) Debrief Etienne's changes on the document (vi) Next meeting in 2010 (vii) AOB (3) Screen-Sharing to increase our productivity: I have tried out a number of technologies and will setup a screen-sharing tool for today. Please expect news about this before the start of the Telcon, but it will typically not require installation on your side - only based on a Website. Please feel free to add other items on the agenda as you like. A high participation from the PGI and GIN members would be appreciated. Your co-chair, Morris ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------ Forschungszentrum Juelich GmbH 52425 Juelich Sitz der Gesellschaft: Juelich Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDir'in Baerbel Brumme-Bothe Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt, Prof. Dr. Sebastian M. Schmidt ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------

2 2

OGF PGI : PGI Execution Service - Wiki : Main page - Points to be discussed
by Etienne URBAH 29 Jan '10

29 Jan '10

Balazs, Morris, Luigi, Johannes and all, Inside the OGF PGI Wiki : 1) I created a new 'Points to be discussed' page at http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/Executi… - Using also the 'Draft Specification Discussion Slides' of Morris, I inserted the points written down in following mails: - 2010/01/27 Balazs KONYA, - 2010/01/14 Bernd SCHULLER, - 2009/12/18 Steven NEWHOUSE. - Please update this Wiki page with useful comments and answers to questions. 2) I also restructured the main page at http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/HomePage - Rename 'GES' page as 'New Execution Service vs. OGSA–BES profiling', - Create separate 'Security Matrix' page, - Point to new 'Points to be discussed' page. Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr -----------------------------------------------------

1 0

Reminder & Agenda: PGI Telcon Today 2010-01-28; 3:30 pm CET
by Morris Riedel 28 Jan '10

28 Jan '10

Dear PGI team, Reminder: We have our meeting today at 3:30 pm CET: (1) Numbers: To join the PGI teleconference, please use this calling information: via Skype call +9900827049931906 (free of charge), ordinary phone numbers (local rates) with the 9931906 conference number: Austria 0820 401 15470 Belgium 0703 57 134 France 0826 109 071 Germany +49 (0) 180 500 9527 Switzerland 0848 560 397 (2) Screen-Sharing: http://webconf.vc.dfn.de/ogf-pgi-wg/ No login is required. Just enter as 'guest' with your real world name. (3) Proposed agenda: (a) Debrief minutes of last PGI TelCon (b) Debrief PGI actions (c) Debrief list of changes to specification document by Balazs et al. (d) Debrief Steven Newhouse comments on the list (e) Debrief Bernd Schuller comments on the list (f) Debrief Etienne Comments on the list (g) Next meeting (h) AOB Please feel free to add other items on the agenda as you like. A high participation from the PGI and GIN members would be appreciated. Your co-chair, Morris ------------------------------------------------------------ Morris Riedel Jülich Supercomputing Centre (JSC) More: http://www.fz-juelich.de/jsc/JSCPeople/riedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender) ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------ Forschungszentrum Juelich GmbH 52425 Juelich Sitz der Gesellschaft: Juelich Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDir'in Baerbel Brumme-Bothe Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt, Prof. Dr. Sebastian M. Schmidt ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------

1 0

PGI draft v0.40
by Balazs Konya 27 Jan '10

27 Jan '10

Dear All, As i promised on the last meeting, i started to go through the "PGI Execution Service Specification" draft and made numerous editorial changes. I accepted/rejected tracked changes, removed obsoleted sentences, inserted notes, fixed text here and there. I managed to complete only the Introduction, CreateValidatedActvity, CreateActivity operation sections. The modifications of the State model section made by Etienne were also processed. From now, i'll be doing editorial cleanup regularly. Please find the new version here (v0.40): http://forge.gridforum.org/sf/go/doc15839?nav=1 As part of this work, i also started to collect "open questions" based on the yellow texts and notes in the draft (copied below). These issues have to be resolved during the calls. bye, Balazs PGI open questions: ------------------- 1) SERVICE VECTOR LIMITS: work out the details of how vector limits of operations are published, decide upon the granularity of these limits (per portType, per operations, etc..). Define FAULT mechanism. 2) Which of the Execution portType operations are mandatory? What about the CreateValidatedActivity? 3) Activity ID: any special requirement? Currently the specs only states "service creates an instance of each activity that is identified by a global unique ID assigned by the service" How about UNICORE Gateway issue, Find out why that is required? maybe the address has to be there or the extension mechanism? 4) Finalize the holdpoint specification within job description 5) Decide how/if state changes are tightly coupled to operations, is it allowed that an operation aggregates multiple state changes? 6) Elaborate on how data staging can be monitored via the state model. 7) Decide whether some kind of "LEASE" feature is to be introduced within Execution portType.

1 0

Re: [Pgi-wg] OGF PGI : Draft PGI Execution Service Specification - Next version
by Etienne URBAH 25 Jan '10

25 Jan '10

Hi Balazs, Concerning the draft of 'PGI Execution Service Specification' : I have improved chapters 2 and 5 with following modifications : - CreateActivity performs minimal validation, quickly returns Jobids (but NO Stage-in information) and goes to 'Submitted:Incoming' - CreateValidatedActivity performs complete validation, may return Stage-in information, and goes directly to 'Submitted:Validated', at the expense of response time. I have also updated the State Diagram. You can take over the editing of the draft at http://forge.gridforum.org/sf/go/doc15839?nav=1 Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr ----------------------------------------------------- On Mon, 25/01/2010 15:19, Balazs Konya wrote: > hi, > > Etienne URBAH wrote: >> Hi Balazs, >> >> Concerning the draft of 'PGI Execution Service Specification' : >> >> I am currently working on it, and I will have finished this evening or >> tomorrow morning. Then, I will send you a mail so that you can take it >> over. > > great > >> By the way, for the new substate of the 'Submitted' state : >> In order to avoid confusion between 'Validating' and 'Validated', I >> suggest that this new substate should NOT be named 'Validating', but >> 'Incoming', like inside the other first level states. > > agree > > Balazs

1 0

Re: [Pgi-wg] OGF PGI : Draft PGI Execution Service Specification - Next version - New substate
by Etienne URBAH 25 Jan '10

25 Jan '10

Hi Balazs, Concerning the draft of 'PGI Execution Service Specification' : I am currently working on it, and I will have finished this evening or tomorrow morning. Then, I will send you a mail so that you can take it over. By the way, for the new substate of the 'Submitted' state : In order to avoid confusion between 'Validating' and 'Validated', I suggest that this new substate should NOT be named 'Validating', but 'Incoming', like inside the other first level states. Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr ----------------------------------------------------- On Mon, 25/01/2010 12:01, Balazs Konya wrote: > > Hi Etienne, > > Can you please let me know when i can take over the editing of the PGI > draft? > > Would be nice if i could work on it Tomorrow, or latest Wednesday. > > > cheers, > Balazs

2 1

next PGI call
by Johannes Watzl 25 Jan '10

25 Jan '10

Dear all, the next PGI call will take place on Thursday, 28 Jan 2010, 15:30 (CET). Please mind the time change! The following calls will be held on Thursdays, 15:30 (CET). (No call today.) Best, Johannes -- _ _ _ _ _ _ Johannes Watzl |\/| |\ | |\/| Institut für Informatik / Dept. of CS | | | \| | | Ludwig-Maximilians-Universität München ======= TEAM ======= Oettingenstr. 67, 80538 Munich, Germany Room E 005, Phone +49-89-2180-9162 Munich Network Management Team Email: watzl(a)nm.ifi.lmu.de Münchner Netz-Management Team http://www.nm.ifi.lmu.de/~watzl

2 1

Updated Working Slides on GridForge
by Morris Riedel 21 Jan '10

21 Jan '10

All, I directly uploaded the working slides on GridForge: http://forge.gridforum.org/sf/docman/do/downloadDocument/projects.pgi-wg/do… Take care, Morris ------------------------------------------------------------ Morris Riedel Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender)

1 0