August 2006 - ogsa-bes-wg

call for implementers of the OGSA HPC Profile
by Marty Humphrey 28 Aug '06

28 Aug '06

Folks, As chairs of the OGSA HPC Profile WG, Marvin Theimer and I think that we're getting sufficiently close to having a profile defined that we'd like to issue the call for implementers of the OGSA HPC Profile. While there is clearly some more work to be done on the current HPC Profile draft (and the BES spec), we believe that certain ambiguities in the current HPC Profile can only be identified and resolved when parties try to get their implementations to speak with each other. We seek implementers to (a) help solidify the profile through direct interoperability testing, and (b) help define the compliance suite. Therefore, we encourage people interested in prototyping an implementation to email me (Marty Humphrey). The current version of the HPC Profile spec can be found at: http://forge.ggf.org/sf/go/doc13736?nav=1 Thanks a bunch! Marty Marty Humphrey Assistant Professor Department of Computer Science University of Virginia

1 0

RE: [ogsa-bes-wg] OGSA BES Meeting
by Maguire_Tom＠emc.com 24 Aug '06

24 Aug '06

Can we call it WS-BF instead of WS-BS :-)? Tom _______________________________________________ Tom Maguire +1(845) 729-4806 _____ From: owner-ogsa-bes-wg(a)ggf.org [mailto:owner-ogsa-bes-wg@ggf.org] On Behalf Of Ian Foster Sent: Wednesday, August 23, 2006 11:14 PM To: Pulsipher, Darren; ogsa-bes-wg(a)ggf.org Subject: Re: [ogsa-bes-wg] OGSA BES Meeting I can't make the call tomorrow. It seems important to address the WS-BaseFaults issue. I've proposed that we organize a call with the Microsoft people who say that they cannot use WS-BS, so that we can understand their concerns and also have an opportunity for a WS-BS advocate to explain the benefits of WS-BS. I haven't seen a response to that proposal. At 05:23 AM 8/22/2006 -0400, Pulsipher_Darren(a)emc.com wrote: When: Thursday, August 24, 2006 10:30 AM-11:30 AM (GMT-06:00) Central Time (US & Canada). Where: On Line *~*~*~*~*~*~*~*~*~* You are invited to join a meeting hosted by MR DARREN PULSIPHER. Meeting details are listed below. Instant Meeting Details: ------------------------------- Aug. 24, 2006 11:30 am EDT 8:30 am PDT If you are unable to join with the above link, please dial in using one of the phone numbers below: UNITED KINGDOM Toll Number: +44-20-7108-6316 USA Toll Free Number: 866-880-0098 Participant Passcode: 3425861 Instant Net Conference Details: ------------------------------- Meeting Number: SW124357 Meeting Passcode: GGF Meeting Host: MR DARREN PULSIPHER Join Instructions for Instant Net Conference: 1. Join the meeting now: http://www.mymeetings.com/emc/nc/join.php?i=SW124357 <http://www.mymeetings.com/emc/nc/join.php?i=SW124357&p=GGF&t=c> &p=GGF&t=c 2. Enter the required fields. 3. Indicate that you have read the Privacy Policy. 4. Click on Proceed. EMC² Darren Pulsipher Director of Engineering Grid Business Unit 501-442-9074 Email: Pulsipher_Darren(a)emc.com <mailto:Pulsipher_Darren@emc.com> _______________________________________________________________ Ian Foster -- Weblog: http://ianfoster.typepad.com <http://ianfoster.typepad.com/> Computation Institute: www.ci.uchicago.edu <http://www.ci.uchicago.edu/> & www.ci.anl.gov <http://www.ci.anl.gov/> Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439 Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637 Tel: +1 630 252 4619 --- Globus Alliance: www.globus.org <http://www.globus.org/>

1 0

v23 of BES draft
by Marvin Theimer 24 Aug '06

24 Aug '06

Hi; My apologies for getting this draft out so late -- it's been another week of "agenda bending interruptions". In any case, enclosed is a revised version of the BES draft that includes a full exposition of the extensible state model concept as well as a refactoring of the two port-types so that attribute information and its retrieval are now part of the BES-Factory port-type. This was in response to the decision that there should be a "sys admin" port-type and an "ordinary users" port-type and that obtaining information about the state of a BES and its activities is something that ordinary users do and not just sys admins. Marvin.

2 1

RE: [ogsa-bes-wg] OGSA BES Meeting and WS-BaseFaults
by Marvin Theimer 24 Aug '06

24 Aug '06

Hi; Apologies for not responding until now. I will try to cover the topic of WS-BaseFaults and potential alternatives on today's BES telecon call. I will also send out an email about the topic afterwards. Marvin. ________________________________ From: owner-ogsa-bes-wg(a)ggf.org On Behalf Of Ian Foster Sent: Wednesday, August 23, 2006 8:14 PM To: Pulsipher_Darren(a)emc.com; ogsa-bes-wg(a)ggf.org Subject: Re: [ogsa-bes-wg] OGSA BES Meeting I can't make the call tomorrow. It seems important to address the WS-BaseFaults issue. I've proposed that we organize a call with the Microsoft people who say that they cannot use WS-BS, so that we can understand their concerns and also have an opportunity for a WS-BS advocate to explain the benefits of WS-BS. I haven't seen a response to that proposal. At 05:23 AM 8/22/2006 -0400, Pulsipher_Darren(a)emc.com wrote: When: Thursday, August 24, 2006 10:30 AM-11:30 AM (GMT-06:00) Central Time (US & Canada). Where: On Line *~*~*~*~*~*~*~*~*~* You are invited to join a meeting hosted by MR DARREN PULSIPHER. Meeting details are listed below. Instant Meeting Details: ------------------------------- Aug. 24, 2006 11:30 am EDT 8:30 am PDT If you are unable to join with the above link, please dial in using one of the phone numbers below: UNITED KINGDOM Toll Number: +44-20-7108-6316 USA Toll Free Number: 866-880-0098 Participant Passcode: 3425861 Instant Net Conference Details: ------------------------------- Meeting Number: SW124357 Meeting Passcode: GGF Meeting Host: MR DARREN PULSIPHER Join Instructions for Instant Net Conference: 1. Join the meeting now: http://www.mymeetings.com/emc/nc/join.php?i=SW124357&p=GGF&t=c 2. Enter the required fields. 3. Indicate that you have read the Privacy Policy. 4. Click on Proceed. EMC² Darren Pulsipher Director of Engineering Grid Business Unit 501-442-9074 Email: Pulsipher_Darren(a)emc.com <mailto:Pulsipher_Darren@emc.com> _______________________________________________________________ Ian Foster -- Weblog: http://ianfoster.typepad.com<http://ianfoster.typepad.com/> Computation Institute: www.ci.uchicago.edu<http://www.ci.uchicago.edu/> & www.ci.anl.gov<http://www.ci.anl.gov/> Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439 Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637 Tel: +1 630 252 4619 --- Globus Alliance: www.globus.org<http://www.globus.org/>

1 0

Re: [ogsa-bes-wg] OGSA BES Meeting
by Ian Foster 24 Aug '06

24 Aug '06

I can't make the call tomorrow. It seems important to address the WS-BaseFaults issue. I've proposed that we organize a call with the Microsoft people who say that they cannot use WS-BS, so that we can understand their concerns and also have an opportunity for a WS-BS advocate to explain the benefits of WS-BS. I haven't seen a response to that proposal. At 05:23 AM 8/22/2006 -0400, Pulsipher_Darren(a)emc.com wrote: >When: Thursday, August 24, 2006 10:30 AM-11:30 AM (GMT-06:00) Central Time >(US & Canada). >Where: On Line > >*~*~*~*~*~*~*~*~*~* > >You are invited to join a meeting hosted by MR DARREN PULSIPHER. Meeting >details are listed below. > >Instant Meeting Details: >------------------------------- >Aug. 24, 2006 >11:30 am EDT >8:30 am PDT > >If you are unable to join with the above link, please dial in using one of >the phone numbers below: > >UNITED KINGDOM Toll Number: +44-20-7108-6316 >USA Toll Free Number: 866-880-0098 > >Participant Passcode: 3425861 > >Instant Net Conference Details: >------------------------------- >Meeting Number: SW124357 >Meeting Passcode: GGF >Meeting Host: MR DARREN PULSIPHER > >Join Instructions for Instant Net Conference: > >1. Join the meeting now: >http://www.mymeetings.com/emc/nc/join.php?i=SW124357&p=GGF&t=c >2. Enter the required fields. >3. Indicate that you have read the Privacy Policy. >4. Click on Proceed. > >EMC² >Darren Pulsipher >Director of Engineering >Grid Business Unit >501-442-9074 >Email: Pulsipher_Darren(a)emc.com <mailto:Pulsipher_Darren@emc.com> _______________________________________________________________ Ian Foster -- Weblog: http://ianfoster.typepad.com Computation Institute: www.ci.uchicago.edu & www.ci.anl.gov Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439 Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637 Tel: +1 630 252 4619 --- Globus Alliance: www.globus.org

2 1

OGSA BES Meeting
by Pulsipher_Darren＠emc.com 22 Aug '06

22 Aug '06

When: Thursday, August 24, 2006 10:30 AM-11:30 AM (GMT-06:00) Central Time (US & Canada). Where: On Line *~*~*~*~*~*~*~*~*~* You are invited to join a meeting hosted by MR DARREN PULSIPHER. Meeting details are listed below. Instant Meeting Details: ------------------------------- Aug. 24, 2006 11:30 am EDT 8:30 am PDT If you are unable to join with the above link, please dial in using one of the phone numbers below: UNITED KINGDOM Toll Number: +44-20-7108-6316 USA Toll Free Number: 866-880-0098 Participant Passcode: 3425861 Instant Net Conference Details: ------------------------------- Meeting Number: SW124357 Meeting Passcode: GGF Meeting Host: MR DARREN PULSIPHER Join Instructions for Instant Net Conference: 1. Join the meeting now: http://www.mymeetings.com/emc/nc/join.php?i=SW124357&p=GGF&t=c 2. Enter the required fields. 3. Indicate that you have read the Privacy Policy. 4. Click on Proceed. EMC² Darren Pulsipher Director of Engineering Grid Business Unit 501-442-9074 Email: Pulsipher_Darren(a)emc.com <mailto:Pulsipher_Darren@emc.com>

1 0

Meeting Minutes
by Pulsipher_Darren＠emc.com 17 Aug '06

17 Aug '06

Aug. 17, 2006 Attendees Darren Mark Ellen Chris Marvin Glen Ian F Michel David S Agenda Go through the document Go through the tracker Action Items - Appendix to be added for general container model. (Ellen) - Trackers have been assigned to the appropriate people as tasks to be completed at this time. Notes - Meeting minutes approved without comment EMC² Darren Pulsipher Director of Engineering Grid Business Unit 501-442-9074 Email: Pulsipher_Darren(a)emc.com <mailto:Pulsipher_Darren@emc.com>

1 0

Re: [ogsa-bes-wg] Create a revised BES spec draft that reflects the decisions of the July F2F mtg
by Ian Foster 17 Aug '06

17 Aug '06

Marvin: I've claimed the pen on the document, but have been finding it hard to find time to make a lot of progress. I will try to do some work on it tomorrow morning. That said, I want to mention an important development that Dave Snelling may or may not have mentioned on calls. Dave argues that we can avoid the need for distinct renderings by defining our interfaces carefully. The basic idea, as I understand it, is that: a) the "core interface" has the basic operations for creating jobs, modifying their status, etc., and an operation for grabbing all of the factory state; b) then, if desired, a WSRF service (for example) can also implement the WS-ResourceProperties, WS-ResourceLifetime, WS-BaseNotification, operations; c) while a WS-Resource service would implement the WS-Resource equivalents of those. So we exploit the power of interface composition to avoid the need for separate bindings. The only problematic issue, as I understand it, is that of faults. The question is how we render faults. The WSRF binding must (by the spec) use WS-BaseFaults. If we can all agree to use that, then we are ok. If not, then we still have problems. Ian. At 01:29 PM 8/4/2006 -0700, Marvin Theimer wrote: >x-ms-exchange-organization-recipient-p2-type: To >Content-Type: text/plain; charset="us-ascii" > >Hi; > >The HPC Profile (HPCP) work depends critically on BES. The recent >face-to-face meeting at Argonne made substantial progress in terms of >reshaping the proposed BES specification in a way that would make it >suitable for supporting the HPCP on top of it. Are there plans to >generate a new revision of the BES specification draft in the near >future? As soon as the revised version comes into existence we'll be able >to seriously start doing the actual HPCP work (which will take place on >the hpcp-ogsa-wg mailing list and in weekly telecom calls that will be >starting shortly). > >Since the HPCP WG is effectively gated on this revised spec, having a >draft of a revised spec sometime in the next week or so would be really >helpful. I would be willing to help rewrite the BES spec if that would be >useful to the BES WG. > >Marvin. _______________________________________________________________ Ian Foster, Director, Computation Institute Argonne National Laboratory & University of Chicago Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439 Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637 Tel: +1 630 252 4619. Web: www.ci.uchicago.edu. Globus Alliance: www.globus.org.

3 3

RE: Re: [ogsa-bes-wg] V21 of the BES draft
by Mark Morgan 16 Aug '06

16 Aug '06

> Let me say again that Mark has done an outstanding job. Thank you > A Q: should I add the items below as trackers? That would probably be best. I suspect that some of these issues need to be discussed in group. Thanks, Mark > > Ian. > > > > Delivered-To: grdfm-ogsa-bes-wg-outgoing(a)mailbouncer.mcs.anl.gov > X-Original-To: grdfm-ogsa-bes-wg(a)mailbouncer.mcs.anl.gov > Delivered-To: grdfm-ogsa-bes-wg(a)mailbouncer.mcs.anl.gov > X-Sender: itf(a)pop.mcs.anl.gov > X-Mailer: QUALCOMM Windows Eudora Version 5.2.0.9 > Date: Tue, 15 Aug 2006 20:57:37 -0500 > To: "Mark Morgan" <mmm2a(a)virginia.edu>, <ogsa-bes-wg(a)ggf.org> > From: Ian Foster <foster(a)mcs.anl.gov> > Subject: Re: [ogsa-bes-wg] V21 of the BES draft > Sender: owner-ogsa-bes-wg(a)ggf.org > > Mark: > > You have done an outstanding job. This is looking > really very nice, IMHO. > > I'll resist the temptation to take the pen for a quick > edit, but instead just make a few comments: > > 1) I disagree with moving the BES-Activity document to > an appendix: that feels like a funny half-way house. If we > don't want it in the main body of this specification, then I > propose we move it into a separate spec. Either resolution is > fine with me. > > 2) I also disagree with moving the JSDL extension > discussion to an appendix, for the same reason. In this case, > I want to argue for restoring the material (probably just the > first two extensions) in the main body. I can work on more > detailed text if desired. > > 3) Section 5.1 is quite verbose: could we not replace > it with a table? If that is not preferred, then we should add > a table summarizing the attributes. (In both cases, the table > shculd ontain the data we had previously showing number of > occurences--that is useful information.) > > 4) Someone had commented that > Start/StopAcceptingNewActivities should allow for a > "notauthorized" fault. Was it decided that this was not required? > > 5) The description of the response from > TerminateActivities ["The Cancelled element is a boolean > value indicating whether the BES container successfully > (true) cancelled the activity or not (false)."] seems > inconsistent with the earlier text saying that the operation > only passes the request to the activity--it does not confirm > that it succeeded in cancelling it. > > 6) In F.3.2, G.1.2, and elsewhere, I propose that the > example ActivityReferences simply be shown as WS-Addresses, > leaving open the question of what reference parameters may or > may not be included in those WS-Addresses. This > representation is more consistent with our statement in > Section 3 that we do not require WS-Naming syntax, and also > give us one less thing to explain. > > 7) I thought that the text in Appendix A could be > clearer, and also would be more useful in the introduction. I > propose that we remove Appendix A, and place the following > text at the end of the Introduction, which also provides a > useful summary of the Appendices. > > We define in Appendices A-D normative XSD and WSDL for > BES-Management > and BES-Factory, respectively, and in Appendices E and > F non-normative > examples for the two interfaces. > > Recall that the OGF OGSA WG has defined the notion of a > Base Profile: > a specification that places certain constraints on how resource > modeling specifications such as the WSRF or WS-Transfer families > should be used in any OGSA-compliant specification. At > the time of > writing, only an OGSA WSRF Base Profile [OGSA WSRF BP] has been > defined, but others will presumably be produced in the future. > > We have sought to define a BES specification that while not, in > itself, compliant with any OGSA Base Profile, can be > composed with > appropriate other port-types to produce a BES that is > compliant with > any specific OGSA Base Profile. To illustrate how this > composition can > be achieved, we explain in the (non-normative) Appendix H how an > implementor can construct a BES that is compliant with > the OGSA WSRF > Base Profile. > > 8) I also propose the following alternative text for > Appendix I (Appendix H if we remove Appendix I): > > We explained in the Introduction how the BES > specification is designed > to enable the creation of BESs that are compliant with > OGSA Base Profiles > via the composition of BES port-types with other > appropiate port-types. > To illustrate how this can be done, we explain how an > implementor would > create a BES that is compliant with the OGSA WSRF Base Profile. > This material is not intended to be normative. > > 1) A BES that is to be compliant with the OGSA WSRF > Base Profile must > implement, in addition to the BES-Management and BES-Factory > port-types, the WS-ResourceProperties, WS-ResourceLifetime, and > WS-BaseNotification port-types, in a manner compliant with the > OGSA WSRF Base Profile. > > 2) Implementers MUST also ensure that all attributes > given in the > description of the attributes document appear as exactly named > WS-ResourceProperties. Exactly named here implies that > each resource > property must have the QName > > {http://schemas.ggf.org/bes/2006/08/bes-management}attr-name where > attr-name is the name of the attribute used inside the > attributes > document types (e.g., TotalNumberOfActivities, > CommonName, etc.). > > Ian. > > > At 05:26 PM 8/15/2006 -0400, Mark Morgan wrote: > > > Fellow BES'ers, > > I have uploaded to GridForge (and attached to > this email for your > convenience) my revamped version of the BES > specification as agreed to > during last week's telecon. The great majority > of changes reflect > resolutions that we reached on that telecon and > include a re-work of the > state model (both in text and xml form) as well > as a rework of the > attributes or info model (again, in text and > XML form). It is my belief > that the document now constitutes a consistent > story from English > description through XSD and WSDL though by no > means should the document be > considered fully proofed or ready for > ppublishing. The following details > apply: > > The version of the document that I uploaded is > based originally on that > received from Mr. Ian Foster and so should > include many of his changes. As > per the BES telecon discussion, some of the > material in that document has > been moved to an appendix. In particular, the > discussion on JSDL extensions > is now an appendix (in fact, I simply > cut-and-paste that chapter into the > appendix so no editing has been done there and > probably should be before we > go public). > > Also, the specification had been split into > three separate port types; > management, factory, and activity. As per our > discussions, activity is out > of scope for BES but quite reasonable as an > appendix. I therefor removed > this port type from the document proper. > However, I didn't feel like I had > the time nor the vested interest in that port > type necessary to do it > justice. It therefor has not been re-added > into an appendix and if the > group feels like it has a place there, some > work needs to be done to > re-insert it. > > In Ian's original draft, each of the separate > port types had it's own > attributes/properties. However, as per > resolutions on last week's telecon, > this no longer fit the model we had agreed > upon. I have therefor moved all > such attributes into the management port type > (which seems reasonable as one > could construe info model as a management function). > > Finally, just to be clear on how I handled the > state model (as I think this > was one of our key features), I have defined a > new data type called > OverallStatusType which contains exactly one of > bes-factory:New, > bes-factory:Pending, bes-factory:Running, > bes-factory:Cancelled, > bes-factory:Failed, and bes-factory:Finished as > a child element. Each of > these elements in turn has an xsd:any inside > which can be used for arbitrary > specialization or sub-stating. For example, > suppose I wished to reflect > that I was in the Mark Morgan Blocked sub-state > of the Uva VCGR Staging-In > sub-state of the spec. defined Running state. > My XML for that would look > like: > > <bes-factory:OverallStatus > > xmlns:bes-factory="http://schemas.ggf.org/bes/2006/08/bes-factory" > xmlns:vcgr="http://vcgr.cs.virginia.edu/bes/2006/08/states" > > xmlns:morgan="http://mark-morgan.org/bes/2006/08/states"> > > <bes-factory:Running> > <vcgr:Staging-In> > <morgan:Blocked/> > </vcgr:Staging-In> > </bes-factory:Running> > > </bes-factory:OverallStatus> > > > _______________________________________________________________ > Ian Foster, Director, Computation Institute > Argonne National Laboratory & University of Chicago > Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439 > Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637 > Tel: +1 630 252 4619. Web: www.ci.uchicago.edu > <http://www.ci.uchicago.edu/> . > Globus Alliance: www.globus.org <http://www.globus.org/> . > > > _______________________________________________________________ > Ian Foster, Director, Computation Institute Argonne > National Laboratory & University of Chicago > Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439 > Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637 > Tel: +1 630 252 4619. Web: www.ci.uchicago.edu > <http://www.ci.uchicago.edu/> . > Globus Alliance: www.globus.org <http://www.globus.org/> . > > >

2 2

V21 of the BES draft
by Mark Morgan 16 Aug '06

16 Aug '06

Fellow BES'ers, I have uploaded to GridForge (and attached to this email for your convenience) my revamped version of the BES specification as agreed to during last week's telecon. The great majority of changes reflect resolutions that we reached on that telecon and include a re-work of the state model (both in text and xml form) as well as a rework of the attributes or info model (again, in text and XML form). It is my belief that the document now constitutes a consistent story from English description through XSD and WSDL though by no means should the document be considered fully proofed or ready for ppublishing. The following details apply: The version of the document that I uploaded is based originally on that received from Mr. Ian Foster and so should include many of his changes. As per the BES telecon discussion, some of the material in that document has been moved to an appendix. In particular, the discussion on JSDL extensions is now an appendix (in fact, I simply cut-and-paste that chapter into the appendix so no editing has been done there and probably should be before we go public). Also, the specification had been split into three separate port types; management, factory, and activity. As per our discussions, activity is out of scope for BES but quite reasonable as an appendix. I therefor removed this port type from the document proper. However, I didn't feel like I had the time nor the vested interest in that port type necessary to do it justice. It therefor has not been re-added into an appendix and if the group feels like it has a place there, some work needs to be done to re-insert it. In Ian's original draft, each of the separate port types had it's own attributes/properties. However, as per resolutions on last week's telecon, this no longer fit the model we had agreed upon. I have therefor moved all such attributes into the management port type (which seems reasonable as one could construe info model as a management function). Finally, just to be clear on how I handled the state model (as I think this was one of our key features), I have defined a new data type called OverallStatusType which contains exactly one of bes-factory:New, bes-factory:Pending, bes-factory:Running, bes-factory:Cancelled, bes-factory:Failed, and bes-factory:Finished as a child element. Each of these elements in turn has an xsd:any inside which can be used for arbitrary specialization or sub-stating. For example, suppose I wished to reflect that I was in the Mark Morgan Blocked sub-state of the Uva VCGR Staging-In sub-state of the spec. defined Running state. My XML for that would look like: <bes-factory:OverallStatus xmlns:bes-factory="http://schemas.ggf.org/bes/2006/08/bes-factory" xmlns:vcgr="http://vcgr.cs.virginia.edu/bes/2006/08/states" xmlns:morgan="http://mark-morgan.org/bes/2006/08/states"> <bes-factory:Running> <vcgr:Staging-In> <morgan:Blocked/> </vcgr:Staging-In> </bes-factory:Running> </bes-factory:OverallStatus>

4 3