- ogsa-hpcp-wg - lists.ogf.org

Microsoft HPCBP Endpoint
by Steven Newhouse 13 Sep '07

13 Sep '07

All, The Microsoft HPC Basic Profile implementation is available for testing - https://hpc.msftlabs.com/HPCProfileInterop/JobSubmission.svc . This has been updated to the published specs. A typical job is described below. This uses username and password to identify the connecting client. You will need a username and password for this. Please contact me directly for this. Regards, Steven <?xml version="1.0" encoding="utf-8" ?> <jsdl:JobDefinition xmlns:jsdl="http://schemas.ggf.org/jsdl/2005/11/jsdl" xmlns:jsdl-hpcp="http://schemas.ggf.org/jsdl/2006/07/jsdl-hpcp" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <jsdl:JobDescription> <jsdl:JobIdentification> <jsdl:JobName>HPCBP Example Job</jsdl:JobName> <jsdl:JobProject>OGSA-HPCBP</jsdl:JobProject> </jsdl:JobIdentification> <jsdl:Application> <jsdl-hpcp:HPCProfileApplication name="IPConfig" > <jsdl-hpcp:Executable>dir</jsdl-hpcp:Executable> <jsdl-hpcp:Argument>c:\program files</jsdl-hpcp:Argument> <jsdl-hpcp:Argument>/s</jsdl-hpcp:Argument> <jsdl-hpcp:Input></jsdl-hpcp:Input> <jsdl-hpcp:Output>ipconfig_out.txt</jsdl-hpcp:Output> <jsdl-hpcp:Error>ipconfig_err.txt</jsdl-hpcp:Error> </jsdl-hpcp:HPCProfileApplication> </jsdl:Application> <jsdl:Resources> <jsdl:CandidateHosts> <jsdl:HostName></jsdl:HostName> </jsdl:CandidateHosts> <jsdl:ExclusiveExecution>true</jsdl:ExclusiveExecution> <jsdl:OperatingSystem> <jsdl:OperatingSystemType> <jsdl:OperatingSystemName>other</jsdl:OperatingSystemName> </jsdl:OperatingSystemType> <jsdl:OperatingSystemVersion>Windows_2003_Server</jsdl:OperatingSystemVersion> <jsdl:Description>Operating System Description</jsdl:Description> </jsdl:OperatingSystem> <jsdl:CPUArchitecture> <jsdl:CPUArchitectureName>x86_64</jsdl:CPUArchitectureName> </jsdl:CPUArchitecture> <jsdl:TotalCPUCount> <jsdl:UpperBoundedRange>1.0</jsdl:UpperBoundedRange> <jsdl:LowerBoundedRange>1.0</jsdl:LowerBoundedRange> </jsdl:TotalCPUCount> </jsdl:Resources> </jsdl:JobDescription> </jsdl:JobDefinition>

1 0

Telecon - Thursday 13th September - NOTE NEW TIME
by Steven Newhouse 11 Sep '07

11 Sep '07

Time: 9.30AM (Pacific), 12.30PM (East Coast), 5.30PM (UK) Call details: PIN - 2719140 USA: 866 500 6738 UK +44 118 909 2000 I'll try and supply further local numbers if people require them. Agenda 1. OGF IPR Notice 2. Agenda Bashing 3. Update on collaboration tool & conformance checker (UVa) 4. Report on status (All) 5. Contributions to the experiences document a. Review outline (http://www.ogf.org/pipermail/ogsa-hpcp-wg/2007-August/000389.html) 6. Any Other Business

1 0

Telecon Notes - Auguest 30th 2007
by Steven Newhouse 30 Aug '07

30 Aug '07

Present Steve McGough Steven Newhouse Glenn Wasson Vesso Novov John Ehrig Bill Nitzberg Chris Smith Blair Dillaway Agenda 1. OGF IPR Notice 2. Agenda Bashing a. Include a discussion about data staging 3. Update on collaboration tool & conformance checker (UVa) a. UVa has deployed a sharepoint server which is hosting the conformance checker. Can select username/password or X.509 certificate security profiles. May need to provide your root certificate to Glenn for the X.509 profile to work. b. Must (minimally) ensure that the contents of the wiki is uploaded to GridForge after SC07. c. Ensure there is recognition on the server that this is an OGF based activity. d. Glenn to circulate URL. e. Glenn to provide links to published specifications on GridForge on the wiki 4. Report on status (All) a. UVa (Glenn): Will be able to support endpoints for both security mechanisms. Compliant with final specification. May deploy an endpoint into PBS. b. GridSAM (Steve & Vesso): Involved in OGSA Base Profile and HPC Basic Profile interop activities. Need to update implementation to current specifications. Will be able to support both security profiles. c. Microsoft (Steven): Implementation has been updated. Need to host these on public facing servers. Hopefully this week. Will email details when available. Initially username/password profile. Later X.509. d. PBS (Bill): Just working on a client. Will try to consume others endpoints. e. LSF (Chris): Implementation needs to be updated to final specifications. Hopefully in the next two weeks. Will be able to support both authentication mechanisms. 5. Data Staging Discussion (Steven) a. Before any in depth discussion of the extension to the profile... useful to have a scoping discussion. b. Resolve that this work will: 1. NOT address any data staging that takes place within the cluster, i.e. moving files from the cluster filestore to a local compute node before job execution 2. Any data transfer activity will be initiated server side. This may be on the head node, the machine hosting the web service or somewhere else. 3. Depending on the protocol used there may be a dependency with Activity Credential work. 4. Only dealing with files NOT structured data c. Proposal to rename the extension to the 'File Staging' extension. d. Need to define some testing scenarios that stage through anonymous & authenticated protocols that are independent & dependent on the proposed activity credential work. 6. Contributions to the experiences document a. Glenn to move current outline (http://www.ogf.org/pipermail/ogsa-hpcp-wg/2007-August/000389.html) on to the sharepoint server so that it can hold the master copy and be used to co-ordinate edits. b. Issue with the current gSOAP implementation used by LSF and the WCF relating to a timestamp in the WS-Security headers. The gSOAP implementation does not provide one. If WCF sends one out it expects one back. By WCF not sending one out there is no problem not getting a timestamp back and the two systems interop. 7. Any Other Business a. Moving the time of the telecon. Proposal to start 90 minutes later (9.30 Pacific) in two weeks time.

2 1

Telecon 30th August 2007
by Steven Newhouse 27 Aug '07

27 Aug '07

Time: 8AM (Pacific), 11AM (East Coast), 4PM (UK) Call details: PIN - 2719140 USA: 866 500 6738 UK +44 118 909 2000 I'll try and supply further local numbers if people require them. Agenda 1. OGF IPR Notice 2. Agenda Bashing 3. Update on collaboration tool & conformance checker (UVa) 4. Report on status (All) 5. Contributions to the experiences document a. Review outline (http://www.ogf.org/pipermail/ogsa-hpcp-wg/2007-August/000389.html) 6. Any Other Business

1 0

Telecon Minutes
by Steven Newhouse 16 Aug '07

16 Aug '07

Present Steven Newhouse (Microsoft) Steve McGough (Imperial College) Glenn Wasson (UVa) Blair Dillaway (Microsoft) John Ehrig (OGF) Marty Humphreys (UVa) Chris Smith (Platform) Agenda 1. OGF IPR Notice 2. Agenda Bashing a. Will there be activity at OGF21? b. What is the purpose of this activity? 1. To write the experiences document (main priority) 2. Explore extensions for activity credential & data staging (secondary - but significant targets) 3. Explore the use of an extended information model around the GLUE schema (lower priority than 1 & 2) 3. Who will be involved? a. Please respond to questions in advance (http://www.ogf.org/pipermail/ogsa-hpcp-wg/2007-August/000390.html) 1. GridSAM 2. Microsoft HPC 3. UVa - GCG 4. UVa - VCGR 5. Platform (LSF) 6. Altair (PBS) 7. Others TBC: Globus, Unicore, CROWN & gLite Action: Wiki page on GridForge to hold the information (http://forge.ogf.org/sf/wiki/do/viewPage/projects.ogsa-hpcp-wg/wiki/HomePage) . All to upload information requested in email onto wiki page which has a link to the compliance checker, which will be active once firewall issues have been resolved. b. Demonstration space at SC07? Those present: Microsoft (HPC & UVa - GCR), Platform, Altair, UK e-Science (TBC) No dedicated space: UVa - VGCR 4. Procedure a. HPCP UVa: Two implementations: One has username & password, one has X.509 certificate. Go for pairwise application demonstrations rather than a single 'big' demo. b. Additional areas for JSDL & BES specifications BES: Vector length UVa: Greater than 1 throws fault. Platform: Should be able to fix implementation to handle longer vector lengths JSDL: HPCP does not use resources and POSIXApplication model. c. Supported security models Host both types endpoint: UVa, Platform (probably), GridSAM (probably), Microsoft (probably) 5. Experiences document a. Review outline (http://www.ogf.org/pipermail/ogsa-hpcp-wg/2007-August/000389.html) Initially, try out the compliance checker and once the implementation is up and running, post the endpoint for doing N to N interoperability checks. Action: Run your endpoint against UVa compliance checker by end of the month. Glenn to send out email once firewall issues resolved. Please send feedback as issues around the triggered faults may need to be tweaked. Goal is to collect experiences as we go so that a PUBLIC draft of the experiences document can be made available at SC07. Extensions: Activity Credential: Specification is solid. Has been implemented. Authentication credential for the application NOT for the service endpoint. For use in data staging or meta-scheduling. Data Staging: Specification is less mature. Not been implemented yet. Relies on activity credential extension to provide a credential if data is then going to be staged out from the execution host. 6. Next Call: Same time in 2 weeks 7. Any Other Business a. OGF21 Meeting. HPCP WG 11am Monday 15th October 2007. Consider the maturity of the interoperation activity on later calls to see if we do a mini demo at OGF21. John would need minimum of 2 weeks lead time for PR. More notice needed for industry invites.

1 0

OGF docs for your review
by Ellen Stokes 14 Aug '07

14 Aug '07

Folks, These documents describe OGSA approach to Information Modeling (e.g. describing resources). They are in public comment now and your input is welcome. Even a comment that says, 'This was a helpful document.' can be very helpful. See: http://www.ogf.org/Public_Comment_Docs/Documents/Aug-2007/ogsa-bes-model-v1… http://www.ogf.org/Public_Comment_Docs/Documents/Aus-2007/ogsa-modeling-gui… Post comments no later than Sep 10 at: http://www.ogf.org/gf/docs/?public_comment Regards, Ellen Stokes STSM, STG System Software Strategy & Standards Member, IBM Academy of Technology Austin, Texas Tel: +1 512 838 0552

1 0

SC07 Interop Fest
by Steven Newhouse 14 Aug '07

14 Aug '07

It's that time of year again... the sun is out, the holiday season nearly upon us, your thoughts must turn to OGF related work... it must be time to think about HPC Basic Profile interop. Following on from the 'proof of concept' demonstrators from last year, we expect this year to have 'prototypes' that are part of many organizations product plans with commitments to ship (or have shipped) HPCP complaint services. Our experiences this year with the published specifications will form the basis of the experiences document (see Glenn's outline) submitted to OGF to show that these specifications are implementable and being implemented! To kick start this process I would like to suggest a planning call next Thursday 16th August at 8AM PACIFIC for 1 hour. Regards, Steven Call details: PIN - 2719140 USA: 866 500 6738 I'll try and supply local numbers if people require them. Agenda 1. OGF IPR Notice 2. Agenda Bashing 3. Who will be involved? a. Please respond to questions in advance (http://www.ogf.org/pipermail/ogsa-hpcp-wg/2007-August/000390.html) b. Demonstration space at SC07? 4. Procedure a. HPCP b. Additional areas for JSDL & BES specifications c. Supported security models 5. Experiences document a. Review outline (http://www.ogf.org/pipermail/ogsa-hpcp-wg/2007-August/000389.html) 6. Next Call a. Every 2 weeks? 7. Any Other Business

2 1

HPC Profile, BES and JSDL experiences document
by Glenn Wasson 07 Aug '07

07 Aug '07

Everyone, I have created a potential outline for the experiences document for HPC Profile, BES and JSDL. As you all know, each of these specs needs an experiences report as part of the OGF process and this document could satisfy that requirement for all 3. Please have a look. We are hoping to fill out the document based on experiences gained doing an interop demo for SC07. The exact scenarios for this demo are still to be decided, but right now we are looking for groups that want to be involved. Anyone who has an implementation (of the latest versions) of HPCP, BES and/or JSDL can potentially contribute to the demo and the document. Our interop demo at SC06 was very successful and we're looking forward to an expanded version this year. Please let me know if you are interested in taking part in the demo and we will set up a call/list/wiki for this. Glenn

3 2

JSDL documents in public comment
by Andreas Savva 20 Jun '07

20 Jun '07

[Apologies for the cross-posting.] This is a reminder that JSDL-WG has two documents in public comment until July 10. We'd appreciate people reviewing these documents and posting their comments to the public comment tracker. In particular the "JSDL HPC Profile Application Extension" document has already been implemented as part of the HPC Profile SC06 interop. It would be fine for people that have already implemented it to put in a comment to that effect. The second document "JSDL SPMD Application Extension" addresses MPI application requirements. Both documents are fairly short and should not take too long for you to review. > I'd like to alert you to two new documents that have started public > comment. Please find all documents in public comment here: > http://www.ogf.org/gf/docs/?public_comment > > For the recommendation track: > > JSDL HPC Profile Application Extension, Version 1.0. M. Humphrey > et al., via JSDL-WG. > > JSDL SPMD Application Extension, Version 1.0. A. Savva, via > JSDL-WG. > -- Andreas Savva

1 0

HPC Profile meeting at OGF 19, Tuesday, 10:30am-noon
by Marty Humphrey 03 May '07

03 May '07

Folks, I just want to remind you that we'll have a meeting of the HPC Profile WG at OGF 19 on Tuesday (May 8), 10:30-noon, location: "Exchange 4/5" We will discuss the next steps for the WG. Given that public comments on the HPC Profile end *tomorrow*, this is a GREAT time to have a face-to-face meeting! Our topics include: an experiences document, plans for potential extensions (e.g., security, data staging, etc.), and planning for an SC 2007 demo/interop event (which is NOT that far away!) Please email me if there are additional topics you think we should discuss. See you on Tuesday! -- Marty Marty Humphrey Assistant Professor Department of Computer Science University of Virginia

1 0