November 2007 - ogsa-hpcp-wg

Telecon Notes
by Steven Newhouse 03 Dec '07

03 Dec '07

Present: Steven Newhouse Glenn Wasson Vesselin Novov Gabor Roczei Marty Humphrey (at end) Agenda 1. OGF IPR Notice 2. SC07 PM * Good from an implementation perspective - especially from client configuration * Pushed forward on specifications and proposed extensions * Big issues on establishing SSL configurations * UVa may still have issue accepting NorduGrid connections * Overall good experience Action: Continue updating interop matrix on wiki 3. Experience Document * Update from Glenn... last draft on 1st Nov. Action: All to review and make contributions 4. Data Staging & Activity Credential Revision * Discussion on SJN's email and Glenn's response * FileStaging element in JSDL optional - we may Fault if present or silently ignore * Use xsd:any within the Credential element * Define a list of minimally supported authentication tokens and protocols that an implementation MUST support (e.g. username/password and ftp, others...) * The credential for job initiation to not go in the file staging spec. Perhaps as an optional extension to the basic profile specification? Action: Glenn currently revising document. Will circulate next few days 5. Activity Filter Action: All to read & comment 6. OGF Article * Glenn thought it read OK. Make it clear that extensions are separate - not part of the specification. 7. AOB 8. Next Meeting - Thursday 6th December 2007 - 9.30 PACIFIC

3 5

new version of the HPC File Staging Profile
by Glenn Wasson 30 Nov '07

30 Nov '07

Guys, Here is a new version of the HPCP-FSP document with changes we discussed on yesterday's phone call. Please send me your comments. Glenn

1 0

Proposed Changes to Data Staging specification
by Steven Newhouse 30 Nov '07

30 Nov '07

Based on my (& others?) implementation experience of this draft at SC07 I would propose the following modifications: 1. Change the specification name from Data Staging to File Staging. [I know I keep raising this... but data has very specific meaning to some people and this spec does not cover it any form at the moment.] 2. No use of the FileSystemName element in JSDL 3. Scrap the StagingSchedule element in section 3.2 4. Remove the dependency of this specification on the Activity Credential specification by: a) Placing a Credential element (wrapping a WS-Security authentication token) within the JSDL DataStaging element if a specific credential is needed for that file operation b) Placing a Credential element (wrapping a WS-Security authentication token) within the JSDL JobDescription element if a specific credential (different from the one used to connect to the service) is required to execute that application on the resource. There are probably other tweaks... but these would be my immediate issues following on from the SC07 experience. Steven

3 2

SC07 Article
by Steven Newhouse 28 Nov '07

28 Nov '07

All, John Ehrig asked for an article on the HPCBP activities at SC07 for the OGF newsletter. Attached is a first draft. Please provide comments and corrections ASAP and hopefully we can spend a few minutes on the call in the morning (if in the USA) or in the afternoon (for those in Europe) or whenever (for the rest of the world) to discuss it. Steven

1 0

Microsoft Endpoint Unavailable
by Steven Newhouse 28 Nov '07

28 Nov '07

Due to the planned refurbishment of the machine room hosting our HPC resources this endpoint will be unavailable until mid-December. Apologies. Steven

1 0

Advanced Filter V0.2
by Steven Newhouse 27 Nov '07

27 Nov '07

All, An update of the document incorporating comments from Glenn and an XML schema for your implementation enjoyment. Steven

1 0

Telecon this Thursday - 29th November 2007
by Steven Newhouse 26 Nov '07

26 Nov '07

Time: 9.30AM (Pacific), 12.30PM (East Coast), 5.30PM (UK) Call details: PIN - 2719140 USA: 866 500 6738 UK +44 118 909 2000 I'll try and supply further local numbers if people require them. Basic Agenda 1. OGF IPR Notice 2. Agenda Bashing 3. SC07 Post Mortem 4. Experience document 5. Any Other Business

1 0

HPCBP-SC07v3
by Steven Newhouse 14 Nov '07

14 Nov '07

I think this is nearly it. Thank you for all your comments and contributions. Further changes to the word document need to come in very very soon! The wiki page - www.ogf.org/HPCBasicProfile<http://www.ogf.org/HPCBasicProfile> - can of course be continuously updated. Steven

3 2

***SPAM*** HPCBP Advanced Filter extension
by Steven Newhouse 09 Nov '07

09 Nov '07

Attached is a first draft of the 'Advanced Filter' specification for the HPCBP to reduce the size of the GetFactoryAttributesDocument for large activities and resources lists. Comments and active discussion welcomed! Steven

3 3

Telecon Minutes
by Steven Newhouse 08 Nov '07

08 Nov '07

Glenn Wasson, UVa Marty Humphrey, UVa Steven Newhouse, Microsoft Shahbaz Memon, FZJ Chris Smith, Platform Steve McGough, Imperial College London John Ehrig, OGF Vesselin Novov, Imperial College London Paolo Andreetto, INFN Joel Replogle, OGF Gabor Robbei, KnowARC Steve Crumb, OGF Bill Nitzberg, Altair SC07 Activity Flyer : Update awaited from FZJ. Needed by 11:00 Pacific time TODAY, i.e. NOW!!! Press Release: Chris and Bill have initiated getting quotes from their respective organizations. Quotes from MS and OGF in place. Press release will probably come out Wednesday morning. Discussion will be off list due to it having embargoed contents. Demo Updates * UVa: FileStaging and ActivityCredential is now implemented in the compliance tester. Available for interop. * Microsoft: FileStaging, ActivityCredential and AdvancedFilter. Available for interop. * FZJ: Endpoint up and running and working with CREAM BES. Has just got username & password for UVa * Platform: Service that is mostly compliant for username & password. Contact Chris Smith. * Imperial College: See wiki page for basic service details. Different service for file staging. Problems with Platform and UVa endpoints with the GridSAM client. * INFN: Service & FTP server available. Problems with gLite and the certificate in the compliance tester - unable to workaround. OK with NorduGrid and GridSAM. * KnowARC: Service details up on wiki page. Only certificate. * Altair: Just demoing client side. BES++ activity at UVa: Deploy BES++ on SGE and PBS. Will modify the wiki. Marty will be touring SC07 getting feedback on your implementation experiences for the document. Please talk to him directly or contribute thoughts to the list. Good experiences are as important as identifying issues that needed resolution. Chris raised an issue as to how to handle the faults that may be generated on the operations taking a vector of activity identifiers as input. For HPCBP where the vector length can be constrained to be 1 a normal SOAP fault can be generated. For BES compliant operations this SOAP fault need to become (potentially) a vector of SOAP faults. This support is proving difficult to achieve in gSOAP tooling. In WCF it was also hard to get the correct classes generated from the XML declaration.

1 0