- glue-wg - lists.ogf.org

GLUE 2.0 - Executable discussion at OGF22
by Gerson Galang 26 Feb '08

26 Feb '08

Daniel has asked me to forward this to the list while he waits for Sergio to authorize his mailing list subscription request. ===== I had a meeting with JP this morning after the opening session to discuss ideas for Executable in ApplicationEnvironment. Here are some links to background information and some possible ideas. I would like to discuss this with other group members at one of the sessions this week. There are 2 sessions on Wed and 1 on Thu, however JP will not be available for the afternoon session on Wed (which is scheduled to be 'computing' I think). Alternatively we could meet Tuesday afternoon? *Background* Executable (LocalID, Name, Parallel)http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/Pho… http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/GridAustrali… More on ParallelType, NetworkInfohttp://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/P… *Current SPEC 24/2*https://forge.gridforum.org/sf/go/projects.glue-wg/docman.root.drafts No ParallelType or NetworkInfo yet. 5.0 Auxiliar Entities Spelling in title and GLUEntitiy in image need fixing! This could be used for executable. But since we agree that it is better to have a setup method (eg. module) then things like InstalledRoot should not be required either - and we don't want everything as an Auxiliary Entity! It appears to be 'less supported' and would not have a properly documented description. 6.7 p21 ApplicationEnvironment SetupMethod (module or softenv), SetupKey - only allows ONE! It would be better to be a Setup entity with method, key attributes. eg: <Setup method="module" key="blast"> Possibly rename Setup to Handle? This is what Teragrid have used in their non-GLUE schema. Or some other name? Allowing multiple entities, the method could then allow a value of "executable". This suggested alternative requires extra parsing and is more difficult to use XPath to extract modules for software: <Setup>module:blast</Setup> JP also suggested that things like parallel could be supported in a SoftwareAttributes (or similarly named) entity. But it is hard to decide what should be 'generic' and what should just be part of the SPEC to start with. Maybe best to keep as already discussed - but make sure it is put in the SPEC. Daniel.

2 1

LDAP hierarchy
by Burke, S (Stephen) 25 Feb '08

25 Feb '08

Hi all, A comment on the LDAP mapping prompted by trying to find things in the current info system using an LDAP browser ... basically it's a real nightmare at the moment because the hierarchy is so flat. Firstly we have all 250+ sites in one long list below the top level, and then within a site there is in many cases an equally huge list of CEs, Clusters, Services, SEs and CESEBinds. At a quick count mds-vo-name=CERN_PROD seems to have 826 objects directly under it! When we do the LDAP mapping for Glue 2 can we try to get a deeper hierarchy with more grouping to make it easier to find things? Stephen

1 0

GLUE 2.0 Spec - Draft 24
by Sergio Andreozzi 25 Feb '08

25 Feb '08

Dear all, at the following page you can find draft 24 of the GLUE 2.0 spec: http://forge.ogf.org/sf/go/projects.glue-wg/docman.root.drafts Cheers, Sergio -- Sergio Andreozzi INFN-CNAF, Tel: +39 051 609 2860 Viale Berti Pichat, 6/2 Fax: +39 051 609 2746 40126 Bologna (Italy) Web: http://www.cnaf.infn.it/~andreozzi

1 0

GLUE Spec 2.0 - Draft 23
by Sergio Andreozzi 22 Feb '08

22 Feb '08

Dear all, in the document repository I've updated the version 23 of the GLUE 2.0 Spec. This document contains the merge of all the contributions. http://forge.ogf.org/sf/docman/do/listDocuments/projects.glue-wg/docman.roo… The list of authors and contributors was updated according to the participation to the discussion. Please, let me know if I missed someone. There will be probably one more minor update before the GLUE sessions at OGF 22, nevertheless you are invited to download and read this document and report your feedback. Consider that data types and unit have all to be revised, concentrate on class and properties definitions, multiplicity and relationships. In the last weeks, we made important progress and if we keep this level of activity, we can aim for going public comment in the coming weeks after OGF. I want to thank everybody for the time you have dedicated to this activity so far. Cheers, Sergio -- Sergio Andreozzi INFN-CNAF, Tel: +39 051 609 2860 Viale Berti Pichat, 6/2 Fax: +39 051 609 2746 40126 Bologna (Italy) Web: http://www.cnaf.infn.it/~andreozzi

3 6

[Reminder] info/data modeling architecture @ 2008-02-21 07:00 - 08:00 ()
by Google Calendar 20 Feb '08

20 Feb '08

glue-wg(a)ogf.org, this is a reminder for Title: info/data modeling architecture Time: 2008-02-21 07:00 - 08:00 (Timezone: Central Time) Calendar: Description: When: 8-9am EDT, 7-8am CDT, 5-6am PDT, 10-11pm JST, 1-2pm UK Dial-in numbers for Thursday: US: +1 718 3541071 (New York) or +1 408 9616509 (San Jose) UK: +44 (0)207 3655269 (London) Germany: +49 (0)69 50070802 (Frankfurt) Switzerland: +41 (0)1 8009574 (Zurich) Japan: +81 (0)3 3570 8225 (Tokyo) PIN: 4371991 See more information: - https://forge.gridforum.org/sf/go/wiki1477 Screen share service: URL: http://ogsa.glance.net/ Usage: https://forge.gridforum.org/sf/go/wiki1584 Note: ** OGF IPR POLICY APPLIES ** http://www.ogf.org/About/abt_policies.php 1) Early discussion Note taker assignment - https://forge.gridforum.org/sf/go/wiki1848 Roll call Minutes approval and AI review (see the bottom of this agenda) Agenda bashing 2) Minutes approval and AI review Minutes for approval Feb. 14 call: https://forge.gridforum.org/sf/go/doc15040 Action Item review http://forge.ogf.org/short/ogsa-wg/ailist 3) architecture document update review (Ellen Stokes) Please read the document before the call. It is expected that this review will be the last one before the document goes to final call. https://forge.gridforum.org/sf/go/doc13726 4) Any other business You can view this event at http://www.google.com/calendar/event?action=VIEW&eid=bG5wYnJmbGp0aWJnamhpaG… You are receiving this courtesy email at the account glue-wg(a)ogf.org because you are an attendee of this event. To stop receiving future notifications for this event, decline this event. Alternatively you can sign up for a Google Calendar account at http://www.google.com/calendar/ and control your notification settings for your entire calendar.

1 0

minutes of today meeting + GLUE 2.0 spec 22
by Sergio Andreozzi 19 Feb '08

19 Feb '08

Dear all here you can find the new draft 22 for the computing part: http://forge.ogf.org/sf/docman/do/listDocuments/projects.glue-wg/docman.roo… the storage part will be send by Felix. As regards the today telecons, here are the minutes: http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/PhoneMeeting… by Friday, we plan to circulate a full draft of the schema merging the current two documents and polished for the OGF event. Cheers, Sergio -- Sergio Andreozzi INFN-CNAF, Tel: +39 051 609 2860 Viale Berti Pichat, 6/2 Fax: +39 051 609 2746 40126 Bologna (Italy) Web: http://www.cnaf.infn.it/~andreozzi

1 0

Software publishing - TeraGrid use cases
by JP Navarro 19 Feb '08

19 Feb '08

On a GLUE2 call last week or the week before I agreed to review the currently proposed schema for publishing software information and comment on whether it addresses TeraGrid requirements and use cases. The TeraGrid has been publishing software information in information services since the summer of 2007. Our goals were to support the following use cases: 1) users can discover which compute resources offer a specific software package 2) users can discover the version, or versions, of available software packages 3) users can discover if a package is in the default login/execution environment (users or application do not need to do anything to access this software) 4) if a package is not in the default login/execution environment, how can a user or job access the software package We support the above use cases by publishing the following attributes about the software available on each compute resource: - TeraGrid standard software name - TeraGrid standard software version - In default environment (yes/no) - How to access the software: - access technique (the TeraGrid currently only uses the "softenv" technique) - access key (a key/string understood by a technique handler) Some notes: Even though we currently only use the "softenv" technique we abstracted the schema a little so we could eventually support other techniques (i.e. "modules", "path", ..) A software component may include multiple binaries, have man page directories, have various library directories, have multiple binary directories (bin/, sbin/, etc), be parallel/non-parallel, threaded/non-threaded, scripted/compiled, and have other arbitrary but relevant user information. We chose not to design or implement a schema complex enough to communicate all this information, but instead expect users will discover such details thru other methods. What we offer is a way for users/jobs to request that a specific piece of software be available in their login or execution environment, and will set all the appropriate environment variables for them to make that software component available (using the access technique and key listed above). Example: User wants to use "mpich-gm" and must know ahead of time how to compile (mpicc, mpicxx, mpif77, mpif90, etc) and run (mpirun) 1) a single info service query can return the compute resources that offer "mpich-gm", which version(s), the access technique and key for each available "mpich-gm", and the endpoint of the execution service where each "mpich-gm" is available 2 the user then submits jobs to the endpoint with the information: request software "softenv:<an-mpich-gm-key>" mpirun <myprogram> <arguments> The softenv handler will make sure the libraries, paths, and anything else needed by the application are configured correctly. The user doesn't need to know the mpirun binary path because the correct mpirun will be first in their PATH (and LD_LIBRARY_PATH and other variables will be set also) Comparing the proposed GLUE2 ApplicationEnvironment entity attributes: ID Name Version State License LifeTime InstalledRoot EnvironmentSetup Description The attributes that would directly map to TeraGrid attributes, or be generated automatically include: ID Name Version Description For the TeraGrid the "EnvironmentSetup" attribute is a tuple "EnvironmentSetupMethod" and "EnvironmentSetupKey". This could be represented as a compound value inside "EnvironmentSetup" (i.e. softenv:<key>), but it would be better if the schema had the attributes separately. We propose "EnvironmentSetupMethod" and "EnvironmentSetupKey". We currently have no need for License, LifeTime, or InstalledRoot, so would suggest that these attributes all be OPTIONAL. Lastly the TeraGrid's "in default environment" attribute doesn't map to any proposed GLUE2 attributes. It could be added as an OPTIONAL attribute, or the TeraGrid could add it as a local extension in our implementation of GLUE2. Regards, JP

3 3

[Invitation] info/data modeling architecture @ 2008-02-21 07:00 - 08:00 ()
by Hiro Kishimoto 19 Feb '08

19 Feb '08

glue-wg(a)ogf.org, you are invited to Title: info/data modeling architecture Time: 2008-02-21 07:00 - 08:00 (Timezone: Central Time) Calendar: Description: When: 8-9am EDT, 7-8am CDT, 5-6am PDT, 10-11pm JST, 1-2pm UK Dial-in numbers for Thursday: US: +1 718 3541071 (New York) or +1 408 9616509 (San Jose) UK: +44 (0)207 3655269 (London) Germany: +49 (0)69 50070802 (Frankfurt) Switzerland: +41 (0)1 8009574 (Zurich) Japan: +81 (0)3 3570 8225 (Tokyo) PIN: 4371991 See more information: - https://forge.gridforum.org/sf/go/wiki1477 Screen share service: URL: http://ogsa.glance.net/ Usage: https://forge.gridforum.org/sf/go/wiki1584 Note: ** OGF IPR POLICY APPLIES ** http://www.ogf.org/About/abt_policies.php 1) Early discussion Note taker assignment - https://forge.gridforum.org/sf/go/wiki1848 Roll call Minutes approval and AI review (see the bottom of this agenda) Agenda bashing 2) Minutes approval and AI review Minutes for approval Feb. 14 call: https://forge.gridforum.org/sf/go/doc15040 Action Item review http://forge.ogf.org/short/ogsa-wg/ailist 3) architecture document update review (Ellen Stokes) Please read the document before the call. It is expected that this review will be the last one before the document goes to final call. https://forge.gridforum.org/sf/go/doc13726 4) Any other business You can view this event at http://www.google.com/calendar/event?action=VIEW&eid=bG5wYnJmbGp0aWJnamhpaG… You are receiving this courtesy email at the account glue-wg(a)ogf.org because you are an attendee of this event. To stop receiving future notifications for this event, decline this event. Alternatively you can sign up for a Google Calendar account at http://www.google.com/calendar/ and control your notification settings for your entire calendar.

1 0

minutes from today telecons
by Sergio Andreozzi 19 Feb '08

19 Feb '08

Dear all, at this page you can find the minutes of the today telecons: http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/PhoneMeeting… next Monday and Tuesday we will held the last telecons before OGF, the schedule is available here: http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/PhoneMeetings for Gerson, if you are available to talk on Monday, 2 PM CET, we can anticipate the telecon and finalize the discussion on the ApplicationEnvironment. Cheers, Sergio -- Sergio Andreozzi INFN-CNAF, Tel: +39 051 609 2860 Viale Berti Pichat, 6/2 Fax: +39 051 609 2746 40126 Bologna (Italy) Web: http://www.cnaf.infn.it/~andreozzi

3 4

minutes today telecon + tomorrow telecons + new draft
by Sergio Andreozzi 19 Feb '08

19 Feb '08

Dear all, here you can find the minutes of the today telecon: http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/PhoneMeeting… since tomorrow will be the last available day to make calls before OGF, we agreed to run one more GLUE telecon on computing resources, therefore we will have three calls: http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/PhoneMeeting… a new draft was updated just as PDF doc: http://forge.ogf.org/sf/docman/do/downloadDocument/projects.glue-wg/docman.… Cheers, Sergio -- Sergio Andreozzi INFN-CNAF, Tel: +39 051 609 2860 Viale Berti Pichat, 6/2 Fax: +39 051 609 2746 40126 Bologna (Italy) Web: http://www.cnaf.infn.it/~andreozzi

1 1