February 2008 - glue-wg - lists.ogf.org

nordugrid feedback
by Balazs Konya 19 Mar '08

19 Mar '08

Hi, Recently, NorduGrid started to look at the potential xml rendering of the current glue2 draft. We tried to follow INFN's initial attempt (linked from the glue group's wiki page: http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/GLUE2XMLSche…) nevertheless we run into several questions. Please find our questions/suggestions collected on a newly created wiki page: http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/FeedbackGLUE… Sergio, I suggest to go through our items during one of the scheduled phone meetings. Tomorrow or the day after i'll make our glue2 xml examples of a homogeneous cluster, desktop machine, a multi-service computer box available too (i have to clean them a bit, first). Meanwhile i encourage every potential glue2 users that they start putting together small XML/LDAP/SQL examples of their resource/service descriptions. The glue2 draft has reached that level it is feasible to start creating examples. This is the best way to provide feedback to the glue group. regards, Balazs Konya

3 8

short updated after OGF 22
by Sergio Andreozzi 28 Feb '08

28 Feb '08

Dear all, we just finished a another long day of work on GLUE during OGF. In these days, we have polished many concepts and relationships and we have improved the consistency of the whole model. Summary minutes are reported in these slides: http://forge.ogf.org/sf/docman/do/listDocuments/projects.glue-wg/docman.roo… An updated version of the spec is on the doc repository: http://forge.ogf.org/sf/docman/do/listDocuments/projects.glue-wg/docman.roo… Here is the tentative schedule for resuming telecons activity: http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/PhoneMeetings By the end of March, we would like to have a WG last call and we'll collect all the comments in order to prepare for a Public Comments request by the end of April If we keep the current level of participation and work, we should manage to achieve this goal. Please check the slide no 12 for the roadmap. More updates will be given at the next first group call (11/March). Cheers, Sergio -- Sergio Andreozzi INFN-CNAF, Tel: +39 051 609 2860 Viale Berti Pichat, 6/2 Fax: +39 051 609 2746 40126 Bologna (Italy) Web: http://www.cnaf.infn.it/~andreozzi

1 0

material and updates from OGF22
by Sergio Andreozzi 27 Feb '08

27 Feb '08

Dear all, today we run our first GLUE session. In the forge document repository you can find the updated Spec document plus the slides used for the sessions. http://forge.ogf.org/sf/docman/do/listDocuments/projects.glue-wg/docman.roo… http://forge.ogf.org/sf/docman/do/listDocuments/projects.glue-wg/docman.roo… As a reminder, the next sessions are. Wed 27 Feb, 3:45 pm - 5:15 pm Room William Dawes Agenda: Computing entites Thu 28 Feb, 9:00 am - 10:30 am (EXTRA SESSION) Room Crispus Attucks Agenda: Renderings: XSD, LDAP, SQL, ... Thu 28 Feb, 10:45 am - 12:15 pm Room Crispus Attucks Agenda Storage entities Cheers, Sergio -- Sergio Andreozzi INFN-CNAF, Tel: +39 051 609 2860 Viale Berti Pichat, 6/2 Fax: +39 051 609 2746 40126 Bologna (Italy) Web: http://www.cnaf.infn.it/~andreozzi

1 0

GLUE 2.0 - Executable discussion at OGF22
by Gerson Galang 26 Feb '08

26 Feb '08

Daniel has asked me to forward this to the list while he waits for Sergio to authorize his mailing list subscription request. ===== I had a meeting with JP this morning after the opening session to discuss ideas for Executable in ApplicationEnvironment. Here are some links to background information and some possible ideas. I would like to discuss this with other group members at one of the sessions this week. There are 2 sessions on Wed and 1 on Thu, however JP will not be available for the afternoon session on Wed (which is scheduled to be 'computing' I think). Alternatively we could meet Tuesday afternoon? *Background* Executable (LocalID, Name, Parallel)http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/Pho… http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/GridAustrali… More on ParallelType, NetworkInfohttp://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/P… *Current SPEC 24/2*https://forge.gridforum.org/sf/go/projects.glue-wg/docman.root.drafts No ParallelType or NetworkInfo yet. 5.0 Auxiliar Entities Spelling in title and GLUEntitiy in image need fixing! This could be used for executable. But since we agree that it is better to have a setup method (eg. module) then things like InstalledRoot should not be required either - and we don't want everything as an Auxiliary Entity! It appears to be 'less supported' and would not have a properly documented description. 6.7 p21 ApplicationEnvironment SetupMethod (module or softenv), SetupKey - only allows ONE! It would be better to be a Setup entity with method, key attributes. eg: <Setup method="module" key="blast"> Possibly rename Setup to Handle? This is what Teragrid have used in their non-GLUE schema. Or some other name? Allowing multiple entities, the method could then allow a value of "executable". This suggested alternative requires extra parsing and is more difficult to use XPath to extract modules for software: <Setup>module:blast</Setup> JP also suggested that things like parallel could be supported in a SoftwareAttributes (or similarly named) entity. But it is hard to decide what should be 'generic' and what should just be part of the SPEC to start with. Maybe best to keep as already discussed - but make sure it is put in the SPEC. Daniel.

2 1

LDAP hierarchy
by Burke, S (Stephen) 25 Feb '08

25 Feb '08

Hi all, A comment on the LDAP mapping prompted by trying to find things in the current info system using an LDAP browser ... basically it's a real nightmare at the moment because the hierarchy is so flat. Firstly we have all 250+ sites in one long list below the top level, and then within a site there is in many cases an equally huge list of CEs, Clusters, Services, SEs and CESEBinds. At a quick count mds-vo-name=CERN_PROD seems to have 826 objects directly under it! When we do the LDAP mapping for Glue 2 can we try to get a deeper hierarchy with more grouping to make it easier to find things? Stephen

1 0

GLUE 2.0 Spec - Draft 24
by Sergio Andreozzi 25 Feb '08

25 Feb '08

Dear all, at the following page you can find draft 24 of the GLUE 2.0 spec: http://forge.ogf.org/sf/go/projects.glue-wg/docman.root.drafts Cheers, Sergio -- Sergio Andreozzi INFN-CNAF, Tel: +39 051 609 2860 Viale Berti Pichat, 6/2 Fax: +39 051 609 2746 40126 Bologna (Italy) Web: http://www.cnaf.infn.it/~andreozzi

1 0

GLUE Spec 2.0 - Draft 23
by Sergio Andreozzi 22 Feb '08

22 Feb '08

Dear all, in the document repository I've updated the version 23 of the GLUE 2.0 Spec. This document contains the merge of all the contributions. http://forge.ogf.org/sf/docman/do/listDocuments/projects.glue-wg/docman.roo… The list of authors and contributors was updated according to the participation to the discussion. Please, let me know if I missed someone. There will be probably one more minor update before the GLUE sessions at OGF 22, nevertheless you are invited to download and read this document and report your feedback. Consider that data types and unit have all to be revised, concentrate on class and properties definitions, multiplicity and relationships. In the last weeks, we made important progress and if we keep this level of activity, we can aim for going public comment in the coming weeks after OGF. I want to thank everybody for the time you have dedicated to this activity so far. Cheers, Sergio -- Sergio Andreozzi INFN-CNAF, Tel: +39 051 609 2860 Viale Berti Pichat, 6/2 Fax: +39 051 609 2746 40126 Bologna (Italy) Web: http://www.cnaf.infn.it/~andreozzi

3 6

[Reminder] info/data modeling architecture @ 2008-02-21 07:00 - 08:00 ()
by Google Calendar 20 Feb '08

20 Feb '08

glue-wg(a)ogf.org, this is a reminder for Title: info/data modeling architecture Time: 2008-02-21 07:00 - 08:00 (Timezone: Central Time) Calendar: Description: When: 8-9am EDT, 7-8am CDT, 5-6am PDT, 10-11pm JST, 1-2pm UK Dial-in numbers for Thursday: US: +1 718 3541071 (New York) or +1 408 9616509 (San Jose) UK: +44 (0)207 3655269 (London) Germany: +49 (0)69 50070802 (Frankfurt) Switzerland: +41 (0)1 8009574 (Zurich) Japan: +81 (0)3 3570 8225 (Tokyo) PIN: 4371991 See more information: - https://forge.gridforum.org/sf/go/wiki1477 Screen share service: URL: http://ogsa.glance.net/ Usage: https://forge.gridforum.org/sf/go/wiki1584 Note: ** OGF IPR POLICY APPLIES ** http://www.ogf.org/About/abt_policies.php 1) Early discussion Note taker assignment - https://forge.gridforum.org/sf/go/wiki1848 Roll call Minutes approval and AI review (see the bottom of this agenda) Agenda bashing 2) Minutes approval and AI review Minutes for approval Feb. 14 call: https://forge.gridforum.org/sf/go/doc15040 Action Item review http://forge.ogf.org/short/ogsa-wg/ailist 3) architecture document update review (Ellen Stokes) Please read the document before the call. It is expected that this review will be the last one before the document goes to final call. https://forge.gridforum.org/sf/go/doc13726 4) Any other business You can view this event at http://www.google.com/calendar/event?action=VIEW&eid=bG5wYnJmbGp0aWJnamhpaG… You are receiving this courtesy email at the account glue-wg(a)ogf.org because you are an attendee of this event. To stop receiving future notifications for this event, decline this event. Alternatively you can sign up for a Google Calendar account at http://www.google.com/calendar/ and control your notification settings for your entire calendar.

1 0

minutes of today meeting + GLUE 2.0 spec 22
by Sergio Andreozzi 19 Feb '08

19 Feb '08

Dear all here you can find the new draft 22 for the computing part: http://forge.ogf.org/sf/docman/do/listDocuments/projects.glue-wg/docman.roo… the storage part will be send by Felix. As regards the today telecons, here are the minutes: http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/PhoneMeeting… by Friday, we plan to circulate a full draft of the schema merging the current two documents and polished for the OGF event. Cheers, Sergio -- Sergio Andreozzi INFN-CNAF, Tel: +39 051 609 2860 Viale Berti Pichat, 6/2 Fax: +39 051 609 2746 40126 Bologna (Italy) Web: http://www.cnaf.infn.it/~andreozzi

1 0

Software publishing - TeraGrid use cases
by JP Navarro 19 Feb '08

19 Feb '08

On a GLUE2 call last week or the week before I agreed to review the currently proposed schema for publishing software information and comment on whether it addresses TeraGrid requirements and use cases. The TeraGrid has been publishing software information in information services since the summer of 2007. Our goals were to support the following use cases: 1) users can discover which compute resources offer a specific software package 2) users can discover the version, or versions, of available software packages 3) users can discover if a package is in the default login/execution environment (users or application do not need to do anything to access this software) 4) if a package is not in the default login/execution environment, how can a user or job access the software package We support the above use cases by publishing the following attributes about the software available on each compute resource: - TeraGrid standard software name - TeraGrid standard software version - In default environment (yes/no) - How to access the software: - access technique (the TeraGrid currently only uses the "softenv" technique) - access key (a key/string understood by a technique handler) Some notes: Even though we currently only use the "softenv" technique we abstracted the schema a little so we could eventually support other techniques (i.e. "modules", "path", ..) A software component may include multiple binaries, have man page directories, have various library directories, have multiple binary directories (bin/, sbin/, etc), be parallel/non-parallel, threaded/non-threaded, scripted/compiled, and have other arbitrary but relevant user information. We chose not to design or implement a schema complex enough to communicate all this information, but instead expect users will discover such details thru other methods. What we offer is a way for users/jobs to request that a specific piece of software be available in their login or execution environment, and will set all the appropriate environment variables for them to make that software component available (using the access technique and key listed above). Example: User wants to use "mpich-gm" and must know ahead of time how to compile (mpicc, mpicxx, mpif77, mpif90, etc) and run (mpirun) 1) a single info service query can return the compute resources that offer "mpich-gm", which version(s), the access technique and key for each available "mpich-gm", and the endpoint of the execution service where each "mpich-gm" is available 2 the user then submits jobs to the endpoint with the information: request software "softenv:<an-mpich-gm-key>" mpirun <myprogram> <arguments> The softenv handler will make sure the libraries, paths, and anything else needed by the application are configured correctly. The user doesn't need to know the mpirun binary path because the correct mpirun will be first in their PATH (and LD_LIBRARY_PATH and other variables will be set also) Comparing the proposed GLUE2 ApplicationEnvironment entity attributes: ID Name Version State License LifeTime InstalledRoot EnvironmentSetup Description The attributes that would directly map to TeraGrid attributes, or be generated automatically include: ID Name Version Description For the TeraGrid the "EnvironmentSetup" attribute is a tuple "EnvironmentSetupMethod" and "EnvironmentSetupKey". This could be represented as a compound value inside "EnvironmentSetup" (i.e. softenv:<key>), but it would be better if the schema had the attributes separately. We propose "EnvironmentSetupMethod" and "EnvironmentSetupKey". We currently have no need for License, LifeTime, or InstalledRoot, so would suggest that these attributes all be OPTIONAL. Lastly the TeraGrid's "in default environment" attribute doesn't map to any proposed GLUE2 attributes. It could be added as an OPTIONAL attribute, or the TeraGrid could add it as a local extension in our implementation of GLUE2. Regards, JP

3 3