February 2006 - cddlm-wg

Last call for Application Contents Service Specification 1.0
by Keisuke Fukui 08 Mar '06

08 Mar '06

Folks in ogsa-wg, cddlm-wg and acs-wg, We, acs-wg, has come to completion of the ACS Specification 1.0 after discussions and reviews. This is the last call for comments before submission to the GGF Editor for publication. If you have comments, please get them to me by 9 am Japan time on Monday November 7. If there are no significant comments I plan to submit the document on Monday afternoon. Below is the link for the document: https://forge.gridforum.org/projects/acs-wg/document/draft-ggf-acs-spec-1.0… Regards, Keisuke Fukui ACS-WG co-chair

1 1

component model specification
by Hiro Kishimoto 28 Feb '06

28 Feb '06

Hi all, > Comment By: Greg Newby (2006-02-28 12:13:36) > The GFSG approved this document for publication > on February 28. It is now in final Editor review prior > to publication. Thanks, -- Hiro Kishimoto

1 0

Notes from the regular CDDLM meeting, today, 2/22, 6am PST
by Milojicic, Dejan S (HP Labs) 23 Feb '06

23 Feb '06

Attendees Flavio, Steve, Jun, and Dejan. > 1. Update from GGF16 We all (Jun, Stuart, and Dejan) shared impressions from GGF. Overall summary was that we made a lot of progress. Looking back at commitments, it seems that evaluating expressions might take most time. > 2. Planning interoperability demonstrations CDL: We could have additional tests provided by Jun, before the end of March. We should run them and come up with a report document (informational GGF document) that will demonstrate the interoperability between reference implementations. Deployment APIs: Bringing up live end point is critical wrt security. Everyone will implement tests and then run them against the other people's reference implementations. Hopefully we can also accomplish this before GGF17, but at latest we should for accomplishing this at GGF17. Component model: this is an unknown at this time, we'll wait for Stuart to show up so that we can sync up with him. If not possible, this one will have to be postponed until after GGF17, if Stuart pushes it, we might be able to accomplish it along with other interoperability tests. > 3. Update on the status of specs Comp. model and deployment API are in the GFSG 15 days review, the CDL is in public review. > 4. Planning OGSA & CDDLM relationship (CDDLM and JSDL in particular) We are awaiting Steve Newhouse to come up with his document. > 5. Various Nothing else. Next meeting next week, we will track the progress of tests. Thanks, Dejan.

1 0

Notes from GGF16
by Milojicic, Dejan S (HP Labs) 22 Feb '06

22 Feb '06

Hi, Below is the summary of notes from GGF16. Thanks to all note takers. I am missing the 2/15 interop notes, Stephen, can you post them to this group, please. Steve, can you please post your presentation from the same session. Best regards, Dejan. CDDLM-WG (and related) Sessions at GGF 16 2/13, 3:30pm: CDDLM #1, Demos of reference implementations 2/13, 5:30pm: CDDLM #2, Relationship to other technologies 2/14, 5:30pm: CDDLM #3, Planning interoperability 2/15, 5:30pm: BoF Interoperability Fests, CDDLM's participation 2/17: OGSA F2F, Continued discussions on OGSA (EMS) & CDDLM Quick Update on our Status and Where We are Going - Documents - Two documents are public - Two documents finished public comment period, we expect them to become public documents shortly - One document entering public comment - Reference implementations - Four in place with more or less completeness - Interoperability - Planned for March-May 2006, but some aspects already accomplished! - GGF17 (GGF18?) mission accomplished ------------------------------------------------------------------------ --------------------------- CDDLM WG session #1, Demos of reference implementations (about 30 people), Note Taker Hiro ------------------------------------------------------------------------ --------------------------- Introduction by Dejan Session plans in this week Quick update Two document are published, two went through PC and will be published soon, and one starts PC soon. Jun presents NEC implementation. It is stored in sourceforge.net, use common test environment, use CDL test (still growing). Test tool is using JUNIT. Handling multiple CDL documents to test <cdl:import> "CDL processor" and "component generator" they are based on tomcat and muse with GUI. Demonstrate deployment and start "footwear shop" application. What does component generator consume and generate? Show Ayla's demonstration without vocal. Destroy undeploy the stuff? They do not do such optimization, yet. What is the main difference between this demo and previous demo in Boston? Demo in Boston is just show it works. Now her implementation can take care of most of CDL specs. Do you have any statistics for her coverage? No. but this demo covers many corner cases and becomes much reliable. Steven's SF based demo Show "hello world" demo Use VMware to demonstrate deploying networked machine. Demonstrate deploying jboss as more realistic example Do you also use CDL type for this window? No GLARE presentation Askalon's grid environment Based on Globus services Problem is hardcoded binding between activity and component Want to move to runtime binding GLARE activity description = CDL? Super-peer model is distributed Do you read CDLLM document? Many of features are already covered by them. We've implemented the system one ore more year before and are now reading specs. Dejan says they are very glad if you could give feedback in the future. Wrap up Dejan recaps another CDDLM sessions in this week. Dejan emphasizes they have four independent implementations. Meeting adjourned at 4:00pm ------------------------------------------------------------------------ -------------------------- CDDLM WG session #2, Relationship to other technologies (about 30 people), Note Taker Jun Tatemura ------------------------------------------------------------------------ -------------------------- (participation from DMTF CIM and OASIS WSDM groups) relationship of CDDLM and BES to WSDM WSDM 1.1 (Fred) - referring to WSRF standardized version - WSRF expected March - problem: waiting for WS-Addressing treat manageability as a profile... CDDLM - CIM - deployment artifact - underlying attribute model - may be good time to start thinking of mapping - need experts from DMTF? future interoperability fest DMTF + CDDLM + WSDM? - getting various groups to integrate a mock-up implementation impact from EGA merger - use cases available? JSDL discussion initial idea on homework SDD - they are now refining requirements GRAAP Hiro explained OGSA EMS discussion/ definition of deployment and provisioning (policy) ------------------------------------------------------------------------ --------------------- CDDLM WG session #3, Planning interoperability (about 30 people), Note Taker Dejan Milojicic ------------------------------------------------------------------------ --------------------- CDL - Really in good shape - Do not have tests for some areas (lists, expressions) - Jun will complete this some time in March - Get status report from others where they are (e.g. expressions as well as generic test reports) - Dejan will get the format for the interop document - Steve will automate tests inclusion - Lazy references not covered here (will be addressed by component model) - Jun/Steve will work on this, at least HP & NEC ref impl. but Softricity and UFCG Basic deployment API - Need a common test client, we will have at least 2, Steve & TBD - HOWEVER: everyone should write his own test clients to be general enough to run against other servers - How to enforce that side effects are captured (create files and assert content) - Also blurred with the deployment model, we need test components - See deployment test plan (WSRF properties, create errors, testing APIs) Component Model (& Complete Deployment APIs) - What is tested - lifecycle - notifications (??) - file upload - Everyone should try to have publicly accessible servers (with passwords) so that we can try doing this ahead of the GGF17 - CRITICAL: common test components (even if all different implementations for each team) - file operations - assertions ------------------------------------------------------------------------ --------------------- OGSA F2F, excerpt from Andreas' notes: ------------------------------------------------------------------------ --------------------- CDDLM joint discussion A JSDL BLAST example was posted to the list prior to GGF16. Steve Loughran introduced a CDL example 'corresponding' to the JSDL one. This immediately raised a number of questions on the approach taken: - What should the correspondence or relation between a JSDL and CDL document? One could encapsulate the other; or there could be a reference relation. - What is the added value of using CDL? There is not much point in simply duplicating the functions in the JSDL document. It was agreed that the CDL document should not just reproduce the JSDL document but it should instead provide a more detailed description of what needs to be set up to make it possible to run the job described by the JSDL document. - In part this is drawing the line between the deployment and provisioning. - As a general approach it was also agreed out that we should aim for a relation such that 'moving the line' between deployment/provisioning should not affect the contents of JSDL and CDL documents. (There was also a repeat of the Sunnyvale (Jan 2006) discussion. That is whether configuration actions should be done implicitly by the container vs making them explicit. Re-affirmed the consensus that configurations actions should be made explicit.) How close is CDL to be a declarative vs procedural language? Agreed that it can probably be used either way, but with a preference towards a declarative use for OGSA purposes. Proposal to work out details in a smaller group with people from the various groups (JSDL, BES, CDDLM) before bringing it back for an architecture review. - Accepted in principle, but was put aside in favor of the following action. ACTION: Steven Newhouse to write up a first draft of a few more scenarios on the relationship between JSDL and CDL. - To be included in the current EMS scenarios document. - To be delivered by mid-March - Review on an OGSA call and continue refinement ** Whiteboard list produced during the discussion - Duplication of JSDL in CDL? - Directory/user creation - What is the difference between [job / application / container] configuration] - Where is line between JSDL and CDL and is it policy specific - Job lifecycle including deployment and start/stop

2 1

SOAP interoperability
by Steve Loughran 22 Feb '06

22 Feb '06

These are the slides on SOAP interop that I presented at the interop testing workshop. Note that there is an error; WS-I never mandated DIME.

1 0

Regular CDDLM meeting, today, 2/22, 6am PST
by Milojicic, Dejan S (HP Labs) 22 Feb '06

22 Feb '06

Hi, We shall have a regular meeting today, Wed 2/22/06, at 6am PST. We will use our usual numbers: +1 866-639-4732 (toll free while in US) Code 2362906 (followed by a '#' sign) +1 574-948-0379 (toll & international) Agenda: 1. Update from GGF16 2. Planning interoperability demonstrations 3. Update on the status of specs 4. Planning OGSA & CDDLM relationship (CDDLM and JSDL in particular) 5. Various Thanks, Dejan.

1 0

Re: CDL schema/API
by Mumtaz Siddiqui 22 Feb '06

22 Feb '06

Dear Steve Loughran, Many thanks for the software link and related information. The main focus of the GLARE is to provide dynamic mapping between abstract (semantic or functional) description to concrete (deployment) descriptions of a software component. For on-demand deployment, initially we use autoconf steps like 'configure|make|make install' or 'ant build|ant deploy', and did not use any special language for it, but this was not sufficient for legacy applications which sometimes require special env to be set and/or user interaction during the installation. In order to overcome this problem we introduced this simple language in which provider can provide send/expect like steps, which are executed automatically before on-demand provisioning. We would like to adapt ggf standards as much as possible. Currently we are exploring CDL and related APIs and will come back with some feedback. Thanks again. best mumtaz Loughran, Steve wrote: > >Everything is under SCM; see https://sourceforge.net/projects/deployment >for stuff to check out. > >-you will need a prerelease of Ant1.7 to build the JARs, grab one from > http://people.apache.org/~stevel/dist/ > if you don't want to build one yourself > >-We also build nightly on apache gump; if your project also has a public >CVS or SVN repository, you can get added to the Gump and so catch any >changes in CDDLM or any other Java dependency. > >Regarding the GLARE language versus CDL, there is some appeal to Glare. >Indeed, the Ant dev team is always bemused when people use it as the >reference language for workflows; yours is probably the third such >version, following on from GridAnt, and Sun's XML Pipeline language >(http://www.w3.org/TR/2002/NOTE-xml-pipeline-20020228/) One thing that >Ant does model well is the notion of files, paths and directories, >though even there its model of resources is weak because the lack of >unity across the many groups of things that you can use (hence ant1.7's >refactoring to have an abstract ResourceSet as the parent of all >groupings). > > >CDL tries to be more abstract, but personally, file systems are so >important to deployment/configuration that its important to have a good >way to model them. We end up having components which do nothing but map >a platform independent filename into a platform-specific one, setting a >lazy attribute to the final, absolute value at deployment time. > > > >Tschuss, > -Steve > > > >>-----Original Message----- >>From: Milojicic, Dejan S (HP Labs) >>Sent: 21 February 2006 14:08 >>To: Mumtaz Siddiqui; scrumb(a)ggf.org >>Cc: Loughran, Steve; Alex Villazon >>Subject: RE: CDL schema/API >> >>Hi Mumtaz, >> >>Sorry for the confusion, I was suggesting that you talk to >>Steve Loughran (cc-ed), not Steve Crumb. >> >>Thanks, >> >>Dejan. >> >> >> >>>-----Original Message----- >>>From: Mumtaz Siddiqui [mailto:mumtaz@dps.uibk.ac.at] >>>Sent: Tuesday, February 21, 2006 4:55 AM >>>To: scrumb(a)ggf.org >>>Cc: dejan(a)hpl.hp.com; Alex Villazon >>>Subject: CDL schema/API >>> >>>Dear Steve Crumb, >>> >>>I presented my work about GLARE in first session of CDDLM at GGF16. >>>GLARE provides XML based software component description and >>> >>> >>automatic >> >> >>>deployments framework. >>> >>>Currently we are using simple XML documents for software component >>>descriptions, but as Dr. Dejan Milojicic suggested, we >>> >>> >>would like to >> >> >>>use CDL for descriptions and deployment specifications >>> >>> >>sometime later. >> >> >>>I could not find CDL schema and APIs (including Java stubs) >>> >>> >>on CDDLM >> >> >>>homepage. >>>May I request for a copy of schema as well as APIs? >>> >>>Thanks with best regards >>>mumtaz >>> >>>-- >>>http://dps.uibk.ac.at/~mumtaz >>> >>> >>> >>> -- http://dps.uibk.ac.at/~mumtaz

1 0

RE: CDL schema/API
by Milojicic, Dejan S (HP Labs) 21 Feb '06

21 Feb '06

Hi Mumtaz, Also feel free to post questions to the CDDLM mailing list (you need to join in order to post). Chances are someone from the four teams will reply to you. I have cc-ed the list on this reply. Thanks, Dejan. > -----Original Message----- > From: Loughran, Steve > Sent: Tuesday, February 21, 2006 8:15 AM > To: 'Mumtaz Siddiqui'; 'Alex Villazon' > Cc: Milojicic, Dejan S (HP Labs) > Subject: RE: CDL schema/API > > > Everything is under SCM; see > https://sourceforge.net/projects/deployment for stuff to check out. > > -you will need a prerelease of Ant1.7 to build the JARs, grab > one from > http://people.apache.org/~stevel/dist/ > if you don't want to build one yourself > > -We also build nightly on apache gump; if your project also > has a public CVS or SVN repository, you can get added to the > Gump and so catch any changes in CDDLM or any other Java dependency. > > Regarding the GLARE language versus CDL, there is some appeal > to Glare. Indeed, the Ant dev team is always bemused when > people use it as the reference language for workflows; yours > is probably the third such version, following on from > GridAnt, and Sun's XML Pipeline language > (http://www.w3.org/TR/2002/NOTE-xml-pipeline-20020228/) One > thing that Ant does model well is the notion of files, paths > and directories, though even there its model of resources is > weak because the lack of unity across the many groups of > things that you can use (hence ant1.7's refactoring to have > an abstract ResourceSet as the parent of all groupings). > > CDL tries to be more abstract, but personally, file systems > are so important to deployment/configuration that its > important to have a good way to model them. We end up having > components which do nothing but map a platform independent > filename into a platform-specific one, setting a lazy > attribute to the final, absolute value at deployment time. > > > > Tschuss, > -Steve > > > -----Original Message----- > > From: Milojicic, Dejan S (HP Labs) > > Sent: 21 February 2006 14:08 > > To: Mumtaz Siddiqui; scrumb(a)ggf.org > > Cc: Loughran, Steve; Alex Villazon > > Subject: RE: CDL schema/API > > > > Hi Mumtaz, > > > > Sorry for the confusion, I was suggesting that you talk to Steve > > Loughran (cc-ed), not Steve Crumb. > > > > Thanks, > > > > Dejan. > > > > > -----Original Message----- > > > From: Mumtaz Siddiqui [mailto:mumtaz@dps.uibk.ac.at] > > > Sent: Tuesday, February 21, 2006 4:55 AM > > > To: scrumb(a)ggf.org > > > Cc: dejan(a)hpl.hp.com; Alex Villazon > > > Subject: CDL schema/API > > > > > > Dear Steve Crumb, > > > > > > I presented my work about GLARE in first session of CDDLM > at GGF16. > > > GLARE provides XML based software component description and > > automatic > > > deployments framework. > > > > > > Currently we are using simple XML documents for software > component > > > descriptions, but as Dr. Dejan Milojicic suggested, we > > would like to > > > use CDL for descriptions and deployment specifications > > sometime later. > > > > > > I could not find CDL schema and APIs (including Java stubs) > > on CDDLM > > > homepage. > > > May I request for a copy of schema as well as APIs? > > > > > > Thanks with best regards > > > mumtaz > > > > > > -- > > > http://dps.uibk.ac.at/~mumtaz > > > > > > > > >

1 0

FW: UFCG Demo
by Milojicic, Dejan S (HP Labs) 21 Feb '06

21 Feb '06

Hi Hiro, You asked what was the percentage of the new functionality in the UFCG demo compared to Boston. Please find Ayla's answer. I cc OGSA because of some other participants in the meeting. Thanks, Dejan. ________________________________ From: Ayla Débora [mailto:ayladebora@gmail.com] Sent: Monday, February 13, 2006 6:52 PM To: Milojicic, Dejan S (HP Labs) Cc: Rafaeli, Sandro; Saikoski, Katia (HP Brazil) Subject: Re: UFCG Demo Hi Dejan, Regarding the demo questions, in this demo we have explored notifications, which was not explored in the other one. Besides that, we have also explored deployment in more than a single node, using hostname hints. We have also included in CDDLM Web some other functionalities from CDDLM like the WSRF ones, but I did not include in the demo to avoid making it take more time than that. The version from the demo is also more stable than the previous one and has incorporated adjustments due to CDL changes and new tests that have pointed out misunderstandings. Thanks, Ayla PS: As we are having problems with the UFCG mailing server since Friday, please use this email address to contact me when necessary. On 2/13/06, Milojicic, Dejan S (HP Labs) <dejan.milojicic(a)hp.com> wrote: Thanks Ayla, Demo went well, people liked it (some, in a positive manner suggested that you could have added voice; we did try to fill in the gap by talking to it, but we also did not want to take focus away from the demo itself). Hiro asked, percentage-wise, how much was the demo different from the one you gave in Boston. I answered that it was not much different functionality-wise, but that it was much different wrt stability and completeness. Do you have any different answer that I can provide to him? Thank, Dejan. ________________________________ From: Ayla Débora [mailto:ayladebora@gmail.com] Sent: Sunday, February 12, 2006 4:16 PM To: Milojicic, Dejan S (HP Labs) Subject: Re: UFCG Demo Hi Dejan, I'm glad you liked it. We are still planning the OVUA submission, but maybe I'll only be able to send you a version probably on Wednesday because we took more time than expected to make the architectural changes in our implementation to make paralelism work as expected and to prepare the demo. Thanks and have a nice time in Athens, Ayla On 2/12/06, Milojicic, Dejan S (HP Labs) <dejan.milojicic(a)hp.com> wrote: Hi Ayla, G ot it and ran it. It is excellent. Thanks, Dejan. PS Are you still planning the OVUA submission. If so, and if interested, you can send to me the version of the paper for review, although I might be busy with the conference. However, I would do my best to provide some feedback at minimum. ________________________________ From: Ayla Débora [mailto:ayladebora@gmail.com] Sent: Saturday, February 11, 2006 4:13 PM To: Milojicic, Dejan S (HP Labs) Subject: UFCG Demo Hi Dejan, sorry for the delay. I just finished now the presentation. Please let me know if you want me to make any changes to the text or if you have any doubts or suggestions. I've generated a flash presentation that can be downloaded from: http://www.lsd.ufcg.edu.br/~ayla/cddlm/ufcg_demo.zip <http://www.lsd.ufcg.edu.br/%7Eayla/cddlm/ufcg_demo.zip> . For the presentation, you will need a browser with a Flash plugin. Please confirm when you download the file. Thanks, Ayla

2 1

RE: BoF on Interoperability Fests at GGF16
by Milojicic, Dejan S (HP Labs) 14 Feb '06

14 Feb '06

Hi Stephen, Thanks for your email. Yes, we are profoundly interested in demonstrating interoperability since this is a requirement for any GGF spec to become a standard. We would like to attend the BoF and we would be glad to present the ways how we plan to demonstrate interoperability. It will be a good learning for all sides, I expect. Thanks for the offer, we will be glad to take it (my group cc-ed). Best regards, Dejan. > -----Original Message----- > From: Stephen M Pickles [mailto:Stephen.Pickles@manchester.ac.uk] > Sent: Tuesday, February 07, 2006 9:00 AM > To: Milojicic, Dejan S (HP Labs) > Subject: BoF on Interoperability Fests at GGF16 > > Hi Dejan, > > I noticed that one of the CDDLM sessions at GGF16 is called > "Planning interoperability demonstrations at GGF17". > > May I draw your attention to a BoF on Interoperability Fests > on Wednesday afternoon (5:30): > http://www.ggf.org/gf/event_schedule/index.php?id=212 > It would be great if CDDLM could be represented in the discussions. > > If you also have experience of doing this kind of thing > before, and would be keen to share some good advice or > lessons learned in a short (10-15 minute) presentation, then > please let me know. I've still got room for one or two speakers. > > Best regards, > > Stephen > > ==================== Stephen M. Pickles ==================== > > Technical Director, Grid Operations Support Centre Software > Infrastructure Manager, RealityGrid Manchester Computing Room > G49.1, Kilburn Building > The University of Manchester tel: +44 161 275 5974 > Oxford Road fax: +44 161 275 6800 > Manchester M13 9PL stephen.pickles(a)manchester.ac.uk > >

2 1