Re: [SAGA-RG] planning for OGF-30 interop demo
Quoting [Yutaka Kawai] (Aug 11 2010):
Dear Andre,
From the top of my head, I would think that the following parties might be interested to team up resources (endpoints, code, people) to get things in place:
- VU Amsterdam - IN2P3, France - CCT, LSU - KEK/Naregi - RAL, UK
OK for KEK to use NAREGI. However,
A simple interop demo would be to submit the same job (NOT /bin/date) to a set of resources in the various infrastructures discovered via SD, from various tools. A job submitted via python for example should be monitorable from C++ tools, and output could be reaped via PySAGA-over-JSAGA, etc.
Using SD to discover NAREGI resources will be difficult at the demo. Certainly, we are developing SD adaptor for NAREGI now but the development and test cannot be completed by that time. In my understanding, SAGA has a prototype SD adaptor only for glite at this moment. Do you know how about other middlewares?
I do not know about any other sd adaptor. However, we do have a default adaptor in saga-core, which, at the moment, does nothing. We shouod certainly be able to extend that one to read service locations from a config file. Together with the gLite adaptor that should provide all we need for the demo. Hartmut, is that something you could take on?
Replica Management (not JSAGA?)
JSAGA supports Replica Management package for gLite-LFC, iRODS and SRB.
Great. Andre, Sylvain already has an iRODS replica adaptor for their JSAGA. Do you still need that adaptor for SAGA C++ at the demo? If so, we will try to complete the adaptor by then.
IMHO, iRods would be an excellent OGF demo backend, given the consistent and strong OGF participation of the iRods developers and users! Best, Andre.
Best regards, Yutaka
Yutaka Kawai ?????? ??? High Energy Accelerator Research Organization (KEK) Computing Research Center Tel: +81-(0)29-864-5200 (Ext: 4503) Fax: +81-(0)29-864-4402 E-Mail : yutaka.kawai@kek.jp
(2010/08/09 18:44), Andre Merzky wrote:
Hi all,
as most of you should now by now, we plan a SAGA interop demo for OGF30 in Brussels (http://www.ogf.org/OGF30/). In order to pull that off successfully, we need to start to define
- participants - scope - implementations to be used - interop demo scenario
From the top of my head, I would think that the following parties might be interested to team up resources (endpoints, code, people) to get things in place:
- VU Amsterdam - IN2P3, France - CCT, LSU - KEK/Naregi - RAL, UK
It would be great if each party could let us know explicitely if they are interested in participating! Did I miss anybody?
We have the following bits and pieces which may, or may not, play a role in the interop demo
implementations: JavaSAGA JSAGA SAGA-C++ PySAGA (over JavaSAGA) PySAGA (over JSAGA) SAGA-Python (over SAGA-C++) command line tools for most of the implementations
functionality: Job Submission (all) Data transfer / access (all) Advert Service (not JSAGA I think, not in PySAGA) Replica Management (not JSAGA?) Service Discovert (not in JSAGA? not in PySAGA)
backends: local (all) globus (all) ssh (all) aws (all?) glite (all?) bes (all?)
Infrastructures local institutions teragrid loni naregi What about European Grids?
Again, is there something I miss?
PySAGA appears to be a great integration point, and SAGA-C++ intents to support it very soon, too - but it is not sure that we manage to do that before OGF30.
A simple interop demo would be to submit the same job (NOT /bin/date) to a set of resources in the various infrastructures discovered via SD, from various tools. A job submitted via python for example should be monitorable from C++ tools, and output could be reaped via PySAGA-over-JSAGA, etc.
The above is just an initial input, to get the discussion and planning started. Please feed back, and complete the item lists above. Once we have those lists complete, we should be able to come up with some more or less realistic scenario.
I'll mirror thiss list on our wiki at GridForge, so that we can edit things in place. Feel free to discuss on the list though, I'll try to keep the thread in sytnc with the wiki.
Best, Andre.
-- Nothing is ever easy.
Dear Andre, OGF-30 is coming next month. Can you let us know the status of the demo plan? We need to prepare for that.
IMHO, iRods would be an excellent OGF demo backend, given the consistent and strong OGF participation of the iRods developers and users!
The prototype of the irods replica adaptor will be available by then. Best regards, Yutaka Yutaka Kawai 河井 裕 High Energy Accelerator Research Organization (KEK) Computing Research Center Tel: +81-(0)29-864-5200 (Ext: 4503) Fax: +81-(0)29-864-4402 E-Mail : yutaka.kawai@kek.jp (2010/08/11 18:09), Andre Merzky wrote:
Quoting [Yutaka Kawai] (Aug 11 2010):
Dear Andre,
From the top of my head, I would think that the following parties might be interested to team up resources (endpoints, code, people) to get things in place:
- VU Amsterdam - IN2P3, France - CCT, LSU - KEK/Naregi - RAL, UK
OK for KEK to use NAREGI. However,
A simple interop demo would be to submit the same job (NOT /bin/date) to a set of resources in the various infrastructures discovered via SD, from various tools. A job submitted via python for example should be monitorable from C++ tools, and output could be reaped via PySAGA-over-JSAGA, etc.
Using SD to discover NAREGI resources will be difficult at the demo. Certainly, we are developing SD adaptor for NAREGI now but the development and test cannot be completed by that time. In my understanding, SAGA has a prototype SD adaptor only for glite at this moment. Do you know how about other middlewares?
I do not know about any other sd adaptor. However, we do have a default adaptor in saga-core, which, at the moment, does nothing. We shouod certainly be able to extend that one to read service locations from a config file. Together with the gLite adaptor that should provide all we need for the demo.
Hartmut, is that something you could take on?
Replica Management (not JSAGA?)
JSAGA supports Replica Management package for gLite-LFC, iRODS and SRB.
Great. Andre, Sylvain already has an iRODS replica adaptor for their JSAGA. Do you still need that adaptor for SAGA C++ at the demo? If so, we will try to complete the adaptor by then.
IMHO, iRods would be an excellent OGF demo backend, given the consistent and strong OGF participation of the iRods developers and users!
Best, Andre.
Best regards, Yutaka
Yutaka Kawai ?????? ??? High Energy Accelerator Research Organization (KEK) Computing Research Center Tel: +81-(0)29-864-5200 (Ext: 4503) Fax: +81-(0)29-864-4402 E-Mail : yutaka.kawai@kek.jp
(2010/08/09 18:44), Andre Merzky wrote:
Hi all,
as most of you should now by now, we plan a SAGA interop demo for OGF30 in Brussels (http://www.ogf.org/OGF30/). In order to pull that off successfully, we need to start to define
- participants - scope - implementations to be used - interop demo scenario
From the top of my head, I would think that the following parties might be interested to team up resources (endpoints, code, people) to get things in place:
- VU Amsterdam - IN2P3, France - CCT, LSU - KEK/Naregi - RAL, UK
It would be great if each party could let us know explicitely if they are interested in participating! Did I miss anybody?
We have the following bits and pieces which may, or may not, play a role in the interop demo
implementations: JavaSAGA JSAGA SAGA-C++ PySAGA (over JavaSAGA) PySAGA (over JSAGA) SAGA-Python (over SAGA-C++) command line tools for most of the implementations
functionality: Job Submission (all) Data transfer / access (all) Advert Service (not JSAGA I think, not in PySAGA) Replica Management (not JSAGA?) Service Discovert (not in JSAGA? not in PySAGA)
backends: local (all) globus (all) ssh (all) aws (all?) glite (all?) bes (all?)
Infrastructures local institutions teragrid loni naregi What about European Grids?
Again, is there something I miss?
PySAGA appears to be a great integration point, and SAGA-C++ intents to support it very soon, too - but it is not sure that we manage to do that before OGF30.
A simple interop demo would be to submit the same job (NOT /bin/date) to a set of resources in the various infrastructures discovered via SD, from various tools. A job submitted via python for example should be monitorable from C++ tools, and output could be reaped via PySAGA-over-JSAGA, etc.
The above is just an initial input, to get the discussion and planning started. Please feed back, and complete the item lists above. Once we have those lists complete, we should be able to come up with some more or less realistic scenario.
I'll mirror thiss list on our wiki at GridForge, so that we can edit things in place. Feel free to discuss on the list though, I'll try to keep the thread in sytnc with the wiki.
Best, Andre.
Dear Yutaka, sorry for the late reply - the OGF demo preparations somehow slipped down in my TODO list... Quoting [Yutaka Kawai] (Sep 14 2010):
Dear Andre,
OGF-30 is coming next month. Can you let us know the status of the demo plan? We need to prepare for that.
As said in the previous mail, it might be simplest to aim for separate demos from the individual groups. That is much easier to orchestrate, and the setup effort is distributed amongst all of us that way. Also, as Sylvain says, we are able to show the broadness of the SAGA capabilities, which would be difficult if we had to agree on the least common denominator for a single demo. Does that make sense?
IMHO, iRods would be an excellent OGF demo backend, given the consistent and strong OGF participation of the iRods developers and users!
The prototype of the irods replica adaptor will be available by then.
That is great news! :-D I'm quite sure that some SRM and iRods people will be in Brussels - we should invite them over :-) Thanks, Andre.
Best regards, Yutaka
Yutaka Kawai ?????? ??? High Energy Accelerator Research Organization (KEK) Computing Research Center Tel: +81-(0)29-864-5200 (Ext: 4503) Fax: +81-(0)29-864-4402 E-Mail : yutaka.kawai@kek.jp
(2010/08/11 18:09), Andre Merzky wrote:
Quoting [Yutaka Kawai] (Aug 11 2010):
Dear Andre,
From the top of my head, I would think that the following parties might be interested to team up resources (endpoints, code, people) to get things in place:
- VU Amsterdam - IN2P3, France - CCT, LSU - KEK/Naregi - RAL, UK
OK for KEK to use NAREGI. However,
A simple interop demo would be to submit the same job (NOT /bin/date) to a set of resources in the various infrastructures discovered via SD, from various tools. A job submitted via python for example should be monitorable from C++ tools, and output could be reaped via PySAGA-over-JSAGA, etc.
Using SD to discover NAREGI resources will be difficult at the demo. Certainly, we are developing SD adaptor for NAREGI now but the development and test cannot be completed by that time. In my understanding, SAGA has a prototype SD adaptor only for glite at this moment. Do you know how about other middlewares?
I do not know about any other sd adaptor. However, we do have a default adaptor in saga-core, which, at the moment, does nothing. We shouod certainly be able to extend that one to read service locations from a config file. Together with the gLite adaptor that should provide all we need for the demo.
Hartmut, is that something you could take on?
Replica Management (not JSAGA?)
JSAGA supports Replica Management package for gLite-LFC, iRODS and SRB.
Great. Andre, Sylvain already has an iRODS replica adaptor for their JSAGA. Do you still need that adaptor for SAGA C++ at the demo? If so, we will try to complete the adaptor by then.
IMHO, iRods would be an excellent OGF demo backend, given the consistent and strong OGF participation of the iRods developers and users!
Best, Andre.
Best regards, Yutaka
Yutaka Kawai ?????? ??? High Energy Accelerator Research Organization (KEK) Computing Research Center Tel: +81-(0)29-864-5200 (Ext: 4503) Fax: +81-(0)29-864-4402 E-Mail : yutaka.kawai@kek.jp
(2010/08/09 18:44), Andre Merzky wrote:
Hi all,
as most of you should now by now, we plan a SAGA interop demo for OGF30 in Brussels (http://www.ogf.org/OGF30/). In order to pull that off successfully, we need to start to define
- participants - scope - implementations to be used - interop demo scenario
From the top of my head, I would think that the following parties might be interested to team up resources (endpoints, code, people) to get things in place:
- VU Amsterdam - IN2P3, France - CCT, LSU - KEK/Naregi - RAL, UK
It would be great if each party could let us know explicitely if they are interested in participating! Did I miss anybody?
We have the following bits and pieces which may, or may not, play a role in the interop demo
implementations: JavaSAGA JSAGA SAGA-C++ PySAGA (over JavaSAGA) PySAGA (over JSAGA) SAGA-Python (over SAGA-C++) command line tools for most of the implementations
functionality: Job Submission (all) Data transfer / access (all) Advert Service (not JSAGA I think, not in PySAGA) Replica Management (not JSAGA?) Service Discovert (not in JSAGA? not in PySAGA)
backends: local (all) globus (all) ssh (all) aws (all?) glite (all?) bes (all?)
Infrastructures local institutions teragrid loni naregi What about European Grids?
Again, is there something I miss?
PySAGA appears to be a great integration point, and SAGA-C++ intents to support it very soon, too - but it is not sure that we manage to do that before OGF30.
A simple interop demo would be to submit the same job (NOT /bin/date) to a set of resources in the various infrastructures discovered via SD, from various tools. A job submitted via python for example should be monitorable from C++ tools, and output could be reaped via PySAGA-over-JSAGA, etc.
The above is just an initial input, to get the discussion and planning started. Please feed back, and complete the item lists above. Once we have those lists complete, we should be able to come up with some more or less realistic scenario.
I'll mirror thiss list on our wiki at GridForge, so that we can edit things in place. Feel free to discuss on the list though, I'll try to keep the thread in sytnc with the wiki.
Best, Andre.
-- Nothing is ever easy.
Dear Andre, I know you are busy guy, thanks for your reply.
As said in the previous mail, it might be simplest to aim for separate demos from the individual groups. That is much easier to orchestrate, and the setup effort is distributed amongst all of us that way. Also, as Sylvain says, we are able to show the broadness of the SAGA capabilities, which would be difficult if we had to agree on the least common denominator for a single demo.
Does that make sense?
OK, I understand we will prepare individual demos. Are you planning our demos will be held only in SAGA workshop sessions or in some booths? If we use demo booths, should all equipment and environments for the demos be brought and prepared by each group? I mean we want to know whether some of them are secured by SAGA group or totally not. Regards, Yutaka Yutaka Kawai 河井 裕 High Energy Accelerator Research Organization (KEK) Computing Research Center Tel: +81-(0)29-864-5200 (Ext: 4503) Fax: +81-(0)29-864-4402 E-Mail : yutaka.kawai@kek.jp (2010/09/22 9:09), Andre Merzky wrote:
Dear Yutaka,
sorry for the late reply - the OGF demo preparations somehow slipped down in my TODO list...
Quoting [Yutaka Kawai] (Sep 14 2010):
Dear Andre,
OGF-30 is coming next month. Can you let us know the status of the demo plan? We need to prepare for that.
As said in the previous mail, it might be simplest to aim for separate demos from the individual groups. That is much easier to orchestrate, and the setup effort is distributed amongst all of us that way. Also, as Sylvain says, we are able to show the broadness of the SAGA capabilities, which would be difficult if we had to agree on the least common denominator for a single demo.
Does that make sense?
IMHO, iRods would be an excellent OGF demo backend, given the consistent and strong OGF participation of the iRods developers and users!
The prototype of the irods replica adaptor will be available by then.
That is great news! :-D I'm quite sure that some SRM and iRods people will be in Brussels - we should invite them over :-)
Thanks, Andre.
Quoting [Yutaka Kawai] (Sep 22 2010):
OK, I understand we will prepare individual demos. Are you planning our demos will be held only in SAGA workshop sessions or in some booths? If we use demo booths, should all equipment and environments for the demos be brought and prepared by each group? I mean we want to know whether some of them are secured by SAGA group or totally not.
I do not know if we'll have a demo booth available - will check with Joel. If so, a projector will likely be supplied by OGF or local staff - I don't think we need more than a laptop. I'd be happy to offer mine as a fixed entry point, but I guess that swapping laptops between demos should also be doable. Let me know which way you prefer. In case we do not have a booth, I think that laptop swapping is the simplest way - do you agree? Best wishes, Andre.
Regards, Yutaka
Yutaka Kawai ?????? ??? High Energy Accelerator Research Organization (KEK) Computing Research Center Tel: +81-(0)29-864-5200 (Ext: 4503) Fax: +81-(0)29-864-4402 E-Mail : yutaka.kawai@kek.jp
(2010/09/22 9:09), Andre Merzky wrote:
Dear Yutaka,
sorry for the late reply - the OGF demo preparations somehow slipped down in my TODO list...
Quoting [Yutaka Kawai] (Sep 14 2010):
Dear Andre,
OGF-30 is coming next month. Can you let us know the status of the demo plan? We need to prepare for that.
As said in the previous mail, it might be simplest to aim for separate demos from the individual groups. That is much easier to orchestrate, and the setup effort is distributed amongst all of us that way. Also, as Sylvain says, we are able to show the broadness of the SAGA capabilities, which would be difficult if we had to agree on the least common denominator for a single demo.
Does that make sense?
IMHO, iRods would be an excellent OGF demo backend, given the consistent and strong OGF participation of the iRods developers and users!
The prototype of the irods replica adaptor will be available by then.
That is great news! :-D I'm quite sure that some SRM and iRods people will be in Brussels - we should invite them over :-)
Thanks, Andre.
-- Nothing is ever easy.
Dear Andre, (2010/09/24 18:27), Andre Merzky wrote:
I do not know if we'll have a demo booth available - will check with Joel. If so, a projector will likely be supplied by OGF or local staff - I don't think we need more than a laptop. I'd be happy to offer mine as a fixed entry point, but I guess that swapping laptops between demos should also be doable. Let me know which way you prefer.
Umm, I think, that depends on how much space we have at the booth if such a booth is available. If we have a large space booth, we can demo in parallel so swapping laptops does not seems smart. If not so large, I prefer swapping PCs between demos because we can reduce some works to set up each environment. Also it might be possible that we will use more than one PCs for the demo (I'm not sure that at this moment).
In case we do not have a booth, I think that laptop swapping is the simplest way - do you agree?
Yes, for the same reason as above. BTW, Go and Yoshiyuki from KEK will join the SAGA workshops at the OGF30. I will not, sorry. Go is "go"ing to take over this discussion. Regards, Yutaka Yutaka Kawai 河井 裕 High Energy Accelerator Research Organization (KEK) Computing Research Center Tel: +81-(0)29-864-5200 (Ext: 4503) Fax: +81-(0)29-864-4402 E-Mail : yutaka.kawai@kek.jp
Quoting [Yutaka Kawai] (Sep 27 2010):
Dear Andre,
(2010/09/24 18:27), Andre Merzky wrote:
I do not know if we'll have a demo booth available - will check with Joel. If so, a projector will likely be supplied by OGF or local staff - I don't think we need more than a laptop. I'd be happy to offer mine as a fixed entry point, but I guess that swapping laptops between demos should also be doable. Let me know which way you prefer.
Umm, I think, that depends on how much space we have at the booth if such a booth is available. If we have a large space booth, we can demo in parallel so swapping laptops does not seems smart. If not so large, I prefer swapping PCs between demos because we can reduce some works to set up each environment. Also it might be possible that we will use more than one PCs for the demo (I'm not sure that at this moment).
It seems there won't be a booth available, so I assume we have a very simple setup like in our normal sessions. Best, Andre.
In case we do not have a booth, I think that laptop swapping is the simplest way - do you agree?
Yes, for the same reason as above.
BTW, Go and Yoshiyuki from KEK will join the SAGA workshops at the OGF30. I will not, sorry. Go is "go"ing to take over this discussion.
Regards, Yutaka
Yutaka Kawai ?????? ??? High Energy Accelerator Research Organization (KEK) Computing Research Center Tel: +81-(0)29-864-5200 (Ext: 4503) Fax: +81-(0)29-864-4402 E-Mail : yutaka.kawai@kek.jp
-- Nothing is ever easy.
participants (2)
-
Andre Merzky -
Yutaka Kawai