- pgi-wg - lists.ogf.org

OGF Data management : HTTP(S) and NFS have to be supported by Computing Services too
by Etienne URBAH 13 Mar '12

13 Mar '12

Paul, Thank you very much for your presentation about standardization in EMI middleware stacks for Data Management. The fact that various flavors of storage elements support (or will be supporting) HTTP(S) and NFS is very good news. But as far as I know, gLite does currently NOT accept HTTP(S) and NFS URLs as references for files in the Input Sandbox of gLite Jobs. So please disseminate HTTP(S) and NFS to the providers of Computing Services, and please ask them to accept such URLs as references for files in the Input Sandbox. Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr -----------------------------------------------------

1 0

REMINDER: OGF34 Oxford PGI/BES/JSDL/GLUE2 Session Today - 1:30pm in Theatre A
by Morris Riedel 13 Mar '12

13 Mar '12

All, just a gentle reminder about our joint group session [1] across PGI/BES/JSDL & GLUE2 today: Tuesday, March 13 1:30 pm - 3:00 pm Location: Lecture Theatre A The session aims to resolve some issues in re-using the XML GLUE2 rendering by other specs such as PGI/JSDL profiles. Several experts of GLUE2 will attend the session! Some initial supporting material for the discussion with 'issues' for the PGI group can be found here [2]. A broad participation from the community and the different OGF groups is appreciated! Take care, Morris [1] http://www.ogf.org/gf/event_schedule/index.php?id=2429 [2] https://forge.gridforum.org/sf/docman/do/downloadDocument/projects.jsdl-wg/… ------------------------------------------------------------ Morris Riedel Deputy Division Leader Federated Systems and Data (FSD) Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/SharedDocs/Personen/IAS/JSC/EN/staff/riedel_m.html

1 0

REMINDER: OGF34 Oxford GIN Session I TODAY - 11:00am in Theatre A
by Morris Riedel 13 Mar '12

13 Mar '12

All, just a gentle reminder for our first GIN session [1] at OGF34 today: Tuesday, March 13 11:00 am - 12:30 pm Location: Lecture Theatre A The following presentations/demos are on the agenda: (1) Welcome Morris Riedel (10 min) (2) "DEMO: SAGA and BES Interop with VENUS-C and UNICORE" Daniele Lezzi, Hakan Soncu, Shahbaz Memon, Andre Merzky (20+5 min) (3) "ExTENCI update - wide area filesystems for interoperation"" Dan Katz (15+5 min) (4) "Interoperability in XSEDE" Bastian Demuth, Andrew Grimshaw ~(20+5 min) A broad participation from the community is appreciated! Finally, I would like to draw your attention already on our second GIN session [2] on wednesday. Your co-chair, Morris [1] http://www.ogf.org/gf/event_schedule/index.php?id=2418 [2] http://www.ogf.org/gf/event_schedule/index.php?id=2469 ------------------------------------------------------------ Morris Riedel Deputy Division Leader Federated Systems and Data (FSD) Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/SharedDocs/Personen/IAS/JSC/EN/staff/riedel_m.html

1 0

Two documents for discussion in the BES session this week
by Andrew Grimshaw 11 Mar '12

11 Mar '12

All, Attached are two EARLY DRAFT documents for discussion this week in Oxford. A

1 0

PGI/BES/JSDL/GLUE2 TelCon: 2pm Today & Call-in Details & Agenda
by Morris Riedel 07 Oct '11

07 Oct '11

All, it seems with our doodle poll [1] we collaboratively agreed to have a telcon at: 2 p.m. today (1) Telcon-System and Screen-Sharing http://webconf.vc.dfn.de/ogf-pgi-wg/ No login is required. Just enter as 'guest' with your real world name. (2) Proposed agenda: (a) OGF33 Minutes Debrief and follow-up of actions (b) Progress check on agreed activities and next steps (c) Regular weekly telcon setup (d) AOB Let me know if I missed something. Your co-chair, Morris [1] Doodle http://www.doodle.com/k4a8sh335iaviect#table ------------------------------------------------------------ Morris Riedel Deputy Division Leader Federated Systems and Data (FSD) Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/SharedDocs/Personen/IAS/JSC/EN/staff/riedel_m.html

1 0

PGI/BES/JSDL/GLUE2 Telcon Doodle for This Week
by Morris Riedel 05 Oct '11

05 Oct '11

All, the availability from European and US participants is truly limited in this week, but we might find a slot on Friday that fits both time zones: http://www.doodle.com/k4a8sh335iaviect#table Please fill in the doodle until tomorrow (2011-10-06) evening. Your co-chair, Morris ------------------------------------------------------------ Morris Riedel Deputy Division Leader Federated Systems and Data (FSD) Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/SharedDocs/Personen/IAS/JSC/EN/staff/riedel_m.html

1 0

Re: [Pgi-wg] [jsdl-wg] PGI-BES-JSDL-GLUE2 Joint TelCon Calls
by Michel Drescher 01 Oct '11

01 Oct '11

Hi Morris, all, As some of you may already know, I am volunteering to co-chair the JSDL WG. However, I would need some help with getting up to speed as soon as possible. Once I have a picture on what is necessary I'd like to resume regular JSDL conference calls. Until then I'd be happy to piggy-back PGI calls, if you don't mind. :) Cheers, Michel On 29 September 2011 13:23, Morris Riedel <m.riedel(a)fz-juelich.de> wrote: > All, > > in checking the PGI minutes [1] kindly provided by Steve I may have > overlooked how we continue with our efforts. > > We agreed that after the EGI-TF we start with telcons and if no JSDL telcon > is happening, I start with PGI calls latest next week > again to get things going. > > As I was in SIENA at the PGI days at OGF33: what plans have been discussed > and who is organizing the next calls and when?! > > Take care, > Morris > > [1] > > http://forge.gridforum.org/sf/go/projects.pgi-wg/docman.root.meeting_materi… > > > > ------------------------------------------------------------ > Morris Riedel > Deputy Division Leader > Federated Systems and Data (FSD) > > Jülich Supercomputing Centre (JSC) > Info: > http://www.fz-juelich.de/SharedDocs/Personen/IAS/JSC/EN/staff/riedel_m.html > > > -- > jsdl-wg mailing list > jsdl-wg(a)ogf.org > http://www.ogf.org/mailman/listinfo/jsdl-wg > -- Stichting European Grid Initiative (EGI.eu) P.O. Box 41882, 1009 DB Amsterdam 140 Science Park, 1098 XG Amsterdam The Netherlands F: +31 (0)20 893 2007 M:+31 (0)6 303 726 55 Skype: michel.drescher.egi

3 2

PGI-BES-JSDL-GLUE2 Joint TelCon Calls
by Morris Riedel 29 Sep '11

29 Sep '11

All, in checking the PGI minutes [1] kindly provided by Steve I may have overlooked how we continue with our efforts. We agreed that after the EGI-TF we start with telcons and if no JSDL telcon is happening, I start with PGI calls latest next week again to get things going. As I was in SIENA at the PGI days at OGF33: what plans have been discussed and who is organizing the next calls and when?! Take care, Morris [1] http://forge.gridforum.org/sf/go/projects.pgi-wg/docman.root.meeting_materi… ------------------------------------------------------------ Morris Riedel Deputy Division Leader Federated Systems and Data (FSD) Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/SharedDocs/Personen/IAS/JSC/EN/staff/riedel_m.html

1 0

OGF33 PGI Sessions 1-3 Minutes on GridForge
by Steve Crouch 23 Sep '11

23 Sep '11

Hi All, Many thanks for all your comments, I've integrated them into the minutes. I've uploaded the revised minutes to the PGI-WG GridForge area at: http://forge.gridforum.org/sf/go/projects.pgi-wg/docman.root.meeting_materi… For any further corrections just let me know. Cheers Steve -- Dr Stephen Crouch, Software Architect, Software Sustainability Institute (SSI), School of Electronics and Computer Science, Room 4067, Level 4, Building 32, University of Southampton, Highfield, Southampton SO17 1BJ Tel: +44 (0)23 8059 8787 EMail: s.crouch(a)software.ac.uk Fax: +44 (0)23 8059 3045 WWW: http://www.ecs.soton.ac.uk/~stc

1 0

OGF PGI-JSDL : For resource requirements, proposal to use benchmarks as measurement units
by Etienne URBAH 22 Sep '11

22 Sep '11

Oxana, During OGF PGI Session 2 at OGF 33 on Wednesday 21 September 11:00-12:30, for JSDL resource requirements, we agreed to present a proposal for using benchmarks as measurement units. This relates to PGI requirement 115 traced at http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/ReqJD20 Practical Problem ----------------- For a given input data set, a user knows, by summing the CPU usage of individual cores, that his application needs 3 hours of CPU in total on a reference machine where the 'SPEC CFP 2006' floating point benchmark rates each CPU at 30. The user wants to send a Job running the same application on the same input data set. At Job submission time, the user is NOT able to know the 'SPEC CFP 2006' rating of the machine which will eventually run the Job. Still, the user wants to express in the Job Description document that the total CPU time limit for his Job must be large enough. Solution in English ------------------- The user does NOT know how well the applications of the 'SPEC CFP 2006' benchmark use multithreading. So, by security, this user rates each of the cores of his reference machine at maximum 30 'SPEC CFP 2006'. So, the total number of 'SPEC CFP 2006' operations needed by the Job is at most : 3 * 3600 * 30 = 324000 (s * 'SPEC CFP 2006') The user then wants to express following resource requirement in the Job Description document : Using the GLUE2 model, the 'MaxTotalCPUTime' attribute of the 'ComputingShare' entity must be at least 324000 divided by the 'Value' attribute of the 'Benchmark' whose 'Type' is 'cfp2006'. Solution in short human-readable pseudo-code -------------------------------------------- Job Definition: Job Description: Resource Requirements: GLUE2.ComputingShare.MaxTotalCPUTime >= 324000 / (GLUE2.Benchmark.Value where GLUE2.Benchmark.Type = 'cfp2006') Same solution in human readable pseudo-code with key=value statements --------------------------------------------------------------------- Job Definition: Job Description: Resource Requirements: Resource With Unit: Resource Reference = GLUE2.ComputingShare.MaxTotalCPUTime Lower Bounded Range = 324000 Resource Unit Reference = GLUE2.Benchmark.Type Resource Unit Name = 'cfp2006' Resource Unit Value = GLUE2.Benchmark.Value Simple solution in JSDL using a new 'jsdl+dx:BenchmarkType' element ------------------------------------------------------------------- This solution, which is simple for JSDL, requires that in the Execution Service, a reference to 'jsdl+dx:BenchmarkType' is hard-coded as a lookup from 'GLUE2.Benchmark.Type' to 'GLUE2.Benchmark.Value'. I also use the fact that : jsdl:TotalCPUTime == GLUE2.ComputingShare.MaxTotalCPUTime <jsdl:JobDefinition> <jsdl:JobDescription> ... <jsdl:Resources> <jsdl:TotalCPUTime> <jsdl:LowerBoundedRange> 324000.0 </jsdl:LowerBoundedRange> <jsdl+dx:BenchmarkType> cfp2006 </jsdl+dx:BenchmarkType> </jsdl:TotalCPUTime> </jsdl:Resources> ... </jsdl:JobDescription> </jsdl:JobDefinition> Complex solution in JSDL using a new 'jsdl+dx:ResourceWithUnit' element ----------------------------------------------------------------------- This solution, which is more complex for JSDL, provides the necessary information permitting the Execution Service to perform the lookup dynamically and prevents hard-coding. <jsdl:JobDefinition> <jsdl:JobDescription> ... <jsdl:Resources> <jsdl+dx:ResourceWithUnit> <jsdl+dx:ResourceReference> GLUE2.ComputingShare.MaxTotalCPUTime </jsdl+dx:ResourceReference> <jsdl:LowerBoundedRange> 324000.0 </jsdl:LowerBoundedRange> <jsdl+dx:ResourceUnitReference> GLUE2.Benchmark.Type </jsdl+dx:ResourceUnitReference> <jsdl+dx:ResourceUnitName> cfp2006 </jsdl+dx:ResourceUnitName> <jsdl+dx:ResourceUnitValue> GLUE2.Benchmark.Value </jsdl+dx:ResourceUnitValue> </jsdl+dx:ResourceWithUnit> </jsdl:Resources> ... </jsdl:JobDescription> </jsdl:JobDefinition> Thank you in advance for studying these proposals, and for providing comments and suggestions for improvement. Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr -----------------------------------------------------

1 0