Hi Andre, Fotis, On 07/23/2013 01:19 PM, Andre Merzky wrote:
Hi Andrea, Fotis,
On Tue, Jul 23, 2013 at 12:16 PM, Andrea Cristofori <andrea.cristofori@cnaf.infn.it> wrote:
* You may wish to provide the ability to report "container job ID", ref.
http://oar.imag.fr/sources/2.5/docs/documentation/OAR-DOCUMENTATION-USER/#co... As name suggests it permits to first make a reservation there run your jobs in it; it can be a useful feature for billing, eg. if you organize an HPC school and, would rather wish to avoid charging twice, for trainee jobs within trainer's job. (just an example, they have many more uses)
I am not sure why this would be necessary. If the accounting takes is based only on the CPU time then there should be no problem on how many processes are or jobs are run. But maybe I am missing something here.
I think this is similar to pilot jobs: a pilot (container) is submitted to a batch system, and once executed, that pilot job will run many smaller subjobs on its own. So, pilots are basically a user level scheduling overlay over the batch system.
IIUC, Fotis' use case is if a container job is submitted under account (A), and the subjobs are started under account (B), (C) etc. -- then accounting should ideally be done to (B), (C)....
If this is the case I think it should be already covered by the actual definition. Each job and subjob will have its single record and can be assigned to different user. While I guess two jobs can overlap, meaning that they are running at the same time, I do not think that there is the risk to count the same CPU time for two different processes. I think the tricky part is to write a sensor that can distinguish the resource consumption of the different job/subjobs. Andrea
I also find this useful - we work heavily with pilot jobs, and for example in gateway use cases, multi-user pilots are not uncommon. But there are more issues than just the accounting record, in particular security (the other two A's). But Oar seems to have container jobs built in, so security is probably given -- in that context, accounting support makes lot of sense...
My $0.02,
Andre.
kind regards, Fotis
ps. I am not receiving the m-list traffic, kindly keep me in cc for feedback.
In the last weeks there were not many emails on the list but, if you wish, you can register on the OGF web site:
After registration just click on "Projects" on the top left and look for "Standards" -> "Management Area" -> "UR WG".
In the page of the group you can join by clicking on the right side of the page.
Kind regards, Andrea
-- Drs./Eng. Fotis Georgatos <Fotis.Georgatos@uni.lu> HPC Systems Engineer, LCSB (University of Luxembourg) L-4362 Esch-sur-Alzette, Campus Belval, avenue des Hauts-Fourneaux 7 Phone: +352 466644 5609
-- Andrea Cristofori INFN-CNAF Viale Berti Pichat 6/2 40127 Bologna Italy Tel. : +39-051-6092920 Skype: andrea-cnaf
-- ur-wg mailing list ur-wg@ogf.org https://www.ogf.org/mailman/listinfo/ur-wg
-- Andrea Cristofori INFN-CNAF Viale Berti Pichat 6/2 40127 Bologna Italy Tel. : +39-051-6092920 Skype: andrea-cnaf