eResearch Doc

User Tools

Site Tools

You are here: start » hpc » slurm
hpc:slurm

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
hpc:slurm [2024/11/20 09:03] – [GPGPU jobs] Yann Sagonhpc:slurm [2025/07/25 10:18] (current) – [spart] Yann Sagon
Line 68: Line 68:
   * Special public partitions:   * Special public partitions:
     * ''debug-cpu'' - to test your CPU jobs and make sure everything works fine (max. 15 min)     * ''debug-cpu'' - to test your CPU jobs and make sure everything works fine (max. 15 min)
-    * ''debug-gpu'' - to test your GPU jobs and make sure everything works fine (max. 15 min)+    * ''public-interactive-gpu'' - Run interactive jobs or to test your GPU jobs and make sure everything works fine (max. 04h)
     * ''public-interactive-cpu'' - for interactive CPU jobs (max. of 6 cores for 8h)     * ''public-interactive-cpu'' - for interactive CPU jobs (max. of 6 cores for 8h)
     * ''public-longrun-cpu'' - for CPU jobs that don't need much resources, but need a longer runtime time (max. of 2 cores for 14 days)     * ''public-longrun-cpu'' - for CPU jobs that don't need much resources, but need a longer runtime time (max. of 2 cores for 14 days)
Line 113: Line 113:
 ^ Partition             ^Time Limit ^Max mem per core ^ ^ Partition             ^Time Limit ^Max mem per core ^
 |debug-cpu              |15 Minutes |full node memory | |debug-cpu              |15 Minutes |full node memory |
-|debug-gpu              |15 Minutes |full node memory |+|public-interactive-gpu |4 hours    |full node memory |
 |public-interactive-cpu |8 hours    |10GB             | |public-interactive-cpu |8 hours    |10GB             |
 |public-longrun-cpu     |14 Days    |10GB             | |public-longrun-cpu     |14 Days    |10GB             |
Line 126: Line 126:
 Minimum resource is one core. Minimum resource is one core.
  
-N.B. : no ''debug-gpu'', nor ''public-gpu'' partitions on Baobab, as there are only private GPU nodes.+N.B. : no ''public-interactive-gpu'', nor ''public-gpu'' partitions on Baobab, as there are only private GPU nodes.
  
  
Line 137: Line 137:
 ^ Partition             ^Time Limit^Max mem per core  ^default Mem Per core ^ ^ Partition             ^Time Limit^Max mem per core  ^default Mem Per core ^
 | private-<privatename> |7 Days    | full node memory | 3GB                 | | private-<privatename> |7 Days    | full node memory | 3GB                 |
- 
-To see details about a given partition, go to the web page https://baobab.unige.ch and click on the "status" tab. 
-If you belong in one of these groups, please contact us to request to have access to the correct partition as we have to manually add you. 
- 
  
  
Line 768: Line 764:
 If you want other information please see the sacct manpage. If you want other information please see the sacct manpage.
  
 +<note tip>by default the command displays a lot of fields. You can use this trick to display them correctly. Then you can move with left and right arrows to see the remaining fields
 +<code>
 +(yggdrasil)-[root@admin1 ~]$ sstat -j 39919765 --all | less -#2 -N -S
 +      1 JobID         MaxVMSize  MaxVMSizeNode  MaxVMSizeTask  AveVMSize     MaxRSS MaxRSSNode MaxRSSTask     AveRSS MaxPages MaxPagesNode   MaxPagesTask   AvePages     MinCPU MinCPUNode MinCPUTask     AveCPU   NTasks AveCPUFreq ReqCPUF>
 +      2 ------------ ---------- -------------- -------------- ---------- ---------- ---------- ---------- ---------- -------- ------------ -------------- ---------- ---------- ---------- ---------- ---------- -------- ---------- ------->
 +      3 39919765.ex+    489808K         cpu095              0      5584K      1728K     cpu095          0      1728K        0       cpu095              0          0   00:00:00     cpu095          0   00:00:00        1      2.80M        >
 +      4 39919765.ba+   1298188K         cpu095              0   1298188K    599588K     cpu095          0    599588K     2511       cpu095              0       2511   00:39:25     cpu095          0   00:39:25        1       984K        >
 +</code>
 +
 +</note>
 ===== Energy usage ===== ===== Energy usage =====
 ==== CPUs ==== ==== CPUs ====
Line 795: Line 801:
 </code> </code>
  
-===== Job history ===== 
-You can see your job history using ''sacct'': 
  
-<code> 
-[sagon@master ~] $ sacct -u $USER -S 2021-04-01 
-       JobID    JobName  Partition    Account  AllocCPUS      State ExitCode 
------------- ---------- ---------- ---------- ---------- ---------- -------- 
-45517641        jobname  debug-cpu   rossigno          1     FAILED      2:0 
-45517641.ba+      batch              rossigno          1     FAILED      2:0 
-45517641.ex+     extern              rossigno          1  COMPLETED      0:0 
-45517641.0            R              rossigno          1     FAILED      2:0 
-45518119        jobname  debug-cpu   rossigno          1  COMPLETED      0:0 
-45518119.ba+      batch              rossigno          1  COMPLETED      0:0 
-45518119.ex+     extern              rossigno          1  COMPLETED      0:0 
-</code> 
- 
- 
- 
-===== Report and statistics with sreport ===== 
- 
-To get reporting about your past jobs, you can use ''sreport'' (https://slurm.schedmd.com/sreport.html). 
- 
-Here are some examples that can give you a starting point : 
- 
-To get the number of jobs you ran (you <=> ''$USER'') in 2018 (dates in yyyy-mm-dd format) : 
- 
-<code console> 
-[brero@login2 ~]$ sreport job sizesbyaccount user=$USER PrintJobCount start=2018-01-01 end=2019-01-01 
- 
--------------------------------------------------------------------------------- 
-Job Sizes 2018-01-01T00:00:00 - 2018-12-31T23:59:59 (31536000 secs) 
-Units are in number of jobs ran 
--------------------------------------------------------------------------------- 
-  Cluster   Account     0-49 CPUs   50-249 CPUs  250-499 CPUs  500-999 CPUs  >= 1000 CPUs % of cluster  
---------- --------- ------------- ------------- ------------- ------------- ------------- ------------  
-   baobab      root           180            40             4            15             0      100.00% 
-</code> 
- 
-You can see how many jobs were run (grouped by allocated CPU). You can also see we  specified an extra day for the //end date// ''end=2019-01-01'' in order to cover the whole year : 
-<code>Job Sizes 2018-01-01T00:00:00 - 2018-12-31T23:59:59''</code> 
- 
-You can also check how much CPU time (seconds) you have used on the cluster between since 2019-09-01 : 
- 
-<code console> 
-[brero@login2 ~]$ sreport cluster AccountUtilizationByUser user=$USER start=2019-09-01 -t Seconds 
--------------------------------------------------------------------------------- 
-Cluster/Account/User Utilization 2019-09-01T00:00:00 - 2019-09-09T23:59:59 (64800 secs) 
-Usage reported in CPU Seconds 
--------------------------------------------------------------------------------- 
-  Cluster         Account     Login     Proper Name     Used   Energy  
---------- --------------- --------- --------------- -------- --------  
-   baobab        rossigno     brero   BRERO Massimo     1159        0  
-</code> 
- 
-In this example, we added the time ''-t Seconds'' parameter to have the output in seconds. //Minutes// or //Hours// are also possible. 
- 
-Please note : 
-  * By default, the CPU time is in Minutes 
-  * It takes up to an hour for Slurm to upate this information in its database, so be patient 
-  * If you don't specify a start, nor an end date, yesterday's date will be used. 
-  * The CPU time is the time that was allocated to you. It doesn't matter if the CPU was actually used or not. So let's say you ask for 15min allocation, then do nothing for 3 minutes then run 1 CPU at 100% for 4 minutes and exit the allocation, then 7 minutes will be added to your CPU time. 
- 
-Tip : If you absolutely need a report including your job that ran on the same day, you can override the default end date by forcing tomorrow's date : 
- 
-<code> 
-sreport cluster AccountUtilizationByUser user=$USER start=2019-09-01 end=$(date --date="tomorrow" +%Y-%m-%d) -t seconds 
-</code> 
  
  
Line 867: Line 807:
  
 ==== spart ==== ==== spart ====
 +
 +<note warning>This tool isn't working anymore and it seems a dead project</note>
  
 ''spart'' (( https://github.com/mercanca/spart )) is a tool to check the overall partition usage/description. ''spart'' (( https://github.com/mercanca/spart )) is a tool to check the overall partition usage/description.
hpc/slurm.1732093382.txt.gz · Last modified: (external edit)