in order to see the details of all the nodes you can use: scontrol show node For an specific node: scontrol show node “nodename” And for the cores of job you can use the format mark %C, for instance: squeue -o”%.7i %.9P %.8j %.8u %.2t %.10M %.6D %C” More info about format.
Found an approach, enter scontrol interpreter (in command line type scontrol) and then scontrol: update NodeName=node10 State=DOWN Reason=”undraining” scontrol: update NodeName=node10 State=RESUME Then scontrol: show node node10 displays amongst other info State=IDLE Update: some of these nodes got DRAIN state back; noticed their root partition was full after e.g. show node a10 which showed Reason=SlurmdSpoolDir … Read more
A job consists of one or more steps, each consisting of one or more tasks each using one or more CPU. Jobs are typically created with the sbatch command, steps are created with the srun command, tasks are requested, at the job level with –ntasks or –ntasks-per-node, or at the step level with –ntasks. CPUs … Read more
It means no further job will be scheduled on that node, but the currently running jobs will keep running (by contrast with setting the node down which kills all jobs running on the node). Nodes are often set to that state so that some maintenance operation can take place once all running jobs are finished. … Read more
You should use the format option, with: sacct –helpformat you’ll see the parameters to show, for instance: sacct –format=”JobID,JobName%30″ will print the job id and the name up to 30 characters: JobID JobName ———— —————————— 19009 bash 19010 launch.sh 19010.0 hydra_pmi_proxy 19010.1 hydra_pmi_proxy Now, you can to customize your own output.
If your job is finished, then the sacct command is what you’re looking for. Otherwise, look into sstat. For sacct the –format switch is the other key element. If you run this command: sacct -e you’ll get a printout of the different fields that can be used for the –format switch. The details of each … Read more
Use the scontrol command to modify a job scontrol update jobid=<job_id> TimeLimit=<new_timelimit> Use the SLURM time format, eg. for 8 days 15 hours: TimeLimit=8-15:00:00 Requires admin privileges, on some machines. Will be allowed to users only if the job is not running yet, on most machines.