[Info-vax] What choices are available to the OpenVMS Process Scheduler once all the CPUs are in use?

[sean at obanion.us]

We had an unusual beginning of Feb., where our typical heavy month end (of Jan.) pushed us to an unexpected 32 CUR processes (25 or so are typical for month end) for about 7 hours during the day, resulting in unusual performance. With a peak of about 120 COM processes (measured from PAWZ from PerfCap, and a typical value for month end), CPU utilization averaged below 20% (on Monitor System, CPU Busy reported 500-600% out of 3200). We observed that higher Priority processes, including internal connected users and external networked companies/services all expecting responses in 2-4 seconds had no complaints, but many reports in batch took 8 to 10 times as long as typical to complete.
Additionally, disk I/O rates and response times were good, paging rates were low and there was substantial memory on the free page list, and virtual IO cache (approximately 32 GB) appeared to be fully used.
 
We are on OpenVMS 8.4, patches to Update 10, BL870 (16 cores with Hyper threading enabled = 32 CPUs seen, as recommended by our Cache application vendor), 64GB memory, Fibre Channel to P9500 storage array, Cache 2010 database and applications.
 
We have engaged PerfCap, HP support, and our application vendor to understand what we measured and observed, including loading T4 onto a production scale test system to validate what PAWZ is saying and to try to replicate some of the issues.
 
But my question is:
 
What choices are available to the OpenVMS Process Scheduler once all the CPUs are in use?
And if (I suspect) the Scheduler was struggling to choose what processes to execute, how would it's efforts (CPU cycles) be reported/measured?


Sean