Microsoft's Scott Hanselman open-sources gputaskman, a per-process GPU monitor that identifies local LLM processes
IT Home, citing NeoWin, says the tool shows per-process GPU use, memory, temperature, power, clocks, encoder and decoder activity and PCIe traffic, and for local LLMs shows model, runtime, quantisation, layers and memory.