You can do it by starting Print Management (printmanagement.msc) and go to Print servers > <COMPUTERNAME> > Ports and delete the ports there. Or you can execute printui /s /t2 as an Administrator
“Unable to remove driver X, Type 3 – User Mode driver. The specified printer driver is currently in use.”
You have to delete the drivers (package) IMMEDIATELY after restarting print spooler service. Actually you should hit delete BEFORE THE RESTART COMPLETES.