U4919DW, KVM makes the kb/mouse not work, reboot is needed which causes BSOD

I have a U4919DW monitor and am using Dell Display Manager 2.1.

I have a laptop connected via USB-C and a desktop connected via DisplayPort. I have a kb/mouse plugged into the monitor which I use for both machines.

I have CTRL-ALT-[tilde key] as my hot key to swap between machines.

This works most of the time, but occasionally, when I switch back to the laptop, my mouse and keyboard don't register on the laptop anymore. The laptop kb/mouse still works, but not the one I plugged into my monitor. If I manually switch back to my desktop, the kb/mouse (plugged into monitor) work just fine, but when I switch to laptop the kb/mouse doesn't register. On the laptop DDM 2.1 says to plug in a supported monitor, on the desktop (which still works) DDM 2.1 reports it is connected to a supported monitor. The monitor shows the laptop's desktop/video just fine, it's just the kb/mouse not recognized. 

The only fix is to reboot, but the shut down process spins for 5 mins before showing a BSOD. After that the laptop says it has a dell supported monitor in DDM 2.1 and it works fine. I have tried to quit and re-load DDM 2.1 when the issue happens, but it doesn't work, it still says a dell supported display isn't plugged in. 

I have updated all of the software (DDM 2.1 updated on both machines) and I'm running the latest firmware on the monitor. 

Has anyone else experienced this and/or know the fix?