Microsoft AVD Authentication Timeout

Our organization currently uses Citrix but we're testing Microsoft AVD as a potential replacement solution. I have a new Group setup in WMS where i changed the Broker settings from Citrix to Azure. 

When this is applied to the thin client, immediately a microsoft login box pops up over the Dell Login UI. That URL is pointing to login.microsoftonline.com. If no user enters credentials in that login window for a while (I believe it's 30-60min), the next person who tries to login receives the following message "Sorry, your sign-in timed out. Please sign in again." 

At that point the user can type their credentials in again and it successfully authenticates them. My worry is that we'll have this happen to the first user who logs into each thin client every single morning and throughout the day as the thin clients set idle. 

There aren't many options you can set for the Azure broker. I was wondering if anyone else has come across this and has a potential solution?