Unable to update BIOS on Precision 3620 Tower [Solved]

I have been spending a few days trying to update the BIOS of a Precision 3620 Tower.
It was on BIOS update 1.3.6 and I have tried so many things that I don't remember what I have tried.
But I finally figured out what worked. Only manual BIOS update from the F12 menu worked and only if the update files didn't have dots in the name, if you download the file from Dell it shows up like this Precision_Tower_3620_1.3.8.exe and that did not work.
I had to change the file name to either update.exe or Precision_Tower_3620_1_3_8.exe and that finally worked.
Posting this to hopefully help people in the future.