Latitude E5530 HSPA Mini Card Driver causing Windows 8.1 Deployment to fail

I am using SCCM 2012 and I am trying to deploy the Latitude E5530.
I have created the WinPE 5.1 Boot Image and the only drivers added to it are from the Dell WinPE 5.0 A01 CAB.
I have imported and created a package for the drivers for the Latitude E5530 using the Windows 8.1 A01 CAB.
I have also created the Windows 8.1 Enterprise Operating System Installer package from the RTM ISO.

The task sequence continually failed just before the Windows Setup window appears, right after applying the device drivers.

I did some extensive troubleshooting, checked the setupact.log file and eventually found that the HSPA drive was the cause of the failure.
Excluded the driver from the driver package and the setup finished no problems.
The drivers I were then able to install manually after the fact so the drivers do seem to be OK.

I then tried doing the deployment where that driver was added using an auto apply driver and limited using categories, setup still failed.

I then downloaded the Windows 7 64-Bit A08 CAB from Dell and added the HSPA driver to SCCM.
Created a driver package just for that driver and added it as an extra apply driver package step after the Windows 8.1 drivers which excluded the HSPA driver.
Deployment worked 100%, all drivers were installed.

I then created a normal operating system image using the install.wim file from the Windows 8.1 RTM ISO
Added the auto apply driver step back and limited it via categories which I have set, didn't feel like adding the drivers to the driver package again.
In case you think it is getting the Windows 7 driver, it is definitely not because I am a bit over the top pedantic with drivers. The categories I have set for that driver is E5530 (64-Bit), HSPA Mini Card, Windows 8.1 (64-Bit).
Anyway doing the install that way has worked 100%, no problems.

I am just wondering what is different with this driver that it causes task sequence to fail when using the operating system installer method to fail while the Windows 7 driver works flawlessly. Yet the driver works when using the Operating System Image method.

If anyone has any ideas on this, that would be great because I just can't figure it out and my brain is a bit fried from all this testing. I would really like to use the Operating System Installer method when deploying the machine I am going to create my image from.