I wish I had better/less hazy details for you. I think one of the things one of the engineers mentioned was getting Bay Trail's power management to work with Android, or something to that effect. I also remember one of the tests in the Vellamo suite didn't run (OpenCL?).
All I know is, as of early September, the Android software stack for Bay Trail wasn't ready.
An early Intel comment on this mentioned core affinity. They had to modify Android initially for Clover Trail+ to recognize the 2 real cores amongst the 2 virtual ones. I suspect Bay Trail meant undoing/modifying some of this Android work to recognize 4 real cores and 0 virtual cores. Core affinity is something AMD had to sort out with MSFT for Bulldozer too.
re: Is there any information on what the issue is with Baytrail driver
I'm not sure about this but it looked to me like they were recoding some stuff to use x32 mode (64 bit mode but using 32 bit addresses) instead of the standard 32 bit mode. This would improve the cpu performance a bit to properly beat the current ARM lineup instead of people just going meh. The graphics are the main problem though.