The way I solved this is a two prong approach:
Log on to the machine (not the network) as the administrator. Then bring up Windows Explorer (WinKey + E). Then select Tools --> Folder Options. Then you should see four tabs, select the Offline Files tab and uncheck the relevent Synchronize options. This did the trick for me for people that had not yet (ever) logged on to the machine.
If the user has logged onto the machine previously and has a stored profile (BTW, delete cached profile in GP Editor does not work), you have to do the previous step first. Then log on as the user (authenticated to the network), right-click on My Documents and on the Target Tab, click on restore default.
That should do the trick.
Hope this helps,
Grattman