This is a reference for others who encounter the same issue.
Actually, this issue is related to regional setting in Windows Server 2012 and to fix it, download Locale Builder 2.0 and you can change the setting using this tools.
Again, thanks Will for your help.