So when you create new empty database on your server, it does not have default filegroup named "PRIMARY"? That is unexpected as database scripts executed by configuration wizard are relying on its existence.
Could you try preparing empty database manually, create filegroup named "PRIMARY" in it, make it default and then point configuration wizard to that existing database instead of creating new one?
One more question: Is not this SQL server instance installed using case-sensitive collation?