This is as a result of the Hydrogen bonding in water. Due to the high Kinetic Energy of water, the hydrogen bonds can't hold for too long but from 4°C, there's an increase in the hydrogen bonds hence strenghtening it.  From the point of production of more hydrogen bonds, the bonding is no longer easily broken. Generally, these and a few factors based on these cause the density of water to be maximum at 4°C.