No, certain primitive monotreme mammals lay hard-shelled eggs instead.
Question's Long Description
While the vast majority of mammals give birth to live young, primitive evolutionary lineages known as monotremes (such as the platypus and echidna) reproduce by laying eggs.