It's really awful and unfair how people treating you. This is a good reminder that if other areas of one's life aren't fixed (for instance if money is still an issue), then not having children isn't necessarily going to make it better; it'll just mean fewer struggles.
But it is awful that people don't consider that being 40 can mean being in your prime, or don't understand that growing older doesn't necessarily mean... this sort of decay, everyone associates with this age.
At least you own your own home! There's always that.