To make someone feel very happy.
The news of their engagement will overjoy their families.
To feel very happy about something.
They will overjoy at the sight of their newborn baby.