Though reps for the couple were not immediately available, sources revealed that the little boy will most probably be named Usher Raymond V, as the new father had said before the birth.
Usher, 29, and Foster, 36, announced the pregnancy in June, reports People magazine.
In September, Usher told the mag that they were expecting a boy.
He added: "I just want my son to fully be coherent and to be healthy, first and foremost."
The couple were married in a quiet civil ceremony in Atlanta on Aug. 3.