A historic Manhattan synagogue celebrated its rebirth Sunday after a renovation that took more than 20 years and cost $20 million.