Temple Sinai was founded on December 2, 1953 during Chanukah, the Festival of Lights. Seven families acted as sponsors of the congregation. Within a few weeks, religious services were held regularly at the Portsmouth Woman's Club, Glensheallah; they were also held at the Portsmouth Coca-Cola Bottling Works and the Suburban Country Club.

The site on which Temple Sinai now stands at 4401 Hatton Point Rd comprises two acres. The deed to the land was acquired in January 1955, and the temple building's cornerstone was laid the next year. Within months, the first service was held at the temple's present location.

In the mid-1990s, Temple membership exceeded 100 member units. In 2004, the congregation celebrated Temple Sinai's 50th anniversary.