The Soldier's Synagogue was established in 1870. It is a brick building, with the eastern wall adorned with six windows topped with semi-circular arches. It is one of the oldest brick buildings in the town. Its walls were covered with plaster in the Soviet era, but fragments of the plaster have since cracked and fallen off, exposing the authentic red brick walls of the synagogue.

The construction was financed by the Jewish community. Before World War I, the synagogue was mostly used by the Jewish troops from the nearby garrison. It was converted into a sports hall during the Soviet occupation and the interior was stripped of all its original fittings. Therefore, no trace is left of the former appearance of the interior, nor is there any indication of the former location of the women’s courtyard. After Lithuania regained its independence, the building was returned to the Jewish community and sold. Today, it houses
a furniture store.