This romantic classicism stonework church with one tower was built in 1803. This is the oldest Catholic (Piarist–Marian) house of worship in the city. In the beginning, the church services would only cover the monastery and the school. After the 1831 rebellion, the Russian authorities shut the Piarist monastery, the church and the gymnasium down. In 1847, the church was converted into a Byzantine Orthodox church. In 1918, the church was returned to the Catholics and was renovated by outfitting three altars, an organ and tearing down the Orthodox church turrets. In 1927, the bishop of Panevėžys handed the church over to Marians. Its rector, Rev. Jurgis Tilvytis decorated the interior of the church. The church was consecrated by the Bishop Kazimieras Paltarokas. The sanctum holds sculptures by Juozas Lebednykas and Alfridas Pajuodis.