n the 19th century, the estate at Kėdainiai came under the ownership of General Eduard Totleben, a Russian army general. He reconstructed the manor, redesigned, and adorned the park, creating one of Lithuania's earliest and most beautiful landscape parks. Around 1880, in remembrance of his campaigns against Turkey, a pavilion, mosque, and minaret (28 m tall) were erected in the park. These structures were built with sentimental ties to the Balkans.

In 1944, the manor was destroyed by the Germans, but the minaret miraculously survived. From this minaret, the owner of Kėdainiai and its surroundings would showcase the park and his estates to guests. Inside the mosque and pavilion, General Totleben kept items commemorating his past achievements. Today, the minaret stands as the sole separate minaret in Lithuania, a testament to its rich historical and cultural significance

On the southeastern wall of the minaret, there is a plaque in Ottoman Turkish, which translates to: "These magnificent mansions, captivating with their charm and resembling paradise, were built by the greatness of the Ottoman Sultan. He adorned these splendid mansions so beautifully that even heaven has never seen more beautiful and magnificent."

Above the door, there is an inscription in Arabic, taken from Quran, verse 255 of Surah Al-Baqarah, which translates to: "Who is it that can intercede with Him except by His permission?"