Veszprém Castle and its fortifications were built in two phases. The first was the hill part of the castle, the area of the cathedral and the bishop's palace. The further extension of the castle is not known.
In 1527, King John's followers stormed the castle and then occupied it. However, the imperialists soon recaptured it, as Bálint Török did with Veszprém in 1537. In the years that followed, however, the Spanish mercenaries of Ferninánd regained control of the castle.
In 1566, the imperial general Salm launched a campaign to retake the castles of the Transdanubian region. In the case of Veszprém, this was not difficult, as the fortress fell after a one-day siege. The bastions and walls were almost completely destroyed, so rebuilding and reinforcement were necessary. The reconstruction was carried out in 1570 on the basis of plans by Italian military engineers.
However, the reconstruction was not to be enjoyed for long, as in 1593 a Turkish army of 50,000 men destroyed the walls in a fiery attack and, fleeing the desperate defenders, took the castle without a fight.
The campaign to take the castle continued for several decades, but finally, in 1620, Pál Zichy came to power. In 1640, further alterations were made to strengthen the defences. After the conquest and the Rákóczi War of Independence, the defence function was lost due to the destruction of the castle by the Heister general groups.
In 1730, the walls between the inner and lower castle were demolished, and in the 18th century a new building process began, with the construction of a number of church buildings, Baroque-style civic buildings and palaces.