The Kaaba caught fire and was burned down during the Siege of Mecca.

Source