You say that kaaba is purely for directional purposes and is not a religious monument/symbol. then please expalin the following verses from hadiths.
Hadith Sahih Volume 2, Book 26, Number 750
The Prophet performed Tawaf of the Kaaba on his arrival (at Mecca); he touched the (Black Stone) corner first of all and then did Ramal (fast walking with moving of the shoulders) during the first three rounds round the Kaaba, and during the last four rounds he walked .
Hadith Sahih Bukhari Volume 2, Book 26, Number 671: Narrated Ibn Abbas:
When Allahs Apostle came to Mecca, he refused to enter the Kaaba with idols in it. He ordered (idols to be taken out). So they were taken out. The people took out the pictures of Abraham and Ishmael holding Azlams in their hands. Allahs Apostle said, "May Allah curse these people. By Allah, both Abraham and Ishmael never did the game of chance with Azlams." Then he entered the Kaaba and said Takbir at its corners.
Hadith Sahih Bukhari Volume 2, Book 26, Number 673: Narrated Salim that his father said:
I saw Allahs Apostle arriving at Mecca; he kissed the Black Stone Corner first while doing Tawaf and did ramal in the first three rounds of the seven rounds (of Tawaf).
The above verses prove that the kaaba is much more than a directional sign post.