Is stone worship allowed in Islam?

I have heard that, throughout history, Muslim invaders destroyed Hindu temples, and muslims had contempt towards stone worshippers. Always the two religions Christianity and Islam, that have spread all over the world, asserted superiority over smaller cultures. Worshipping Idols is one such practice Muslim invaders loathed and for this reason Hindu temples seems destroyed..

I wonder are not muslims worshipping idols? Ka aba in Mecca is a stone. The do circum ambulation (going around) the stone just like Hindus do while worshipping in temples. Yet, muslims ridicule hindu religious practices about stone worship..

“Tradition goes that the Kaaba was ordained by Allah to be built in the shape of the House in Heaven called Baitul Ma’amoor. Allah in his infinite Mercy ordained a similar place on earth and Prophet Adam was the first to build this place.”

Muslims pray God without figure. Yet Allah, the God seems to be residing in a house in the heaven whose shape is emulated in Ka aba.
What is the real difference between Hindu and Muslim Gods? Replacement of hundreds or idols with single idol is good for cultural unification anyway and reduce wars between followers of different God worshippers. No other difference..