Yeah sure - you can easily remove it. Just "Edit this page" for the site homepage, and go tothe Layout tab, then move the Contact Information includelet into trash (or into scratch, if you don't want it to be gone forever), and publish the change.

The Contact Information takes its data from the values you have in "Website Details" in the admin pages of your site.

There's more information on Includelets in the documentation.

Thanks

Joe - Voice Admin