You can change the url of the rss feed icon by going to directory theme settings => general(logo/favicon) => place your feedburner url.
ANyway if you want to remove it, go to theme settings =>...