The Add as a Fav button is there if you don't already have it Favorited. So, anybody viewing your board that doesn't it marked will see it. Once added, we remove it from the screen to free up space. :)