This quote from Matthew 6: clearly shows that making a public issue of your beliefs or even the fruits of your faith are considered by Jesus to be the actions of heathens and hypocrites.

4.That thine alms may be in secret: and thy Father which seeth in secret himself shall reward thee openly.
5.And when thou prayest, thou shalt not be as the hypocrites are: for they love to pray standing in the synagogues and in the corners of the streets, that they may be seen of men. Verily I say unto you, They have their reward.
6.But thou, when thou prayest, enter into thy closet, and when thou hast shut thy door, pray to thy Father which is in secret; and thy Father which seeth in secret shall reward thee openly.
7.But when ye pray, use not vain repetitions, as the heathen do: for they think that they shall be heard for their much speaking.

Arguments over what sort of public displays that our nation permits should be left to the heathens. Let them be concerned with the form that the worldly culture takes. Christianity thrived and grew at a time when Christians risked being martyred, and it did so without any need for public displays of religious symbols. The gospels tell us that anyone wanting to grow spiritually will find what he needs to do so.

Matthew 7:
7: Ask, and it shall be given you; seek, and ye shall find; knock, and it shall be opened unto you:
8: For every one that asketh receiveth; and he that seeketh findeth; and to him that knocketh it shall be opened.