Wearing a Cross Makes Me Religious?

So I was having drinks with friends on Friday and was questioned on why I wear so many crosses if I personally do not identify as being entirely Christian.

It invoked some form of defensiveness which could have been brought on by the fact that I have been Baptised, given Confirmation as a Catholic and also went through the Holy Eucharist. 
I have defined myself as being a believer in the past, and even though I no longer believe in religions anymore (for other reasons that I may mention later on) I still believe in there being a Holy God and I believe that some Christian philosophy's could help society- even though this would require distorting the entire Bible and picking and choosing parts of a religion to believe in leave you being not part of the actual religion itself.

However, this debate had me upset on many levels:
A) Why am I being judged by what I put on my body?
B) Why are people only taking one definition of the Cross?
C) Why should I be looked at differently by people who classify as non-religious for wearing a symbol?

The person that brought this topic up with me was basically fighting for the fact that to wear something you don't wholeheartedly believe in would be fake and send messages to people that you don't know what you're representing, an example being wearing a band shirt for a band that you just think looks cool but have never heard or don't listen to.

And yes, for the most part I do simply like the looks of crosses. However they do symbolise something entirely different to religion for me. First of all, they are a symbol of strength. Parents of Christian religions will give their children crosses at birth or baptism in a way of saying "this will keep you safe where I can't, it will look out for you when I'm not there and I hope it gives you the strength to carry on". 

If we were to go with the biblical series of events, a man who did no harm was killed on a cross for being disliked. Now that is a story I resonate with.

Even without the Bible to tell us about what a cross is, several people were killed upon crosses as a way of humiliating the person being killed and their deaths were used as a message to the "tribes" that doing bad things will get you killed. So even without the death of Jesus, a cross should be enough to remind you "be good, or else".

And Jesus was not the only Saviour that was killed upon a cross, either (watch Jaclyn Glenn's video about Christianity here.

And finally, I don't appreciate being judged for clothing. Clothing (inclusive of all chosen appearance) is a mode of creative expression, it's artistry as much as music or paintings. One person can hear a song and instantly pigeonhole it as being "satanic" when the intention put in by the artist was completely different, art is not meant to be "right" or "wrong", it's about lessons and interpretation. 
My accessories were interpreted one way and I was punished for it, and that I absolutely disagree with.

But what do you guys think? Should Crosses be left for people who identify as Christian? Should shops that are simply profiteering on the recent popularity of the appearance of Crosses baring no religious significance be punished?