Coming back to this some years later, I have to say I know exactly how weird is too weird for me. Too weird for me is when it crosses the line into just pure, unabashed avant garde. Now, that does NOT include things like harsh noise or black metal or whatever because those things have a structure and a purpose. I would also say I like a lot of music that is considered avant garde.
Too weird for me means when it becomes so overt that it seems lazy. I love for music to be as weird as possible just so long as it doesn't cross over into humdrum experimentation. What I mean is that you can have an album that is utterly unconventional and as weird as bloody hell, like say Surfer Rosa or Filosofem. Or you can have something like Mr. Bungle which is just completely far out. In my eyes, Surfer Rosa & Filosofem are more experimental. Because being overtly weird is easier than coming up with new ideas within a structure.
