I have a long torso, long arms and small boobs, so women's off-the-rack blazers never fit me properly. There is always too much room for the chest, the sleeves are too short, and the fitted cut flares out in the wrong place. I can occasionally pull off a women's blazer with rolled-up sleeves, teamed with a high-waisted skirt, but that's about it. That's why most of my blazers are from the men's section.
I'm lucky that I'm tall and slim, because it means that small men's slim-cut blazers work pretty well on me. No, they are not tailored to perfection, but at least they don't look completely ridiculous on me. The sleeves and the overall length fit me rather well (the sleeves are almost a tad too long), and more often than not, the top button still closes, just the way it's supposed to, according to menswear rules. But does it look like I'm wearing men's clothing?
I don't think so. It's a matter of teaming up the boys' items with garments that have smooth textures and pretty colors. It's only after you start paying attention to the details - like the side the buttons are on, or the coat tails, that anyone will notice. Not that I'd really care even if it was more obvious.