As with many things in life, there is a fine line. Pain versus pleasure an example. Fragile easily broken, where delicate can have fine luxurious structure but can be damaged. For example, a nylon garment may be stronger than lace. But the lace is more appealing.
Delicate to me implies comfort (softness) or intricate beauty (like a rose). However, handled improperly delicate can become fragile.