More than tariffs, fragmentation, high finance and logistics cost are challenging the apparel and textiles industry