By association with worldly people, one becomes devoid of truthfulness, cleanliness, mercy, gravity, spiritual intelligence, shyness, austerity, fame, forgiveness, control of the mind, control of the senses, fortune and all opportunities. One should not at any time associate with a coarse fool who is bereft of the knowledge of self-realization and who is no more than a toy animal in the hands of a woman. The illusion and bondage that accrue to a man from attachment to any other object are not as complete as that resulting from association with a woman or with men too attached to women.
Kapiladeva, an incarnation of the Supreme Personality of Godhead, discusses pious and impious activities and the symptoms of those who are devoid of devotional service to Kṛṣṇa. Generally people do not know about the miserable conditions within the womb of a mother in any species of life. Due to bad association, one gradually falls into lower species. Association with women is greatly stressed in this regard. When one becomes attached to women or to those who are attached to women, one falls down into the lower species.
According to Vedic civilization, one’s association with women should be very much restricted. In spiritual life there are four āśramas-brahmacarya, gṛhastha, vānaprastha and sannyāsa. The brahmacārī, vānaprastha and sannyāsī are completely forbidden to associate with women. Only gṛhasthas are allowed to associate with women under certain very restricted conditions-that is, one associates with women to propagate nice children. Other reasons for association are condemned.
Ref >> Srila Prabhupada Vani.