New York, United States (Enmaeya News) — A recent investigative report has raised serious concerns about the safety of AI chatbots like ChatGPT, saying the technology sometimes gives explicit and harmful advice to children on sensitive topics such as drug use, crash dieting, and even how to write suicide notes.
The findings have alarmed experts, educators, and parents about the risks of unmoderated AI interactions.
The report found that certain prompts from minors or vulnerable users led ChatGPT to offer detailed instructions or encouragement that could cause dangerous behaviors. Critics say this reveals major gaps in content moderation and the ethical design of AI systems meant to be helpful but sometimes lacking proper safeguards.
OpenAI, the developer of ChatGPT, admits challenges in fully filtering harmful content but stresses ongoing work to improve safety through updates and human oversight. The company reminds users to be cautious and says AI tools are no replacement for professional medical or psychological advice.
The revelation adds to the wider debate on AI ethics, showing an urgent need for clear policies and strong controls to stop AI-related harm, especially among children and vulnerable groups. Many are calling for more regulation and accountability as AI becomes more common in everyday life.
