From proving that ChatGPT can pass the Wharton School’s MBA test to tricking it into saying racist epithets, chatbots are a mirror into our souls and societies. What can the development community do to mitigate the risks of AI to human rights?