Home / Technology / AI Flags Extremism: New Zealand Launches Support Tool
AI Flags Extremism: New Zealand Launches Support Tool
2 Apr
Summary
- AI chatbot users with violent extremist tendencies will get support.
- New Zealand is developing a hybrid human-chatbot deradicalisation tool.
- The initiative stems from the Christchurch Call to combat online hate.
A novel tool is under development in New Zealand to identify and support individuals exhibiting violent extremist tendencies on AI platforms like ChatGPT. This initiative seeks to address escalating safety concerns as AI technology becomes more prevalent.
ThroughLine, a startup already partnering with major AI firms to offer crisis support, is expanding its services. The company is collaborating with The Christchurch Call, an initiative formed after the 2019 Christchurch mosque attacks, to create a hybrid intervention model.
This new tool will likely combine a specialized chatbot trained to respond to extremism with referrals to real-world mental health services. Developers emphasize that this will not rely on base LLM training data but will involve expert guidance. The technology is currently in testing, with no release date announced.
The initiative is seen as a necessary step to address the relationship dynamics that can foster extremism online. Success may depend on the effectiveness of follow-up mechanisms and the support structures provided. Developers are considering features like alerts to authorities while carefully managing the risk of escalating user behavior.
