Sadiq Khan warns of potential chaos caused by fabricated AI audio impersonating him

London Mayor Sadiq Khan has expressed concerns about the rise of deepfake audio technology and called for updated laws to address the issue. He made these comments after a clip of a deepfake audio recording, featuring him making inflammatory remarks, went viral. The audio creator behind the clip has not faced any consequences, leading Mr Khan to criticize the current legal framework. The fake audio, which used artificial intelligence to replicate Mr Khan's voice, included derogatory remarks about Remembrance weekend and expressed support for pro-Palestinian marches. The clip spread rapidly, leading to a spike in hateful comments against the mayor on social media. Mr Khan expressed his worry about the potential impact of deepfake audio in various situations, such as elections or community unrest. He emphasized that while criticism is acceptable, using AI to spread false information is not. In response to the incident, Mr Khan called for organizations like the Electoral Commission to have more powers to tackle fake information, as current UK criminal laws do not specifically cover deepfake scenarios. He also expressed concern about social media companies' lack of action in addressing the spread of the fake audio.