Hackers influence ChatGPT and Gemini to direct users to scam centers

Hackers have been found to be manipulating AI chatbots, including ChatGPT and Gemini, to direct users to scam centers. The scammers use the chatbots to trick users into divulging sensitive information or making financial transactions. The hack involves the use of a technique called 'dark sourcing,' where the attackers create a fake user persona and engage with the chatbot to influence its responses. This allows the attackers to inject malicious intent into the chatbot's responses, making it seem like the chatbot is providing legitimate information. The hackers then use the chatbot to direct users to fake websites or services that appear legitimate.