Blockchain security firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API

Yu Xian, founder of the blockchain security firm Slowmist, has raised alarms about a rising threat known as AI code poisoning.

This attack type involves injecting harmful code into the training data of AI models, which can pose risks for users who depend on these tools for technical tasks.

The incident

The issue gained attention after a troubling incident involving OpenAI’s ChatGPT. On Nov. 21, a crypto trader named “r_cky0” reported losing $2,500 in digital assets after seeking ChatGPT’s help to create a bot for Solana-based memecoin generator Pump.fun.

However, the chatbot recommended a fraudulent Solana API website, which led to the theft of the user’s private keys. The victim noted that within 30 minutes of using the malicious API, all assets were drained to a wallet linked to the scam.

[Editor’s Note: ChatGPT appears to have recommended the API after running a search using the new SearchGPT as a ‘sources’ section can be seen in the screenshot. Therefore, it does not seem to be a case of AI poisoning but a failure of the AI to recognize scam links in search results.]

Further investigation revealed this address consistently receives stolen tokens, reinforcing suspicions that it belongs to a fraudster.

The Slowmist founder noted that the fraudulent API’s domain name was registered two months ago, suggesting the attack was premeditated. Xian furthered that the website lacked detailed content, consisting only of documents and code repositories.

While the poisoning appears deliberate, no evidence suggests OpenAI intentionally integrated the malicious data into ChatGPT’s training, with the result likely coming from SearchGPT.

Implications

Blockchain security firm Scam Sniffer noted that this incident illustrates how scammers pollute AI training data with harmful crypto code. The firm said that a GitHub user, “solanaapisdev,” has recently created multiple repositories to manipulate AI models to generate fraudulent outputs in recent months.

AI tools like ChatGPT, now used by hundreds of millions, face increasing challenges as attackers find new ways to exploit them.

Xian cautioned crypto users about the risks tied to large language models (LLMs) like GPT. He emphasized that once a theoretical risk, AI poisoning has now materialized into a real threat. So, without more robust defenses, incidents like this could undermine trust in AI-driven tools and expose users to further financial losses.

Mentioned in this article

#Blockchain #security #firm #warns #code #poisoning #risk #OpenAIs #ChatGPT #recommends #scam #API

News plays a pivotal role in our lives by keeping us informed and connected to the world. It serves as a critical source of information, offering updates on current events, politics, economics, science, and more. Through news, we gain awareness of global issues and local developments, helping us make informed decisions in our personal and professional lives. News also fosters discussion and debate, encouraging critical thinking and perspective-taking. Moreover, it promotes transparency and accountability among governments, businesses, and other institutions. In a rapidly changing world, staying updated with the news enables us to adapt to new challenges and opportunities, shaping our understanding of the complexities of society. Ultimately, news is not just about information; it empowers us to participate actively in the world around us, contributing to a more informed, engaged, and responsible global citizenry.

Health is fundamental to our well-being and quality of life, making it an essential aspect of daily existence. It encompasses physical, mental, and emotional aspects, influencing our ability to function effectively and enjoy life fully. Prioritizing health allows individuals to maintain optimal physical fitness, reducing the risk of diseases and promoting longevity. Mental health, equally crucial, affects our cognitive abilities, emotional stability, and overall happiness. Investing in preventive healthcare through exercise, balanced nutrition, and regular medical check-ups helps in early detection of potential health issues, ensuring timely intervention and treatment. Beyond individual benefits, a population’s health impacts societal productivity and economic stability. Governments and organizations worldwide emphasize public health initiatives to address pandemics, health disparities, and promote overall well-being. Ultimately, health serves as the foundation upon which we build our lives, influencing our ability to pursue goals, nurture relationships, and contribute meaningfully to society.

Money plays a crucial role in our lives as a means of financial security and freedom. It enables us to meet basic needs such as food, shelter, and healthcare, while also providing opportunities for education, travel, and personal growth. Beyond material comforts, money facilitates social connections and experiences that enrich our lives. It empowers individuals to invest in their futures, whether through savings, investments, or entrepreneurial ventures, thereby fostering economic stability and growth. However, the pursuit of wealth should also be balanced with ethical considerations, as money can influence relationships and societal dynamics. Responsible management of finances is key to achieving long-term goals and mitigating financial stress. Ultimately, while money is a tool for achieving aspirations and fulfilling desires, its true value lies in how it is utilized to improve both personal well-being and the broader community.



Earning Easy Money in 2024: Opportunities and Considerations 💸

In 2024, the landscape of earning easy money presents diverse opportunities, albeit with considerations. The digital age offers platforms for freelancing, online trading, and e-commerce, allowing individuals to leverage skills and creativity for financial gain. Cryptocurrency investments continue to allure with potential for quick profits, yet they entail high volatility and risk. Moreover, the rise of the gig economy enables flexible work arrangements through apps and websites, offering quick payouts but often without job security or benefits. Passive income streams such as rental properties and investments in stocks or bonds remain viable, but demand initial capital and ongoing management. Amid these options, caution is essential to avoid scams and unsustainable ventures promising overnight success. Ultimately, while the allure of easy money persists, informed decisions, diligence, and a long-term perspective are crucial for sustainable financial growth and security in the dynamic year ahead.