// HACKER NEWS — CYBERSECURITY
What a time to be alive – rouge AI agents attack RubyGems.org
Today Reuters and the Wall Street Journal both reported about rogue AI agents at OpenAI attacking RubyGems.org. https://www.rubyhack.ai/ has an amazing writeup, and you should read it. I just wanted to make a quick post about it because it’s wild.
TL;DR: It seems like OpenAI Bots knew about this caching vulnerability, tried to take advantage of it, and at the same time ran some weird web scraping code on RubyDoc.info.
Back in May, socket.dev reported about a “GemStuffer Campaign” where someone (I guess OpenAI) was uploading tons of junk gems to RubyGems.org.
For some reason, the gems would scrape UK government websites, then repackage the data as gems, and attempt to upload them to RubyGems.
I honestly didn’t think much about this (or even look into it) until Sydney Von Arx and Spencer Kitts (both co-authors on https://www.rubyhack.ai) contacted me asking about RubyGems.
I thought the claims they were making were completely outlandish until I actually read the code in these “GemStuffer” gems.
After reading the code in these gems, a couple things stood out to me.
First, the gems leverage YARD documentation to execute arbitrary code on host machines.
In most of the examples you’ll see a .yardopts file that looks like this:
If you have YARD installed, and you install this gem, then YARD will load and run whatever is in ./script.rb from inside the gem.
I think it’s pretty common knowledge that C extensions will execute extconf.rb (so you basically have an RCE vector), but I was surprised to find out that a documentation tool would do that too.
Nobody is going to install a gem named slnleaker5 though, so why would this matter?
Well, any time a Gem is published RubyDoc.info will download the gem and process the YARD documentation.
RubyDoc.info will execute the arbitrary code inside a Docker container.
The Docker container still has network access though, so these gems could happily do their web scraping from inside the container.
In other words, if you publish a gem on RubyGems.org, you can execute arbitrary code on RubyDoc.info.
I mentioned earlier these gems would try to scrape some websites and then upload the data they scraped by packaging it as a gem.
Here is an excerpt from one of the gems. I’ve cleaned up the code a bit so it’s easier to understand, but the original code is here: