25

Hoping to get help and/or pique interest. I remember coming across the story online. A couple of system administrators are trying to track down an issue in a network, where a particular packet refuses to transmit across the network. The router keeps reporting no traffic, even though they're sending a packet. Eventually, they pull out an ancient router, stick it in the middle and discover that traffic is flowing, but being hidden by an AI that has embedded itself in all the modem devices' firmware.

0

1 Answer 1

27

This sounds like "Coding Machines" by Lawrence Kesteloot.

It starts with a trio of software developers investigating what appears to be a compiler bug. After a lengthy investigation (which is described in considerable detail) they discover that the compiler is "infected" with a mysterious code sequence that modifies programs as they are being compiled, potentially compromising all other programs on the system.

After some discussion, they perform the experiment you describe:

“I don’t know what it’s doing,” said Patrick. “I wonder if it’s sending stuff over the network.”

“We could check that with Wireshark,” said Dave, referring to the program that monitored network activity on a machine.

[...]

Patrick guessed what I was looking for and saw the reaction on my face when I had found it.

“I guess we can’t trust it,” he said.

“Trust what?” said Dave, coming back with a soda.

“Wireshark,” said Patrick. “It’s infected.”

[...]

“Whoa,” said Patrick. I looked over and the scope was showing a long stretch of activity. I looked back at the switch’s lights, which were dark.

Dave said, “You are not going to tell me that the switch is infected and hiding packets.”

“It is totally hiding packets,” said Patrick, staring at the activity on the scope and putting both hands on his head.

[...]

He came back with an old switch, from years earlier, and plugged it in. Its lights flickered in sync with the scope, to packets censored by Wireshark and the modern switch.

7
  • 11
    Ah! An application of "Reflections on Trusting Trust" (PDF - Ken Thompson, 1984)? Jan 9, 2021 at 11:36
  • Also it wasn't an AI... yet, but it was self-modifying code which was mindlessly evolving to stay hidden.
    – Vilx-
    Jan 9, 2021 at 20:38
  • @Vilx-: Actually, the story is a cute one, but completely unrealistic. Truly mindless self-modifying code cannot stay hidden and reveal itself only to one group of people.
    – user21820
    Jan 10, 2021 at 11:06
  • @user21820 - I know. I'm a computer programmer myself and completely realize that it's unrealistic. Evolution requires millions of trials and failures - and those failures would have been widely noticed. But the story was nicely written nonetheless and managed to send shivers down my spine, so thumbs up! :)
    – Vilx-
    Jan 10, 2021 at 12:07
  • @Vilx-: Indeed. I found it a really fun read too! =)
    – user21820
    Jan 10, 2021 at 12:58

Not the answer you're looking for? Browse other questions tagged or ask your own question.