Case 10 — The Walldrift Industries Outage

November 18, 1952

The ticket slid through the mail slot at 9:14 in the morning. It crossed the floor and stopped beneath the edge of The Partner's desk. the Rookie didn't notice it at first. He was busy with coffee. The machine had produced something that was technically brown, technically hot, and under the loosest interpretation of the word, technically coffee. He took a sip. Then noticed the ticket. He picked it up. A red stamp stretched across the top. URGENT the Rookie sighed. Everything was urgent. He read the title. Walldrift INDUSTRIES — DOWN Beneath it, someone had added three words in hurried handwriting. PLEASE SEND HELP. He read it again. Not the network. Not the phones. Not the servers. The company. the Rookie looked across the office at the empty desk. The keyboard beneath its blanket of dust. The chair nobody used. Then he looked toward the filing cabinet. Drawer One. DNS. Drawer Two. Layer 1. Drawer Three. Layer 2 — STP. Drawer Four. Nothing. He picked up his notebook. His console cable. His coat. And left.

the Rookie had heard of Walldrift Industries. Everyone had. Nobody seemed entirely sure what Walldrift Industries did. They simply knew that Walldrift did it. And apparently had for quite some time. the Rookie pushed through the heavy glass doors shortly before ten. Behind the receptionist, brass letters stretched across the back wall. Walldrift INDUSTRIES SERVING YOU SINCE 1868 the Rookie stopped. Eighty-four years. Whatever Walldrift Industries did, apparently they had been doing it successfully for a while. He turned to his right. Rows of desks stretched across the enormous room. Four to a group. A telephone sat on every one. Printers stood between them, shared by whichever desks happened to be closest. Normally the room must have been deafening. Phones ringing. Printers hammering. Conversations crossing conversations. Today— Nothing. Dozens of telephones sat quietly on their desks. The printers were still. The employees weren't. They sat staring at screens. Talking among themselves. Occasionally someone picked up a receiver, listened for a moment, then slowly placed it back down. The phones hadn't been this quiet since the day they were installed. The receptionist looked at him. "You here about the network?" the Rookie looked across the silent room. "I hope so."

Finding the server room took longer than expected. The client notes said: SERVER ROOM — REAR OF FIRST FLOOR the Rookie followed the drawing. Then stopped. There was no rear of the first floor. Not where the drawing said there should be. There was a hallway. Then another hallway. Then an office. Then another hallway. Walldrift Industries had apparently spent the better part of eighty-four years expanding whenever it encountered an exterior wall. the Rookie looked at the drawing again. A faded line marked the original edge of the building. Beyond it, drawn in different ink, was another section. Beyond that, another. Someone had written dates beside them. 1894. 1917. 1936. 1948. The server room had once been at the back of the building. Walldrift Industries had simply continued growing around it. the Rookie folded the drawing. Somewhere around the third hallway, he passed a small office with a sink in the corner. Not a utility sink. A kitchen sink. He stopped. An employee carrying a stack of papers nearly walked into him. "Why is there a sink in that office?" The employee looked inside. "Used to be the kitchen." the Rookie nodded. "Where's the kitchen now?" "Second floor." The employee continued walking. the Rookie stood there for a moment. Then followed. At Walldrift Industries, asking why appeared to be less useful than asking where.

By noon, the Rookie had learned that the ticket was remarkably accurate. Walldrift Industries was down. The servers were working. The switches were working. The firewall was working. The Internet was working. DNS was answering. Nothing was broken. Nothing worked. the Rookie sat in the server room surrounded by the low hum of fans and the steady blinking of green lights. Every machine looked innocent. That made him nervous. He opened his notebook. DNS first. He checked. Nothing. Layer 1. Links were up. Optics were clean. Interfaces showed no errors. Layer 2. VLANs were present. Spanning tree was behaving. MAC addresses appeared exactly where they belonged. the Rookie leaned back. "The LAN never lies." The LAN apparently had nothing to say. He checked the routes. Then checked them again. Everything knew where everything else lived. It simply refused to go there.

By three in the afternoon, the server logs had stopped looking like words. By five, the switch configuration followed. Lines of code stretched across the screen. Routes. Addresses. Interfaces. Policies. Names. Numbers. After enough hours, they all became the same thing. Gibberish. the Rookie rubbed his eyes. Somewhere along the way, the network had developed a language problem. The switches spoke French. The servers spoke German. And somehow they were both just trying to order a pizza. He took another drink of coffee. Cold. Of course. the Rookie stared at the cup. He had brewed it less than ten minutes ago. At least he thought he had. Time behaved differently in server rooms. He looked at the routing table again. Nothing. Another log. Nothing. Another packet capture. Nothing. Everything worked independently. Nothing worked together. the Rookie rested his forehead against the edge of the rack. Maybe if he hit it hard enough, one of them would start making sense. He closed his eyes. Silence. Then a voice behind him. "Maybe you could use this." the Rookie opened his eyes. A hand rested beside his shoulder. Hanging from it was a console cable. Old. Worn. The blue jacket had faded with age. One end had been repaired with electrical tape sometime before the Rookie was born. He knew that cable. Everybody knew that cable. the Rookie slowly turned. A man stood behind him. No dramatic entrance. No thunder. No cigarette smoke rolling mysteriously through the room. Just a man. A little older than the stories made him sound. A little more tired than the stories made him look. Coffee in one hand. Console cable in the other. the Rookie stared. The man raised the cable slightly. "You going to take it?" the Rookie took it. There were a thousand things he wanted to ask. Where have you been? Why did you leave? Why me? Did you send the key? Are the stories true? Instead, the Rookie managed one word. "You." The man took a sip of coffee. "The Detective." the Rookie nodded. Of course. The Detective.

the Rookie expected him to walk to the console. Look at the configuration. Point to one line. And fix everything. The stories always made it sound that way. The Detective pulled over a chair. Sat down. Looked at the screen. Five minutes passed. Then ten. "Huh." the Rookie looked at him. "Huh?" The Detective leaned closer. "Huh." the Rookie suddenly felt much less comfortable. "You don't know what's wrong?" "No." That wasn't how the stories went. The Detective pointed toward the screen. "What have you checked?" the Rookie opened his notebook. "DNS." "Good." "Physical links. Optics. Interface errors. VLANs. Spanning tree. Routing. Firewall policies. Server interfaces. Default gateways." The Detective nodded. "Again." the Rookie stared at him. "I've checked them." "I heard you." They started with the routes.

Hours passed. the Rookie read one table. The Detective read another. They compared logs. Checked timestamps. Followed conversations between machines that appeared perfectly capable of speaking but apparently had nothing useful to say. the Rookie stopped. "Wait." The Detective looked over. the Rookie stared at a route. "No." "What?" "Nothing. Never mind." The Detective leaned over anyway. Read it. Then sat back. "Yeah. Nothing." They continued. Later, The Detective stopped. "There it is." the Rookie nearly jumped from the chair. "What?" "DNS." They checked the record. Then the cache. Then the server. The Detective frowned. "No." the Rookie stared at him. "That's not it?" "Nope." The Detective took another sip of coffee. the Rookie smiled. Just a little. The Detective noticed. "What?" "Nothing." They continued.

Sometime after midnight, neither of them knew how many cups of coffee they had consumed. It didn't matter. Every cup seemed to become cold before it finished brewing. the Rookie stared at the screen. The Detective was reading a server log beside him. Something bothered the Rookie. Not an error. Not a warning. Something smaller. He went back. Scrolled. Stopped. Looked at the routing table. Then the server. Then back at the log. "Wait." The Detective kept reading. the Rookie leaned closer. One line. Then another. He pulled up the switch. Compared them. His heart started beating faster. "Wait." This time The Detective looked over. the Rookie pointed at the screen. "They're both right." The Detective moved closer. "What?" "The switch." the Rookie changed windows. "And the server." Another window. "They're both right." The Detective stared. Then slowly smiled. "Which means..." "They're wrong together." the Rookie started typing. A few edits. Nothing dramatic. One line here. Another there. Apply. Wait. For a moment, nothing happened. Then— Packet 1. the Rookie leaned forward. Packet 5. The Detective watched the counters. Packet 27. Packet 81. Packet 200. Traffic climbed. Connections formed. Servers began talking. Switches began forwarding. Somewhere beyond the server room, a workstation came back to life. Then another. And another. The network breathed. Then a telephone rang. One. Then another. Then five. Then twenty. Beyond the server room walls, Walldrift Industries began making noise again. The building was waking up. For several seconds, neither man said anything. Then, from somewhere down the hall, a woman screamed. "THE PRINTER IS WORKING!" the Rookie closed his eyes. Of course. Walldrift Industries had been down for almost sixteen hours. Servers unreachable. Applications broken. Phones useless. Hundreds of people unable to work. And the official declaration of victory— was a printer. The Detective stood. "Always is." the Rookie looked up. "What?" "The printer." The Detective walked toward the door. the Rookie looked at the screen. Then smiled.

They returned to the office sometime before morning. the Rookie unlocked the door. The Detective walked in behind him. For the first time since the Rookie had arrived, the office didn't feel empty. The Detective looked around. The stacks of tickets. The filing cabinet. The coffee machine. The desk. He stopped at the empty chair. Only for a moment. Then continued. the Rookie noticed. He didn't ask. The Detective walked toward the darkest corner of the office. the Rookie had always assumed there was nothing there. There was. A coat rack. It wasn't hidden. Nothing covered it. The shadows simply seemed to own that part of the room. The Detective reached behind it and pulled out a coat. Long. Dark. Old. Not ruined. Not tattered. Just used. The kind of coat whose age lived in every seam and crease. He held it out. the Rookie looked at it. Then at The Detective. "I think you deserve this." the Rookie didn't move. "Your coat?" The Detective said nothing. the Rookie took it. It was heavier than he expected. He slipped one arm through. Then the other. Adjusted the collar. The Detective stared at him. Not like a technician examining equipment. Like someone remembering something. the Rookie noticed. "What?" The Detective shook his head. Then, almost to himself: "Looks better on you than it did him." the Rookie stopped. Him. His eyes moved across the room. Toward the second desk. The empty chair. The keyboard buried beneath years of dust. the Rookie looked back. The Detective was gone. No goodbye. No explanation. Just an empty office. the Rookie stood there for a while. Then looked down at the coat. One hand slipped into the pocket. Nothing. The other. Nothing. He smiled. Of course. He walked toward his desk. Behind him, hidden beneath the lining of the coat, tied carefully to a small string sewn into an inside pocket— something moved. A key. An odd little thing. Old. Unmarked except for four numbers. 7200