History and stories
How Toy Story 2 was almost deleted
Animators at Pixar watched characters vanish from their screens. The film was being deleted, and the backups turned out to be broken.
1 min readStory
The short version
In 1998, a mistyped command started erasing the files for Toy Story 2, and the backups had not been working for a month.
The story
In 1998, an animator at Pixar was doing some routine cleanup of files on the company’s servers. The command they ran was aimed at the wrong folder: the top folder holding everything for Toy Story 2.
Associate technical director Oren Jacob noticed character models disappearing from the work in progress. By the time the file servers were shut down, about 90 percent of two years of work was gone.
The team turned to the backups. They had not been working for roughly a month.
The film was saved by luck. Technical director Galyn Susman had been working from home after the birth of her child, and she had a copy of the film on her home computer. The team carefully brought that computer in and rebuilt almost everything from it, losing only a few days of recent work.
Why it mattered
The backups had been failing for about a month and nobody knew, because nobody had tried to restore anything from them. A major film survived only because one person happened to have a copy at home. It became one of the best-known reminders that a backup only counts once a restore has been tested.
The lesson today
Pixar had backups. Nobody knew they had stopped. A backup that fails quietly gives no warning until the day it is needed. The fix is routine: check backup results every day, and test restores on a schedule so you know the copies actually work.
Talk to us about your technology
Tell us what you run today and what is getting in the way. We will get back to you about how we can help.