Kill Holiday played around town from 1994 through their split in 2000. Frontman Steven Andrew Miller of Unbroken originally planned the band as a side project. After releasing their Monitor Dependency EP (New Age Records 1995), former Unbroken drummer Todd Beattie joined the band on bass, with guitarist Chris Perreira coming aboard in May 1997. A 7-inch was released on Simba Records, "Meant To Let You Down," and a successful European tour was accomplished in November 1997. With the addition of I Wish I drummer Gabriel Gamboa to the lineup, the band joined the Revelation Records roster.
A full-length called Somewhere Between the Wrong is Right featured the lineup of Sean Andrew Miller (vocals, guitars, keyboards), Christopher Perreira (guitars), Todd Beattie (bass), and Gabriel Gamboa (drums).
After the group split, Miller later convened a new version of the band. They reunited on May 31, 2014, for performances at the Soda Bar with the also-reunited lineup of I Wish I, which shares their drummer Gabe Gamboa.