Starting in 2001, Rhino Records began an eighteen double-disc reissue program for Costello's back catalogue prior to his Polygram/Universal contract. Except for the compilation, each of the reissues presented the remastered original album on one disc, and a separate bonus disc of B-sides, outtakes, live tracks, alternate versions and/or demos of songs.

The project featured the direct participation and guidance of Elvis Costello himself, who wrote new liner notes for each album consisting of his thoughts on the music as well as anecdotes and reminiscences from the time. They were released in batches of three, with the exception of King of America, The Juliet Letters, and The Very Best of Elvis Costello, the last being an unaltered re-release of the Polygram compilation of 1999, which arrived in the stores singularly. The reissue dates are as follows:

The Almost Blue and Kojak Variety bonus discs were particularly notable as each contained, essentially, an entire new album