The Decemberists were guests on Conan O’Brien’s late night show on Thursday, November 18. The Portland-based band played their new single “Down by the Water,” off their new album The King Is Dead, with Gillian Welch.

The King Is Dead is due out January 18 of next year.