Biloxi

Biloxi, written by M.C. Taylor, opens Heart Like a Levee and runs 2:51. It was released first on the promotional Merge Records Fall Sampler 2016 on September 6 and then on the album on October 7, and as the lead single; Stereogum's post on it is dated July 12, 2016. It was recorded in Durham, North Carolina and produced by Taylor and Brad Cook; the studio and recording dates were not found. Americana UK names Phil and Brad Cook as musical support and credits Matt McCaughan's drums.

According to Americana UK and KEXP, the song is about the guilt of being an absent parent and provider through touring, and it is set at the birthday party of Taylor's eldest child. KEXP anchors on the refrain, it's hard, Lord, and calls the instrumentation almost joyous. It did not chart as a single.

The live version

The hypersongs upload is labeled Biloxi (live) on the band's own channel. Its date and venue are not stated. A likely match, not confirmed, is the NPR World Cafe session with host David Dye at World Cafe Live in Philadelphia, published on October 26, 2016, where the band played Biloxi, Cracked Windshield, Say It Like You Mean It and John the Gun with Phil Cook, Brad Cook and the drummer Darren Jessee; NPR's video of that version runs 2:51.

MusicBrainz lists other live versions by the band, including WFUV in the Bronx on October 6, 2016, The Parish in Austin on October 18, 2016, the 9:30 Club in Washington on April 22, 2017, Cat's Cradle in Carrboro on January 11, 2020, and EartH in London on June 15, 2022.