This small building sits to the north of the Section Gang's Quarters, and is considered by oral history sources as a place where some of the Black American workers bunked during the time when the island was used as a maintenance camp (1914 - 1935). The back section of the house has a small room with a separate outside door - this was reportedly a post office for a few years.

Few old photos show the Negro Worker's Cottage. At the right it is seen in the left part of the photo (the Assistant Bridge Tender's House is on the right). The main portion of the Negro Quarters may also have served as a commissary at one time.

The house is now listed on the National Black Heritage Trail. Shown below after historic preservation in 1998, the Negro Worker's Cottage is a dormitory for Pigeon Key Foundation Education Programs, with bunk beds for 14 students.