Established in 1981 at the Bastion Inn, the club began when Hermann Nieweler was encouraged to host Friday Harbor's Island City Jazz Band for a weekend performance at his hotel. In 1986, he relocated the club to its current View Street location, renaming it "Hermann's Jazz Club".

Today, Hermann's Jazz Club is an all-ages venue, restaurant, and lounge featuring both ticketed shows and general admission. With live jazz performances seven nights a week, the club immerses visitors in its rich musical atmosphere, highlighted by walls adorned with photographs of musical friends, vintage instruments, and an eclectic collection of artifacts.

Patrick Boyle, an associate professor of jazz studies at the University of Victoria, has described Hermann's as "both a sanctuary and a laboratory for improvising musicians", recognizing it as one of the world's most significant institutions dedicated to supporting and preserving jazz music.