Bifidobacteria are a part of the normal gut commensal flora in humans and are generally considered to be nonpathogenic. They have been used as probiotics in different formulations for potential health benefits. However, infections have been reported secondary to this microbe. We present a rare case of Bifidobacterium longum bacteremia in a woman who had diverticulosis, was on high-dose steroids, and had a history of significant probiotic use. We reviewed all reported cases of Bifidobacterium bloodstream infections and have provided an overview of clinical presentations, treatment, and outcomes.