The Little Shop team experiments with putting different objects in different fluids and seeing which float. Helium filled bubbles in the air and granite in mercury metal! Does it float?
There’s nothing intrinsically “floaty” about helium. You can make a helium balloon that sinks, if it’s cold enough, as we see in this video.