Can a helium balloon released from deep underwater rise through the ocean surface and continue into the atmosphere?

Consider a helium-filled balloon made of an ideal material that cannot burst, stretch permanently, or leak, regardless of pressure. If it is released from a great depth in the ocean, will it necessarily rise through the water, cross the ocean surface, and continue ascending into the atmosphere? If not, what physical mechanism would stop it? Please ignore material failure and focus only on buoyancy, pressure, gas compression, and expansion.