Ulva is separated from Mull by a narrow strait, and connected to the neighbouring island of Gometra by a bridge. Much of the island is formed from Cenozoic basalt rocks, which is formed into columns in places.

Celtic culture was a major influence on Ulva during both Pictish and Dalriadan times as well as the post-Norse period when the islands became part of modern Scotland. This long period, when Gaelic became the dominant language, was ended by the 19th-century Clearances. At its height Ulva had a population of over 800, but today this has declined to less than 20.