Sure! It is surrounded by the sea after all. The west side of the island is kept as a nature reservation though, but you are allowed to walk along a nice path through there.
Island used to have an iron mine there and has a lot of cool abandoned buildings from the old days. Also some old bunkers.