Sure! It is surrounded by the sea after all. The west side of the island is kept as a nature reservation though, but you are allowed to walk along a nice path through there.
Island used to have an iron mine there and has a lot of cool abandoned buildings from the old days. Also some old bunkers.
I smoked weed here once in a coffee house and saw some beautiful prostitutes while walking through the local red light district. Back at the hostel some black woman laughed at my dumb drunk/stoned stories.