Well, whats-his-name who was in love with Nimrodel tries to swim back to Middle Earth from the ship that was carrying him to the Undying Lands, and apparently drowns, so I'd guess not. But perhaps the problem there was the trying to go back rather than the swimming?