Technically you need an IDP to hire although you'll probably be okay with a Manx licence, however if you have an incident the police will probably be looking for an IDP.
But is it really worth the risk for what little it costs to take the chance of some jobsworth in a car hire office wanting to adhere to the rules and refusing to let you drive away ?