And I quote...
Your browser does not meet the HSBC Internet Banking security requirements and you are therefore not able to use the Internet Banking Service using your current browser version. Please access the Internet Banking Service using an alternative browser version. If you require further assistance please call 0845 600 2290.
Looks like I need to be using IE.