How to code for Outlook 2003 using Visual Studio 2010

My target system has Microsoft Office Outlook 2003 (11.8169.8172) SP3 installed on it.

My development pc has Visual Studio 2010 and Microsoft Office 2010 on it.

I am developing a vb.net application in .net 3.5 framework and works but when I put the .exe on the target system it errors. The target system only has 2003 and my code is using a newer Interop.

How can I develop for 2003?

Thanks.

I see Microsoft has Office 2003 Update: Redistributable Primary Interop Assemblies is available for download but when I go and try to install I get the message, "Please install Microsoft Office 2003 before installing this product."

Any way to get these without having to install 2003?