Can you make the property overridable? Then in Class B, override it but make it private that way it isn't visible to the user and it would be illegal to use it.

That is theory, I can't run the test right now to see if that would work (don't have .Net on this machine).