I cannot delete the whole record from B, coz other fields in it is still needed.

How to remove referential integrity?