Ask him about food allergies or something...favorite dishes, etc. Force the conversation to dinner. I think saying yes to the Field of Lights is an implication that dinner is fine, too.

I now officially hate men (but I still like sleeping with them).