How do you remove a linked record from a table with an editable field?

How?

If the field is set to editable, hovering over the linked record pill should show a little x to remove it. If you don’t see it, check the field permissions in the table block settings.

I don’t get the “X” and the field is editable. So I am unable to unlink the record.