[Cil] avoid crashing due to attribute differences

Attributes such as 'visibility' must be ignored for casting purposes,
to avoid errors with implicit casts.