iavf: Fix out-of-bounds when setting channels on remove (CVE-2023-53659) | HOL Guard CVE