soundwire: qcom: fix storing port config out-of-bounds (CVE-2023-53465) | HOL Guard CVE