With 6.0.4 kernel, framebuffer on GPU1 is disabled, if vfio-pci driver is used for GPU2

Hello,

not sure where is the right place to post this.
I already posted reply to patch that caused this https://lore.kernel.org/lkml/ba4caf7a-9e1f-d5fb-f20c-dba81dc00c06@bstnet.org/ (local)

Problem is that after kernel 6.0.4 console/framebuffer on GPU 1 is disabled, if GPU 2 is bound to vfio-pci driver.
Git bisect lead to commit af9ac541e88390d97b01d5e8c77309d2637c1d4c.
After this patch sysfb_disable() is always called. Before it was not.
Maybe it should be "if (primary) sysfb_disable();" or check if framebuffer
is used on pci_dev passed to aperture_remove_conflicting_pci_devices() and only in this case call sysfb_disable()?
But I don't know how this things work.
Is this intended change? I see no reason to disable framebuffer/console on GPU 1, if GPU 2 is bound to vfio-pci driver.
And this was not the case until 6.0.4 kernel. Kernel 6.0.3 still works.