backport commit ("e96bd2d3b1f8 phy: avoid unnecessary link-up delay in polling mode") to linux-5.4-stable

Hi reviewers,

I suggest to backport 
commit "e96bd2d3b1f8 phy: avoid unnecessary link-up delay in polling mode"
to linux-5.4 stable tree.

This patch reports a solution to an incorrect phy link detection issue.
"With this solution we don't miss a link-down event in polling mode and
link-up is faster."

commit: e96bd2d3b1f83170d1d5c1a99e439b39a22a5b58
subject: phy: avoid unnecessary link-up delay in polling mode
kernel version to apply to: Linux-5.4

Thanks.
Macpaul Lin