option driver crashes on modem removal

I have following problem. When removing USB dongle 07d1:3e01 or
SierraWireless MC7304 I get following messages:

option1 ttyUSB10: option_instat_callback: error -71
option1 ttyUSB9: option_instat_callback: error -71
option1 ttyUSB10: option_instat_callback: error -71
option1 ttyUSB9: option_instat_callback: error -71
option1 ttyUSB10: option_instat_callback: error -71
option1 ttyUSB9: option_instat_callback: error -71
INFO: rcu_sched detected stalls on CPUs/tasks: {} (detected by 0,
t=2102 jiffies, g=694, c=693, q=24)
INFO: Stall ended before state dump start
option1 ttyUSB10: option_instat_callback: error -71

drivers/usb/serial/option.c seems to make nothing with such a status
and just prints error. How one would handle this properly and just
unregister device? Do you need more info?

Tested kernels: 3.18.20 and 4.2.0-rc5 (this kernel shows only RCU stall crash)
Hardware: TI am335x

Regards,
Yegor