When no connection is opened we should not call into
the networking stack. Otherwise it can happen that we
delay further execution until the network stack detected
a link (or timed out bringing the link up).
Signed-off-by: Sascha Hauer <s.hauer@pengutronix.de>