The only user (pcm030) already setups the bus clocks in its board code. Signed-off-by: Sascha Hauer <s.hauer@pengutronix.de>