Ayton based Mr Wheelhouse was previously minister for environment, climate change and land reform.
That role has been taken by Aileen McLeod, one of a number of female MSPs promoted by First Minister Nicola Sturgeon, to make the cabinet gender split 50-50.
Mr Wheelhouse has been given the role of minister for community safety and legal affairs, under the new secretary for justice, Michael Matheson, after Kenny McAskill was replaced in the reshuffle.