Shakeup comes as Canadian prime minister is mulling his future as Liberal Party leader after top minister's resignation.