NATO's former Secretary General Jens Stoltenberg is set to become Norway's next finance minister on Tuesday, the country's finance ministry confirmed to CNBC.