Iran and Azerbaijan began two days of joint naval exercises in the Caspian Sea on Monday, state media reported, signaling improving ties between the neighbors amid soaring regional tensions.