Motivated by a control problem of a certain queueing network we consider a control problem where the dynamics is constrained in the nonnegative orthant $\mathbb{R}^{d}_{+}$ of the $d$-dimensional Euclidean space and ...