The final version of this manuscript will appear in IEEE Wireless Communication Letters
| Title: | The final version of this manuscript will appear in IEEE Wireless Communication Letters |
|---|---|
| Authors: | Tomaso Erseghe; Andrea Zanella; Claudio G Codemo |
| Contributors: | The Pennsylvania State University CiteSeerX Archives |
| Source: | http://www.dei.unipd.it/%7Ezanella/PAPER/CR_2013/WCL2013_CR.pdf. |
| Publication Year: | 2013 |
| Collection: | CiteSeerX |
| Description: | This letter investigates the structure of the optimal policy for a class of Markov decision processes (MDPs), having convex and piecewise linear cost function. The optimal policy is proved to have a piecewise linear structure that alternates flat and constant-slope pieces, resembling a staircase with tilted rises and as many steps (thresholds) as the breakpoints of the cost function. This particular structure makes it possible to express the policy in a very compact manner, particularly suitable to be stored in low-end devices. More importantly, the thresholdbased form of the optimal policy can be exploited to reduce the computational complexity of the iterative dynamic programming (DP) algorithm used to solve the problem. These results apply to a rather wide set of optimization problems, typically involving the management of a resource buffer such as the energy stored in a battery, or the packets queued in a wireless node. |
| Document Type: | text |
| File Description: | application/pdf |
| Language: | English |
| Relation: | http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.1074.440; http://www.dei.unipd.it/%7Ezanella/PAPER/CR_2013/WCL2013_CR.pdf |
| Availability: | http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.1074.440; http://www.dei.unipd.it/%7Ezanella/PAPER/CR_2013/WCL2013_CR.pdf |
| Rights: | Metadata may be used without restrictions as long as the oai identifier remains attached to it. |
| Accession Number: | edsbas.87181A97 |
| Database: | BASE |