Quantized incremental algorithms for distributed optimization

@article{citeulike:2363744, abstract = {Wireless sensor networks are capable of collecting an enormous amount of data. Often, the ultimate objective is to estimate a parameter or function from these data, and such estimators are typically the solution of an optimization problem (e.g., maximum likelihood, minimum mean-squared error, or maximum a posteriori). This paper investigates a general class of distributed optimization algorithms for "in-network" data processing, aimed at reducing the amount of energy and bandwidth used for communication. Our intuition tells us that processing the data in-network should, in general, require less energy than transmitting all of the data to a fusion center. In this paper, we address the questions: When, in fact, does in-network processing use less energy, and how much energy is saved? The proposed distributed algorithms are based on incremental optimization methods. A parameter estimate is circulated through the network, and along the way each node makes a small gradient descent-like adjustment to the estimate based only on its local data. Applying results from the theory of incremental subgradient optimization, we find that the distributed algorithms converge to an approximate solution for a broad class of problems. We extend these results to the case where the optimization variable is quantized before being transmitted to the next node and find that quantization does not affect the rate of convergence. Bounds on the number of incremental steps required for a certain level of accuracy provide insight into the tradeoff between estimation performance and communication overhead. Our main conclusion is that as the number of sensors in the network grows, in-network processing will always use less energy than a centralized algorithm, while maintaining a desired level of accuracy.}, author = {Rabbat, M. G. and Nowak, R. D. }, booktitle = {Selected Areas in Communications, IEEE Journal on}, citeulike-article-id = {2363744}, doi = {http://dx.doi.org/10.1109/JSAC.2005.843546}, journal = {Selected Areas in Communications, IEEE Journal on}, keywords = {gossip}, number = {4}, pages = {798--808}, posted-at = {2008-02-11 21:02:40}, priority = {2}, title = {Quantized incremental algorithms for distributed optimization}, url = {http://dx.doi.org/10.1109/JSAC.2005.843546}, volume = {23}, year = {2005} }

TY - JOUR ID - citeulike:2363744 L3 - citeulike-article-id:2363744 N2 - Wireless sensor networks are capable of collecting an enormous amount of data. Often, the ultimate objective is to estimate a parameter or function from these data, and such estimators are typically the solution of an optimization problem (e.g., maximum likelihood, minimum mean-squared error, or maximum a posteriori). This paper investigates a general class of distributed optimization algorithms for "in-network" data processing, aimed at reducing the amount of energy and bandwidth used for communication. Our intuition tells us that processing the data in-network should, in general, require less energy than transmitting all of the data to a fusion center. In this paper, we address the questions: When, in fact, does in-network processing use less energy, and how much energy is saved? The proposed distributed algorithms are based on incremental optimization methods. A parameter estimate is circulated through the network, and along the way each node makes a small gradient descent-like adjustment to the estimate based only on its local data. Applying results from the theory of incremental subgradient optimization, we find that the distributed algorithms converge to an approximate solution for a broad class of problems. We extend these results to the case where the optimization variable is quantized before being transmitted to the next node and find that quantization does not affect the rate of convergence. Bounds on the number of incremental steps required for a certain level of accuracy provide insight into the tradeoff between estimation performance and communication overhead. Our main conclusion is that as the number of sensors in the network grows, in-network processing will always use less energy than a centralized algorithm, while maintaining a desired level of accuracy. IS - 4 JF - Selected Areas in Communications, IEEE Journal on EP - 808 TI - Quantized incremental algorithms for distributed optimization VL - 23 T2 - Selected Areas in Communications, IEEE Journal on SP - 798 KW - gossip AU - Rabbat, MG AU - Nowak, RD PY - 2005/// UR - http://dx.doi.org/10.1109/JSAC.2005.843546 ER -