| Stochastic approximation: a dynamical systems viewpoint VS Borkar, VS Borkar Cambridge University Press, 2008 | 1936 | 2008 |
| A unified framework for hybrid control: Model and optimal control theory MS Branicky, VS Borkar, SK Mitter IEEE transactions on automatic control 43 (1), 31-45, 1998 | 1827 | 1998 |
| Discrete-time controlled Markov processes with average cost criterion: A survey A Arapostathis, VS Borkar, E Fernández-Gaucherand, MK Ghosh, ... SIAM Journal on Control and Optimization 31 (2), 282-344, 1993 | 705 | 1993 |
| The ODE method for convergence of stochastic approximation and reinforcement learning VS Borkar, SP Meyn SIAM Journal on Control and Optimization 38 (2), 447-469, 2000 | 681 | 2000 |
| Stochastic approximation with two time scales VS Borkar Systems & Control Letters 29 (5), 291-294, 1997 | 513 | 1997 |
| An actor-critic algorithm for constrained Markov decision processes VS Borkar Systems & control letters 54 (3), 207-213, 2005 | 413 | 2005 |
| Asymptotic agreement in distributed estimation V Borkar, P Varaiya IEEE transactions on automatic control 27 (3), 650-655, 1982 | 393 | 1982 |
| A unified framework for hybrid control MS Branicky, VS Borkar, SK Mitter Proceedings of 1994 33rd IEEE Conference on Decision and Control 4, 4228-4234, 1994 | 365 | 1994 |
| Q-learning for risk-sensitive control VS Borkar Mathematics of operations research 27 (2), 294-311, 2002 | 338 | 2002 |
| A theory of QoS for wireless IH Hou, V Borkar, PR Kumar IEEE INFOCOM 2009, 486-494, 2009 | 316 | 2009 |
| Actor-critic--type learning algorithms for Markov decision processes VR Konda, VS Borkar SIAM Journal on control and Optimization 38 (1), 94-123, 1999 | 306 | 1999 |
| Ergodic control of diffusion processes A Arapostathis, VS Borkar, MK Ghosh Cambridge University Press, 2011 | 300 | 2011 |
| A new distributed time synchronization protocol for multihop wireless networks R Solis, VS Borkar, PR Kumar Proceedings of the 45th IEEE Conference on Decision and Control, 2734-2739, 2006 | 282 | 2006 |
| Learning algorithms for Markov decision processes with average cost J Abounadi, D Bertsekas, VS Borkar SIAM Journal on Control and Optimization 40 (3), 681-698, 2001 | 271 | 2001 |
| Optimal control of diffusion processes VS Borkar (No Title), 1989 | 258 | 1989 |
| Probability theory: an advanced course VS Borkar Springer Science & Business Media, 2012 | 249 | 2012 |
| Risk-constrained Markov decision processes V Borkar, R Jain IEEE Transactions on Automatic Control 59 (9), 2574-2579, 2014 | 241 | 2014 |
| A sensitivity formula for risk-sensitive cost and the actor–critic algorithm VS Borkar Systems & Control Letters 44 (5), 339-346, 2001 | 229 | 2001 |
| Distributed asynchronous incremental subgradient methods A Nedić, DP Bertsekas, VS Borkar Studies in Computational Mathematics 8 (C), 381-407, 2001 | 211 | 2001 |
| Topics in controlled Markov chains VS Borkar (No Title), 1991 | 195 | 1991 |