{ "id": "1307.5944", "version": "v3", "published": "2013-07-23T04:13:44.000Z", "updated": "2016-01-19T17:14:35.000Z", "title": "Online Optimization in Dynamic Environments", "authors": [ "Eric C. Hall", "Rebecca M. Willett" ], "comment": "arXiv admin note: text overlap with arXiv:1301.1254", "journal": "IEEE Journal of Selected Topics in Signal Processing - Signal Processing for Big Data, vol. 9, no 4. 2015", "categories": [ "stat.ML", "cs.LG", "math.OC" ], "abstract": "High-velocity streams of high-dimensional data pose significant \"big data\" analysis challenges across a range of applications and settings. Online learning and online convex programming play a significant role in the rapid recovery of important or anomalous information from these large datastreams. While recent advances in online learning have led to novel and rapidly converging algorithms, these methods are unable to adapt to nonstationary environments arising in real-world problems. This paper describes a dynamic mirror descent framework which addresses this challenge, yielding low theoretical regret bounds and accurate, adaptive, and computationally efficient algorithms which are applicable to broad classes of problems. The methods are capable of learning and adapting to an underlying and possibly time-varying dynamical model. Empirical results in the context of dynamic texture analysis, solar flare detection, sequential compressed sensing of a dynamic scene, traffic surveillance,tracking self-exciting point processes and network behavior in the Enron email corpus support the core theoretical findings.", "revisions": [ { "version": "v2", "updated": "2014-07-03T21:21:17.000Z", "abstract": "High-velocity streams of high-dimensional data pose significant ``big data'' analysis challenges across a range of applications and settings. Online learning and online convex programming play a significant role in the rapid recovery of important or anomalous information from these large datastreams. While recent advances in online learning have led to novel and rapidly converging algorithms, these methods are unable to adapt to nonstationary environments arising in real-world problems. This paper describes a dynamic mirror descent framework which addresses this challenge, yielding low theoretical regrets bounds and accurate, adaptive, and computationally efficient algorithms which are applicable to broad classes of problems. The methods are capable of learning and adapting to an underlying and possibly time-varying dynamical model. Empirical results in the context of dynamic texture analysis, sequential compressed sensing of a dynamic scene, and tracking self-exciting point processes support the core theoretical findings.", "journal": null, "doi": null }, { "version": "v3", "updated": "2016-01-19T17:14:35.000Z" } ], "analyses": { "keywords": [ "online optimization", "dynamic environments", "high-dimensional data pose significant", "dynamic mirror descent framework", "tracking self-exciting point processes support" ], "tags": [ "journal article" ], "note": { "typesetting": "TeX", "pages": 0, "language": "en", "license": "arXiv", "status": "editable", "adsabs": "2013arXiv1307.5944H" } } }