Since nonsmooth optimization problems arise in a diverse range of real-world applications, the potential impact of efficient methods for solving such problems is undeniable. Even solving difficult smooth problems sometimes requires the use of nonsmooth optimization methods, in order to either reduce the problem’s scale or simplify its structure. Accordingly, the field of nonsmooth optimization is an important area of mathematical programming that is based on by now classical concepts of variational analysis and generalized derivatives, and has developed a rich and sophisticated set of mathematical tools at the intersection of theory and practice. This volume of ISNM is an outcome of the workshop "Nonsmooth Optimization and its Applications," which was held from May 15 to 19, 2017 at the Hausdorff Center for Mathematics, University of Bonn. The six research articles gathered here focus on recent results that highlight different aspects of nonsmooth and variational analysis, optimization methods, their convergence theory and applications.

This book is the first easy-to-read text on nonsmooth optimization (NSO, not necessarily differentiable optimization). Solving these kinds of problems plays a critical role in many industrial applications and real-world modeling systems, for example in the context of image denoising, optimal control, neural network training, data mining, economics and computational chemistry and physics. The book covers both the theory and the numerical methods used in NSO and provide an overview of different problems arising in the field. It is organized into three parts: 1. convex and nonconvex analysis and the theory of NSO; 2. test problems and practical applications; 3. a guide to NSO software. The book is ideal for anyone teaching or attending NSO courses. As an accessible introduction to the field, it is also well suited as an independent learning guide for practitioners already familiar with the basics of optimization.

This book is a self-contained elementary study for nonsmooth analysis and optimization, and their use in solution of nonsmooth optimal control problems. The first part of the book is concerned with nonsmooth differential calculus containing necessary tools for nonsmooth optimization. The second part is devoted to the methods of nonsmooth optimization and their development. A proximal bundle method for nonsmooth nonconvex optimization subject to nonsmooth constraints is constructed. In the last part nonsmooth optimization is applied to problems arising from optimal control of systems covered by partial differential equations. Several practical problems, like process control and optimal shape design problems are considered.

Nonsmooth optimization covers the minimization or maximization of functions which do not have the differentiability properties required by classical methods. The field of nonsmooth optimization is significant, not only because of the existence of nondifferentiable functions arising directly in applications, but also because several important methods for solving difficult smooth problems lead directly to the need to solve nonsmooth problems, which are either smaller in dimension or simpler in structure.This book contains twenty five papers written by forty six authors from twenty countries in five continents. It includes papers on theory, algorithms and applications for problems with first-order nondifferentiability (the usual sense of nonsmooth optimization) second-order nondifferentiability, nonsmooth equations, nonsmooth variational inequalities and other problems related to nonsmooth optimization.

Mathematical optimization encompasses both a rich and rapidly evolving body of fundamental theory, and a variety of exciting applications in science and engineering. The present book contains a careful selection of articles on recent advances in optimization theory, numerical methods, and their applications in engineering. It features in particular new methods and applications in the fields of optimal control, PDE-constrained optimization, nonlinear optimization, and convex optimization. The authors of this volume took part in the 14th Belgian-French-German Conference on Optimization (BFG09) organized in Leuven, Belgium, on September 14-18, 2009. The volume contains a selection of reviewed articles contributed by the conference speakers as well as three survey articles by plenary speakers and two papers authored by the winners of the best talk and best poster prizes awarded at BFG09. Researchers and graduate students in applied mathematics, computer science, and many branches of engineering will find in this book an interesting and useful collection of recent ideas on the methods and applications of optimization.

This book deals with nonsmooth structures arising within the optimization setting. It considers four optimization problems, namely, mathematical programs with complementarity constraints, general semi-infinite programming problems, mathematical programs with vanishing constraints and bilevel optimization. The author uses the topological approach and topological invariants of corresponding feasible sets are investigated. Moreover, the critical point theory in the sense of Morse is presented and parametric and stability issues are considered. The material progresses systematically and establishes a comprehensive theory for a rather broad class of optimization problems tailored to their particular type of nonsmoothness. Topological Aspects of Nonsmooth Optimization will benefit researchers and graduate students in applied mathematics, especially those working in optimization theory, nonsmooth analysis, algebraic topology and singularity theory. ​ ​

Nonsmooth Optimization contains the proceedings of a workshop on non-smooth optimization (NSO) held from March 28 to April 8,1977 in Austria under the auspices of the International Institute for Applied Systems Analysis. The papers explore the techniques and theory of NSO and cover topics ranging from systems of inequalities to smooth approximation of non-smooth functions, as well as quadratic programming and line searches. Comprised of nine chapters, this volume begins with a survey of Soviet research on subgradient optimization carried out since 1962, followed by a discussion on rates of convergence in subgradient optimization. The reader is then introduced to the method of subgradient optimization in an abstract setting and the minimal hypotheses required to ensure convergence; NSO and nonlinear programming; and bundle methods in NSO. A feasible descent algorithm for linearly constrained least squares problems is described. The book also considers sufficient minimization of piecewise-linear univariate functions before concluding with a description of the method of parametric decomposition in mathematical programming. This monograph will be of interest to mathematicians and mathematics students.

The aim of this book was to collect the most recent methods developed for NSO and its practical applications. The book contains seven papers: The first is the foreword by the Guest Editors giving a brief review of NSO and its real-life applications and acknowledging the outstanding contributions of Professor Adil Bagirov to both the theoretical and practical aspects of NSO. The second paper introduces a new and very efficient algorithm for solving uncertain unit-commitment (UC) problems. The third paper proposes a new nonsmooth version of the generalized damped Gauss–Newton method for solving nonlinear complementarity problems. In the fourth paper, the abs-linear representation of piecewise linear functions is extended to yield simultaneously their DC decomposition as well as the pair of generalized gradients. The fifth paper presents the use of biased-randomized algorithms as an effective methodology to cope with NP-hard and nonsmooth optimization problems in many practical applications. In the sixth paper, a problem concerning the scheduling of nuclear waste disposal is modeled as a nonsmooth multiobjective mixed-integer nonlinear optimization problem, and a novel method using the two-slope parameterized achievement scalarizing functions is introduced. Finally, the last paper considers binary classification of a multiple instance learning problem and formulates the learning problem as a nonconvex nonsmooth unconstrained optimization problem with a DC objective function.

This brief describes the basics of Riemannian optimization—optimization on Riemannian manifolds—introduces algorithms for Riemannian optimization problems, discusses the theoretical properties of these algorithms, and suggests possible applications of Riemannian optimization to problems in other fields. To provide the reader with a smooth introduction to Riemannian optimization, brief reviews of mathematical optimization in Euclidean spaces and Riemannian geometry are included. Riemannian optimization is then introduced by merging these concepts. In particular, the Euclidean and Riemannian conjugate gradient methods are discussed in detail. A brief review of recent developments in Riemannian optimization is also provided. Riemannian optimization methods are applicable to many problems in various fields. This brief discusses some important applications including the eigenvalue and singular value decompositions in numerical linear algebra, optimal model reduction in control engineering, and canonical correlation analysis in statistics.

Solving nonsmooth optimization (NSO) problems is critical in many practical applications and real-world modeling systems. The aim of this book is to survey various numerical methods for solving NSO problems and to provide an overview of the latest developments in the field. Experts from around the world share their perspectives on specific aspects of numerical NSO. The book is divided into four parts, the first of which considers general methods including subgradient, bundle and gradient sampling methods. In turn, the second focuses on methods that exploit the problem’s special structure, e.g. algorithms for nonsmooth DC programming, VU decomposition techniques, and algorithms for minimax and piecewise differentiable problems. The third part considers methods for special problems like multiobjective and mixed integer NSO, and problems involving inexact data, while the last part highlights the latest advancements in derivative-free NSO. Given its scope, the book is ideal for students attending courses on numerical nonsmooth optimization, for lecturers who teach optimization courses, and for practitioners who apply nonsmooth optimization methods in engineering, artificial intelligence, machine learning, and business. Furthermore, it can serve as a reference text for experts dealing with nonsmooth optimization.