This overview provides a single-volume treatment of key algorithms and theories. Begins with the derivation of optimality conditions and discussions of convex programming, duality, generalized convexity, and analysis of selected nonlinear programs, and then explores techniques for numerical solutions and unconstrained optimization methods. 1976 edition. Includes 58 figures and 7 tables.

This third edition of the classic textbook in Optimization has been fully revised and updated. It comprehensively covers modern theoretical insights in this crucial computing area, and will be required reading for analysts and operations researchers in a variety of fields. The book connects the purely analytical character of an optimization problem, and the behavior of algorithms used to solve it. Now, the third edition has been completely updated with recent Optimization Methods. The book also has a new co-author, Yinyu Ye of California’s Stanford University, who has written lots of extra material including some on Interior Point Methods.

This book is an introduction to nonlinear programming. It deals with the theoretical foundations and solution methods, beginning with the classical procedures and reaching up to “modern” methods like trust region methods or procedures for nonlinear and global optimization. A comprehensive bibliography including diverse web sites with information about nonlinear programming, in particular software, is presented. Without sacrificing the necessary mathematical rigor, excessive formalisms are avoided. Several examples, exercises with detailed solutions, and applications are provided, making the text adequate for individual studies. The book is written for students from the fields of applied mathematics, engineering, economy, and computation.

Recent interest in interior point methods generated by Karmarkar's Projective Scaling Algorithm has created a new demand for this book because the methods that have followed from Karmarkar's bear a close resemblance to those described. There is no other source for the theoretical background of the logarithmic barrier function and other classical penalty functions. Analyzes in detail the "central" or "dual" trajectory used by modern path following and primal/dual methods for convex and general linear programming. As researchers begin to extend these methods to convex and general nonlinear programming problems, this book will become indispensable to them.

Nonlinear Programming 3 covers the proceedings of the Special Interest Group on Mathematical Programming Symposium conducted by the Computer Sciences Department at the University of Wisconsin, Madison, on July 11-13, 1977. This book is composed of 17 chapters. The first eight chapters describe some of the most effective methods available for solving linearly and nonlinearly constrained optimization problems. The subsequent chapter gives algorithms for the solution of nonlinear equations together with computational experience. Other chapters provide some applications of optimization in operations research and a measurement procedure for optimization algorithm efficiency. These topics are followed by discussion of the methods for solving large quadratic programs and algorithms for solving stationary and fixed point problems. The last chapters consider the minimization of certain types of nondifferentiable functions and a type of Newton method. This book will prove useful to mathematicians and computer scientists.

Nonlinear Programming, 4 focuses on linear, quadratic, and nonlinear programming, unconstrained minimization, nonsmooth and discrete optimization, ellipsoidal methods, linear complementarity problems, and software evaluation. The selection first elaborates on an upper triangular matrix method for quadratic programming, solving quadratic programs by an exact penalty function, and QP-based methods for large-scale nonlinearly constrained optimization. Discussions focus on large-scale linearly constrained optimization, search direction for superbasic variables, finite convergence, basic properties, comparison of three active set methods, and QP-based methods for dense problems. The book then examines an iterative linear programming algorithm based on an augmented Lagrangian and iterative algorithms for singular minimization problems. The publication ponders on the derivation of symmetric positive definite secant updates, preconditioned conjugate gradient methods, and finding the global minimum of a function of one variable using the method of constant signed higher order derivatives. Topics include effects of calculation errors, application to polynomial minimization, using moderate additional storage, updating Cholesky factors, and utilizing sparse second order information. The selection is a valuable source of data for researchers interested in nonlinear programming.

Control Applications of Nonlinear Programming contains the proceedings of the International Federation of Automatic Control Workshop on Control Applications of Nonlinear Programming, held in Denver, Colorado, on June 21, 1979. The workshop provided a forum for discussing the application of optimal and nonlinear programming techniques to real-life control problems. The volume covers a variety of specific applications ranging from microprocessor control of automotive engines and optimal design of structures to optimal aircraft trajectories, system identification, and robotics. Comprised of 14 chapters, this book begins by describing the application of nonlinear programming to an optimum design problem coming from mechanical engineering. The reader is then introduced to a nonlinear regulator design for magnetic suspension; optimal control solution of the automotive emission-constrained minimum fuel problem; and nonlinear programming for system identification. Subsequent chapters focus on mathematical programming algorithms based on Lagrangian functions for solving optimal control problems; computer-aided design via optimization; optimal and suboptimal control of oscillating dynamical systems; and the application of nonlinear programming to the solution of optimal output-constrained regulator problems. This monograph will be of interest to mathematicians, computer scientists, and engineers.

Many engineering, operations, and scientific applications include a mixture of discrete and continuous decision variables and nonlinear relationships involving the decision variables that have a pronounced effect on the set of feasible and optimal solutions. Mixed-integer nonlinear programming (MINLP) problems combine the numerical difficulties of handling nonlinear functions with the challenge of optimizing in the context of nonconvex functions and discrete variables. MINLP is one of the most flexible modeling paradigms available for optimization; but because its scope is so broad, in the most general cases it is hopelessly intractable. Nonetheless, an expanding body of researchers and practitioners — including chemical engineers, operations researchers, industrial engineers, mechanical engineers, economists, statisticians, computer scientists, operations managers, and mathematical programmers — are interested in solving large-scale MINLP instances.

These Proceedings provide valuable information on the exchange of ideas between scientists who apply nonlinear programming and optimization to real world control problems and those who develop new methods, algorithms and software. The papers deal with windshear problems, optimization of aircraft and spacecraft trajectories, optimal control for robots, the optimization of urban traffic control, general mechanical systems, multilevel inventory systems and robust control.