This articledoes notcite anysources. Please helpimprove this article byadding citations to reliable sources. Unsourced material may be challenged andremoved. Find sources: "Column generation" – news ·newspapers ·books ·scholar ·JSTOR(May 2024) (Learn how and when to remove this message)

You can helpexpand this article with text translated fromthe corresponding article in French. (February 2026)Click [show] for important translation instructions. Machine translation, likeDeepL orGoogle Translate, is a useful starting point for translations, but translators must revise errors as necessary and confirm that the translation is accurate, rather than simply copy-pasting machine-translated text into the English Wikipedia. Consideradding a topic to this template: there are already 1,347 articles in themain category, and specifying|topic= will aid in categorization. Do not translate text that appears unreliable or low-quality. If possible, verify the text with references provided in the foreign-language article. Youmust providecopyright attribution in theedit summary accompanying your translation by providing aninterlanguage link to the source of your translation. A model attribution edit summary isContent in this edit is translated from the existing French Wikipedia article at [[:fr:Génération de colonnes]]; see its history for attribution. You may also add the template{{Translated|fr|Génération de colonnes}} to thetalk page. For more guidance, seeWikipedia:Translation.

Column generation ordelayed column generation is an efficient algorithm for solving largelinear programs.

The overarching idea is that many linear programs are too large to consider all the variables explicitly. The idea is thus to start by solving the considered program with only a subset of its variables. Then iteratively, variables that have the potential to improve theobjective function are added to the program. Once it is possible to demonstrate that adding new variables would no longer improve the value of the objective function, the procedure stops. The hope when applying a column generation algorithm is that only a very small fraction of the variables will be generated. This hope is supported by the fact that in theoptimal solution, most variables will be non-basic and assume a value of zero, so the optimal solution can be found without them.

In many cases, this method allows to solve large linear programs that would otherwise be intractable. The classical example of a problem where it is successfully used is thecutting stock problem. One particular technique in linear programming which uses this kind of approach is theDantzig–Wolfe decomposition algorithm. Additionally, column generation has been applied to many problems such ascrew scheduling,vehicle routing, and thecapacitated p-median problem.

The algorithm considers two problems: the master problem and the subproblem. The master problem is the original problem with only a subset of variables being considered. The subproblem is a new problem created to identify an improving variable (i.e. which can improve theobjective function of the master problem).

The algorithm then proceeds as follow:

1. Initialise the master problem and the subproblem
2. Solve the master problem
3. Search for an improving variable with the subproblem
4. If an improving variable is found: add it to the master problem then go to step 2
5. Else: The solution of the master problem is optimal. Stop.

The most difficult part of this procedure is how to find a variable that can improve theobjective function of the master problem. This can be done by finding the variable with the most negativereduced cost (assumingwithout loss of generality that the problem is a minimization problem). If no variable has a negative reduced cost, then the current solution of the master problem is optimal.

When the number of variables is very large, it is not possible to find an improving variable by calculating all the reduced cost and choosing a variable with a negative reduced cost. Thus, the idea is to compute only the variable having the minimum reduced cost. This can be done using an optimization problem called the pricing subproblem which strongly depends on the structure of the original problem. The objective function of the subproblem is the reduced cost of the searched variable with respect to the current dual variables, and the constraints require that the variable obeys the naturally occurring constraints. The column generation method is particularly efficient when this structure makes it possible to solve the sub-problem with an efficient algorithm, typically a dedicatedcombinatorial algorithm.

We now detail how and why to compute the reduced cost of the variables. Consider the following linear program in standard form:

which we will call theprimal problem as well as itsdual linear program:

Moreover, let${\displaystyle x^{\ast }}$ and${\displaystyle u^{\ast }}$ be optimal solutions for these two problems which can be provided by any linear solver. These solutions verify the constraints of their linear program and, byduality, have the same value of objective function (${\displaystyle c^T{x}^{\ast }=u^{\ast T}b}$) which we will call${\displaystyle z^{\ast }}$. This optimal value is a function of the different coefficients of the primal problem:${\displaystyle z^{\ast }=z^{\ast }(c,A,b)}$. Note that there exists a dual variable${\displaystyle u_i^{\ast }}$ for each constraint of the primal linear model. It is possible to show that an optimal dual variable${\displaystyle u_i^{\ast }}$ can be interpreted as the partial derivative of the optimal value${\displaystyle z^{\ast }}$ of the objective function with respect to the coefficient${\displaystyle b_i}$ of the right-hand side of the constraints:${\displaystyle u_i^{\ast }=\frac{\mathrm{\partial }{z}^{\ast }}{\mathrm{\partial }{b}_i}}$ or otherwise${\displaystyle u^{\ast }=\frac{\mathrm{\partial }{z}^{\ast }}{\mathrm{\partial }b}}$. More simply put,${\displaystyle u_i^{\ast }}$ indicates by how much increases locally the optimal value of the objective function when the coefficient${\displaystyle b_i}$ increases by one unit.

Consider now that a variable${\displaystyle y}$ was not considered until then in the primal problem. Note that this is equivalent to saying that the variable${\displaystyle y}$ was present in the model but took a zero value. We will now observe the impact on the primal problem of changing the value of${\displaystyle y}$ from${\displaystyle 0}$ to${\displaystyle \hat{y}}$. If${\displaystyle c_y}$ and${\displaystyle A_y}$ are respectively the coefficients associated with the variable${\displaystyle y}$ in the objective function and in the constraints then the linear program is modified as follows:

In order to know if it is interesting to add the variable${\displaystyle y}$ to the problem (i.e to let it take a non-zero value), we want to know if the value${\displaystyle z_{\hat{y}}^{\ast }}$ of the objective function of this new problem decreases as the value${\displaystyle \hat{y}}$ of the variable${\displaystyle y}$ increases. In other words, we want to know${\displaystyle \frac{\mathrm{\partial }{z}_{\hat{y}}^{\ast }}{\mathrm{\partial }\hat{y}}}$. To do this, note that${\displaystyle z_{\hat{y}}^{\ast }}$ can be expressed according to the value of the objective function of the initial primal problem:${\displaystyle z_{\hat{y}}^{\ast }=c_y\hat{y}+z^{\ast }(c,A,b-A_y\hat{y})}$. We can then compute the derivative that interests us:

In other words, the impact of changing the value${\displaystyle \hat{y}}$ on the value${\displaystyle z_{\hat{y}}^{\ast }}$ translates into two terms. First, this change directly impacts the objective function and second, the right-hand side of the constraints is modified which has an impact on the optimal variables${\displaystyle x^{\ast }}$ whose magnitude is measured using the dual variables${\displaystyle u^{\ast }}$. The derivative${\displaystyle \frac{\mathrm{\partial }{z}_{\hat{y}}^{\ast }}{\mathrm{\partial }\hat{y}}}$ is generally called thereduced cost of the variable${\displaystyle y}$ and will be denoted by${\displaystyle c{r}_y}$ in the following.

Thisapplied mathematics–related article is astub. You can help Wikipedia byadding missing information.

• v
• t
• e

• Optimization algorithms and methods
• Applied mathematics stubs

• Articles with short description
• Short description matches Wikidata
• Articles lacking sources from May 2024
• All articles lacking sources
• Articles needing translation from French Wikipedia
• All stub articles