Difference between revisions of "Jensen's Inequality"

Revision as of 08:21, 31 July 2020

Jensen's Inequality is an inequality discovered by Danish mathematician Johan Jensen in 1906.

Inequality

Let ${F}$ be a convex function of one real variable. Let $x_1,\dots,x_n\in\mathbb R$ and let $a_1,\dots, a_n\ge 0$ satisfy $a_1+\dots+a_n=1$ . Then

$F(a_1x_1+\dots+a_n x_n)\le a_1F(x_1)+\dots+a_n F(x_n)$

If ${F}$ is a Concave Function, we have:

$F(a_1x_1+\dots+a_n x_n)\ge a_1F(x_1)+\dots+a_n F(x_n)$

Proof

We only prove the case where $F$ is concave. The proof for the other case is similar.

Let $\bar{x}=\sum_{i=1}^n a_ix_i$ . As $F$ is concave, then its derivative $F'$ is monotonically decreasing. We consider two cases.

If $x_i \le \bar{x}$ , then $\int_{x_i}^{\bar{x}} F'(t) \, dt \ge \int_{x_i}^{\bar{x}} F'(\bar{x}) \, dt .$ If $x_i > \bar{x}$ , then $\int_{\bar{x}}^{x_i} F'(t) \, dt \le \int_{\bar{x}}^{x_i} F'(\bar{x}) \, dt .$ By the fundamental theorem of calculus, we have $\int_{x_i}^{\bar{x}} F'(t) \, dt = F(\bar{x}) - F(x_i) .$ Evaluating the integrals, the last two inequalities both result in $\begin{align*} && F(\bar{x})-F(x_i) &\ge F'(\bar{x})(\bar{x}-x_i) \\ \Longrightarrow && a_i F(\bar{x}) - a_i F(x_i) &\ge F'(\bar{x})(a_i\bar{x}-a_i x_i) && \text{as } a_i>0 \\ \Longrightarrow && F(\bar{x}) - \sum_{i=1}^n a_i F(x_i) &\ge F'(\bar{x})\left(\bar{x} - \sum_{i=1}^n a_i x_i \right) && \text{as } \sum_{i=1}^n a_i = 1 \\ \Longrightarrow && F(\bar{x}) &\ge \sum_{i=1}^n a_i F(x_i) && \text{as } \bar{x}=\sum_{i=1}^n a_ix_i \end{align*}$ as desired.

One of the simplest examples of Jensen's inequality is the quadratic mean - arithmetic mean inequality. Take $F(x)=x^2$ (verify that $F'(x)=2x$ and $F''(x)=2>0$ ) and $a_1=\dots=a_n=\frac 1n$ . You'll get $\left(\frac{x_1+\dots+x_n}{n}\right)^2\le \frac{x_1^2+\dots+ x_n^2}{n}$ . Similarly, arithmetic mean-geometric mean inequality can be obtained from Jensen's inequality by considering $F(x)=-\log x$ .

Problems

Introductory

Prove AM-GM using Jensen's Inequality

Intermediate

Prove that for any $\triangle ABC$ , we have $\sin{A}+\sin{B}+\sin{C}\leq \frac{3\sqrt{3}}{2}$ .
Show that in any triangle $\triangle ABC$ we have $\cos {A} \cos{B} \cos {C} \leq \frac{1}{8}$

Olympiad

Let $a,b,c$ be positive real numbers. Prove that

$\frac{a}{\sqrt{a^{2}+8bc}}+\frac{b}{\sqrt{b^{2}+8ca}}+\frac{c}{\sqrt{c^{2}+8ab}}\ge 1$ (Source)

@@ Line 11: / Line 11: @@
 ==Proof==
-The proof of Jensen's inequality is very simple. Since the graph of every convex function lies above its tangent line at every point, we can compare the function <math>{F}</math> with the linear function <math>{L}</math>, whose graph is tangent to the graph of <math>{F}</math> at the point <math>a_1x_1+\dots+a_n x_n</math>. Then the left hand side of the inequality is the same for <math>{F}</math> and <math>{L}</math>, while the right hand side is smaller for <math>{L}</math>. But the equality case holds for all linear functions!  (check it yourself)
+We only prove the case where <math>F</math> is concave. The proof for the other case is similar.
+Let <math>\bar{x}=\sum_{i=1}^n a_ix_i</math>.
+As <math>F</math> is concave, then its derivative <math>F'</math> is monotonically decreasing. We consider two cases.
+If <math>x_i \le \bar{x}</math>, then
+<cmath>\int_{x_i}^{\bar{x}} F'(t) \, dt \ge \int_{x_i}^{\bar{x}} F'(\bar{x}) \, dt .</cmath>
+If <math>x_i > \bar{x}</math>, then
+<cmath>\int_{\bar{x}}^{x_i} F'(t) \, dt \le \int_{\bar{x}}^{x_i} F'(\bar{x}) \, dt .</cmath>
+By the fundamental theorem of calculus, we have
+<cmath>\int_{x_i}^{\bar{x}} F'(t) \, dt = F(\bar{x}) - F(x_i) .</cmath>
+Evaluating the integrals, the last two inequalities both result in
+<cmath>
+\begin{align*}
+&& F(\bar{x})-F(x_i) &\ge F'(\bar{x})(\bar{x}-x_i) \\
+\Longrightarrow && a_i F(\bar{x}) - a_i F(x_i) &\ge F'(\bar{x})(a_i\bar{x}-a_i x_i) && \text{as } a_i>0 \\
+\Longrightarrow && F(\bar{x}) - \sum_{i=1}^n a_i F(x_i) &\ge F'(\bar{x})\left(\bar{x} - \sum_{i=1}^n a_i x_i \right) && \text{as } \sum_{i=1}^n a_i = 1 \\
+\Longrightarrow && F(\bar{x}) &\ge \sum_{i=1}^n a_i F(x_i) && \text{as } \bar{x}=\sum_{i=1}^n a_ix_i
+\end{align*}
+</cmath>
+as desired.
 One of the simplest examples of Jensen's inequality is the [[quadratic mean]] - [[arithmetic mean]] inequality. Take <math>F(x)=x^2</math> (verify that <math>F'(x)=2x</math> and <math>F''(x)=2>0</math>) and <math>a_1=\dots=a_n=\frac 1n</math>. You'll get <math>\left(\frac{x_1+\dots+x_n}{n}\right)^2\le \frac{x_1^2+\dots+ x_n^2}{n} </math>. Similarly, [[arithmetic mean]]-[[geometric mean]] inequality can be obtained from Jensen's inequality by considering <math>F(x)=-\log x</math>.

Page

Toolbox

Search