Difference between revisions of "Power Mean Inequality"

m (The Mean)
m (Inequality)
 
(45 intermediate revisions by 22 users not shown)
Line 1: Line 1:
=== The Mean ===
+
The '''Power Mean Inequality''' is a generalized form of the multi-variable [[Arithmetic Mean-Geometric Mean]] Inequality.
  
The power mean inequality is a generalized form of the multi-variable AM-GM inequality.
+
== Inequality ==
 +
For <math>n</math> positive real numbers <math>a_i</math> and <math>n</math> positive real weights <math>w_i</math> with sum <math>\sum_{i=1}^n w_i=1</math>, the power mean with exponent <math>t</math>, where <math>t\in\mathbb{R}</math>, is defined by
 +
<cmath>
 +
M(t)=
 +
\begin{cases}
 +
\prod_{i=1}^n a_i^{w_i} &\text{if } t=0 \\
 +
\left(\sum_{i=1}^n w_ia_i^t \right)^{\frac{1}{t}} &\text{otherwise}
 +
\end{cases}.
 +
</cmath>
  
The kth "Power Mean", with exponent k and a series (a_i) of positive real numbers is ,
+
(<math>M(0)</math> is the [[AM-GM_Inequality#Weighted_AM-GM_Inequality|weighted geometric mean]].)
  
:<math>
+
The Power Mean Inequality states that for all real numbers <math>k_1</math> and <math>k_2</math>, <math>M(k_1)\ge M(k_2)</math> if <math>k_1>k_2</math>. In particular, for nonzero <math>k_1</math> and <math>k_2</math>, and equal weights (i.e. <math>w_i=1/n</math>), if <math>k_1>k_2</math>, then
M(k) = \left( \frac{\sum_{i=1}^n a_{i}^k}{n} \right) ^ {\frac{1}{k}}
+
<cmath>
</math>
+
\left( \frac{1}{n} \sum_{i=1}^n a_{i}^{k_1} \right)^{\frac{1}{k_1}}  \ge \left( \frac{1}{n} \sum_{i=1}^n a_{i}^{k_2} \right)^{\frac{1}{k_2}}.
 +
</cmath>  
  
(The case k=0 is taken to be the geometic mean)
+
Considering the limiting behavior, we also have <math>\lim_{t\rightarrow +\infty} M(t)=\max\{a_i\}</math>, <math>\lim_{t\rightarrow -\infty} M(t)=\min\{a_i\}</math> and <math>\lim_{t\rightarrow 0} M(t)= M(0)</math>.
  
===  Inequality ===
+
The Power Mean Inequality follows from [[Jensen's Inequality]].
  
If &minus;&infin; &le; ''a'' < ''b'' &le; &infin;, then M(''a'') &le; M(''b''). Equality if and only if ''a''<sub>1</sub> = ''a''<sub>2</sub> = ... = ''a''<sub>''n''</sub>, following from <math>\frac{\partial M(t)}{\partial t}\geq 0</math> for &minus;&infin; &le; ''t'' &le; &infin;, proved with [[Jensen's inequality]].
+
== Proof ==
 +
We prove by cases:
 +
 
 +
1. <math>M(t)\ge M(0)\ge M(-t)</math> for <math>t>0</math>
 +
 
 +
2. <math>M(k_1)\ge M(k_2)</math> for <math>k_1 \ge k_2</math> with <math>k_1k_2>0</math>
 +
 
 +
Case 1:
 +
 
 +
Note that
 +
<cmath>
 +
\begin{align*}
 +
&& \left(\sum_{i=1}^n w_ia_i^{t} \right)^{\frac{1}{t}} &\ge \prod_{i=1}^n a_i^{w_i} \\
 +
\Longleftarrow && \frac{1}{t} \ln\left( \sum_{i=1}^n w_i a_i^{t} \right) &\ge \sum_{i=1}^n w_i \ln{a_i} && \text{as } e^x \text{ is increasing} \\
 +
\Longleftarrow && \ln\left( \sum_{i=1}^n w_i a_i^{t} \right) &\ge \sum_{i=1}^n w_i \ln{a_i^t} && \text{as } t>0
 +
\end{align*}
 +
</cmath>
 +
As <math>\ln(x)</math> is concave, by [[Jensen's Inequality]], the last inequality is true, proving <math>M(t)\ge M(0)</math>. By replacing <math>t</math> by <math>-t</math>, the last inequality implies <math>M(0)\ge M(-t)</math> as the inequality signs are flipped after multiplication by <math>-\frac{1}{t}</math>.
 +
 
 +
 
 +
Case 2:
 +
 
 +
For <math>k_1\ge k_2>0</math>,
 +
<cmath>
 +
\begin{align}
 +
&& \left(\sum_{i=1}^n w_ia_i^{k_1} \right)^{\frac{1}{k_1}} &\ge \left(\sum_{i=1}^n w_ia_i^{k_2} \right)^{\frac{1}{k_2}} \nonumber \\
 +
\Longleftarrow && \left(\sum_{i=1}^n w_ia_i^{k_1} \right)^{\frac{k_2}{k_1}} &\ge \sum_{i=1}^n w_ia_i^{k_2} \label{eq}
 +
\end{align}
 +
</cmath>
 +
As the function <math>f(x)=x^{\frac{k_2}{k_1}}</math> is concave for all <math>x > 0</math>, by [[Jensen's Inequality]],
 +
<cmath>
 +
\left(\sum_{i=1}^n w_i a_i^{k_1} \right)^{\frac{k_2}{k_1}}
 +
= f\left(\sum_{i=1}^n w_i a_i^{k_1} \right)
 +
\geq \sum_{i=1}^n w_i f\left(a_i^{k_1}\right)
 +
=\sum_{i=1}^n w_i a_{i}^{k_2}
 +
</cmath>
 +
For <math>0>k_1\ge k_2</math>, <math>f(x)</math> becomes convex as <math>|k_1|\le |k_2|</math>, so the inequality sign when applying Jensen's Inequality is flipped. Thus, the inequality sign in <math>(1)</math> is flipped, but as <math>k_2<0</math>, <math>x^\frac{1}{k_2}</math> is a decreasing function, the inequality sign is flipped again after applying <math>x^{\frac{1}{k_2}}</math>, resulting in <math>M(k_1)\ge M(k_2)</math> as desired.
 +
 
 +
[[Category:Algebra]]
 +
[[Category:Inequalities]]

Latest revision as of 12:57, 23 August 2024

The Power Mean Inequality is a generalized form of the multi-variable Arithmetic Mean-Geometric Mean Inequality.

Inequality

For $n$ positive real numbers $a_i$ and $n$ positive real weights $w_i$ with sum $\sum_{i=1}^n w_i=1$, the power mean with exponent $t$, where $t\in\mathbb{R}$, is defined by \[M(t)= \begin{cases} \prod_{i=1}^n a_i^{w_i} &\text{if } t=0 \\ \left(\sum_{i=1}^n w_ia_i^t \right)^{\frac{1}{t}} &\text{otherwise} \end{cases}.\]

($M(0)$ is the weighted geometric mean.)

The Power Mean Inequality states that for all real numbers $k_1$ and $k_2$, $M(k_1)\ge M(k_2)$ if $k_1>k_2$. In particular, for nonzero $k_1$ and $k_2$, and equal weights (i.e. $w_i=1/n$), if $k_1>k_2$, then \[\left( \frac{1}{n} \sum_{i=1}^n a_{i}^{k_1} \right)^{\frac{1}{k_1}}  \ge \left( \frac{1}{n} \sum_{i=1}^n a_{i}^{k_2} \right)^{\frac{1}{k_2}}.\]

Considering the limiting behavior, we also have $\lim_{t\rightarrow +\infty} M(t)=\max\{a_i\}$, $\lim_{t\rightarrow -\infty} M(t)=\min\{a_i\}$ and $\lim_{t\rightarrow 0} M(t)= M(0)$.

The Power Mean Inequality follows from Jensen's Inequality.

Proof

We prove by cases:

1. $M(t)\ge M(0)\ge M(-t)$ for $t>0$

2. $M(k_1)\ge M(k_2)$ for $k_1 \ge k_2$ with $k_1k_2>0$

Case 1:

Note that \begin{align*} && \left(\sum_{i=1}^n w_ia_i^{t} \right)^{\frac{1}{t}} &\ge \prod_{i=1}^n a_i^{w_i} \\ \Longleftarrow && \frac{1}{t} \ln\left( \sum_{i=1}^n w_i a_i^{t} \right) &\ge \sum_{i=1}^n w_i \ln{a_i} && \text{as } e^x \text{ is increasing} \\ \Longleftarrow && \ln\left( \sum_{i=1}^n w_i a_i^{t} \right) &\ge \sum_{i=1}^n w_i \ln{a_i^t} && \text{as } t>0 \end{align*} As $\ln(x)$ is concave, by Jensen's Inequality, the last inequality is true, proving $M(t)\ge M(0)$. By replacing $t$ by $-t$, the last inequality implies $M(0)\ge M(-t)$ as the inequality signs are flipped after multiplication by $-\frac{1}{t}$.


Case 2:

For $k_1\ge k_2>0$, \begin{align} && \left(\sum_{i=1}^n w_ia_i^{k_1} \right)^{\frac{1}{k_1}} &\ge \left(\sum_{i=1}^n w_ia_i^{k_2} \right)^{\frac{1}{k_2}} \nonumber \\ \Longleftarrow && \left(\sum_{i=1}^n w_ia_i^{k_1} \right)^{\frac{k_2}{k_1}} &\ge \sum_{i=1}^n w_ia_i^{k_2} \label{eq} \end{align} As the function $f(x)=x^{\frac{k_2}{k_1}}$ is concave for all $x > 0$, by Jensen's Inequality, \[\left(\sum_{i=1}^n w_i a_i^{k_1} \right)^{\frac{k_2}{k_1}} = f\left(\sum_{i=1}^n w_i a_i^{k_1} \right) \geq \sum_{i=1}^n w_i f\left(a_i^{k_1}\right) =\sum_{i=1}^n w_i a_{i}^{k_2}\] For $0>k_1\ge k_2$, $f(x)$ becomes convex as $|k_1|\le |k_2|$, so the inequality sign when applying Jensen's Inequality is flipped. Thus, the inequality sign in $(1)$ is flipped, but as $k_2<0$, $x^\frac{1}{k_2}$ is a decreasing function, the inequality sign is flipped again after applying $x^{\frac{1}{k_2}}$, resulting in $M(k_1)\ge M(k_2)$ as desired.