Thursday 24 June 2021

Discrete Sums to Continuous Integrals with Abel's Partial Summation Formula

It is often easier to understand how a discrete function behaves if it can be expressed as a continuous function. Abel's partial summation formula allows us to write a discrete sum as continuous integral.



In this blog post we'll derive the partial summation formula, and show a simple example of its power.

The video for this post is at [youtube], and the slides are here [pdf].


A Useful Object

The following is a sum over an arithmetic function $a(n)$ weighted by a smooth function $f(x)$. 

$$\sum_{x_{1}<n\leq x_{2}}a(n)f(n)$$

This is a useful general object to find an integral form for, because it gives us flexibility in choosing the arithmetic and smooth functions. 

To be more precise about the functions, $a(n)$ takes only positive integers $n\geq1$, and $f(x)$ has a continuous derivative over the domain $[x_{1},x_{2}]$. Both $a(n)$ and $f(x)$ can be complex.


Deriving An Integral Form

If you look ahead, the derivation of an integral form for the sum might look overwhelming, but it is just lots of simple algebra.

Because $a(n)$ is only defined over integers $n\geq1$, we can clarify the sum by setting $m_{1}=\left\lfloor x_{1}\right\rfloor$  and $m_{2}=\left\lfloor x_{2}\right\rfloor$. Remember that $\left\lfloor x\right\rfloor$  is the largest integer up to, and including, $x$.

$$\sum_{x_{1}<n\leq x_{2}}a(n)f(n)=\sum_{n=m_{1}+1}^{m_{2}}a(n)f(n)$$

Let's define $A(x)=\sum_{n\leq x}a(n)$. By definition $a(n)=A(n)-A(n-1)$ so we can replace $a(n)$.

$$\begin{align}\sum_{m_{1}+1}^{m_{2}}a(n)f(n)&=\sum_{m_{1}+1}^{m_{2}}\left[A(n)-A(n-1)\right]f(n)\\ \\ &=\sum_{m_{1}+1}^{m_{2}}A(n)f(n)-\sum_{m_{1}}^{m_{2}-1}A(n)f(n+1)\end{align}$$

The two sums have different limits for n, but both cover $[m_{1}+1,m_{2}-1]$.

$$\begin{align}\sum_{m_{1}+1}^{m_{2}}a(n)f(n) &=\sum_{m_{1}+1}^{m_{2}-1}A(n)\left[f(n)-f(n+1)\right] \\ \\ &+A(m_{2})f(m_{2})-A(m_{1})f(m_{1}+1)\end{align}$$

Noticing that $\int_{n}^{n+1}f'(t)dt=f(n+1)-f(n)$ allows us to introduce the integral.

$$\begin{align}\sum_{m_{1}+1}^{m_{2}}a(n)f(n) &=-\sum_{m_{1}+1}^{m_{2}-1}A(n)\int_{n}^{n+1}f'(t)dt \\ \\ &+A(m_{2})f(m_{2})-A(m_{1})f(m_{1}+1)\end{align}$$

Now, because $A(t)=A(n)$ over the interval $[n,n+1)$, we can move $A(n)$ it inside the integral as $A(t)$.

$$\begin{align}\sum_{m_{1}+1}^{m_{2}}a(n)f(n) &=-\sum_{m_{1}+1}^{m_{2}-1}\int_{n}^{n+1}A(t)f'(t)dt\\ \\ &+A(m_{2})f(m_{2})-A(m_{1})f(m_{1}+1)\end{align}$$

That sum of integrals over consecutive intervals can be simplified to a single integral. 

$$\begin{align}\sum_{x_{1}<n\leq x_{2}}a(n)f(n) &=-\int_{m_{1}+1}^{m_{2}}A(t)f'(t)dt\\ \\ &+A(m_{2})f(m_{2})-A(m_{1})f(m_{1}+1)\end{align}$$

We now need to adjust the integration limits back to $x_{1}$ and $x_{2}$, not forgetting the intervals to $m_{1}$ and $m_{2}$. Writing out the integrals that split the interval $[x_{1},x_{2}]$ is helpful.

$$\int_{x_{1}}^{x_{2}}Xdt=\int_{m_{1}+1}^{m_{2}}Xdt+\int_{x_{1}}^{m_{1}+1}Xdt+\int_{m_{2}}^{x_{2}}Xdt$$

Rearranging, and noticing that $A(t)=A(x_{1})$ over the interval $[x_{1},m_{1}+1)$, and $A(t)=A(x_{2})$ over the interval $[m_{2},x_{2}]$, gives us the following.

$$\begin{align}-\int_{m_{1}+1}^{m_{2}}A(t)f'(t)dt&=\int_{x_{1}}^{m_{1}+1}A(t)f'(t)dt+\int_{m_{2}}^{x_{2}}A(t)f'(t)dt\\ \\ &-\int_{x_{1}}^{x_{2}}A(t)f'(t)dt\\ \\ &=A(x_{1})\left[f(m_{1}+1)-f(x_{1})\right]+A(x_{2})\left[f(x_{2})-f(m_{2})\right]\\ \\ &-\int_{x_{1}}^{x_{2}}A(t)f'(t)dt\end{align}$$

We plug this integral back into our object, then use $A(m_{1})=A(x_{1})$ and $A(m_{2})=A(x_{2})$.

$$\begin{align}\sum_{x_{1}<n\leq x_{2}}a(n)f(n)&=A(x_{2})f(m_{2})-A(x_{1})f(m_{1}+1)\\ \\ &+A(x_{1})\left[f(m_{1}+1)-f(x_{1})\right]+A(x_{2})\left[f(x_{2})-f(m_{2})\right]\\ \\ &-\int_{x_{1}}^{x_{2}}A(t)f'(t)dt\end{align}$$

Many of these terms cancel out, leaving us with the much neater Abel Identity, as it is also called.

$$\boxed{\sum_{x_{1}<n\leq x_{2}}a(n)f(n)=A(x_{2})f(x_{2})-A(x_{1})f(x_{1})-\int_{x_{1}}^{x_{2}}A(t)f'(t)dt}$$

In many cases $n$ starts at 1, and so the formula reduces further. 

$$\boxed{\sum_{1\leq n\leq x_{2}}a(n)f(n)=A(x_{2})f(x_{2})-\int_{1}^{x_{2}}A(t)f'(t)dt}$$

The lower limit of the integral is 1 because $A(t)=0$ in the range $[0,1)$.


Example: Growth of $\sum1/n$

Abel's identity is particularly useful for clarifying the asymptotic behaviour of discrete functions. Let's illustrate its use to show the how the harmonic series $\sum_{1}^{N}1/n$ grows.

We can choose $a(n)=1$ and $f(x)=1/x$, which means $A(x)=\left\lfloor x\right\rfloor$  and $f'(x)=-1/x^{2}$. 

$$\begin{align}\sum_{n\leq N}\frac{1}{n}&=A(N)f(N)-\int_{1}^{N}A(t)f't)\\ \\ &=\frac{N-\{N\}}{N}+\int_{1}^{N}\frac{t-\{t\}}{t^{2}}dt\end{align}$$

We've used $\left\lfloor x\right\rfloor =x-\{x\}$, where $\{x\}$ is the fractional part of $x$. This also lets us split the integral into manageable parts.

$$\sum_{0<n\leq N}\frac{1}{n}=1+\mathcal{O}\left(\frac{1}{N}\right)+\int_{1}^{N}\frac{1}{t}dt-\int_{1}^{N}\frac{\{t\}}{t^{2}}dt$$

Because $\{t\}$ is only ever in the range $[0,1)$, the last integral is always less than $\int_{1}^{N}1/t^{2}dt$, that is, $\mathcal{O}\left(\left[-1/t\right]_{1}^{N}\right)$.

$$\begin{align}\sum_{0<n\leq N}\frac{1}{n}&=1+\mathcal{O}\left(\frac{1}{N}\right)+\ln(N)+\mathcal{O}\left(1-\frac{1}{N}\right)\\ \\ &=\ln(N)+\mathcal{O}\left(1\right)\end{align}$$

This tells us the harmonic series grows like $\ln(N)$, a powerful result derived easily using the Abel identity. It also tells us the difference is bounded by 1. In fact, the difference tends to the Euler–Mascheroni constant $\gamma\approx0.5772$ which pops up in several areas of number theory and analysis.

No comments:

Post a Comment