The Rigorous Foundation of Limits: The $\varepsilon$-$\delta$ Definition

Prakash

In calculus, we often talk intuitively about limits: “as $x$ gets closer and closer to $a$, $f(x)$ gets closer and closer to $L$.” But what does “close” actually mean? To build calculus on solid logical ground, mathematicians in the 19th century; most notably Augustin-Louis Cauchy and Karl Weierstrass formalized this notion using the $\varepsilon$-$\delta$ definition of a limit.

The Definition

A function $f(x)$ is said to have a limit $L$ as $x$ approaches a point $a$, written as

\begin{align*} \lim_{x \to a} f(x) = L \end{align*}

if and only if:

For every $\varepsilon > 0$, there exists a $\delta > 0$ such that for all $x$, if $0 < |x - a| < \delta$, then $|f(x) - L| < \varepsilon$.

Breaking It Down Piece by Piece

To truly understand this definition, it helps to read it as a challenge game between two players, Skeptic ($\varepsilon$) and Defender ($\delta$):

  1. Skeptic’s Challenge ($\varepsilon$): Skeptic gives you a small positive number $\varepsilon$. They are saying: “I want the output $f(x)$ to be strictly within a distance of $\varepsilon$ from $L$.” This defines a vertical tolerance band around $L$: $(L - \varepsilon, L + \varepsilon)$.
  2. Defender’s Response ($\delta$): Your job as the Defender is to find a corresponding positive number $\delta$ such that whenever $x$ is within a distance of $\delta$ from $a$ (excluding $a$ itself, i.e., $0 < |x - a| < \delta$), the corresponding output $f(x)$ lands safely inside Skeptic’s vertical band. This defines a horizontal interval around $a$: $(a - \delta, a + \delta)$.

If the Defender can always find a winning $\delta$ no matter how maliciously small $\varepsilon$ Skeptic throws at them, then the limit exists and equals $L$.

This interactive plot shows the concept of changing $\varepsilon$ to require finding a corresponding $\delta$. For any given epsilon, which can be adjusted with the slider, you can find a delta, provided that $L$ is chosen as the true limit over which the band of $\varepsilon$ is taken.

A Concrete Example

Let’s prove that $\lim_{x \to 3} (2x + 1) = 7$ using the $\varepsilon$-$\delta$ definition.

Step 1: Scratchwork (Finding the relationship between $\delta$ and $\varepsilon$)

We want to find a $\delta > 0$ such that whenever $0 < |x - 3| < \delta$, we have:

\begin{align*} |(2x + 1) - 7| < \varepsilon \end{align*}

Let’s simplify the inequality inside the absolute value for our target output:

\begin{align*} |2x - 6| < \varepsilon \\ 2|x - 3| < \varepsilon \\ |x - 3| < \frac{\varepsilon}{2} \end{align*}

This scratchwork reveals the exact relationship: if we choose $\delta = \frac{\varepsilon}{2}$, our proof will work!

Step 2: The Formal Proof

Let $\varepsilon > 0$ be given. Choose $\delta = \frac{\varepsilon}{2}$.

Now, assume that $0 < |x - 3| < \delta$. Then:

\begin{align*} |(2x + 1) - 7| &= |2x - 6| \\ &= 2|x - 3| \\ &< 2\delta \\ &= 2\left(\frac{\varepsilon}{2}\right) = \varepsilon \end{align*}

Thus, whenever $0 < |x - 3| < \delta$, we have $|(2x + 1) - 7| < \varepsilon$. Therefore, by the formal definition, $\lim_{x \to 3} (2x + 1) = 7$.

Why Do We Need It?

Intuition is a powerful guide, but it can also lead to paradoxes and false assumptions, especially when dealing with continuous but non-differentiable functions, infinite limits, or pathological behaviors. The $\varepsilon$-$\delta$ definition removes all ambiguity, turning vague geometric notions into precise mathematical proofs. It forms the rigorous backbone of mathematical analysis, continuity, derivatives, and integration.