Advanced Calculus: Rigorous Integration Theory, Special Forms & Numerical Algorithms

Integral calculus is one of the foundational pillars of modern mathematical physics, continuous probability theory, and machine learning. At its core, integration measures cumulative quantity—whether computing areas under curves, volumes of higher-dimensional manifolds, or total probability densities.

Series·Interactive Multivariable Calculus & Geometry

Chapter 4 of 5

1Geometric Mastery: Circle Equations, Parametric Geometry & Interactive Proofs

Read →

2Calculus & Geometry: 2D Function Analysis, Tangent Slopes & Interactive Curve Plotting

Read →

3Multivariable Calculus: 3D Quadric Surfaces, Implicit Equations & Interactive WebGL Geometry

Read →

4Advanced Calculus: Rigorous Integration Theory, Special Forms & Numerical Algorithms

Current

5Step-by-Step Calculus Solutions: Three Classic Definite & Indefinite Integration Problems

Read →

Multivariable Calculus: 3D Quadric Surfaces, Implicit Equations & Interactive WebGL Geometry

Step-by-Step Calculus Solutions: Three Classic Definite & Indefinite Integration Problems

1. The Fundamental Definition: Riemann Sums & Limit Processes

The definite integral of a real-valued function $f(x)$ over a closed interval $[a, b]$ is defined as the limit of a Riemann sum as the mesh size of the partition approaches zero:

\int_{a}^{b} f(x) \, dx = \lim_{\|\Delta x\| \to 0} \sum_{i=1}^{n} f(x_i^*) \, \Delta x_i

Where:

$P = \{x_0, x_1, \dots, x_n\}$ is a partition of $[a, b]$ with $x_0 = a$ and $x_n = b$ .
$\Delta x_i = x_i - x_{i-1}$ represents the width of the $i$ -th subinterval.
$x_i^* \in [x_{i-1}, x_i]$ is an arbitrary sample evaluation point.

If this limit exists independently of the choice of partition $P$ and sample points $x_i^*$ , the function $f(x)$ is declared Riemann integrable.

2. Fundamental Theorem of Calculus (FTC)

The Fundamental Theorem of Calculus bridges differential operator rates of change with cumulative integral accumulation.

Part 1: Accumulation Function Derivative

If $f(x)$ is continuous on $[a, b]$ , then the accumulation function $g(x) = \int_{a}^{x} f(t) \, dt$ is continuous on $[a, b]$ , differentiable on $(a, b)$ , and satisfies:

g'(x) = \frac{d}{dx} \left[ \int_{a}^{x} f(t) \, dt \right] = f(x)

Part 2: Evaluation Theorem

If $F(x)$ is any antiderivative of $f(x)$ such that $F'(x) = f(x)$ , then:

\int_{a}^{b} f(x) \, dx = F(b) - F(a) = \Big[ F(x) \Big]_{a}^{b}

3. Advanced Integration Techniques & Analytical Solutions

Integration by Parts

Derived directly from the differential product rule $d(uv) = u \, dv + v \, du$ :

\int u \, dv = u v - \int v \, du

For example, integrating $x \cdot e^x$ :

\int x \, e^x \, dx = x e^x - \int e^x \, dx = e^x (x - 1) + C

The Gaussian Integral (Euler-Poisson Integral)

One of the most essential integrals in statistics and quantum mechanics is the Gaussian probability integral:

I = \int_{-\infty}^{\infty} e^{-x^2} \, dx = \sqrt{\pi}

Step-by-Step Proof: Gaussian Integral Evaluation

Handwritten Engineering Computation Pad

Notebook Pad

Square the integral I to express as a double Cartesian surface integral[Variable Independence]

$I^2 = \left( \int_{-\infty}^{\infty} e^{-x^2} dx \right) \left( \int_{-\infty}^{\infty} e^{-y^2} dy \right) = \int_{-\infty}^{\infty} \int_{-\infty}^{\infty} e^{-(x^2+y^2)} dx dy$

Convert differential area element to Polar Coordinates (r, theta)[Jacobian Transformation]

$x^2 + y^2 = r^2, \quad dx dy = r dr d\theta$

Separate angular component d\theta and radial component r dr[Radial Symmetry]

$I^2 = \int_{0}^{2\pi} d\theta \int_{0}^{\infty} r e^{-r^2} dr = 2\pi \cdot \int_{0}^{\infty} r e^{-r^2} dr$

Apply u-substitution: u = r^2, du = 2r dr[U-Substitution]

$I^2 = 2\pi \cdot \left[ -\frac{1}{2} e^{-r^2} \right]_{0}^{\infty} = 2\pi \cdot \left( 0 - \left( -\frac{1}{2} \right) \right) = \pi$

Take square root to obtain final result[Final Evaluation]

$I = \int_{-\infty}^{\infty} e^{-x^2} dx = \sqrt{\pi}$

4. Numerical Quadrature Implementations

When analytical antiderivatives do not exist (e.g. $\int e^{-x^2} dx$ ), numerical quadrature algorithms estimate the definite integral.

1import numpy as np
2from scipy.integrate import quad
3import sympy as sp
4
5# 1. Analytical Symbolic Integration using SymPy
6x = sp.Symbol('x')
7f_expr = sp.exp(-x**2)
8exact_indefinite = sp.integrate(f_expr, x)
9print(f"[SymPy] Indefinite Integral of e^(-x^2): {exact_indefinite}")
10
11# 2. Numerical Integration using Composite Simpson's 1/3 Rule
12def simpsons_rule(f, a, b, n=1000):
13    if n % 2 != 0:
14        n += 1  # n must be even for Simpson's rule
15    x_pts = np.linspace(a, b, n + 1)
16    h = (b - a) / n
17    y_pts = f(x_pts)
18    
19    integral = (h / 3) * (y_pts[0] + 4 * np.sum(y_pts[1:-1:2]) + 2 * np.sum(y_pts[2:-2:2]) + y_pts[-1])
20    return integral
21
22# Evaluate Gaussian integral from -5 to +5
23gaussian = lambda x: np.exp(-x**2)
24approx = simpsons_rule(gaussian, -5.0, 5.0, n=10000)
25exact_scipy, err = quad(gaussian, -np.inf, np.inf)
26
27print(f"[Simpson's 1/3] Computed Integral: {approx:.8f}")
28print(f"[SciPy Quad] Exact Integral:      {exact_scipy:.8f} (Error: {err:.2e})")
29print(f"[Theoretical] sqrt(pi):            {np.sqrt(np.pi):.8f}")

5. Summary Equation Reference Table

Formula Name	Analytical Expression	Primary Use Case
Definite Integral	$\int_{a}^{b} f(x) dx = F(b) - F(a)$	Computing net accumulated area
Gaussian Integral	$\int_{-\infty}^{\infty} e^{-x^2} dx = \sqrt{\pi}$	Normal probability density normalization
Integration by Parts	$\int u \, dv = uv - \int v \, du$	Products of transcendental functions
Laplace Transform	$\mathcal{L}\{f(t)\} = \int_{0}^{\infty} e^{-st} f(t) dt$	Differential equation domain transformation

Series·Interactive Multivariable Calculus & Geometry

Chapter 4 of 5

1Geometric Mastery: Circle Equations, Parametric Geometry & Interactive Proofs

Read →

2Calculus & Geometry: 2D Function Analysis, Tangent Slopes & Interactive Curve Plotting

Read →

3Multivariable Calculus: 3D Quadric Surfaces, Implicit Equations & Interactive WebGL Geometry

Read →

4Advanced Calculus: Rigorous Integration Theory, Special Forms & Numerical Algorithms

Current

5Step-by-Step Calculus Solutions: Three Classic Definite & Indefinite Integration Problems

Read →

Multivariable Calculus: 3D Quadric Surfaces, Implicit Equations & Interactive WebGL Geometry

Step-by-Step Calculus Solutions: Three Classic Definite & Indefinite Integration Problems

1. The Fundamental Definition: Riemann Sums & Limit Processes

The definite integral of a real-valued function $f(x)$ over a closed interval $[a, b]$ is defined as the limit of a Riemann sum as the mesh size of the partition approaches zero:

\int_{a}^{b} f(x) \, dx = \lim_{\|\Delta x\| \to 0} \sum_{i=1}^{n} f(x_i^*) \, \Delta x_i

Where:

$P = \{x_0, x_1, \dots, x_n\}$ is a partition of $[a, b]$ with $x_0 = a$ and $x_n = b$ .
$\Delta x_i = x_i - x_{i-1}$ represents the width of the $i$ -th subinterval.
$x_i^* \in [x_{i-1}, x_i]$ is an arbitrary sample evaluation point.

If this limit exists independently of the choice of partition $P$ and sample points $x_i^*$ , the function $f(x)$ is declared Riemann integrable.

2. Fundamental Theorem of Calculus (FTC)

The Fundamental Theorem of Calculus bridges differential operator rates of change with cumulative integral accumulation.

Part 1: Accumulation Function Derivative

If $f(x)$ is continuous on $[a, b]$ , then the accumulation function $g(x) = \int_{a}^{x} f(t) \, dt$ is continuous on $[a, b]$ , differentiable on $(a, b)$ , and satisfies:

g'(x) = \frac{d}{dx} \left[ \int_{a}^{x} f(t) \, dt \right] = f(x)

Part 2: Evaluation Theorem

If $F(x)$ is any antiderivative of $f(x)$ such that $F'(x) = f(x)$ , then:

\int_{a}^{b} f(x) \, dx = F(b) - F(a) = \Big[ F(x) \Big]_{a}^{b}

3. Advanced Integration Techniques & Analytical Solutions

Integration by Parts

Derived directly from the differential product rule $d(uv) = u \, dv + v \, du$ :

\int u \, dv = u v - \int v \, du

For example, integrating $x \cdot e^x$ :

\int x \, e^x \, dx = x e^x - \int e^x \, dx = e^x (x - 1) + C

The Gaussian Integral (Euler-Poisson Integral)

One of the most essential integrals in statistics and quantum mechanics is the Gaussian probability integral:

I = \int_{-\infty}^{\infty} e^{-x^2} \, dx = \sqrt{\pi}

Step-by-Step Proof: Gaussian Integral Evaluation

Handwritten Engineering Computation Pad

Notebook Pad

Square the integral I to express as a double Cartesian surface integral[Variable Independence]

$I^2 = \left( \int_{-\infty}^{\infty} e^{-x^2} dx \right) \left( \int_{-\infty}^{\infty} e^{-y^2} dy \right) = \int_{-\infty}^{\infty} \int_{-\infty}^{\infty} e^{-(x^2+y^2)} dx dy$

Convert differential area element to Polar Coordinates (r, theta)[Jacobian Transformation]

$x^2 + y^2 = r^2, \quad dx dy = r dr d\theta$

Separate angular component d\theta and radial component r dr[Radial Symmetry]

$I^2 = \int_{0}^{2\pi} d\theta \int_{0}^{\infty} r e^{-r^2} dr = 2\pi \cdot \int_{0}^{\infty} r e^{-r^2} dr$

Apply u-substitution: u = r^2, du = 2r dr[U-Substitution]

$I^2 = 2\pi \cdot \left[ -\frac{1}{2} e^{-r^2} \right]_{0}^{\infty} = 2\pi \cdot \left( 0 - \left( -\frac{1}{2} \right) \right) = \pi$

Take square root to obtain final result[Final Evaluation]

$I = \int_{-\infty}^{\infty} e^{-x^2} dx = \sqrt{\pi}$

4. Numerical Quadrature Implementations

When analytical antiderivatives do not exist (e.g. $\int e^{-x^2} dx$ ), numerical quadrature algorithms estimate the definite integral.

1import numpy as np
2from scipy.integrate import quad
3import sympy as sp
4
5# 1. Analytical Symbolic Integration using SymPy
6x = sp.Symbol('x')
7f_expr = sp.exp(-x**2)
8exact_indefinite = sp.integrate(f_expr, x)
9print(f"[SymPy] Indefinite Integral of e^(-x^2): {exact_indefinite}")
10
11# 2. Numerical Integration using Composite Simpson's 1/3 Rule
12def simpsons_rule(f, a, b, n=1000):
13    if n % 2 != 0:
14        n += 1  # n must be even for Simpson's rule
15    x_pts = np.linspace(a, b, n + 1)
16    h = (b - a) / n
17    y_pts = f(x_pts)
18    
19    integral = (h / 3) * (y_pts[0] + 4 * np.sum(y_pts[1:-1:2]) + 2 * np.sum(y_pts[2:-2:2]) + y_pts[-1])
20    return integral
21
22# Evaluate Gaussian integral from -5 to +5
23gaussian = lambda x: np.exp(-x**2)
24approx = simpsons_rule(gaussian, -5.0, 5.0, n=10000)
25exact_scipy, err = quad(gaussian, -np.inf, np.inf)
26
27print(f"[Simpson's 1/3] Computed Integral: {approx:.8f}")
28print(f"[SciPy Quad] Exact Integral:      {exact_scipy:.8f} (Error: {err:.2e})")
29print(f"[Theoretical] sqrt(pi):            {np.sqrt(np.pi):.8f}")

5. Summary Equation Reference Table

Formula Name	Analytical Expression	Primary Use Case
Definite Integral	$\int_{a}^{b} f(x) dx = F(b) - F(a)$	Computing net accumulated area
Gaussian Integral	$\int_{-\infty}^{\infty} e^{-x^2} dx = \sqrt{\pi}$	Normal probability density normalization
Integration by Parts	$\int u \, dv = uv - \int v \, du$	Products of transcendental functions
Laplace Transform	$\mathcal{L}\{f(t)\} = \int_{0}^{\infty} e^{-st} f(t) dt$	Differential equation domain transformation