r/math•
AngelTC

What are some interesting linear functions?

My favorite exercise to give to students when I teach linear algebra is to calculate the Jordan canonical form of the differentiation operator on the space of degree (at most) n polynomials, but a few years back some students came to me to ask me to please mix it up a little as the examples involving this operator were a bit complicated for them but the ones that werent about this operator were too easy for them ( I was just doing random matrices that I knew werent too hard, or simple stuff corresponding to transformations in space ).

So, to be precise, my question is about linear transformations between spaces that are interesting, by this I mean Im looking for transformation that show up in nature, that are challenging but one can still do pencil and paper computations on them at the level of your universities' 2nd year linear algebra course ( or 1st or 3rd or whatever ).

Posted Feb 8, 2021, 3:50 PM UTC · edited

5759
Electrical-Ad-1798•

Derivative, integral and by extension of the integral, transforms like Fourier, LaPlace.

36
AngelTCOPAlgebraic Geometry•

Between what spaces?

17
bluesam3Algebra•

Any reasonable spaces where they're defined.

26
AngelTCOPAlgebraic Geometry•

This is what's wrong with mathematics smh

84
Remarkable-Win2859•

The answer you seek exists and is reasonably well defined. Goodbye.

89
twoface117Undergraduate•

Decent answer: consider the span of {e^t, e^(2t)} sitting inside a function space. The derivative function can be represented by multiplying an element of the span by a matrix, which is pretty neat. Can you see what the matrix should be?

(Not giving the matrix partially for the exercise but mostly bc I don't want to type it out on my phone lol)

13
NimkolpTheory of Computing•

I feel bad for laughing at this - especially since I have no grasp on this thread lol

Best part is that I won’t be surprised if u/bluesam3’s response is the only “correct” answer - even if it’s incredibly vague

9
bluesam3Algebra•

For a specific example: take the linear subspace of C(ℝ) spanned by (x -> cos(ax)) and (x -> sin(ax)) for some (finite, presumably) set of real numbers a.

6
[deleted]•

[deleted]

-1
kfgauss•

One example I like for first year linear algebra is to look at differentiation on a small invariant subspace like the span of {e^3t cos(t), e^3t sin(t)}. On that subspace the derivative operator is actually invertible, and you can calculate a non-trivial antiderivative by inverting the matrix.

14
jagr2808Representation Theory•

For differentiation/integration you could do the space of polynomials, but it's perhaps to easy.

Also something like span{ e^t , te^t , t^(2)e^t , ...} possible also mixing in e^at for other a would make sense.

Are the students familiar with Fourier series/transform? If so something like the transformation from span{ cos(t), sin(t), ...} to C^n computing some appropriate number of fourier coefficients would make sense.

I guess it mostly comes down to what sort of transformations your students are used to.

9
Electrical-Ad-1798•

For one example, if I recall correctly the Fourier transform and its inverse exist on L2[0, 1].

5
Oscar_Cunningham•

They exist on L^(2)(ℝ). But the transform of a function with bounded support never has bounded support itself, so the fourier transform won't restrict to [0,1].

8
Electrical-Ad-1798•

I didn't say the transform or its inverse restrict to that interval.

3
Ualrus•

Similarly, very related to linear differential equations, it's cool to consider how the derivative looks under certain special cases.

For instance, the derivative restricted to [ e^x ] is the identity. The derivative restricted to [sinh,cosh] looks like ((0,1),(1,0)). And then there's cool stuff like the truncated taylor expansion of the exponential gives a companion matrix.

2
GLukacs_ClassWarsProbability•

I immediately want to say "linearity of expectation" as the cardinal example of a linear thing, but of course talking about L1 on an abstract measure space would go way above their heads.

Perhaps something could be done with a collection of dice or something like that, as a more concrete space of random variables?

19
AngelTCOPAlgebraic Geometry•

This would be cool tbh, can make it somewhat interactive and steal the glory from the probability people.

14
IanisVasilev•

To be honest, conditional expectation only clicked for me once I learned that it is a projection operator onto a certain subspace of random variables (just like non-conditional expectation is a linear functional, e.g. a projection onto the subspace of constant random variables). The definitions for conditional expectation that you see in an introductory probability course don't really make a lot of sense.

7
sciflare•

Isn't conditional expectation about disintegration of a measure? You have a measure space (X, 𝜇) and a (trivial) fibration F --> X --> B and you want to prove that there are measures on B and F such that their product measure is 𝜇?

2
IanisVasilev•

This isn't what I was taught in my introductory probability course.

6
GLukacs_ClassWarsProbability•

That is true for variables with finite variance. Once you move out of L2, you obviously can't define conditional expectation as a projection in L2. Then you get into the more complicated definition the other guy was talking about.

2
IanisVasilev•

Does it depend on L2 being a Hilbert space? I guess its time to learn some advanced probability. Can you recommend some read that is neither too basic nor too specific to stochastic processes? Perhaps from the perspective of functional analysis?

1
SchurThingRepresentation Theory•

The usual Lie theory maps. For concreteness, examples for 2x2 matrices are pretty tractable:

  1. conjugation by invertible X on 2x2 matrices, usual basis,

  2. same but use usual bases for symmetric + anti-symmetric matrices,

  3. Fix any Y. Then X -> XY-YX in bases as above,

  4. If physics is on the table, sciflare's example (and its infinitesimal version) leads to angular momentum. You could even hide it in cross-product, curl, etc.

  5. Conjugation by unitary on space of skew-Hermitian matrices.

13
seanziewonzieSpectral Theory•

Maybe the adjacency matrix of a graph.

11
IanisVasilev•

Spectral graph layouts are only a step away from the adjacency matrix. Drawing graphs is a difficult problem that can sometimes be solved using eigendecomposition.

2
Steenan•

Discrete Fourier transform on a small (4 or 8 component) vector

Multiplication by a specific quaternion, treated as a linear operation on R^4

9
innovatedname•

This is an excellent one, I had the privilege of being taught the DFT in my first year and it blew my mind despite my absolutely tiny understanding of linear algebra at the time.

2
IanisVasilev•

Applied statistics relies heavily on linear algebra and the methods have a strong geometric interpretation. For example, linear regression involves "inverting" non-invertible matrices in a lower-dimensional space and rotations of the covariance matrix for bivariate normally distributed populations correspond to finding the canonical equation of an ellipse. Both can be found in a lot of books, e.g. "Practical Regression and Anova using R" (free online) or "Applied Multivatiate Statistics" by Richard Johnson and Dean Wichern.

Also, discrete wavelet transforms can be represented as matrix multiplication. Gilbert Strang has a paper here which shows concrete matrices.

8
M4mb0Machine Learning•

The transpose.

Or more generally let them show that any linear map that takes an (m, n) matrix as input and outputs a (m', n') matrix can be expressed as X -> 𝛴i AiXBi

8
catusePDE•

A particularly useful linear projection is the Littlewood-Paley projection P that projects L^2 to functions which are band-limited to frequencies in the interval [2^j , 2^{j+1} ]. This operator has the useful feature that it's easy to motivate (limiting signals to a specific band of frequencies is, very crudely speaking, how a radio works) but its abstract definition is going to be way beyond a second-year course in linear algebra.

But that's no problem. Look at the vector space V spanned by exp(ikt) where k ranges over integers 1, ..., K. Then P has a very obvious form, namely a diagonal matrix with just 0's and 1's. This is, of course, too easy to diagonalize, but there are probably other bases you could put on V which feel natural but in which P does not have a trivial form. An example that I thought of, which seems way too complicated to implement but also a lot of fun, would be to let the basis consist of K different "songs" (= linear combinations of exp(ikt)) and so in some sense the Littlewood-Paley decomposition would be writing a song as a linear combination of other songs.

6
MathPersonIGuess•

We just talked about this in my PDEs class :D

1
sciflare•

Write down explicitly the double covering map from SU(2) to SO(3).

5
AngelTCOPAlgebraic Geometry•

This seems very far fetched for people that dont know what any of those things mean :P But i wonder if you could rephrase it in a down to earth way.

6

SU(2) is the set of 2x2 matrices with determinant 1. SO(3) is the group of all 3x3 rotation matrices. You can think of these as vector subspaces of the spaces of 2x2 and 3x3 matrices, respectively, with the conditions we put on them equivalent to "fixing" certain entries.

The idea is that each rotation is a determinant-1 transformation which fixes an axis, so you can think of it acting on the 2d plane perpendicular to the axis. But, there are 2 "orientations" you can choose for the axis (in other words, a rotation is clockwise from 1 direction and counterclockwise from the other). So, each rotation in SO(3) corresponds to exactly 2 transformations in SU(2). We call this map a "double cover" in that each element of the image is "covered" exactly twice by elements of the preimage.

4
innovatedname•

Unrelated to the thread, but your post just made covering spaces "click" for me intuitively, thanks.

1

Ah! happy to (inadvertently) help!

1
MagmaMcFry•

This doesn't sound very linear to me.

6
plumpvirgin•

I feel like linear maps acting on the vector space of matrices don't get nearly enough in linear algebra courses, so how about the transpose map? Students in every linear algebra course see the transpose of a matrix, but they don't often do linear algebra on the transposition linear transformation (e.g., represent the transpose via its standard matrix, note that transposition is self-adjoint, compute its eigenvalues (-1 and +1), and so on).

5
foreheadteethAnalysis•

Let $p = \sum_{k=0}^{n-1} a_k z^k$ be a polynomial of degree $n-1$ with coefficients $a = (a_0,\ldots,a_{n-1})$. Let $z_0,\ldots,z_{n-1}$ be n distinct points in the ground field (I use the complex numbers). Clearly the map $F$ from $a$ to $(p(z_0),\ldots,p(z_{n-1}))$ is linear and invertible (its inverse can be computed by any desired polynomial interpolation algorithm). I call the linear map $F$ a Fourier transform, parametrized by the choice of points ${z_k}$.

I call those the "coefficient representation" and the "pointwise representation" of a given polynomial. The advantage of the pointwise representation is that it is easy to multiply polynomials pointwise, but to get the coefficients of a product of polynomials, you have to compute a convolution.

From here, you can compute the matrix $M_F$ of $F$, diagonalize it or whatever. An important special case is when ${z_k}$ enumerate the $n$th roots of unity, there it becomes a bona fide discrete Fourier transform, and the computation of the matrix-vector product $M_F x$ can be efficiently accomplished in $O(n\log n)$ arithmetic operations, instead of $O(n^2)$ by traditional matrix-vector product.

Furthermore, the matrix $M_F$ is unitary and hence it diagonalizes, and its eigenvalues have unit modulus. I realize now though that I've never tried to diagonalize it and I wonder what the eigenvectors are.

4
IanisVasilev•

Some more finite-dimensional linear applied things:

  • The discrete one-period model for option pricing (M. Dothan - Prices In Financial Markets).
  • The simplex method from linear optimization (sorry, I haven't looked for good English resources on the subject).
  • Some graph optimization algorithms can be computed via matrices over dioids (M. Gondran, M. Minoux - Graphs and Algorithms).
3
AngelTCOPAlgebraic Geometry•

These look good, I learned about the simplex method when I took linear algebra and loved it, although at the time I wasnt sure why we were doing that in a linear algebra course, but it was cool nontheless.

Maybe ill motivate myself to learn the tiniest bit of math finance just for this.

Non english is ok, most likely I wont get it but just havin the reference out there in case somebody is looking is ok, specially if there are no other references.

3
beeskness420•

Maybe something from Linear Sketching like Johnson-Lindenstrauss.

3
CommunityLover234•

Maybe by using the linear differential equation(of order n) i.e

a_ny^n + ........ a_1y + a_0 = 0

and using that as a linear operator(in H(C^n(R), where that is the space of real valued function which can be differentiated at least n-times)

So T(y) = a_ny^n + ........ a_1y + a_0

and Ker(T) is the space of solutions

3
BrainsOverGains•

The evaluation map for different domains:

  1. from the space of polynomials K[X] over a field K to the field K
  2. from K[X] to the vector space of square matrices over K
  3. from the Hom(V,W) to W for vector spaces V and W
3
xDiGiiTaLx•

This blog post about linear from R to R is pretty interesting: http://www.cofault.com/2010/01/hunt-for-addictive-monster.html?m=1

On second thought I suppose these aren't actually R-linear, they just satisfy the functional equation f(x+y)=f(x) + f(y). Still interesting though

2

There's some basic differential equations stuff with matrix exponentials:

If u: R^n -> R^n and A is some matrix, then the equation

du / dt = Au

with initial data u = u_0 has as solution

u(t) = exp(tA)u_0

Think of this as a system of ODEs. If you're feeling bold you can throw around words like "semigroup" or "one-parameter group of transformations".

As a specific example, let

dv / dt = w dw / dt = -v

Then A = [[0, 1], [-1, 0]] and we can set it up above as

u = exp(tA) u_0

but also notice that the system is really v'' = -v, so v = e^(it)v_0 also works. This opens up a potentially interesting connection.

2
deadpan2297Mathematical Biology•

Kind of boring but the q derivative

D_q f(x) = f(qx)-f(x)/(q-1)x

and the forward difference

D f(x) = f(x+1) - f(x).

If you're talking about Jordan form you might be passed it, but you could also talk about the canonical basis for D being the falling factorial.

Another one might be summation.

2
pogmatherinoMachine Learning•

Google’s PageRank algorithm is ultimately based on calculating the eigenvectors of a particular matrix that encodes all references from every webpage to every other webpage. More generally, you can calculate what a Markov chain would look like in steady-state conditions (if it exists) by calculating eigenvectors - and you can model quite a lot of real life things with that.

Another thing that was really cool for me when I was first learning linear algebra was writing the Fibonacci series as an iterated matrix multiplication, from which you can then get a closed form for the nth term of the series by using eigendecomposition (and having the golden ratio and its inverse show up in the process).

2
[deleted]•

[removed]

1