That is until you meet analysis people that define a symbol for infinity (and it’s negation) and add it to the real numbers to close the set.

Also there are applications in computer science where ordering stuff after the first infinite ordinal is important and useful.

Yea unfortunately we do kinda calculate with infinity as a concrete thing sometimes in higher level maths…