Just thought I'd pop in and say that I didn't deliberately neglect to give you a link to the TeX software, haha. I was looking up an easy way to start out and learn, because it's kinda difficult at first.
So I came up with this:
http://www.math.uiuc.edu/~hildebr/tex/
It has numerous links on there to various articles and such, which may help you to get started with examples and such.
TeX isn't 'specifically' for Math by the way...it's just a program to typeset...or 'format text' the way you'd like so you don't have to manually do it every single time if you're say, writing a hundred page paper or a novel. So to use math, you require a math library.
For math in particular, this article (found on the page I just linked) was the first document I read when I was learning TeX:
http://www.ctan.org/tex-archive/info/mil/mil.pdf
Now, for actual software, I think MikTeX was relatively easy to use, because it has a compiler in which you can directly input your text (kind of like a text editor). You can download it at:
http://miktex.org/
I don't recommend getting version 2.8 Beta...2.7 should be just fine, and it's definitely working properly.