The TeamSpeak 2 server is the application that allows the clients to talk to each other. The clients log in to the server and the server handles all the traffic and makes sure that everybody can hear each other. In other words, it is a meeting point.
There are 2 platforms on which the server can be installed: Linux and Windows. Both have the same functionality and the clients won't notice any difference.