A start-up basically refers to a newly established business.
However, this is slightly too simple a definition as a start-up is really a company that is beginning to develop, initially financed either by an individual or a handful of founders.
Typically these companies are aiming to offer a service or product that is not being offered by someone else, or are trying to improve an existing service offered by other companies, but in a better way.