In the place of current Terazije water fountain, there used to be another famous water fountain called the "Asian fountain" that was always very crowded.

There used to exist 'cisterns' - built towers that people named water scales (scales = terazije) which eventually became the name of the square.