It does. Its power isn't infinite-- its power source has a finite amount to it, and the power source is very particular.

It would, however, explain why the town is empty, save for us; in order to create a Philosopher's Stone, one has to make a huge sacrifice. Like, say, for instance, using the lives of an entire town.