It depends on who the "more people" are. Schools are the vast bulk of many town budgets. Young families are a net user of town services and enough of them would drive higher property tax rates. (In my case, the town also has negligible commercial activity and no transit--and is spread out enough that transit is basically a non-starter.)