Depends on your definition.
Switzerland has high taxes and strong public services, compulsory military service, but also low levels of government regulation.
The most interesting thing about Switzerland, and the thing that should be emulated around the world is the highly decentralised system of governance.
The country is a federation of 26 Cantons that have a high level of political autonomy. Much decision making is therefore highly localised on things like tax, welfare, heath, education etc.
When people talk about big and small government they look at the wrong measurement.
Instead of big/small being applied to taxation and public service provision, they should be applied to the scale of the government.
Switzerland has small government in this sense. Local policies for local people, not a one size fits all approach.
If I was king of the world, then I'd make everyone follow this model: loosely federalised small scale governance.