That was the assumption. But how am EMP would actually affect things, I do not know. It was merely a thought exercise.
The problem you have with the thought exercise is that there are technologies that have been created to survive various levels of EMP. I have worked in this field before and just because an event happens doesn't mean it renders all tech useless. There are some radiation events that simply change a 1 to a 0 or the reverse and it can effect the operation of certain devices temperarely but not permantly.
Further, the Parker Solar Probe was the first spacecraft to fly into the low solar corona. It assessed the structure and dynamics of the Sun's coronal plasma and magnetic field. It analyzed the energy flow that heats the solar corona and impels the solar wind, and the mechanisms that accelerate energetic particles. In short, the probe flew through a coronal mass ejection from the sun—a powerful eruption of billions of tons of plasma and survived. It spent two days within a CME while just 5.7 million miles (9.2 million kilometers) from the solar [the sun's] surface.
Even if one wants to say that all tech could be knocked out, it would have immediate affects on planes, cars, trains, etc. anything that is in transit in the time the theoretical event happened. It would also affect hospitals, military facilities, etc. but this still doesn't mean that everyon would be in the stone age. There are two problems with the this area of the thought experiment. Appliances like a fireplace, solar oven, power tools or generators won't be affected by an EMP. These non-electric appliances don't necessarily operate with solid-state electronic controls and will probably still work when even after an EMP has blasted through your area.
Lastly, the big problem you have is - what does it mean to live in the stone age? There is a lot of evidence of technological advancement in ever stage of human history. It all depends on what you consider to be techonology. EMP doesn't affect the ability to write and transfer information using low tech methods. It also doesn't affect the ability to build sturcutres. Non-industrialized food production is still done by a number of cultures aruond the word thus one can't say that all of humanity will start from 0.