@topley
As someone who's worked in consumer electronics manufacturing, I don't agree that Ourigo's conversation is even remotely a "really bizarre abstract problem". In fact if anything it's pretty much a direct parallel to discussions mass manufacturers and regulators have been having for decades. There is a ton of thought that's gone into everyday stuff people take for granted to try to ensure that it's fail-safe, not fail-deadly. That it's
hard for children or even tinkerers to accidentally electrocute themselves or cause other damage, that a moment of forgetfulness by an elderly person isn't deadly, etc. When talking Big Numbers, at the scale of millions to hundreds of millions, normal common sense often breaks down and small probability events and situations begin adding up to real numbers.
Magic in this series is a pretty clear stand-in for technology. We've already got capabilities approaching some of the magic we see here, and in the next few decades can expect to have more. That brings ever greater risks and rewards to grapple with. Breakthroughs in genetic tech for a current example offer frankly stunning potential advancement against infectious diseases, the new mRNA techniques used for covid-19 can apply to a ton of others and in the future could allow incredibly rapid responses to new pandemics and existing scourges. Yet genetic tech could also be used to
create some pretty nasty new diseases too. Pretty much every powerful new tech these days is multiple-use, offering both consumer and military applications. Most classic extreme example of all of course being nuclear tech, which has been very important for power and medicine (and will be vital for major space efforts long term) but also allowed potentially civilization-ending weapons.
A small part of what makes the series so compelling (great characters, art and so on certainly key) is that there are real tradeoffs here and both sides have genuine points.