Discussion about this post

User's avatar
Ji-Sook Yim's avatar

Thanks for the preview before I get to reading this book!

The note about overconfidence, and in particular, the failures around high-stakes AI output (ex: when an important decision hinges upon the AI response/output) makes me think of what kind of guardrails can be put in place to prevent misinformation/non-optimal decisions. Some ideas for past projects have included a confidence "score"/meter so users aren't blindly taking decisions at face value (the consensus app shows meter for strength of evidence, for instance), or giving a different type of output based on how strong (or weak) the AI's "match" between its knowledge base and the user's input (ex: giving multiple options for a user to choose from if it's medium confidence; asking users to re-describe or give more info if it has low confidence).

1 more comment...

No posts

Ready for more?