Episode 228 - How To Get The Best From AI Without Falling Off The Edge
Summary
AI can be incredibly helpful, but it’s not always right. Learn about the “jagged frontier” of AI capability and why the most effective leaders know when to rely on AI and when human judgement remains essential. Discover practical ways to get the benefits of AI without falling into its traps.
Transcript
Hello and welcome to episode 228 of the Leadership Today podcast, where each week we share practical tips to improve your leadership. In this episode we explore the so-called “jagged frontier” of Artificial Intelligence - where we fail to apply human judgement and pay the price.
If you’ve been using AI for a while, you’ve probably had two very different experiences. Sometimes it feels almost magical. It helps you generate ideas, summarise information, improve your writing, and solve problems faster than you thought possible. Then there are those other moments. The answer sounds convincing, looks professional, and is completely wrong.
Understanding why that happens is becoming one of the most important leadership skills of our time.
A study involving more than 750 consultants at Boston Consulting Group explored the impact of using GPT-4 on a range of consulting tasks. The results were impressive. People completed more work, worked faster, and generally produced higher-quality outputs when using AI. But the researchers uncovered something equally important. When participants used AI on tasks that were beyond the technology’s capabilities, their performance actually became worse. The AI didn’t simply fail to help. It often led people towards the wrong answer.
The researchers described this as the “jagged frontier” of AI. Some tasks sit comfortably within AI’s capabilities and the benefits can be substantial. Other tasks sit just beyond that frontier. The challenge is that AI often sounds equally confident in both situations. That’s why the biggest risk with AI isn’t that it makes mistakes. Humans make mistakes too. The risk is that we stop applying our own judgement because the answer looks so polished and convincing. So what can leaders do?
First, identify where AI genuinely adds value in your work. Think about the tasks where it consistently helps you save time, generate ideas, improve communication, or increase quality. Just as importantly, identify the situations where you’ve seen it get things wrong. Understanding both sides of the equation helps you use AI more effectively.
Second, keep your judgement in the process. For important decisions, strategic thinking, or complex problem-solving, consider forming your own view before turning to AI. Even a few notes or bullet points can help you avoid being overly influenced by the first answer AI provides.
Third, have open conversations with your team about how they are using AI. Some tasks may be suitable for handing over largely to the technology. Others require people to stay actively involved, challenging assumptions and validating outputs along the way. The more explicit you are about these differences, the better the outcomes are likely to be.
The key point is that AI is neither a miracle solution nor something to be feared. It’s a powerful tool with strengths and limitations. The leaders who get the greatest benefit won’t be those who use it for everything - they’ll be the ones who learn where it performs best and where human judgement remains essential.
Have a great week.
Research reference: Dell'Acqua, F., et al. (2023). Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality. Harvard Business School Working Paper 24-013. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4573321
Leadership Today On-Demand Special Offer
We have a great deal for podcast listeners on our Leadership Today On-Demand subscription. Just go to www.leadershiptoday.com and checkout using the promo code PODCAST for 25% off an annual subscription.
Leadership Today On-Demand is a video subscription service that allows you to work on your leadership in your own time and at your own pace. It is available online and through our Apple iOS and Android apps for phones and tablets. Our mission is to help you to become an even better leader.
Your subscription brings together all of our video content in one place including:
- Five online courses with workbooks
- Five five day challenges with workbooks
- Nineteen recorded webinars
- A searchable library of 170+ "how to" quick videos on a range of leadership challenges
That's over $4,500 of content for less than the price of a single online course. And there are more videos added each week.
Get Connected
Find out ways to get connected here: https://leadership.today/connect