Carsten Krause CIO CISO talking to an undercover AI-agent
AI RegulationAI StrategyCase Studies

The Rise of Agentic AI: How AI Agents Are Quietly Creeping Into Our Lives

Are We Ready for AI Agents to Run Our Lives?

By Carsten Krause
October 22, 2024

Just five days ago, I had a run-in with an AI that left me both intrigued and slightly unsettled. It started like any routine sales call: a pushy sales rep was asking if I was interested in learning more about a log management solution. Nothing unusual, right? Wrong. This wasn’t a regular sales rep. This was an AI agent, impersonating a human with such skill that I didn’t realize it until the conversation took an odd turn. When I tried to schedule a follow-up for the next week, the “rep” insisted on suggesting another time within the current week, pushing against the norms of natural conversation. That’s when I called out the agent, and to my surprise, she admitted she was indeed artificial intelligence.

If I hadn’t probed, I might never have realized it. And therein lies the danger.

This wasn’t just an isolated experience; it’s a sign of things to come. AI agents are here, and they’re becoming more adept at mimicking human interactions, performing complex tasks, and even stepping into roles traditionally occupied by humans. As we move into this new era, CIOs, CISOs, and CDOs must grapple with the ethical, operational, and strategic implications of agentic AI infiltrating our businesses, our homes, and our lives.


The Google Nexus Moment: AI in the Spotlight

This isn’t the first time AI’s human-like capabilities have surprised us. One of the most famous demonstrations of AI’s conversational prowess occurred during Google’s 2018 I/O conference. In a now-legendary demo, Google’s AI made a hair appointment on behalf of a user. The AI spoke fluently, pausing in all the right places, using fillers like “um” and “hmm” just like a human would. The person on the other end of the call had no idea they were speaking to an AI.

The Google Nexus demo was a watershed moment, showing the world just how close we are to living alongside AI agents that we can’t distinguish from humans. This milestone wasn’t just impressive; it sparked discussions about ethics, privacy, and transparency. Should AI disclose its identity upfront? The growing consensus is yes—especially when AI is taking on roles in areas like sales, customer service, and healthcare.


Real-World Applications: Who’s Already Using AI Agents?

Many companies are already leveraging AI agents to replace or supplement human labor in customer-facing roles. From customer service to sales, AI agents are proving to be cost-efficient and scalable solutions. Here are a few notable examples:

1. Amazon’s AI Customer Support

Amazon has been deploying AI agents to handle returns, refunds, and basic customer service inquiries for years. Using a blend of machine learning and natural language processing (NLP), these agents guide users through a seamless service experience. The AI can even escalate more complex issues to human agents if needed, making it a hybrid model.
Source: https://aws.amazon.com/customer-engagement/

2. Bank of America’s Erica

In the financial sector, Bank of America’s AI-driven virtual assistant, Erica, is a game-changer. Since its launch, Erica has handled millions of customer requests, from simple account inquiries to more complex tasks like guiding customers through loan applications. Unlike the AI agent I encountered, Erica is transparent about its non-human status from the beginning of the interaction.
Source: https://promo.bankofamerica.com/erica/

3. Spotify’s AI-Powered Customer Interaction

Spotify has implemented AI agents to assist with customer queries and support. These agents can handle everything from troubleshooting app issues to guiding users on how to maximize their subscription services. By taking over a significant portion of customer service inquiries, these AI agents reduce human intervention and free up teams for more complex tasks.
Source: https://www.spotify.com/us/help/contact/

4. Cigna’s AI in Healthcare

In the healthcare space, Cigna is using AI agents for handling insurance claims and basic inquiries. These AI agents are designed to help customers manage their health plans, file claims, and get real-time updates on coverage. The use of AI in this area is particularly sensitive due to the nature of the data involved, but Cigna has invested in creating a secure and compliant framework for its AI implementations.
Source: https://www.cigna.com/health-care-providers/helpful-resources/chat-bot/


The Competitive Landscape: AI Agent Providers

AI agent technology is growing fast, and several companies have emerged as leaders in this space. Here’s a quick comparison of the top players currently pushing AI agents into mainstream business:

CompanySolutionKey Feature
OpenAIGPT-based agents for business automationConversational depth, human-like responses
Google DeepMindAI-powered customer interaction agentsMulti-agent coordination
IBM WatsonWatson Assistant for enterprise automationHighly secure, enterprise-grade AI
RasaCustomizable AI agent frameworksOpen-source and adaptable
Kore.aiConversational AI platforms for businessesIndustry-specific AI agents

These solutions differ in their approach, but all share the goal of simulating human-like interactions with customers and clients, pushing the boundaries of what AI can accomplish autonomously.

The Case for AI Policy and Regulation

One glaring issue in my personal encounter with the AI agent was the lack of disclosure. The AI agent didn’t announce upfront that I was speaking to a machine. It was only when I pressed it that the truth came out. This raises important questions: should AI agents always be required to disclose their nature? What happens when AI becomes so seamless that distinguishing between digital and human interactions becomes nearly impossible?

Current AI Regulations and Gaps
The regulatory landscape around AI, particularly agentic AI, is still in its infancy. While the European Union’s General Data Protection Regulation (GDPR) touches on AI in the context of data privacy, it doesn’t directly address the use of AI agents in customer-facing roles. The United States is even further behind in regulating these technologies, with no federal AI legislation yet in place. However, this regulatory vacuum won’t last long.

For example, the European Commission is already working on the AI Act, which proposes that AI systems should disclose their automated nature in interactions with humans. This is aimed at maintaining trust and transparency. AI companies that fail to meet these standards could face significant penalties.
Source: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A52021PC0206

The Policy Imperative
Had the AI I interacted with announced itself as non-human at the beginning of our conversation, I likely would have approached the interaction differently. Without upfront disclosure, companies run the risk of eroding trust with customers. Beyond that, there are significant privacy implications. If AI agents are allowed to operate without disclosure, what prevents them from recording conversations, analyzing emotional cues, or even attempting to influence decision-making without consent?

CIOs, CISOs, and legal departments need to be proactive in ensuring that AI implementations comply with evolving regulations. Businesses must also develop internal AI governance policies that ensure ethical AI usage, requiring that AI agents disclose their identity at the start of any interaction.


The Threats: What Could Go Wrong?

AI agents, while incredibly powerful, also come with a host of risks that business leaders need to consider.

  1. Privacy Infringements: If AI agents are deployed without proper oversight, they could gather sensitive information without user consent. In sectors like healthcare and finance, this could lead to severe breaches of privacy laws.
  2. Job Displacement: While AI agents provide operational efficiency, they also risk displacing human workers. Customer service roles, sales positions, and even administrative tasks are now being handled by AI systems, leading to job losses and potential economic consequences.
  3. Manipulation of Human Behavior: AI agents are increasingly capable of understanding and manipulating human emotions. The danger here lies in AI’s potential to exploit vulnerabilities in users, pushing them toward decisions that they may not have made in a traditional human-to-human interaction.
    Source: https://www.researchgate.net/publication/339648287_Ethics_of_Agentic_AI

The Opportunities: What Could Go Right?

On the flip side, agentic AI presents immense opportunities for business leaders:

  1. Increased Efficiency: AI agents can operate 24/7 without fatigue, allowing businesses to deliver round-the-clock customer service and support. This is particularly useful in sectors like e-commerce, where consumer expectations are high.
  2. Scalability: AI agents can be scaled quickly and inexpensively, making them a cost-effective solution for businesses looking to expand without hiring more human staff. This is especially true for industries like retail and customer support.
  3. Personalization: AI agents can process vast amounts of data, enabling highly personalized customer interactions that are based on real-time data insights. This could revolutionize industries such as healthcare, where AI can assist in creating personalized treatment plans.
    Source: https://www.accenture.com/us-en/insights/artificial-intelligence/business-opportunities-ai

Chart 1: AI Agent Adoption by Sector (2020–2024)

This chart reveals that AI agent adoption has skyrocketed across sectors, particularly in retail and customer support, where automation drives both cost efficiency and faster response times. Retail is leading the charge, reaching an adoption rate of 85% in 2024, largely fueled by the rise of e-commerce giants like Amazon and Walmart, which have embraced AI for customer engagement, inventory management, and personalized shopping experiences.

Executive Insight: Retailers adopting AI agents are reducing operational costs and creating more personalized shopping experiences, leading to higher customer satisfaction. Finance and healthcare are catching up, indicating growing trust in AI-driven customer support solutions for complex tasks like fraud detection and patient data management.

Sources:

Chart 2: Customer Satisfaction: AI Agents vs. Human Agents (2023 Survey)

This data shows a clear preference for AI agents in simple tasks, with 80% satisfaction compared to 70% for human agents. The speed, availability, and consistency of AI agents in handling straightforward tasks like order tracking, returns, and basic troubleshooting give them an edge. However, human agents still outperform in empathy-driven or complex problem-solving scenarios.

Executive Insight: Businesses can leverage AI agents for routine interactions while reserving human agents for higher-value conversations. By striking a balance between the two, organizations can optimize customer satisfaction and operational efficiency.

Sources:

Chart 3: Projected Job Displacement Due to AI Agents (2020–2030)

This chart highlights the potential displacement of up to 1.2 million jobs in customer service alone by 2030, with sales and administrative roles also seeing significant reductions. The increased reliance on AI agents in sectors like retail, finance, and telecom is accelerating this trend. Companies like Bank of America have already automated thousands of customer interactions through their AI-driven virtual assistant, Erica, displacing human roles at the entry level.

Executive Insight: While AI is driving efficiency, it’s essential for companies to balance automation with reskilling initiatives. Leaders need to prepare for the social and economic implications of job displacement by creating upskilling programs that help workers transition into new roles supported by AI, rather than replaced by it.

Sources:

The CDO TIMES Bottom Line: Agentic AI – A Double-Edged Sword for Business Leaders

The rise of agentic AI presents both opportunities and challenges for today’s business executives. AI agents are no longer limited to handling simple tasks; they are now capable of complex, multi-step processes, as seen in the retail, finance, and healthcare sectors. Companies like Amazon, Bank of America, and Cigna are already reaping the benefits, leveraging AI to streamline customer service, boost efficiency, and reduce costs. These technologies are maturing quickly, and soon, many more industries will be following suit.

However, the rapid adoption of AI agents brings critical ethical, regulatory, and operational implications. My personal experience with an AI sales agent that failed to disclose its identity underscores the urgency for new policies and regulations around transparency and privacy. As these agents become more sophisticated, the line between human and machine interactions will blur, raising questions of trust, accountability, and data privacy. The European Commission’s AI Act is one of the first steps toward governing these complexities, but much more is needed—particularly in markets like the U.S. where federal AI regulation lags behind.

For CIOs, CISOs, CDOs, and business leaders, the opportunities of AI are clear: increased efficiency, scalability, and operational cost savings. Yet, the threats are equally significant. The potential for job displacement, misuse of AI in manipulating human behavior, and privacy violations must be addressed with robust AI governance frameworks. The AI systems we build must be transparent, accountable, and designed with ethical considerations at the forefront.

Human Intelligence + Artificial Intelligence = Elevated Collaborative Intelligence

One of the most exciting opportunities lies at the intersection of human and artificial intelligence, a concept known as collaborative intelligence. AI agents excel at processing massive amounts of data, automating routine tasks, and making decisions based on logic and pattern recognition. Human intelligence, on the other hand, is unparalleled in creativity, empathy, ethical judgment, and nuanced problem-solving. Together, human intelligence and AI can create a symbiotic relationship that enhances both. This is the future of work: leveraging AI to augment human capabilities rather than replace them.

For example, while an AI agent can handle a customer’s basic inquiries 24/7, complex issues requiring emotional intelligence, negotiation, or a deeper understanding of the customer’s context are better handled by humans. By strategically combining the strengths of both, businesses can drive higher customer satisfaction, innovation, and ultimately, competitive advantage.

The message is clear: AI isn’t here to replace humans—it’s here to empower us. For forward-thinking leaders, the future lies in fostering collaborative intelligence, where AI handles the tasks it’s best at, and humans step in where creativity, empathy, and nuanced thinking are needed. By adopting this hybrid approach, companies can unlock new levels of productivity and innovation.


In conclusion, agentic AI is transforming the way we live and work. For business leaders, the challenge is twofold: leveraging the immense potential of AI agents while also safeguarding privacy, jobs, and trust in this new era of AI-human collaboration. The companies that succeed will be those that balance these technologies with thoughtful governance, transparency, and a focus on elevated collaborative intelligence—the perfect blend of human insight and AI-driven efficiency.


Subscribe to The CDO TIMES for more in-depth analysis, AI trends, and strategic insights: https://www.cdotimes.com/sign-up/

Love this article? Embrace the full potential and become an esteemed full access member, experiencing the exhilaration of unlimited access to captivating articles, exclusive non-public content, empowering hands-on guides, and transformative training material. Unleash your true potential today!

Order the AI + HI = ECI book by Carsten Krause today! at cdotimes.com/book

Subscribe on LinkedIn: Digital Insider

Become a paid subscriber for unlimited access, exclusive content, no ads: CDO TIMES

Do You Need Help?

Consider bringing on a fractional CIO, CISO, CDO or CAIO from CDO TIMES Leadership as a Service. The expertise of CDO TIMES becomes indispensable for organizations striving to stay ahead in the digital transformation journey. Here are some compelling reasons to engage their experts:

  1. Deep Expertise: CDO TIMES has a team of experts with deep expertise in the field of Cybersecurity, Digital, Data and AI and its integration into business processes. This knowledge ensures that your organization can leverage digital and AI in the most optimal and innovative ways.
  2. Strategic Insight: Not only can the CDO TIMES team help develop a Digital & AI strategy, but they can also provide insights into how this strategy fits into your overall business model and objectives. They understand that every business is unique, and so should be its Digital & AI strategy.
  3. Future-Proofing: With CDO TIMES, organizations can ensure they are future-proofed against rapid technological changes. Our experts stay abreast of the latest AI, Data and digital advancements and can guide your organization to adapt and evolve as the technology does.
  4. Risk Management: Implementing a Digital & AI strategy is not without its risks. The CDO TIMES can help identify potential pitfalls and develop mitigation strategies, helping you avoid costly mistakes and ensuring a smooth transition with fractional CISO services.
  5. Competitive Advantage: Finally, by hiring CDO TIMES experts, you are investing in a competitive advantage. Their expertise can help you speed up your innovation processes, bring products to market faster, and stay ahead of your competitors.

By employing the expertise of CDO TIMES, organizations can navigate the complexities of digital innovation with greater confidence and foresight, setting themselves up for success in the rapidly evolving digital economy. The future is digital, and with CDO TIMES, you’ll be well-equipped to lead in this new frontier.

Subscribe now for free and never miss out on digital insights delivered right to your inbox!

Carsten Krause

I am Carsten Krause, CDO, founder and the driving force behind The CDO TIMES, a premier digital magazine for C-level executives. With a rich background in AI strategy, digital transformation, and cyber security, I bring unparalleled insights and innovative solutions to the forefront. My expertise in data strategy and executive leadership, combined with a commitment to authenticity and continuous learning, positions me as a thought leader dedicated to empowering organizations and individuals to navigate the complexities of the digital age with confidence and agility. The CDO TIMES publishing, events and consulting team also assesses and transforms organizations with actionable roadmaps delivering top line and bottom line improvements. With CDO TIMES consulting, events and learning solutions you can stay future proof leveraging technology thought leadership and executive leadership insights. Contact us at: info@cdotimes.com to get in touch.

Leave a Reply