259 | 🏗️ Changes to Brainyacts

In today’s Brainyacts:

1. Siri was always listening (and selling your info)

2. Virtual AI employees are coming and other AI model news

3. AI hallucinations are tools plus more news you can use

   👋 to all subscribers!

To read previous editions, click here.

Lead Memo 👂😏 Yes, Your Device Was Listening: Lessons from Apple’s Siri Settlement

The recent settlement of a class-action lawsuit against Apple serves as both a wake-up call and a glimpse into a privacy-challenged future. Apple has agreed to pay $95 million to settle allegations that its Siri voice assistant inadvertently recorded users’ private conversations and shared them with third parties, such as advertisers. While Apple denies any wrongdoing, the case highlights an uncomfortable reality: our devices may be listening more than we realize, and the implications are profound.

The Allegations: A “Magic” of Convenience with a Price

The lawsuit claims that Siri was frequently activated unintentionally, capturing conversations that users assumed were private. Plaintiffs described unnerving examples: one mentioned Air Jordans in conversation and later saw ads for the sneakers; another saw ads for Olive Garden after discussing dining options. Apple contractors allegedly reviewed some of these recordings to improve Siri, but the inadvertent activations raised serious privacy concerns. 

These claims aren’t isolated. Reports as early as 2019 revealed that accidental triggers could be caused by mundane sounds—like a zipper—and that contractors routinely reviewed sensitive recordings, from medical discussions to private disputes. Despite Apple’s insistence that only a small fraction of data was analyzed, the possibility that such interactions might find their way into advertising pipelines unsettles many.

A Payout, But Little Accountability

The $95 million settlement, equating to up to $20 per Siri-enabled device, is a drop in the bucket for a company with billions in annual revenue. It neither admits fault nor changes the fundamental mechanics of how such systems operate. The payout may momentarily appease consumers, but the underlying concerns about voice-activated technologies remain unresolved.

The Broader Implications: Privacy in the Age of AI

This case is more than an isolated incident. It signals how deeply embedded AI-powered voice assistants are in our lives and the risks they pose. As generative AI and natural language processing advance, interactions with machines will become more seamless, and the lines between private and public conversations blur further.

The Risk of Letting Our Guard Down

Voice assistants are marketed as tools of convenience, designed to simplify our lives by responding to queries and commands. But their ubiquity and passivity—always waiting for a “wake word”—make them potential surveillance devices. In the era of generative AI, where voice and text-based systems become increasingly intelligent and omnipresent, it’s easy to see how people might grow complacent, letting their guard down while discussing sensitive topics near these devices.

The Looming Threat of Data Monetization

Even if companies like Apple claim to use voice data solely for system improvement, the monetization of that data looms large. Advertisers value hyper-specific targeting, and AI systems have the capability to process voice data at scale. With data security and privacy laws lagging behind technological innovation, the temptation to exploit these interactions may prove irresistible for some companies.

What Can Consumers Do?

1. Understand the Risks: Recognize that any voice-activated device in your environment has the potential to mishear and record you.

2. Adjust Settings: Explore privacy settings on your devices, and disable voice assistants or limit permissions where feasible.

3. Advocate for Stronger Laws: Push for robust data privacy regulations to protect consumers from invasive practices.

4.  Cultivate Awareness: Be mindful of what you discuss around smart devices and remember that “off” isn’t always truly off. 

A Future That Balances Convenience and Privacy

As AI technology evolves, so must the ethical standards surrounding its use. Voice assistants and generative AI have the potential to revolutionize how we interact with machines, but that power must be tempered with accountability. Companies should proactively address privacy concerns, not just reactively settle lawsuits. Transparent policies, user consent mechanisms, and meaningful safeguards are critical.

For consumers, the lesson is clear: convenience has a cost, and awareness is our first line of defense. In a world where even a casual conversation might feed an algorithm, mindfulness isn’t just a virtue—it’s a necessity.

AI Model Notables

► Virtual AI employees could join workforce as soon as this year.

► Elon Musk recently revealed on the X that Grok 3 is finally set to launch soon.

► Microsoft expects to spend $80 billion on AI-enabled data centers in fiscal 2025.

► OpenAI’s CEO, Sam Altman, has revealed that they “know how to build Artificial General Intelligence (AGI)”—as they have traditionally defined it—and is now turning its attention to developing “superintelligence.”

► Apple urged to withdraw 'out of control' AI news alerts.

► Panasonic teams up with Anthropic, aims for 30% of sales from AI. Calling it Panasonic Go, the company will offer AI-enabled products and services for customers

News You Can Use:

➭ The U.S. Food and Drug Administration unveiled the first comprehensive draft guidance for AI-enabled medical devices, establishing recommendations across development and deployment — with over 1000 devices already authorized.

➭ Scientists are embracing AI hallucinations as powerful tools for breakthrough discoveries, with the New York Times detailing cases from Nobel Prize-winning protein design to medical devices and weather prediction.

➭ University of Toronto researchers developed an AI app that can detect high blood pressure by analyzing voice recordings, achieving up to 84% accuracy without requiring traditional blood pressure measurements.

➭ Florida Bar members now have a comprehensive guide for incorporating generative AI into a legal practice while being mindful of the ethical implications. The Florida Bar Guide to Getting Started with AI is free and available here.

➭ Trump announces $20B plan to build new data centers in the US.

Who is the author, Josh Kubicki?

Some of you know me. Others do not. Here is a short intro. I am a lawyer, entrepreneur, and teacher. I have transformed legal practices and built multi-million dollar businesses. Not a theorist, I am an applied researcher and former Chief Strategy Officer, recognized by Fast Company and Bloomberg Law for my unique work. Through this newsletter, I offer you pragmatic insights into leveraging AI to inform and improve your daily life in legal services.