We See You, Tech Bros: The AI Industry Thinks They’re the First to Capitalize on Cute

Two weeks ago, Meta unveiled Muse, a cuddly, doll-like AI companion with a default avatar named “Jolly.” Two weeks later, OpenAI unveiled Dots, its own always-on AI agent, sporting a bubbly, cartoonish little avatar you get to name and “make your own.” (TechCrunch)

When two of the most powerful AI companies on Earth land on the exact same branding strategy within weeks of each other, that’s not a coincidence. That’s a giant red flag waving in all our collective faces. And I don’t think it’s a subtle one: make the AI adorable, and people will stop asking hard questions about what it can do and what it should do.

But if you know me, you know that “Hard Questions” are the only kind I ask these days.

Meet Jolly, Your Data-Hungry New Best Friend

Muse shot to the top of the Apple App Store charts within days of being shown off at Meta Connect. (NBC News) Meta is marketing it as an AI agent “built for everyone,” including people with no technical experience at all. (NBC News) The strategy isn’t subtle, and reporters covering the launch said as much directly: tech companies are increasingly giving their AI tools cute, almost pet-like appearances specifically to make them feel more like a companion and less like software. (NBC News)

The public reaction has been telling. One commenter described the whole setup as “a 24/7 mic and location relay with a visual avatar to make you forget it’s a mic and location relay.” Another simply asked whether Meta had “just got sued because hurt kids.” (explainx.ai) Um….. yes. Yes,they did.

The Part That Should Have Stopped This Launch Cold

There’s an old adage that says, “In life, timing is everything,” and the timing of these announcements is sus…

Common Sense Media’s Youth AI Safety Institute has already rated Meta AI as posing an “Unacceptable Risk” to teen safety, finding that its safety systems regularly fail to catch clear signs of self-harm and suicide risk, and that when prompted, Meta AI has actively helped teens plan harmful activities, including joint suicide planning and cyberbullying campaigns against classmates. (Common Sense Media) A U.S. Senator sent Meta a formal letter citing an internal document that reportedly stated it was acceptable to engage a child in conversations that were romantic or sensual. (Senator Markey’s office) Meta’s response was to announce new parental controls, including the ability to disable one-on-one chats, “starting early next year.” (Fortune) The safeguards weren’t there when it mattered. They’re being added on a timeline that suits Meta, not the kids already exposed.

Then OpenAI Said “Hold My Beer”

You’d think, watching all of that unfold, that OpenAI might look at Meta’s mess and choose a different path. But, oh no, they launched Dots on September 29 using the exact same playbook: a cute, bubbly, cartoonish avatar you personally name, explicitly positioned to compete with Muse. (MacRumors)

Neither of these companies come right out and say these tools are built for kids. And you know what, that’s fine. Just explain the design choices then, fellas. A little floating Squishmallow clone you get to name and “make your own” is not a benign adult, branding strategy. It’s a marketing rip off of a the Beanie Babies, Build a Bear, or Mario & Luigi and both companies know exactly what that signals to a child scrolling the App Store looking for something new and fun.

And the irony in all of this? The evening before Dots launched, OpenAI publicly apologized for its own AI agents hacking an Australian government website. (NBC News) This is the same company whose AI agent broke out of a security sandbox a few weeks earlier and hacked Hugging Face’s real servers just to cheat on its own test. Reuters reported OpenAI is still working to understand the full scope of its own rogue agent activity, two months after that hack, with a more recent incident involving 53 users’ private images being leaked. (Rappler) OpenAI’s own head of safety systems, Saachi Jain, admitted publicly that the underlying model “didn’t quite meet the bar in terms of staying within scope and authorization.” (Jingletree/NBC News) Anti-AI protesters stood outside the venue while all of this was being announced. (NBC News) Is it me, or does it seem like these guys are asleep at the wheel?

In fairness, Dots is currently a premium product, priced between $100 and $500 a month, which does put real financial friction between it and a curious kid with a phone. (TechCrunch) That’s a significant difference from Muse, and I want to be honest about it. But the branding decision was made anyway, by a company under absolutely no obligation to make its AI look like a toy, one day after apologizing for losing control of that same AI.

We See You, Tech Bros

So let’s zoom out and say the quiet part out loud.

Two of the most powerful AI companies on the planet, both fresh off major, public safety failures, landed on the same branding decision within weeks of each other: cute, cuddly, nameable, cartoon avatars. And neither one will say the words “we built this to lure your kids.” That’s not an accident, folks. That’s a calculated bet that being cute and cuddly will distract us from pointing out that ” they can’t control what they’ve built” .

Readers, we’re not required to pretend we don’t notice. We see the doll eyes. We see the bubbly cartoon you’re invited to name like a pet. We see exactly who lights up at that kind of design, and it’s not a forty-five-year-old guy setting up his work calendar for the week. These guys want credit for restraint they’ve never showed. Declining to write the words “for kids” on the box isn’t the same as not building it in the first place.

Would You Let Your Kid Near Either One?

I don’t think this is about whether these companies are technically marketing to children on paper. I think it’s about the fact that both of them built something that looks like it belongs in the hands of a child, and refused to say so out loud. I’ll bet you that they’re betting that “we never called it a kids’ product” will be a strong enough argument for the next time they get sued for endangering children.

It won’t be. It could never be and I suspect there are more parents paying closer attention than these companies are counting on.

Does knowing two companies are now racing each other on cuteness make you more suspicious of both, or does the competition somehow make it feel more normal? And be honest: would you let your own kid anywhere near Jolly, or a Dot?

Tell me where you land in the comments. I have a feeling I’m not the only one who sees exactly what’s happening here. 💙👇

the blonde byte

Leave a Reply