How OpenAI turned its coding tools into dots, an always-on personal assistant
The always-on AI personal assistant, which keeps working in the background even when you arenât asking it to, is this yearâs answer to the question of how people will actually use deep learning models. The startup Instinct became an overnight sensation, and Meta put the full force of its marketing behind its assistant, Muse. OpenAI wasnât going to be left out. The companyreleased dots, its assistant offering, at its developer day in late September. Alexander Embiricos, who leads OpenAIâs enterprise product team, joined us at TechCrunch Disrupt this month to explain where the product came fromâstarting with the question of why so many companies seem to be turning to cutesy mascots as avatars for their trillion-parameter matrix multiplication machines. âThereâs kind of this convergent evolution happening,â Embiricos said of the efforts to build AI assistants. âAs we were working on the product, we realized if we could frame this as, itâs an entity and itâs a single conversation, not many different conversationsâŠ.it starts to become intuitive.â The assistant is available in the ChatGPT desktop and mobile apps to subscribers on the Pro tier or higher, with plans starting at $100 a month. Once it is connected to your calendar, email, computer and other tools, the agent tries to help you get your work done. Embiricos points out that you could achieve much of dotsâ functionality with Open AIâs Codex app, its coding tool, released at the beginning of this year. But that requires more work and hand-holding. He recalled celebrating when his wife started leaving her computer on all night so that her agents could keep working. âOn the product team, what I think about is, how do we make this intuitive and useful to people?â he told Disrupt attendees. âA lot of that isnât building some new piece of tech into the product; itâs how you frame it to the user and how it feels.â Making the technology feel intuitive meant repackaging the functionality of the companyâs models into something more accessible, a path it was already on as itspun ChatGPT Workout of the agentic coding tools it had built for software engineers. Even the nameâa play on the negative space inside of OpenAIâs logoâis intended âto feel like just something that could eventually be ubiquitous.â (Asked when he learned that rival AI entrepreneur Elon Musk owns the dot.com URL, Embiricos said, âI found out very late.â) The idea of a persistent agent is that it doesnât need prompting. For OpenAI, means more token usage, and for users, a more pro-active assistant âthatâs sort of thinking about you and thinking how to help you,â as Embiricos put it. In our testing, the assistantâs ability to think ahead is apparent and often useful, but it isnât quite there yet. It will flag calendar conflicts and upcoming deadlines, but not necessarily in the most timely fashion. âThe first time it told me about one of those [conflicts]âthis is like early in developmentâit told me three minutes before the thing,â Embiricos says of his dot. âItâs like, âHey, this thing is coming up. You might want to do something about it.â I only have three minutes!â Embiricos expects the timing to improve over time, but the proactive approach is key to the product. âI was hearing about an engineer at a drone delivery startup, and they were saying, âWe had this outage, and by the time I noticed that the outage was going on, my dot had already noticed the outage was happening, had already analyzed the outage, and had come to me with useful information for how we could resolve the outage.ââ As with most AI agent use cases, thereâs a tension between the personal information an AI model needs to be useful and exactly how much personal data you are exposing to a software company. Muse has been criticized forthe profiles it buildsof your family and friends, which the software uses to know, say, what kind of restaurant you might want to go to with a specific pal, but could also add incredible value to Metaâs advertising business. Does dots collect similar data? âYes, we have a thing that we built into dots, which we call proactive research,â Embiricos said. âOn a cadence, it will think about what it knows about you, what is the conversation that itâs had, and then what have you given it access to that it can think about, and then it will go and research, âWhat could I do to be more helpful to you?â And then, basically, it will propose that.â Itâs difficult to separate the data needs of the agent from that of its parent corporation. Hark, a start-up developing its own AI personal assistant, is explicit in pointing out it that it doesnât collect data to fuel an advertising business the way that OpenAI and Meta do. With dots, OpenAI says that the agent has the same privacy controls as ChatGPT itself: Users can turn off model training (stopping OpenAI from using their conversations to improve its AI), and control what resources it accesses within your computer and how. Still, those controls arenât granular and the app can be pushy. For example, it refuses to accept read-only access to cloud drives. âWhat I think we need to do is basically build out super, super, super granular controls,â Embiricos said, but he pointed to the modelâs intelligence and discretion as the other side of this coin. âThis is actually something we kind of got some flack about when we launched,â Embiricos said. âWe had really conservative defaults over what the agent would do, and it would ask for permission a lot. I remember knowing that we were going to see that feedback, but thinking, âThis is okay, we can tune that over time.ââ The other big question about AI agents is whether they can scale. Theyâre fun when only a few people have them, and stories of agents snagging hard-to-get reservations abound. But businesses donât necessarily like dealing with agents and might not be equipped to. People certainly donât like dealing with them (note: stop having your AI agents pitch me), and Embiricos is among those people. He also has a human assistant because OpenAIâs corporate partners want to interact with a person, he said, adding, âI personally never intend to have a meeting with someone elseâs agent.â If the AI industry is right that agents are our future, can we get there without overwhelming the infrastructure that our world currently runs on, from businesses and websites to payment networks? âAt OpenAIâŠweâre not always moving the fastest in terms of shipping the next ability for the agent to work with the world,â he said. âWhen we do, weâre doing it really closely in collaboration with the rest of the ecosystem. I probably canât say too much here, but weâre deep in lots of conversations with payment processors.â Letting an AI assistant spend money through partnerships with payment companies would be a potentially lucrative first for OpenAI, but also a big ask for consumers. Giving an assistant access to my email inbox already feels like a big ask, but my bank account is off limits. For now.
BestAITools
