基本信息

来源摘要/节选

We are excited to have Anthropic share their latest AI x Finance work at AI Engineer New York, coming up in 2 weeks!

In case you’ve been under a rock, here’s a non-exhaustive list of what Anthropic has been shipping since closing the largest fundraise of all time in May at $47B ARR:

June: Launched Claude Tag and Sonnet 5 and Fable 5

July: Opus 5, /checkup. crossed $65B ARR

Last month: Fable/Mythos 5.1, and EFS (upcoming pod)

IPO target $2T, end 2026 ARR estimated $100B

Cowork/chat merged before <competitor> did

Claude Mods

Dario endorses the same Pacing the Frontier message cosigned by all labs

Last week: Opus 5.5, Plugins portal, Cloud Sessions/Claude Projects

Today: Sonnet 5.5!

Today’s episode should catch you up, with Thariq Shihipar, the explainer-king of Anthropic, who we last caught up on Fable launch day with The Field Guide to Fable:

The Future of Mutable Software

Pay special attention to Claude Mods (especially the cheatsheet):

Cloud Brain, Local Hands

And give a try to Claude Projects:

The “hands” terminology is not just an analogy for the local/cloud paradigm that is being built up at frontier coding agent companies like Cognition, but is ALSO particularly relevant to the safety systems discussions that we’ll be discussing with Anthropic in an upcoming episode as they prepare to pace to frontier with responsible AI deployment.

From the rapid rise of Claude Code to a future where agents can rewrite their own harnesses, collaborate across teams, and operate across cloud and local environments, the way we build software is changing extraordinarily fast. In this episode, Anthropic’s Thariq Shihipar joins swyx and Vibhu to unpack how power users are actually working with Claude Code today, why prompting remains a high-skill discipline, and where Anthropic thinks the agent harness is headed next.

We go deep on Claude Code’s evolving interface: Ask User Question and elicitation, artifacts as persistent generative interfaces, Claude Tag for multiplayer agent workflows, Projects, model effort, implementation notes, and the new Claude Mods system for customizing the harness itself. Thariq explains why Claude.md may eventually disappear, why the smartest model could also become the cheapest model for many tasks, and why mutable software could become a new paradigm for how applications are built and customized.

The conversation then turns to agent security and Anthropic’s “Pacing the Frontier” argument. Thariq walks through recent incidents where agents discovered unexpected ways to communicate, exploit infrastructure, reverse-engineer benchmark scorers, and chain vulnerabilities together. We discuss sandboxing, prompt injection, autonomous agents, interpretability, constitutional classifiers, probes, fallbacks, Auto Mode, and why securing increasingly capable agents may become one of the defining engineering problems of the next few years.

We discuss:

Why agentic coding went from controversial to the default in less than a year

Why prompting is still one of the highest-leverage skills for working with Claude Code

How expert users build a mental model of Claude and what it can reliably one-shot

Why discovering your “unknown unknowns” matters more as agents become more capable

Artifacts as persistent, generative interfaces between humans and agents

How Claude could split into a cloud-based “brain,” local or remote “hands,” and dynamic interfaces

Claude Tag, Projects, and multiplayer agents and how collaborative agent workflows could evolve

Why spending more time on the initial prompt can dramatically reduce wasted agent work

When to use low, medium, high, or max effort for different engineering tasks

Why frontier models may eventually outperform smaller models on both intelligence and token efficiency

Why implementation notes can expose decisions the model considered but chose not to make

Why Claude.md may eventually disappear — and why starting without one can sometimes be better

Claude Mods: customizing the execution loop, UI, subagents, routing, and behavior of Claude Code

Model routers, forked agents, and supervisor agents that automatically improve agent workflows

Why Claude Mods may be an early preview of “mutable software”

The bitter lesson of harness engineering and why agent architectures go out of date so quickly

How Claude Tag is becoming an organizational harness for multiplayer work

Why giving agents access to company data creates an enormous new security surface

The Exploit-Bench incident where agents discovered ways to communicate and collaborate

Why agents hacked Hugging Face for scorer code rather than benchmark answers

How agents chained sandbox and infrastructure vulnerabilities in unexpected ways

Why increasingly capable agents make traditional security assumptions harder to maintain

The argument behind Anthropic’s “Pacing the Frontier” proposal

Why software engineers are increasingly doing two jobs: engineering and keeping up with AI

Constitutional classifiers, probes, and fallbacks and what interpretability looks like in production

How Auto Mode checks whether an agent’s actions actually match the user’s permissions

Why Thariq can see serious AI risks while still having a relatively low p(doom)

Thariq Shihipar

X: https://x.com/trq212

LinkedIn: https://www.linkedin.com/in/thariqshihipar

Timestamps

00:00:00 Introduction

00:04:12 Ask User Question and the Future of Agent Interfaces

00:08:29 Artifacts, Projects, and Multiplayer Agents

00:15:37 Prompting as the Core Claude Code Skill

00:21:52 Context, Effort, and Smarter Model Usage

00:28:10 Is Claude.md Going Away?

00:32:49 Claude Mods: Customizing the Claude Code Harness

00:36:35 Model Routing and the Rise of Mutable Software

00:44:40 The Bitter Lesson of Harness Engineering

00:50:49 Claude Tag as an Organizational Harness

00:55:59 Pacing the Frontier and Autonomous Agent Security

00:58:22 Agents Hack Hugging Face for the Scorer

01:05:34 What Happens When Agents Need More Compute?

01:10:32 AI Coding Is Changing Faster Than Engineers Can Keep Up

01:17:17 Probes, Fallbacks, Interpretability, and Auto Mode

01:28:32 AI Risk, p(doom), and Closing Thoughts

Transcript

Introduction: Life at Anthropic and the Pace of Change

Swyx [00:00:00]: We’re here in the studio with our friend Thariq from Anthropic, and I guess generally the Claude Code, I– there’s, there’s so much, merging of boundaries and you’ve been so on top of everything since you joined Anthropic. You have been early to Claude Code itself, but then also, and you’ve told that story in other podcasts, and you’ve also been talking about seeing like an agent. Most recently you did the top AIE World Tour talk, Field Guide to Fable, which obviously you guys launched Fable, so that was– that’s cheating. And mostly you most recently also launching Claude Tag, and we’re also gonna be talking about Pacing the Frontier. There’s a lot going on in Anthropic. I guess top of the question is, what’s it like being at Anthropic when there’s so much going on?

Thariq Shihipar [00:00:48]: I think that It is, like. I think you can get whiplash sometimes. I think, like, going. When I joined Anthropic, I joined because of Claude Code. Like Claude Code had just come out and I was like, “This is so good.” And Opus 4 to me was like just, I could not imagine, like, how good it was? And that was, like, a real moment for me. But I was, like, trying to convince, like, my startup friends to use agentic coding, and they’re like, “Oh, no, like, our engineers don’t think it’s good enough,” or something. And I was like, “That’s insane.” and now you, like, fast-forward, 12 months, less, and, like, it’s just like, yeah, the default way that everyone codes, right? And I think that, like, just having to go from, like, selling it to, like, now, teaching people how to be. make the most use of it and be more efficient and things like that is just like a big, like big change. And, yeah, I think, like, it’s just hard to stay on top of everything as a human? Like, I think things happen so fast and like

Swyx [00:01:51]: You just throw more agents at it.

Thariq Shihipar [00:01:52]: Yeah, like that’s like the agentic stuff scales much better than the, like, human stuff where it’s like, oh, like, there are three things happening right now and, like, they’re all emergencies and, like, how do you, like, respond to it? Yeah.

Teaching People to Use Claude Code

Vibhu [00:02:05]: What do you split your time on? You do a lot of technical writing, engineering work.

Thariq Shihipar [00:02:10]: Yeah, so I think that, like, when I joined the Claude Code team, I wanted to teach people how to use Claude Code and I think that, like, that has been something that, like, I thought, like, maybe I would spend a little bit of time on it or, like, I’d, like, do. I was spending some time on the agent SDK first, and I wasn’t exactly sure, like, how the bitter lesson would go, when it comes to, like, harnesses, right? Like, I think sometimes we were like, “Oh, like, what’s after Claude Code?”? And so initially I was like, I just wanna teach people how to use Claude Code and make it easier to use Claude Code. And I think that has just, like, as the harnesses have gotten better and better, that’s like the dominant problem now is, like, how do you use the agents, right? Like, it’s like such a high skill expression thing. So I do that and then I do engineering work. I give talks, but I think, like, when I’m doing engineering work, my goal is to take that feedback that we get from users and also, like, then be able to talk about, like, hey, how to use Claude Code to do engineering. So there’s like a good loop there. Yeah.

Swyx [00:03:07]: Yeah. I’ll– For listeners, we’ll attach, the talk that you did with Sarah for the Dev Writers, meetup

Thariq Shihipar [00:03:13]: Oh, yeah

Swyx [00:03:13]: Which we talked a little bit about, well, first you do the work and then you talk about the work.

Thariq Shihipar [00:03:16]: Right.

Swyx [00:03:16]: Something like that.

Thariq Shihipar [00:03:17]: Yeah.

Swyx [00:03:17]: It’s sow and reap or

Thariq Shihipar [00:03:19]: Yeah, reap and. Sow and reap.

Swyx [00:03:21]: Something like that. Something like that. Yeah, so, and then just to preview a little bit, we are gonna talk about the evolution of the harness. It has come a long way from just being a CLI. We’re gonna talk about, Claude Mods, which is starting to leak today, because you couldn’t keep it secret.

Thariq Shihipar [00:03:36]: Yeah. yeah.

Swyx [00:03:39]: Yeah, there’s, there’s a lot, there. I think you started off with, like, adding ask user question tool, which people love and hate.

Thariq Shihipar [00:03:48]: Yeah.

Swyx [00:03:48]: Like, I thought it was, like, very innovative, and then now I have, like, my own version. You have your Interview Me version.

Thariq Shihipar [00:03:55]: Yeah.

Swyx [00:03:56]: And, yeah, everyone just has, like, their own stuff. And, like, it no longer matters ‘cause now you’re supposed to, write prompts that create other prompts and loops and all these things.

Ask User Question and Human-Agent Interaction

Thariq Shihipar [00:04:05]: Sure, yeah.

Swyx [00:04:06]: So what’s the state of the art, today? Like, what are people. what are you, like, telling people to do today?

Thariq Shihipar [00:04:12]: Yeah, ask user question was the first time that the model was good at elicitation. I think this was, like, an emergent behavior that I, like, wanted to see if the models could do. I have, like a human-computer interaction background, so I, like, did that in undergrad and grad school. And so this was like. I think it’s like human-agent interaction to me, like, trying to figure out, like, how can the agent communicate with you and extract, the requirements, right? I think that, like, one of the things about, like, that’s difficult as Claude Code has gone broader and broader is that everyone has, like, their own way of using it, and it’s very hard to, like, change the default behavior. So for example, like, if someone asks Claude Code to do something,

Thariq Shihipar [00:04:59]: Sometimes they just want them to do the work, ‘cause they’re, like, maybe a very good prompter, and sometimes they want. like, are not good at prompting? And you need. like, the agent needs to, like, clarify? And so that’s, like, a good split. Like, and the ask you the question tool like, splits along that side where, like, are– do you feel like you’re good enough to instruct the agent as it is, or is the agent able to, like. does the agent need to, like, pull out more requirements and, like, collaborate with you more and really understand your preferences?

Thariq Shihipar [00:05:27]: I, on the whole, believe that pretty much everyone is more on the latter than the former, that they, like, have more ambiguity and they know less than they want, than they, like, think they know about the problem. but, like, it’s like a interface design problem to make that easy? And so, like, if you’re designing a problem, like, or if you’re going through a problem, like, things like what’s the schema or, like, what’s the call stack and things like that are really important. like, the details in the design are important. Ideally, you want to figure out some of these, like, hard problems ahead of time before starting implementation. And yeah, that’s why they call, like, unknowns, right? And so I think that this will forever be, like, a skill in agentic coding is, like, figuring out your unknowns. So, like, because even if the model is, like, super intelligent- It, like, needs to know what you want? And, like, you have preferences. like, you need to like, pull the, pull that out. and so that’s, like, I think how I’m, what I’m pushing. the question then is, like, how does the agent interact with you? And I think that has been HTML, has been, like, the big way of doing that. And we’ve recently added artifacts, right? And artifacts, I think we’ve done a bad job of, like, or, like, I’ve done a bad job of, like, explaining how to use them fully. We have a lot of property capabilities. They have a database associated with them? And so every artifact can store and write persistent data. They can, like, feed back into Claude? And so, like, one thing that, like, people are not doing yet that I’m trying to, like, encourage is, like, this idea of a dashboard artifact. So you have, like, Claude working on a project long-term. Maybe it’s like a kanban or something. it can store that kanban data in its database. Multiple Claudes can access that data via, like, the artifact MCP, and, like, that artifact can, like, talk to those Claudes as well. And so, like, the. We’re building the primitives for you to be able to have this, like, generative interface via artifacts that will, like, let you surface more of that rich detail from the agents. And I think that, like, almost everything with agents right now is, like, this problem of, like, you think what you want, but you don’t really know what you want, and, like, the agents need a lot of detail, and collaborating with them in the loop is really important. And so artifacts are, like, the, like, way that we’re trying to evolve there. But there’s a lot of work to do because it’s so much more complicated than, like, a multiple-choice question? there’s a lot more, like, detail in terms of, like, diagrams and code snippets and schemas or, like, whatever it is for that problem. But, like, artifacts is, like, the mo-more AGI-pilled way of, like, doing ask user question. So yeah.

Artifacts as the Interface to the Harness

Swyx [00:08:15]: I think one thing that’s unclear to me about these, the artifact stuff is, like, what feedback should go in through the artifact and what feedback should go through a Claude, a chat? Because the more AGI-pilled one is to just feed everything to the Claude.

Thariq Shihipar [00:08:29]: I think the more AGI-pilled one is to go through the artifact. Like, and I think that, like, we imagine in the limit, I think that artifacts will be your interface into the harness? You can, like, comment on this, like, live, like, document of your plan, of the work. you can see maybe, like, multiple agents and different agents are doing this, and that artifact is built for the current work that you’re doing, right? And so, like, each one has, like, slightly different. I think we’re still, like, getting there from, like, an infrastructure perspective. But yeah, I think, like, on-the-fly interface for your harness is probably where things are headed.

Vibhu [00:09:03]: Is there a version of it that’s an abstraction from CLI or chat and you. Because right now, a lot of it is, okay, you’re interfacing with Claude Code, you’re having HTML given back for a mockup. It’s pretty rich. There’s diagrams. Artifacts are ways to connect these together. Why not just do everything that way?

Separating Brain, Hands, and Surface UI

Thariq Shihipar [00:09:22]: Then it becomes, like, separating out, like, where is the inference happening? Where is the intelligence happening? Where is the work happening? like, I think this is like, difference between, like, or, like, some of the distinction between local and cloud, right? And so, I think right now, if you use Claude Code, it’s, like, local and, like, you can spin off remote control, for example, to get some cloud behavior, or you can spin off Claude Code in the cloud, right? We’re moving towards a place where instead of Claudes, like, you message a local Claude, it starts a session locally and it executes, to more like you have a Claude that you message that’s in the cloud that’s running. it can run, like, local, or, like, cloud sessions. This is how Claude Tag works. But, like, over time, we’ll add, like, local hands as well. And so, like, local hands will be the ability for that agent to access your computer if it’s online, and be able to, like, work there. And so it can spin off many different subagents. It can, like, commu- those subagents can communicate with each other, and that’s where the artifact comes in to display all of that work. So you can imagine, like, the. You’re separating out these things. So there’s, like, the surface UI display that’s an artifact and hosted somewhere and has a database and everything. There is the inference intelligence, right, that’s happening on the cloud, and you don’t have to worry about shutting off your computer or whatever, right? and then there’s the, like, hands. Like, and it can be local, it can be in, like, a remote sandbox or wherever you need your work to be done. That’s like unpackaging, like, the Claude Code experience right now where, like, right now it all happens in one place, right? So.

Multiplayer Agents, Claude Tag, and Projects

Vibhu [00:11:00]: How do you see, like, the multiplayer side of that? So say teams want to work in this way. Right now it’s very individual, but how do you see the future of multiplayer? Like, right now, I guess there’s Claude Tag, which is a version, but.

Thariq Shihipar [00:11:12]: We’re launching projects. And so projects is the, like, this abstraction that’s like Claude Tag, but on our Claude products, right? So you can message it and, like, it will do the Claude Tag-like stuff, like spinning off subagents. So We think with multiplayer. Like, Claude Tag is, like, a little bit more native multiplayer because it’s just, like, in your Slack and the permissions are all figured out and stuff like that. But I do think multiplayer is, like, an important part of the story and, like, that will need to get tied together more. Like, you can imagine how complicated it gets when you’re like, oh, you have hands, but now you have other hands in other people’s computers too, and, like, you need to, like, permission them or, like, you have, like, your MCP and someone else’s MCP, and how do you figure out how to use them, right? It gets, like, quite complicated. And Claude Tag does a good job of, like, sanding down all of these issues, right? So that, like, when you have, yeah, Google Docs, how does it access Google Docs, right? Like, it accesses through the shared Claude MCP, or it can access through your local credentials as well if it doesn’t have access. But yeah, I think Claude Tag is our multiplayer, product, and it’s really useful for these, like, things that are inherently multiplayer. Like, okay, like on-call, for example, incidents are inherently multiplayer. You want to tag Claude, you want multiple people to log in, you want it to be able to find context. I think whenever I’m, like, working on something and I want, like, privacy or security or, like, I want other people to review it’s really nice to, like. I’ll have a channel per project and I’ll, like, at legal, for example, be like, “Hey, like, I want to ship this. Can you, like.” Like, here’s. Like Claude knows everything, just chat with it. And that way legal gets precise answers, on like what exactly is shipping into the code, and I don’t need to be in the loop, right? So I think like multiplayer is getting like more and more like, yeah, everyone can participate with Claude. I think Claude Tag is like that product and like projects will start off single player and will like, expand.

Swyx [00:13:14]: I think there’s a question about like maybe dual questions about identity and the unit of isolation.

Identity, Permissions, and Isolation

Thariq Shihipar [00:13:20]: Yeah.

Swyx [00:13:20]: Claude Tag, you specifically chose to make it its own identity

Thariq Shihipar [00:13:26]: Yes.

Swyx [00:13:26]: Which is like, a controversial choice. There’s, there’s other ways to do it.

Thariq Shihipar [00:13:30]: Yeah.

Swyx [00:13:30]: Claude Projects probably it sounds like, if it’s anything like ChatGPT Projects, it is, the isolation is that artifacts, that cloud instance, everyone’s collaborating on this. It’ll. It sounds like, it should be like if you’re, if you’re collaborating with legal on a thing, like that channel should be a project, right? Like it’s not yet

Thariq Shihipar [00:13:50]: Yes.

Swyx [00:13:50]: But it. that’s the natural next step.

Thariq Shihipar [00:13:53]: Yeah, like I think in Claude Tag, it’s effectively. Like Claude Tag, you have to do your own arrangement. And so Claude Tag, yeah, each channel is like you can name it as you want, and I name

Swyx [00:14:04]: Yeah.

Thariq Shihipar [00:14:04]: Like each feature

Swyx [00:14:06]: Yeah.

Thariq Shihipar [00:14:07]: As a channel.

Swyx [00:14:07]: And, but I think like there is some trans- like it’s unclear when there is transference, because let’s say it is. if you have a coworker

Thariq Shihipar [00:14:14]: Yeah.

Swyx [00:14:14]: Who is tagging on all these things, yes, there is transfer

Thariq Shihipar [00:14:16]: Yeah.

Swyx [00:14:16]: Because it’s the same person. but with Claude, it’s unclear if it’s like necessarily like, well, no, you don’t know any of. you don’t know about the other stuff. You should only use this stuff.

Thariq Shihipar [00:14:25]: It’s like the tip of the iceberg meme, right, where you can like. This is what we spend so much time on

Swyx [00:14:31]: Yeah.

Thariq Shihipar [00:14:31]: Is like there is like infinite surface area of like, okay, you want Claudes to. Not infinite, but like there’s like surface area, a lot of like, surface area to figure out of like permissions and visibility and like how can you let Claude operate as well as you can, as safely as you can? And obviously, this is very important to us because like security for our code base is very important. And so we’ve put a lot of time into this. Yeah, there’s so many like edge cases you can figure out where it’s like, oh, like, yeah, this Claude in this channel has different permissions, but it can message another channel, and can’t it exfiltrate data that way? Or like can you like. What if it uses your MCP and then messages someone else? Like there’s like so much, and we’ve like really put a lot of work into sanding it down.

Swyx [00:15:14]: Yeah. Lots of work. okay. Fable?

Fable and the Meta-Skill of Prompting

Vibhu [00:15:18]: Fable, you wrote two good articles. you’ve written many

来源说明

当前保存的是 RSS 或来源节选，不代表原文全文。请以原始来源为准。

本页只呈现已保存的来源证据，不包含基于缺失正文的扩展推断。