Guardian Angels: LLM Personalization for Productivity and Security

gwern.net · by Gwern · clipped 2026-07-23

Preview clipped from the web into my Obsidian — read the full piece at the source.

Pow­er­ful LLMs will be de­ployed at global scale in the next few years, and will dom­i­nate the In­ter­net, and in­creas­ingly, or­di­nary life. As of mid-2026, there is no co­her­ent vi­sion for how knowl­edge pro­fes­sion­als, or or­di­nary peo­ple, will be able to har­ness these LLMs for large pro­duc­tiv­ity in­creases, or how they will han­dle cy­ber­se­cu­rity and cog­ni­tive se­cu­rity.

I pro­pose a goal of cre­at­ing Guardian An­gels (GA): dig­i­tal twin LLMs which are per­son­al­ized with the goal of pro­vid­ing not the stereo­typ­i­cal “as­sis­tant chat­bot agent” per­sona, but em­u­lat­ing a sin­gle user’s per­son­al­ity, val­ues, and pref­er­ences.

This weakly solves the principal-agent prob­lem by uni­fy­ing the prin­ci­pal and agent as much as pos­si­ble. In a GA fu­ture, the focus of the “prin­ci­pal” user is on defin­ing “what is worth doing?” by the GA (agent) users, and not on what or how to do things, func­tion­ing as the CEO or ‘board’ of an ‘AI cor­po­ra­tion’. This al­lows them to de­ploy nu­mer­ous agents to achieve de­sir­able things and to han­dle se­cu­rity, like screen­ing all mes­sages for ad­vanced at­tacks (like in­ter­lock­ing ecosys­tems of syn­thetic media for pro­pa­ganda or spearphish­ing). They can­not solve larger AI align­ment prob­lems, but they can help in­di­vid­ual hu­mans as part of a society-wide defense-in-depth strat­egy.

A GA per­sona is pro­duc­tive be­cause it learns to em­u­late the prin­ci­pal’s out­puts but with higher qual­ity. It is trust­wor­thy be­cause it is, by de­f­i­n­i­tion, al­lied with its prin­ci­pal and shares its val­ues and goals. And it is se­cure in part by hard­wiring a sin­gle, unique, sit­u­ated user (for whom fol­low­ing a prompt at­tack would be ab­surd), avoid­ing ‘con­fused deputy’ prob­lems, while pe­ri­odic up­grades of the un­der­ly­ing model and the de­fend­ers’ ad­van­tage allow GAs to keep up with at­tack­ers.

Stan­dard tech­niques like prompt pro­gram­ming⁠ of in-context-learning for “frozen” mod­els will not cre­ate use­ful GAs due to the lim­i­ta­tions of post-training, con­text win­dows and self-attention with frozen weights in compute-efficient-but-under-parameterized mod­els, low-compute out­puts, and the sta­tus quo of pas­sive of­fline data col­lec­tion—which are col­lec­tively re­spon­si­ble for chat­bots’ dis­ap­point­ing re­sults in knowl­edge worker am­pli­fi­ca­tion and cre­ative writ­ing and fatal er­rors in agen­tic set­tings.

We can try to cre­ate GAs by a com­bi­na­tion of tech­niques: on­line learn­ing (via dy­namic eval­u­a­tion) to up­date LLMs in re­al­time to avoid ig­no­rance and fatal er­rors while re­main­ing com­pet­i­tive with frozen fron­tier mod­els, sam­ple ef­fi­ciency from pre­trained preference-oriented large mod­els and ⁠ac­tive Learn­ing⁠ by query­ing the prin­ci­pal for cor­rec­tions and pref­er­ence data (ob­tain­ing low re­gret from DAgger-style bounds), and a local CLI-first logging-oriented UI/UX par­a­digm.

GAs could be done as an ⁠open-source⁠ com­mu­nity ef­fort, but given the need for high se­cu­rity in de­ploy­ment and the ris­ing chal­lenge of APTs equipped with Mythos-scale at­tack­ers, it prob­a­bly makes more sense as a startup, cater­ing ini­tially to power-users and knowl­edge work­ers such as CEOs or re­searchers, and mov­ing down­wards as it is re­fined.

Minimalist Guardian Angel ambigram logo: a large black serif ‘G’ on the left and matching ‘A’ on the right flank a vertical split quill. The quill is divided by a thin white centerline, with red-and-black feather halves inverted across the midpoint, creating a rotational ambigram effect on a white background.

Minimalist Guardian Angel ambigram logo: a large black serif ‘G’ on the left and matching ‘A’ on the right flank a vertical split quill. The quill is divided by a thin white centerline, with red-and-black feather halves inverted across the midpoint, creating a rotational ambigram effect on a white background.

Read the full version at the source →