基本信息

要点解读

这是什么

论文将可微分的符号逻辑监督引入连续资产配置,使智能体在学习过程中掌握投资政策声明的约束,而非在执行后补救违规。实验显示,在六条随市场状态变化的规则下,违规率明显低于无约束强化学习和奖励惩罚方法。

用在哪里

适用于机构投资者构建资产配置策略的场景,尤其适合需要根据市场状态调整配置、同时必须遵守投资授权规则的应用。

可以推断的

  • 推测:相较于仅优化收益的强化学习方法,符号约束有望提升策略在真实部署中的规则可用性。
  • 推测:将合规能力训练进策略本身,可能减少推理阶段额外拦截和修正的依赖。

来源摘要/节选

Institutional portfolios operate under investment policy statements that specify asset allocation constraints, often conditioned on market regime information. Deep reinforcement learning has been shown to optimize financial performance but typically does not enforce rule compliance, making it unsuitable for real-world deployment. Existing neurosymbolic methods such as Probabilistic Logic Policy Gradient (PLPG) offer constraint-satisfying reinforcement learning (RL) via differentiable symbolic supervision but assume a finite, discrete action space. We present a PLPG-inspired continuous allocation method that estimates the probability that the policy’s own executed action satisfies the investment mandate, using reparameterized Monte Carlo sampling, and adds it to the training objective. No post-hoc enforcement mechanism intercepts actions at inference time and compliance is learned by the agent. Audited directly on deterministic mean actions with no correction, the policy reduces violations of a six-rule regime-conditional mandate from 96-98% for unconstrained RL and 33.4% for a reward-penalty baseline to 4.8%, showing that a continuous-action neurosymbolic policy can substantially internalize a symbolic mandate.

来源说明

当前保存的是来源摘要,不代表论文全文。请以原始来源为准。

「要点解读」由 AI Stack 依据上方已保存内容整理,不代表来源的完整表述;标注「推测:」的判断来自编辑,不是来源陈述。