Confidential AI Beyond Inference

Running model inference inside a trusted execution environment can protect user data while it is being processed. But private inference is only one component of a confidential AI system. Anthony, co-founder and CTO of Maple, draws on several years of operating TEE-based AI infrastructure in production to explore what it takes to protect the larger system around inference, and where local execution complements confidential remote compute.