Product Initiatives
2024/25
User Experiences: Playground, Message Backgrounds, Apple Intelligence International, Shortcuts.
Core Technologies: Multimodal Foundational Models, On-Device Diffusion, Safety Alignment.
2023/24
User Experiences: Genmoji, Image Playground, System Search, Image Wand, Apple Intelligence Safety.
Core Technologies: On-Device Diffusion, On-Device Embeddings, Safety Alignment.
2022/23
User Experiences: Video Segmentation/Stickers, Communication Safety in Video, Copy/Paste Edits.
Core Technologies: Diffusion on ANE, Video Segmentation, Video Safety, Motion Estimation, Im2Im Translation.
2021/22
User Experiences: Segmentation in Camera, Live Stickers, Communication Safety, Memories, Visual Lookup.
Core Technologies: Transformers on the ANE, On Device Scene Analysis, ImLang Foundation Model for iOS/macOS, System Image Safety, Segmentation.
2020/21
User Experiences: Cinematic Mode, Document Scanning in Vision, Live Text, Visual Lookup, Shared With You.
Core Technologies: Color Normalization - Memories, Pixel Semantics, Private Learning, FG Recognition, Color Normalization, Visual Tracking, Memes.
Developer API: Document Segmentation.
2019/20
User Experiences: iPhone 12 Cameras, Voiceover / On Device Captioning, Photos Widget, Final Cut Pro.
Core Technologies: Intelligent Cropping, Content Filtering, Visual Captioning, RT* Classifiers.
Developer API: CreateML Object Detection.
2018/19
User Experiences: iPhone 11 Cameras - RealTime Autofocus, Image Capture, Ultrawide Re-framing, RedEye Correction, Curation.
Core Technologies: Real Time Saliency, Utility Filter, Person Semantics, Face Semantics, Image Fusion.
Developer API: Image Tagging, Image Similarity, Saliency.
2017/18
User Experiences: Photos Search, Memories, CreateML.
Core Technologies: Scene Analysis Backbone, Image Aesthetics, Saliency, Data Workflows.
Developer API: ImagePrint Extraction, Custom CreateML Classifier Training.
2016/17
User Experiences: iPhone X Camera - QR Scanning in Camera, Autoexposure, Image Rendering.
Core Technologies: Scene Analysis Backbone, Image Aesthetics, Saliency, Data Workflows.
Developer API: Facial Landmarks in Vision.
2015/16
User Experiences: Face Analysis in Portrait Mode, Face Recognition in Photos.
Core Technologies: Facial Landmarks, Face Recognition, Face Attributes.