Shih-Yao (Mike) Lin

Senior Applied Scientist @ Microsoft CoreAI

shihyaolin[at]microsoft.com

About Me

Hi, I’m currently a Senior Applied Scientist at Microsoft (CoreAI).

I was worked as a Sr. Applied Scientist at Amazon (2022-2026) on multimodal LLMs, VLMs, and agentic AI systems for video understanding. I focus on post-training foundation models for video action prediction, captioning, and multimodal safety, with an emphasis on building practical, scalable AI agents that reason, plan, and act over video content.

Previously, I worked at Sony (2021–2022) as a Senior Research Scientist, where I developed 3D character motion for real-time game engines. From 2018 to 2021, I was a Senior Researcher at Tencent America, focusing on human pose estimation and motion analysis. Earlier in my career, I held a postdoctoral role at Bosch (2017–2018), working on sensor-based 3D hand gesture recognition.

My research bridges multimodal learning, computer vision, and agentic AI. I aim to design scalable, agent-driven multimodal AI systems that connect foundation models with real-world perception and action.

Photo: Standing before Mount Rainier — a quiet moment that mirrors my work in AI: navigating complexity, appreciating scale, and always aiming higher.

News

2026-03: Joined Microsoft as a Sr. Applied Scientist
2026-01-07: One paper was accepted by WACV'26 Workshop

2023-06-02: One paper was accepted by IJCAI'23 Workshop on Spatio-Temporal Reasoning and Learning (STRL)
2022-08-08: Join Amazon as an Applied Scientist
2022-04-22: One paper was accepted by IJCAI'22
2021-10-15: One paper was accepted by BMVC'21
2021-09: Join Sony as a Sr. Research Scientist
2020-11-02: Two papers were accepted by WACV'21
2020-07-25: One paper was accepted by ACM Multimedia'20
2019-12-08: Our Artificial intelligence apps for Parkinson's patient evaluation was reported by BBC.
2019-09-16: One paper was accepted by WACV'20 (First Round Early Accepted)
2019-07-01: One paper was accepted by BMVC'19
2019-05-09: We launched our Parkinson’s AI clinical trial in London, UK, and it was reported by Parkinson’s Life
2019-05-06: Our Parkinson’s AI diagnosis program was reported by Financial Times [PDF]
2019-01-21: Our work entitled "A Pilot Study to Evaluate the Severity of Motor Dysfunction in Parkinson's Disease Based on AI Video Analysis" has been registered in US NIH-registered Clinical Trial
2018-12-11: Our PD evaluation system was demonstrated at T-Day exhibition and it was reported by Sina and Weixin (Chinese)
2018-12-08: Our AI-Assisted PD motion assessment system was demonstrated at PDMD'18 in Hong Kong and it was reported by Synced and HealthcareWeakly.
2018-10-08: Our Parkinson's patient evaluation and grading system was reported by BBC, Bloomberg, Forbes.
2018-09-03: One paper was accepted by BMVC'18

Page updated

Google Sites

Report abuse