Papers

2023

• Listening Style-Aware Dyadic Facial Motion Generation

  • Gourav Datta, Boshi Huang, Nitesh Sekhar, Vivek Yadav, Shih-Yao Lin, Ayush Jaiswal, Prateek Singhal

  • IJCAI Workshop'23 on Spatio-Temporal Reasoning and Learning (STRL), 2023

2022

• AQT: Adversarial Query Transformers for Domain Adaptive Object Detection

  • Wei-Jie Huang, Yu-Lin Lu, Shih-Yao Lin, Yu-sheng Xie and Yen-Yu Lin

  • Int' Joint Conf.  Artificial Intelligence (IJCAI), 2022 (Oral) [Code]

2021

• TransFusion: Cross-view Fusion with Transformer for 3D Human Pose Estimation

  • Haoyu Ma, Liangjian Chen,  Deying Kong, Zhe Wang, Xingwei, Liu, Hao Tang, Xiangyi Yan, Yusheng Xie, Shih-Yao Lin, and Xiaohui Xie

  • British Machine Vision Conference (BMVC), 2021 [Code]

• Temporal-Aware Self-Supervised Learning for 3D Hand Pose and Mesh Estimation in Videos

  • Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, and Xiaohui Xie

  • Winter Conf. Applications of Computer Vision (WACV), 2021 [Slide][Presentation]

• MVHM: A Large-Scale Multi-View Hand Mesh Benchmark for Accurate 3D Hand Pose Estimation

  • Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, and Xiaohui Xie

  • Winter Conf. Applications of Computer Vision (WACV), 2021 [Slide][Presentation][Dataset]

2020

• MM-Hand: 3D-Aware Multi-Modal Guided Hand Generation for 3D Hand Pose Synthesis

  • Zhenyu Wu, Duc Hoang, Shih-Yao Lin, Yusheng Xie, Liangjian Chen, Yen-Yu Lin, Zhangyang Wang, and Wei Fan

  • ACM Int' Conf. Multimedia (ACM MM), 2020 (Long Paper) [Video] [Poster] [Code]

• DGGAN: Depth-image Guided Generative Adversarial Networks for jointly Disentangling RGB and Depth Images and Estimating 3D Hand Pose

  • Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, Wei Fan, and Xiaohui Xie

  • Winter Conf. Applications of Computer Vision (WACV), 2020 (First Round Early Accepted) [Video][Slide][Poster]

2019

• TAGAN: Tonality Aligned Generative Adversarial Networks for Realistic Hand Pose Synthesis

  • Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Hui Tang, Yufan Xue, Xiaohui Xie, Yen-Yu Lin, and Wei Fan

  • British Machine Vision Conference (BMVC), 2019 [Poster]

2018

• Action Recognition with the Augmented MoCap Data using Neural Data Translation

  • Shih-Yao Lin and Yen-Yu Lin

  • British Machine Vision Conference (BMVC), 2018 [Poster][Video][Code]

• Learning Conditional Random Fields with Augmented Observations for Partially Observed Action Recognition

  • Shih-Yao Lin, Yen-Yu Lin, Chu-Song Chen, and Yi-Ping Hung

  • arXiv preprint, arXiv:1811.09986, 2019 [Video]

2017

• Learning and Inferring Human Actions with Temporal Pyramid Features based on Conditional Random Fields

  • Shih-Yao Lin, Yen-Yu Lin, Chu-Song Chen, and Yi-Ping Hung

  • IEEE Int' Conf. Acoustics, Speech and Signal Processing (ICASSP), 2017 [Poster] [Tai-Chi Chun3D dataset] 

• Recognizing Human Actions with Outlier Frames by Observation Filtering and Completion

  • Shih-Yao Lin, Yen-Yu Lin, Chu-Song Chen, and Yi-Ping Hung,  

  • ACM Trans. Multimedia Comput. Commun. and Appl. (TOMM), Vol. 13 No. 3, pp. 28:1 - 28:23, 2017 (Impact Factor: 2.25) [Video] [Code] [Dataset]

[Publications before 2017]

Patents

• Artificial Intelligence Aided Bug Bite and Transmitted Disease Identification

  •  Lianyi Han, Nan Du, Kun Wang, Min Tu, Shangqing Zhang, Hui Tang,  Shih-Yao Lin, Wei Fan

  • US Patent, US20200327992A1, 2020 [PDF]

• User Device Based Parkinson Disease Detection

  •  Lianyi Han, Hui Tang,  Yusheng Xie,  Zhen Qian, Shih-Yao Lin, Zhimin Huo, Wei Fan

  • US Patent, US20200383625A1, 2020 [PDF]

• Synthesizing 3D Hand Pose Based On Multi-modal Guided Generative Networks

  • Shih-Yao Lin, Kun Wang, Hui Tang, Chao Huang, Lianyi Han, Wei Fan

  • US patent, 17/120,461, 2022 

• A Heart Rate Measurement App based on RPPG

  • Chao Huang, Lianyi Han, Hui Tang, Shih-Yao Lin, Zhimin Huo, and Wei Fan  

  • US Patent (pending)

• Vision-based Rehabilitation Training System Based on 3D Human Pose Estimation Using Multi-view Images 

  • Shih-Yao Lin, Hui Tang, Chao Huang, Lianyi Han, Zhimin Huo, and Wei Fan  

  • US Patent (pending)

• System and Method for Instance Segmentation in Pathological Images using Object-Guided framework

  • Hui Tang, Jingru Yi, Lianyi Han, Chao Huang, Shih-Yao Lin, Zhimin Huo, Wei Fan 

  • US Patent (pending)

• SpO2 Miniprogram: AI Aided SpO2 Measurement App

  • Lianyi Han, Chao Huang, Xiaozhong Chen, Zhimin Huo, Shih-Yao Lin, Hui Tang, Tao Yang, Kun Wang,and Wei Fan

  • US Patent (pending)

• Shape-Aware Organ Segmentation by Predicting Signed Distance Maps

  • Hui Tang, Chao Huang, Shih-Yao Lin, ZhenQian, Zhimin Huo, and Wei Fan

  • US Patent (pending)

• Video-based 3D Hand Pose and Mesh Estimation Based on Temporal-Aware Self-Supervised Learning

  • Shih-Yao Lin, Yusheng Xie, Hui Tang, Chao Huang, Lianyi Han, and Wei Fan 

  • US Patent (pending)

• 3D Hand Pose Estimation Based on Depth-image Guided Adversarial Networks

  • Shih-Yao Lin, Yusheng Xie, Hui Tang, Chao Huang, Lianyi Han, and Wei Fan 

  • US Patent (pending)

• A Deep Learning System for Detecting Acute Intracranial Hemorrhage in Non-Contrast Head CT Images 

  • Chao Huang, Zhen Qian, Hui Tang, Yusheng Xie, Shih-Yao Lin, Kun Wang, Xiaozhong Chen, Zhimin Huo, and Wei Fan

  • US Patent (pending)

• A 2.5-dimensional Convolutional Neural Network for Predicting Hematoma Expansion in Non-Contrast Head CT Images 

  • Chao Huang, Zhen Qian, Hui Tang, Yusheng Xie, Shih-Yao Lin, Kun Wang, Xiaozhong Chen, Lianyi Han, Zhimin Huo, and Wei Fan 

  • US Patent (pending)

• System and Method for Automatic Recognition for Hand Activity defined in Unified Parkinson Disease Rating Scale

  • Hui Tang, Yusheng Xie, Shih-Yao Lin, Lianyi Han, and Wei Fan 

  • US Patent (pending)

• Method and Apparatus for Synthesizing Realistic Hand Poses Based on Blending Generative Adversarial Networks

  • Shih-Yao Lin, Yusheng Xie, Hui Tang, Lianyi Han,and Wei Fan 

  • US Patent, US10916050B1, 2021 [PDF]

• PDD: Parkinson Disease Detection Mobile App

  • Lianyi Han, Hui Tang, Yusheng Xie,  Shih-Yao Lin, Qian Zhen,  Zhimin Huo, and Wei Fan

  • US Patent (pending)

• Multimodal Framework for Heart Abnormalities Analysis based on EMR/EHR and Electrocardiography

  • Nan Du, Kun Wang, Min Tu, Shangqing Zhang, Hui Tang, Shih-Yao Lin, and Wei Fan

  • US Patent,  US20200327985A1, 2020 [PDF]

• Artificial intelligence aided bug bite and transmitted disease identification

  • Lianyi Han, Nan Du, Kun Wang, Min Tu, Shenging Zhang, Hui Tang, Shih-Yao Lin, and Wei Fan

  • US Patent, US20200327992A1, 2020

• Vision-based Motion Capture System for Rehabilitation Training

  • Shih-Yao Lin, Tao Yang, Chao Huang, Zhen Qian, Wei Fan

  • US Patent (pending)

• Method for determining Disease Symptom Relations Using Acceptance and Rejection of Random Samples

  • Yusheng Xie, Tao Yang, Min Tu, Nan Du, Shih-Yao Lin, and Wei Fan

  • US Patent, US-20200265959, 2020 [PDF]

• Augmenting reliable training data with CycleGAN for hand pose estimation

  • Shih-Yao Lin, Yusheng Xie, Kun Wang, Lianyi Han, and Wei Fan

  • US Patent, US20200372668A1, 2020 [PDF]

• Re-anchorable Virtual Panel in Three-dimensional Space

  • Yi-Ping Hung and Shih-Yao Lin 

  • US Patent, US- 20160187991, 2016 

• A re-anchorable Virtual Panel in 3D Space 

  • Yi-Ping Hung and Shih-Yao Lin

  • Taiwan Patent, I521387, 2016