​Protecting Facial Privacy Through Face Swapping
This project develops privacy mechanisms for clinical video observation sessions, specifically focusing on mechanisms that protect the facial identity of the child under observation while retaining gaze and expression based information which is critical for diagnostic assessments.
Funding source(s):
-
NIH R21 “Protecting the privacy of the child through facial identity removal in recorded behavioral observation sessions” (2020-2022)
Publications
Towards mitigating uncann(eye)ness in face swaps via gaze-centric loss terms
Wilson, Ethan and Shic, Frederick and Joerg, Sophie and Jain, Eakta. Towards mitigating uncann(eye)ness in face swaps via gaze-centric loss terms. Computers and Graphics Journal Special Issue: Eye Gaze Visualization, Interaction, Synthesis, and Analysis (2024).
Resources:
-
Bibtex:
@article{wilson_uncanneyeness_2024,
author = {Ethan Wilson and Frederick Shic and Sophie Jörg and Eakta Jain},
title = {Towards mitigating uncann(eye)ness in face swaps via gaze-centric loss terms},
year = {2024},
journal = {Computers & Graphics},
doi = {https://doi.org/10.1016/j.cag.2024.103888},
}
Introducing Explicit Gaze Constraints to Face Swapping
Wilson, Ethan and Shic, Frederick and Jain, Eakta. Introducing Explicit Gaze Constraints to Face Swapping. ACM Symposium on Eye Tracking Research & Applications (ETRA 23).
Resources:
-
Bibtex:
@inproceedings{wilson_explicitgaze_2023,
author = {Wilson, Ethan and Shic, Frederick and Jain, Eakta},
title = {Introducing Explicit Gaze Constraints to Face Swapping},
year = {2023},
publisher = {Association for Computing Machinery},
booktitle = {2023 Symposium on Eye Tracking Research and Applications},
series = {ETRA '23}
}​
Practical Digital Disguises: Leveraging Face Swaps to Protect Patient Privacy
Wilson, Ethan and Shic, Frederick and Skytta, Jenny and Jain, Eakta. Practical Digital Disguises: Leveraging Face Swaps to Protect Patient Privacy. arXiv preprint arXiv:2204.03559. (2022)
Resources:
@misc{wilson_digitaldisguises_2022,
author = {Wilson, Ethan and Shic, Frederick and Skytta, Jenny and Jain, Eakta},
title = {Practical Digital Disguises: Leveraging Face Swaps to Protect Patient Privacy},
publisher = {arXiv},
year = {2022}
}​​
The Uncanniness of Face Swaps
Wilson, Ethan and Persaud, Aidan and Esposito, Nicholas and Joerg, Sophie and Shic, Frederick and Patra, Rohit and Skytta, Jenny and Jain, Eakta. The Uncanniness of Face Swaps. Journal of Vision 2022;22(14):4225. (2022)
Resources:
-
Bibtex:
@article{wilson_uncanniness_2022,
title={The Uncanniness of Face Swaps},
author={Wilson, Ethan and Persaud, Aidan and Esposito, Nicholas and Joerg, Sophie and Patra, Rohit and Shic, Frederick and Skytta, Jenny and Jain, Eakta},
journal={Journal of Vision},
volume={22},
number={14},
pages={4225--4225},
year={2022},
publisher={The Association for Research in Vision and Ophthalmology}
}
Annotation System For Aiding Automatic Face Detectors
Wilson, Ethan and Skytta, Jenny and Shic, Frederick and Jain, Eakta. Annotation System for Aiding Automatic Face Detectors. University of Florida Technical Report. (2021)
Resources:
-
Bibtex:
@techreport{wilson_annotation_2021,
title = {Annotation System For Aiding Automatic Face Detectors},
author = {Ethan Wilson and Jenny Skytta and Frederick Shic and Eakta Jain},
year = {2021},
institution = {University of Florida}
}
Benchmarking Face Detectors
Wilson, Ethan and Skytta, Jenny and Shic, Frederick and Jain, Eakta. Benchmarking Face Detectors. University of Florida Technical Report. (2021)
Resources:
-
Bibtex:
@techreport{wilson_benchmarking_2021,
title = {Benchmarking Face Detectors},
author = {Ethan Wilson and Jenny Skytta and Frederick Shic and Eakta Jain},
year = {2021},
institution = {University of Florida}
}