Publications

2023

Xu L., Lien J., Li H., Gillian, N., Nongpiur R., Li J., Zhang Q., Cui J., Jorgensen D., Bernstein A., Bedal L., Hayashi E., Yamanaka J., Lee A., Wang A., D Shin, Poupyrev I., Thormundsson T., Pathak A., Patel S. (2023), Soli-enabled noncontact heart rate detection for sleep and meditation tracking, Nature Science, Sci Rep 13, 18008, https://doi.org/10.1038/s41598-023-44714-2, October 2023

Li H., Thormundsson T,, Poupyrev I., Gillian, N., (2023), Gated Compression Layers for Efficient Always-On Models, arXiv:2303.08970, March 2023

2022

Book Chapter (2022): Machine Learning for Radar to appear in Motion and Gesture Sensing with Radar, published by Artech House 2022

2021

Hayashi E., Lien J., Gillian, N., Giusti L., Weber D., Yamanaka J., Bedal L., and Poupyrev I..(2021). RadarNet: Efficient Gesture Recognition Technique Utilizing a Miniature Radar Sensor. ACM Conference on Human Factors in Computing Systems, May 2021 [Best Paper Award]

2020

Wu T., Fukuhara S., Gillian, N., Sundara-Rajan K., and Poupyrev I.(2020). ZebraSense: A Double-sided Textile Touch Sensor for Smart Clothing. ACM User Interface Software and Technology (UIST), August 2020

2016

Lien J., Gillian, N., Karagozler M., Amihood P., Schwesig C., Olson E., Raja H., and Poupyrev I.(2016). Soli: ubiquitous gesture sensing with millimeter wave radar. ACM Trans. Graph. 35, 4, Article 142, July 2016

2015

Gillian, N., Nicolls S. (2015) Kinect-ed Piano in Leonardo Music Journal, 294-295, Vol. 48, No. 3, June 2015

N. Zhao, G. Dublon, A. Dementyev, N. Gillian, and J.A. Paradiso.EMI Spy: Harnessing Electromagnetic Interference for Low-Cost, Rapid Prototyping of Proxemic Interaction, presented at IEEE Conference on Body Sensor Networks (BSN), June 2015

2014

Gillian, N., Paradiso J. (2014) The Gesture Recognition Toolkit in Journal of Machine Learning Research, 3483-3487, Volume 15, October 2014

Gillian, N., Pfenninger, S., Russell, S., Paradiso J. (2014) Gestures Everywhere: A Multimodal Sensor Fusion and Analysis Framework for Pervasive Displays in 3rd International Symposium on Pervasive Displays (PerDis’14), June 2014

Gong, N., Steimle, J., Hodges, S., Gillian, N., Olberding, S., Kawahara, Y., Paradiso, J., (2014) PrintSense: A Versatile Sensing Technique to Support Flexible Surface Interaction, In Proceedings of the International Conference on Human Factors in Computing Systems (CHI’14), April 2014

2013

Mayton, B., Zhao, N., Aldrich, M., Gillian, N., Paradiso J. (2013) WristQue: A Personal Sensor Wristband in Proceedings of the Body Sensor Networks Conference (BSN’13), May 2013

Kapri, A., Wong, K., Hunter, S., Gillian, N., Maes P. (2013) InReach: Manipulating 3D Objects Remotely Using Your Body in Proceedings of the International Conference on Human Factors in Computing (CHI’13), April 2013

2012

Gillian, N., Nicolls S. (2012) A Gesturally Controlled Improvisation System for Piano in Proceedings of the 1st International Conference on Live Interfaces: Performance, Art, Music, September 2012

Gillian, N., Paradiso, J. A. (2012) Digito: A Fine-Grain Gesturally Controlled Virtual Musical Instrument in Proceedings of the 12th International Conference on New Interfaces for Musical Expression, May 2012

2011

Gillian, N., Gesture Recognition for Musician Computer Interaction, Ph.D. Thesis, Queen’s University Belfast, 2011

Gillian, N., Knapp R. B., O’Modhrain, S.,Recognition of Multivariate Temporal Musical Gestures Using N-Dimensional Dynamic Time Warping in Proceedings of the 11th International Conference on New Interfaces for Musical Expression, May 2011

Gillian, N., Knapp R. B., O’Modhrain, S.,A Machine Learning Toolbox for Musician-Computer Interaction in Proceedings of the 11th International Conference on New Interfaces for Musical Expression, May 2011

Gillian, N., Knapp R. B., O’Modhrain, S., An Adaptive Classification Algorithm for Semiotic Musical Gestures in Proceedings of the 8th International Conference on Sound and Music Computing, July 2011

2009

Gillian, N., O’Modhrain, S., Juggling Skill Classification System, SKILLS 09 International Conference - Enaction on Skills, December 2009

Lagarde, J., Zelic, G., Avizzano, C. A., Lippi, V., Ruffaldi, E., Zalmanov, H., Erev-Yehene, V., Gillian, N., O’Modhrain, S., Mottet, D., Gopher, D., The light weight juggling training system for juggling, SKILLS 09 International Conference - Enaction on Skills, December 2009

Gillian, N., Knapp, R.B. and O’Modhrain, S.,The SARC EyesWeb Catalog: A pattern recognition toolbox for musician-computer interaction in Proceedings of the 9th International Conference on New Interfaces for Musical Expression, June 2009

Gillian, N., O’Modhrain, S. and Essl, G., Scratch-Off: A gesture based mobile music game with tactile feedback in Proceedings of the 9th International Conference on New Interfaces for Musical Expression, June 2009


Blogs

2020

Soli Radar-Based Perception and Interaction in Pixel 4, Google AI Blog, 2020 https://ai.googleblog.com/2020/03/soli-radar-based-perception-and.html

ZebraSense: Giving Smart Textiles a New Sense of Direction, ACM UIST Blog 2020 https://medium.com/acm-uist/zebrasense-giving-smart-textiles-a-new-sense-of-direction-b345d372f93c


Workshops

2017

Yeo H., Laput G., Gillian, N., Quigley A. (2017), Workshop on Object Recognition for Input and Mobile Interaction, in the Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services, September 2017

2016

Gillian, N.: Using the Gesture Recognition Toolkit, Machine Learning for Artists and Designers, Carnegie Mellon University, 2016

2012

Gillian, N., A Hands-On Introduction to Gesture Recognition & Machine Learning, MIT Media Lab, Cambridge, USA, June 2012 & September 2012

Gillian, N., Fiebrink R., A Hands-On Workshop on Gesture Recognition and Machine Learning for Real Time Musical Interaction, 12th International Conference on New Interfaces for Musical Expression, University of Michigan, Ann Arbor, USA, May 2012

Gillian, N., Gesture Recognition for Real Time Musician Computer Interaction, Computer Science Department, Southern Polytechnic State University, Marietta, Georgia, USA, March 2012

2011

Gillian, N., Jaimovich J., Angel Ortiz M., Coletta P., Maestre E., Workshop on Multi-Modal Data Acquisition for Musical Research, 11th International Conference on New Interfaces for Musical Expression, University of Oslo, Oslo, Norway, May 2011

2010

Gillian, N., Knapp, R. B., An introduction to the SEC, a real-time toolkit for gesture recognition & machine learning, 3rd EyesWeb User Conferences, University of Genoa, Italy, February 2010


Invited Talks & Panels

2022

Embedding Intelligence into everyday objects, AI Day, Embedded Computing conference, September 2022 https://embeddedcomputing.com/webcasts/event/show/1131 [keynote]

Motion Analysis in the Cloud, Berkeley University, May 2022

AI & Sensing invited talk, DocSF Conference, May 2022 https://docsf.health/program-docsf22

AI for Motion, Orthopedics Research Society, March 2022

2020

AI & the future of Sensors, DocSF Conference, May 2020

Jacquard: Embedding ML seamlessly into everyday objects, Tensorflow Developer Summit, March 2020 https://www.youtube.com/watch?v=JpuJY2nAhrA

2016

Project Soli: Google IO June, 2016, https://www.youtube.com/watch?v=IrIY9ASp8JY&t=499s

2012

Gillian, N., Rapid Learning: Novel Machine Learning Algorithms and Tools for Rapid Gestural-Interaction Design, Prototyping and User Customization, Dartmouth College Department of Computer Science, Hanover, New Hampshire, October 2012

[keynote] Gillian, N., Tinker, Hack, Explore. Bridging the gap between artists and engineers through unconventional learning, Southern Polytechnic State University Summer Summit, Marietta, Georgia, June 2012,

Gillian, N., Gesture Recognition for Musician Computer Interaction, Computer Science Department, Southern Polytechnic State University, Marietta, Georgia, USA, March 2012

Gillian, N., The Future of New Media, Together Music Festival, Cambridge, USA, April 2012