Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Unobtrusive Activity Recognition and Position Estimation for Work Surfaces Using RF-Radar Sensing

Unobtrusive Activity Recognition and Position Estimation for Work Surfaces Using RF-Radar Sensing Activity recognition is a core component of many intelligent and context-aware systems. We present a solution for discreetly and unobtrusively recognizing common work activities above a work surface without using cameras. We demonstrate our approach, which utilizes an RF-radar sensor mounted under the work surface, in three domains: recognizing work activities at a convenience-store counter, recognizing common office deskwork activities, and estimating the position of customers in a showroom environment. Our examples illustrate potential benefits for both post-hoc business analytics and for real-time applications. Our solution was able to classify seven clerk activities with 94.9% accuracy using data collected in a lab environment and able to recognize six common deskwork activities collected in real offices with 95.3% accuracy. Using two sensors simultaneously, we demonstrate coarse position estimation around a large surface with 95.4% accuracy. We show that using multiple projections of RF signal leads to improved recognition accuracy. Finally, we show how smartwatches worn by users can be used to attribute an activity, recognized with the RF sensor, to a particular user in multi-user scenarios. We believe our solution can mitigate some of users’ privacy concerns associated with cameras and is useful for a wide range of intelligent systems. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM Transactions on Interactive Intelligent Systems (TiiS) Association for Computing Machinery

Unobtrusive Activity Recognition and Position Estimation for Work Surfaces Using RF-Radar Sensing

Download PDF
28 pages

Loading next page...
 
/lp/association-for-computing-machinery/unobtrusive-activity-recognition-and-position-estimation-for-work-13iQcOQ58R

References

References for this paper are not available at this time. We will be adding them shortly, thank you for your patience.

Publisher
Association for Computing Machinery
Copyright
Copyright © 2019 ACM
ISSN
2160-6455
eISSN
2160-6463
DOI
10.1145/3241383
Publisher site
See Article on Publisher Site

Abstract

Activity recognition is a core component of many intelligent and context-aware systems. We present a solution for discreetly and unobtrusively recognizing common work activities above a work surface without using cameras. We demonstrate our approach, which utilizes an RF-radar sensor mounted under the work surface, in three domains: recognizing work activities at a convenience-store counter, recognizing common office deskwork activities, and estimating the position of customers in a showroom environment. Our examples illustrate potential benefits for both post-hoc business analytics and for real-time applications. Our solution was able to classify seven clerk activities with 94.9% accuracy using data collected in a lab environment and able to recognize six common deskwork activities collected in real offices with 95.3% accuracy. Using two sensors simultaneously, we demonstrate coarse position estimation around a large surface with 95.4% accuracy. We show that using multiple projections of RF signal leads to improved recognition accuracy. Finally, we show how smartwatches worn by users can be used to attribute an activity, recognized with the RF sensor, to a particular user in multi-user scenarios. We believe our solution can mitigate some of users’ privacy concerns associated with cameras and is useful for a wide range of intelligent systems.

Journal

ACM Transactions on Interactive Intelligent Systems (TiiS) – Association for Computing Machinery

Published: Aug 9, 2019

Keywords: Activity recognition

References

  • Capturing the human figure through a wall
    Adib, Fadel; Hsu, Chen-Yu; Mao, Hongzi; Katabi, Dina; Durand, Frédo
  • Medusa: A proximity-aware multi-touch tabletop
    Annett, Michelle; Grossman, Tovi; Wigdor, Daniel; Fitzmaurice, George
  • Below the surface: Unobtrusive activity recognition for work surfaces using RF-radar sensing
    Avrahami, Daniel; Patel, Mitesh; Yamaura, Yusuke; Kratz, Sven
  • Activity recognition from user-annotated acceleration data
    Bao, Ling; Intille, Stephen S.
  • A benchmark dataset to evaluate sensor displacement in activity recognition
    Baños, Oresti; Damas, Miguel; Pomares, Héctor; Rojas, Ignacio; Tóth, Máté Attila; Amft, Oliver
  • Lilsys: Sensing unavailability
    Begole, James “Bo”; Matsakis, Nicholas E.; Tang, John C.
  • Recognizing daily activities with RFID-based sensors
    Buettner, Michael; Prasad, Richa; Philipose, Matthai; Wetherall, David
  • A tutorial on human activity recognition using body-worn inertial sensors
    Bulling, Andreas; Blanke, Ulf; Schiele, Bernt
  • BreakSense: Combining physiological and location sensing to promote mobility during work-breaks
    Cambo, Scott A.; Avrahami, Daniel; Lee, Matthew L.
  • The opportunity challenge: A benchmark database for on-body sensor-based activity recognition
    Chavarriaga, Ricardo; Sagha, Hesam; Calatroni, Alberto; Digumarti, Sundara Tejaswi; Tröster, Gerhard; Del R. Millán, José; Roggen, Daniel
  • XGBoost: A scalable tree boosting system
    Chen, Tianqi; Guestrin, Carlos
  • SmartBuckle: Human activity recognition using a 3-axis accelerometer and a wearable camera
    Cho, Yongwon; Nam, Yunyoung; Choi, Yoo-Joo; Cho, We-Duke
  • The mobile sensing platform: An embedded activity recognition system
    Choudhury, Tanzeem; Borriello, Gaetano; Consolvo, Sunny; Haehnel, Dirk; Harrison, Beverly; Hemingway, Bruce; Hightower, Jeffrey; Klasnja, Predrag “Pedja”; Koscher, Karl; LaMarca, Anthony; Landay, James A.; LeGrand, Louis; Lester, Jonathan; Rahimi, Ali; Rea, Adam; Wyatt, Danny
  • Egocentric real-time workspace monitoring using an rgb-d camera
    Damen, Dima; Gee, Andrew; Mayol-Cuevas, Walterio; Calway, Andrew
  • Device-free detection of approach and departure behaviors using backscatter communication
    Ding, Han; Qian, Chen; Han, Jinsong; Wang, Ge; Jiang, Zhiping; Zhao, Jizhong; Xi, Wei
  • Predicting human interruptibility with sensors
    Fogarty, James; Hudson, Scott E.; Atkeson, Christopher G.; Avrahami, Daniel; Forlizzi, Jodi; Kiesler, Sara; Lee, Johnny C.; Yang, Jie
  • BusyBody: Creating and fielding personalized models of the cost of interruption
    Horvitz, Eric; Koch, Paul; Apacible, Johnson
  • A self-calibrating radar sensor system for measuring vital signs
    Huang, M. C.; Liu, J. J.; Xu, W.; Gu, C.; Li, C.; Sarrafzadeh, M.
  • A review on video-based human activity recognition
    Ke, Shian-Ru; Thuc, Hoang Le Uyen; Lee, Yong-Jin; Hwang, Jenq-Neng; Yoo, Jang-Hee; Choi, Kyoung-Ho
  • Synthetic sensors: Towards general-purpose sensing
    Laput, Gierad; Zhang, Yang; Harrison, Chris
  • A survey on human activity recognition using wearable sensors
    Lara, Oscar D.; Labrador, Miguel A.
  • A weakly supervised activity recognition framework for real-time synthetic biology laboratory assistance
    Lavania, Chandrashekhar; Thulasidasan, Sunil; LaMarca, Anthony; Scofield, Jeffrey; Bilmes, Jeff
  • Soli: Ubiquitous gesture sensing with millimeter wave radar
    Lien, Jaime; Gillian, Nicholas; Karagozler, M. Emre; Amihood, Patrick; Schwesig, Carsten; Olson, Erik; Raja, Hakim; Poupyrev, Ivan
  • Cardiac scan: A non-contact and continuous heart-based user authentication system
    Lin, Feng; Song, Chen; Zhuang, Yan; Xu, Wenyao; Li, Changzhi; Ren, Kui
  • Automatic fall detection based on Doppler radar motion signature
    Liu, Liang; Popescu, Mihail; Skubic, Marjorie; Rantz, Marilyn; Yardibi, Tarik; Cuddihy, Paul
  • The proximity toolkit: Prototyping proxemic interactions in ubiquitous computing ecologies
    Marquardt, Nicolai; Diaz-Marino, Robert; Boring, Sebastian; Greenberg, Saul
  • Scikit-learn: Machine learning in Python
    Pedregosa, Fabian; Varoquaux, Gaël; Gramfort, Alexandre; Michel, Vincent; Thirion, Bertrand; Grisel, Olivier; Blondel, Mathieu; Prettenhofer, Peter; Weiss, Ron; Dubourg, Vincent; Vanderplas, Jake; Passos, Alexandre; Cournapeau, David; Brucher, Matthieu; Perrot, Matthieu; Duchesnay, Édouard
  • Inferring activities from interactions with objects
    Philipose, M.; Fishkin, K. P.; Perkowitz, M.; Patterson, D. J.; Fox, D.; Kautz, H.; Hahnel, D.
  • A survey on vision-based human action recognition
    Poppe, Ronald
  • RadioSense: Exploiting wireless communication patterns for body sensor network activity recognition
    Qi, X.; Zhou, G.; Li, Y.; Peng, G.
  • Iris: Tapping wearable sensing to capture in-store retail insights on shoppers
    Radhakrishnan, Meera; Eswaran, Sharanya; Misra, Archan; Chander, Deepthi; Dasgupta, Koustuv
  • Design-driven research for workplace exergames: The limber case study
    Reilly, Derek; Westecott, Emma; Parker, David; Perreault, Samuel; Neil, Derek; Lapierre, Nathan; Hartman, Kate; Bal, Harjot
  • Creating and benchmarking a new dataset for physical activity monitoring
    Reiss, Attila; Stricker, Didier
  • Unsupervised recognition of interleaved activities of daily living through ontological and probabilistic reasoning
    Riboni, Daniele; Sztyler, Timo; Civitarese, Gabriele; Stuckenschmidt, Heiner
  • Device-free and device-bound activity recognition using radio signal strength
    Scholz, Markus; Riedel, Till; Hock, Mario; Beigl, Michael
  • Enabling gesture-based interactions with objects
    Shangguan, Longfei; Zhou, Zimu; Jamieson, Kyle
  • The telepathic phone: Frictionless activity recognition from WiFi-RSSI
    Sigg, S.; Blanke, U.; Tröster, G.
  • Informing intelligent user interfaces by inferring affective states from body postures in ubiquitous computing environments
    Tan, Chiew Seng Sean; Schöning, Johannes; Luyten, Kris; Coninx, Karin
  • Inferring meal eating activities in real world settings from ambient sounds: A feasibility study
    Thomaz, Edison; Zhang, Cheng; Essa, Irfan; Abowd, Gregory D.
  • Detecting and tracking multiple users in the proximity of interactive tabletops
    Tănase, Andy Cristian; Vatavu, Radu-Daniel; Pentiuc, Ştefan-Gheorghe; Graur, Adrian
  • A hybrid FMCW-interferometry radar for indoor precise positioning and versatile life activity monitoring
    Wang, Guochao; Gu, Changzhan; Inoue, Takao; Li, Changzhi
  • TagScan: Simultaneous target imaging and material identification with commodity RFID devices
    Wang, Ju; Xiong, Jie; Chen, Xiaojiang; Jiang, Hongbo; Balan, Rajesh Krishna; Fang, Dingyi
  • Interacting with soli: Exploring fine-grained dynamic gesture recognition in the radio-frequency spectrum
    Wang, Saiwen; Song, Jie; Lien, Jaime; Poupyrev, Ivan; Hilliges, Otmar
  • Activity recognition of assembly tasks using body-worn microphones and accelerometers
    Ward, Jamie A.; Lukowicz, Paul; Troster, Gerhard; Starner, Thad E.
  • Radio-based device-free activity recognition with radio frequency interference
    Wei, Bo; Hu, Wen; Yang, Mingrui; Chou, Chun Tung
  • A survey of vision-based methods for action representation, segmentation and recognition
    Weinland, Daniel; Ronfard, Remi; Boyer, Edmond
  • CrossMotion: Fusing device and image motion for user identification, tracking and device association
    Wilson, Andrew D.; Benko, Hrvoje
  • CapTable and CapShelf: Unobtrusive activity recognition using networked capacitive sensors
    Wimmer, Raphael; Kranz, Matthias; Boring, Sebastian; Schmidt, Albrecht
  • RadarCat: Radar categorization for input and interaction
    Yeo, Hui-Shyong; Flamich, Gergely; Schrempf, Patrick; Harris-Birtill, David; Quigley, Aaron
  • Analyzing shopper’s behavior through WiFi signals
    Zeng, Yunze; Pathak, Parth H.; Mohapatra, Prasant
  • RGB-D camera-based daily living activity recognition
    Zhang, Chenyang; Tian, Yingli
  • A Review on Human Activity Recognition Using Vision-Based Method
    Zhang, Shugang; Wei, Zhiqiang; Nie, Jie; Huang, Lei; Wang, Shuang; Li, Zhen
  • Reducing interruptions at work: A large-scale field study of FlowLight
    Züger, Manuela; Corley, Christopher; Meyer, André N.; Li, Boyang; Fritz, Thomas; Shepherd, David; Augustine, Vinay; Francis, Patrick; Kraft, Nicholas; Snipes, Will