Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

REGISTOR

REGISTOR This article presents REGISTOR, a platform for regular expression grabbing inside storage. The main idea of Registor is accelerating regular expression (regex) search inside storage where large data set is stored, eliminating the I/O bottleneck problem. A special hardware engine for regex search is designed and augmented inside a flash SSD that processes data on-the-fly during data transmission from NAND flash to host. To make the speed of regex search match the internal bus speed of a modern SSD, a deep pipeline structure is designed in Registor hardware consisting of a file semantics extractor, matching candidates finder, regex matching units (REMUs), and results organizer. Furthermore, each stage of the pipeline makes the use of maximal parallelism possible. To make Registor readily usable by high-level applications, we have developed a set of APIs and libraries in Linux allowing Registor to process files in the SSD by recombining separate data blocks into files efficiently. A working prototype of Registor has been built in our newly designed NVMe-SSD. Extensive experiments and analyses have been carried out to show that Registor achieves high throughput, reduces the I/O bandwidth requirement by up to 97%, and reduces CPU utilization by as much as 82% for regex search in large datasets. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM Transactions on Storage (TOS) Association for Computing Machinery

REGISTOR

Pei, Shuyi; Yang, Jing; Yang, Qing
ACM Transactions on Storage (TOS) , Volume 15 (1): 24 – Mar 26, 2019
Download PDF
24 pages

Loading next page...
 
/lp/association-for-computing-machinery/registor-Jpv18f7T91
Publisher
Association for Computing Machinery
Copyright
Copyright © 2019 ACM
ISSN
1553-3077
eISSN
1553-3093
DOI
10.1145/3310149
Publisher site
See Article on Publisher Site

Abstract

This article presents REGISTOR, a platform for regular expression grabbing inside storage. The main idea of Registor is accelerating regular expression (regex) search inside storage where large data set is stored, eliminating the I/O bottleneck problem. A special hardware engine for regex search is designed and augmented inside a flash SSD that processes data on-the-fly during data transmission from NAND flash to host. To make the speed of regex search match the internal bus speed of a modern SSD, a deep pipeline structure is designed in Registor hardware consisting of a file semantics extractor, matching candidates finder, regex matching units (REMUs), and results organizer. Furthermore, each stage of the pipeline makes the use of maximal parallelism possible. To make Registor readily usable by high-level applications, we have developed a set of APIs and libraries in Linux allowing Registor to process files in the SSD by recombining separate data blocks into files efficiently. A working prototype of Registor has been built in our newly designed NVMe-SSD. Extensive experiments and analyses have been carried out to show that Registor achieves high throughput, reduces the I/O bandwidth requirement by up to 97%, and reduces CPU utilization by as much as 82% for regex search in large datasets.

Journal

ACM Transactions on Storage (TOS) – Association for Computing Machinery

Published: Mar 26, 2019

Keywords: Regular expressions

References

  • A scalable processing-in-memory accelerator for parallel graph processing
    Ahn, Junwhan; Hong, Sungpack; Yoo, Sungjoo; Mutlu, Onur; Choi, Kiyoung
  • Big data analytics in E-commerce: A systematic review and agenda for future research
    Akter, Shahriar; Wamba, Samuel Fosso
  • Amazon S3
    Amazon,
  • Lucene
    Apache,
  • It’s time to think about an operating system for near data processing architectures
    Barbalace, Antonio; Iliopoulos, Anthony; Rauchfuss, Holm; Brasche, Goetz
  • A workload for evaluating deep packet inspection architectures
    Becchi, Michela; Franklin, Mark; Crowley, Patrick
  • A scalable architecture for high-throughput regular-expression pattern matching
    Brodie, Benjamin C.; Taylor, David E.; Cytron, Ron K.
  • Bitwise data parallelism in regular expression matching
    Cameron, Robert D.; Shermer, Thomas C.; Shriraman, Arrvindh; Herdy, Kenneth S.; Lin, Dan; Hull, Benjamin R.; Lin, Meng
  • Regular Expression Matching: The Virtual Machine Approach
    Cox, Russ
  • An efficient and scalable semiconductor architecture for parallel automata processing
    Dlugosch, Paul; Brown, Dave; Glendenning, Paul; Leventhal, Michael; Noyes, Harold
  • NVM Express Revision 1
    Express, NVM
  • Fast support for unstructured data processing: The unified automata processor
    Fang, Yuanwei; Hoang, Tung T.; Becchi, Michela; Chien, Andrew A.
  • UDP: A programmable accelerator for extract-transform-load workloads and more
    Fang, Yuanwei; Zou, Chen; Elmore, Aaron J.; Chien, Andrew A.
  • An improved DFA for fast regular expression matching
    Ficara, Domenico; Giordano, Stefano; Procissi, Gregorio; Vitucci, Fabio; Antichi, Gianni; Di Pietro, Andrea
  • Beyond the hype: Big data concepts, methods, and analytics
    Gandomi, Amir; Haider, Murtaza
  • Practical near-data processing for in-memory analytics frameworks
    Gao, Mingyu; Ayers, Grant; Kozyrakis, Christos
  • HARE: Hardware accelerator for regular expressions
    Gogte, Vaibhav; Kolli, Aasheesh; Cafarella, Michael J.; D’Antoni, Loris; Wenisch, Thomas F.
  • RE2
    Google,
  • Biscuit: A framework for near-data processing of big data workloads
    Gu, Boncheol; Yoon, Andre S.; Bae, Duck-Ho; Jo, Insoon; Lee, Jinyoung; Yoon, Jonghyun; Kang, Jeong-Uk
  • PCRE—Perl Compatible Regular Expressions
    Hazel, Philip
  • Introduction to automata theory, languages, and computation
    Hopcroft, John E.; Motwani, Rajeev; Ullman, Jeffrey D.
  • Performance Comparison of Regular Expression Engines
    Github,
  • Hyperion F1 10G Regex File Scan
    IC., Titan
  • Bluedbm: An appliance for big data analytics
    Jun, Sang-Woo; Liu, Ming; Lee, Sungjin; Hicks, Jamey; Ankcorn, John; King, Myron; Xu, Shuotao
  • Big data: Issues, challenges, tools and good practices
    Katal, A.; Wazid, M.; Goudar, R. H.
  • PCRE—Perl Compatible Regular Expressions
    Kosako, K.
  • Algorithms to accelerate multiple regular expressions matching for deep packet inspection
    Kumar, Sailesh; Dharmapurikar, Sarang; Yu, Fang; Crowley, Patrick; Turner, Jonathan
  • SQRL: Hardware accelerator for collecting software data structures
    Kumar, Snehasish; Shriraman, Arrvindh; Srinivasan, Vijayalakshmi; Lin, Dan; Phillips, Jordon
  • Flex and Bison: Text Processing Tools
    Levine, John
  • Accelerating pattern matching using a novel parallel algorithm on GPUs
    Lin, Cheng-Hung; Liu, Chen-Hsiung; Chien, Lung-Sheng; Chang, Shih-Chieh
  • Parabix: Boosting the efficiency of text processing on commodity processors
    Lin, Dan; Medforth, Nigel; Herdy, Kenneth S.; Shriraman, Arrvindh; Cameron, Rob
  • Source to sys/ioctl
    Linux,
  • Designing a programmable wire-speed regular-expression matching accelerator
    Van Lunteren, Jan; Hagleitner, Christoph; Heil, Timothy; Biran, Giora; Shvadron, Uzi; Atasu, Kubilay
  • MT29F8G16ADADAH4-IT
    Micron,
  • MT29F2T08CUHBBM4-3R
    Micron,
  • BEE3 Established: February 26, 2008
    Microsoft,
  • Fast pattern matching in strings
    Knuth, D. E.; Jr, J. H. Morris
  • Data-parallel finite-state machines
    Mytkowicz, Todd; Musuvathi, Madanlal; Schulte, Wolfram
  • Frequently Asked Questions: PCI Express - 3
    PCI-SIG.,
  • Frequently Asked Questions: PCI Express - 4
    PCI-SIG.,
  • REGISTOR: A platform for unstructured data processing inside SSD storage
    Pei, Shuyi; Yang, Jing; Yang, Qing
  • Regular Expression Library
    RegexLib,
  • High performance pattern matching using the automata processor
    Roy, Indranil; Srivastava, Ankit; Nourian, Marziyeh; Becchi, Michela; Aluru, Srinivas
  • Accelerating business analytics applications
    Salapura, Valentina; Karkhanis, Tejas; Nagpurkar, Priya; Moreira, Jose
  • Computational solutions to large-scale data management and analysis
    Schadt, Eric E.; Linderman, Michael D.; Sorenson, Jon; Lee, Lawrence; Nolan, Garry P.
  • Willow: A user-programmable SSD
    Seshadri, Sudharsan; Gahagan, Mark; Bhaskaran, Meenakshi Sundaram; Bunker, Trevor; De, Arup; Jin, Yanqin; Liu, Yang
  • Fast regular expression matching using FPGAs
    Sidhu, Reetinder; Prasanna, Viktor K.
  • Accelerating pattern matching queries in hybrid CPU-FPGA architectures
    Sidler, David; István, Zsolt; Owaida, Muhsen; Alonso, Gustavo
  • Snort—Network Intrusion Detection and Prevention System
    Snort,
  • Parallel automata processor
    Subramaniyan, Arun; Das, Reetuparna
  • A high throughput string matching architecture for intrusion detection and prevention
    Tan, Lin; Sherwood, Timothy
  • Hawk: Hardware support for unstructured log processing
    Tandon, Prateek; Sleiman, Faissal M.; Cafarella, Michael J.; Wenisch, Thomas F.
  • Programming techniques: Regular expression search algorithm
    Thompson, Ken
  • Active flash: Towards energy-efficient, in-situ data analytics on extreme-scale machines
    Tiwari, Devesh; Boboila, Simona; Vazhkudai, Sudharshan S.; Kim, Youngjae; Ma, Xiaosong; Desnoyers, Peter; Solihin, Yan
  • Morpheus: Creating application objects efficiently for heterogeneous computing
    Tseng, Hung-Wei; Zhao, Qianchen; Zhou, Yuxiao; Gahagan, Mark; Swanson, Steven
  • Hardware-accelerated regular expression matching at multiple tens of Gb/s
    van Lunteren, Jan; Guanella, Alexis
  • ANMLzoo: A benchmark suite for exploring bottlenecks in automata processing engines and architectures
    Wadden, Jack; Dang, Vinh; Brunelle, Nathan; II, Tommy Tracy; Guo, Deyuan; Sadredini, Elaheh; Wang, Ke
  • Social computing: From social informatics to social intelligence
    Wang, Fei-Yue; Carley, Kathleen M.; Zeng, Daniel; Mao, Wenji
  • The Entire Project Gutenberg Works of Mark Twain by Mark Twain
    Gutenberg, Project
  • Beyond the wall: Near-data processing for databases
    Xi, Sam Likun; Babarinsa, Oreoluwa; Athanassoulis, Manos; Idreos, Stratos
  • Compact architecture for high-throughput regular expression matching on FPGA
    Yang, Yi-Hua E.; Jiang, Weirong; Prasanna, Viktor K.
  • GPU acceleration of regular expression matching for large datasets: Exploring the implementation space
    Yu, Xiaodong; Becchi, Michela