Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Dealing with Uncertainty in pWCET Estimations

Dealing with Uncertainty in pWCET Estimations The problem of estimating a tight and safe Worst-Case Execution Time (WCET), needed for certification in safety-critical environment, is a challenging problem for modern embedded systems. A possible solution proposed in past years is to exploit statistical tools to obtain a probability distribution of the WCET. These probabilistic real-time analyses for WCET are, however, subject to errors, even when all the applicability hypotheses are satisfied and verified. This is caused by the uncertainties of the probabilistic-WCET distribution estimator. This article aims at improving the measurement-based probabilistic timing analysis approach providing some techniques to analyze and deal with such uncertainties. The so-called region of acceptance model based on state-of-the-art statistical test procedures is defined over the distribution space parameters. From this model, a set of strategies is derived and discussed to provide the methodology to deal with the trade-off safety/tightness of the WCET estimation. These techniques are then tested over real datasets, including industrial safety-critical applications, to show the increased value of using the proposed approach in probabilistic WCET analyses. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM Transactions on Embedded Computing Systems (TECS) Association for Computing Machinery

Dealing with Uncertainty in pWCET Estimations

Download PDF
23 pages

Loading next page...
 
/lp/association-for-computing-machinery/dealing-with-uncertainty-in-pwcet-estimations-aONVAWAdQT
Publisher
Association for Computing Machinery
Copyright
Copyright © 2020 ACM
ISSN
1539-9087
eISSN
1558-3465
DOI
10.1145/3396234
Publisher site
See Article on Publisher Site

Abstract

The problem of estimating a tight and safe Worst-Case Execution Time (WCET), needed for certification in safety-critical environment, is a challenging problem for modern embedded systems. A possible solution proposed in past years is to exploit statistical tools to obtain a probability distribution of the WCET. These probabilistic real-time analyses for WCET are, however, subject to errors, even when all the applicability hypotheses are satisfied and verified. This is caused by the uncertainties of the probabilistic-WCET distribution estimator. This article aims at improving the measurement-based probabilistic timing analysis approach providing some techniques to analyze and deal with such uncertainties. The so-called region of acceptance model based on state-of-the-art statistical test procedures is defined over the distribution space parameters. From this model, a set of strategies is derived and discussed to provide the methodology to deal with the trade-off safety/tightness of the WCET estimation. These techniques are then tested over real datasets, including industrial safety-critical applications, to show the increased value of using the proposed approach in probabilistic WCET analyses.

Journal

ACM Transactions on Embedded Computing Systems (TECS) – Association for Computing Machinery

Published: Sep 26, 2020

Keywords: embedded systems

References

  • WCET analysis methods: Pitfalls and challenges on their trustworthiness
    Abella, J.; Hernandez, C.; Quiñones, E.; Cazorla, F. J.; Conmy, P. R.; Azkarate-askasua, M.; Perez, J.; Mezzetti, E.; Vardanega, T.
  • Heart of gold: Making the improbable happen to increase confidence in MBPTA
    Abella, J.; Quiñones, E.; Wartel, F.; Vardanega, T.; Cazorla, F. J.
  • Measurement-based probabilistic timing analysis for graphics processor units
    Berezovskyi, Kostiantyn; Guet, Fabrice; Santinelli, Luca; Bletsas, Konstantinos; Tovar, Eduardo
  • WCET analysis of probabilistic hard real-time systems
    Bernat, G.; Colin, A.; Petters, S. M.
  • Probabilistic worst-case timing analysis: Taxonomy and comprehensive survey
    Cazorla, Francisco J.; Kosmidis, Leonidas; Mezzetti, Enrico; Hernandez, Carles; Abella, Jaume; Vardanega, Tullio
  • PROARTIS: Probabilistically analyzable real-time systems
    Cazorla, Francisco J.; Quiñones, Eduardo; Vardanega, Tullio; Cucu, Liliana; Triquet, Benoit; Bernat, Guillem; Berger, Emery; Abella, Jaume; Wartel, Franck; Houston, Michael; Santinelli, Luca; Kosmidis, Leonidas; Lo, Code; Maxim, Dorin
  • A reliable statistical analysis of the best-fit distribution for high execution times
    Civit, Xavier; del Castillo, Joan; Abella, Jaume
  • On the composition of elementary errors
    Cramér, Harald
  • The exact and asymptotic distributions of Cramer-von Mises statistics
    Csorgo, Sandor; Faraway, Julian J.
  • Measurement-based probabilistic timing analysis for multi-path programs
    Cucu-Grosjean, L.; Santinelli, L.; Houston, M.; Lo, C.; Vardanega, T.; Kosmidis, L.; Abella, J.; Mezzetti, E.; Quiñones, E.; Cazorla, F. J.
  • Architectural performance analysis of FPGA synthesized LEON processors
    Damman, Corentin; Edison, Gregory; Guet, Fabrice; Noulard, Eric; Santinelli, Luca; Hugues, Jerome
  • Identifying the sources of unpredictability in COTS-based multicore
    Dasari, D.; Akesson, B.; Nélis, V.; Awan, M. A.; Petters, S. M.
  • A survey of probabilistic schedulability analysis techniques for real-time systems
    Davis, Robert; Cucu-Grosjean, Liliana
  • On the Meaning of pWCET Distributions and Their Use in Schedulability Analysis
    Davis, Robert I.; Burns, Alan; Griffin, David
  • Analysis of probabilistic cache related pre-emption delays
    Davis, Robert I.; Santinelli, Luca; Altmeyer, Sebastian; Maiza, Claire; Cucu-Grosjean, Liliana
  • Portfolio Optimization with Stochastic Dominance Constraints
    Dentcheva, Darinka; Ruszczyński, Andrzej
  • Statistical analysis for shared resources effects with multi-core real-time systems
    Durand, Julien; Bouchebaba, Youcef; Santinelli, Luca
  • Statistical analysis of WCET for scheduling
    Edgar, S.; Burns, A.
  • Probabilistic timing analysis on time-randomized platforms for the space domain
    Fernandez, M.; Morales, D.; Kosmidis, L.; Bardizbanyan, A.; Broster, I.; Hernandez, C.; Quinones, E.; Abella, J.; Cazorla, F.; Machado, P.; Fossati, L.
  • Limiting forms of the frequency distribution of the largest or smallest member of a sample
    Fisher, R. A.; Tippett, L. H. C.
  • Reliable power and time-constraints-aware predictive management of heterogeneous exascale systems
    Fornaciari, William; Agosta, Giovanni; Atienza, David; Brandolese, Carlo; Cammoun, Leila; Cremona, Luca; Cilardo, Alessandro; Farres, Albert; Flich, José; Hernandez, Carles; Kulchewski, Michal; Libutti, Simone; Martínez, José Maria; Massari, Giuseppe; Oleksiak, Ariel; Pupykina, Anna; Reghenzani, Federico; Tornero, Rafael; Zanella, Michele; Zapater, Marina; Zoni, Davide
  • Open challenges for probabilistic measurement-based worst-case execution time
    Gil, S. Jiménez; Bate, I.; Lima, G.; Santinelli, L.; Gogonel, A.; Cucu-Grosjean, L.
  • Sur La Distribution Limite Du Terme Maximum D’Une Serie Aleatoire
    Gnedenko, B.
  • On the representativity of execution time measurements: Studying dependence and multi-mode tasks
    Guet, Fabrice; Santinelli, Luca; Morio, Jerome
  • Statistical-based WCET estimation and validation
    Hansen, Jeffery; Hissam, Scott; Moreno, Gabriel A.
  • Approximation of modified Anderson–Darling test statistics for extreme value distributions with unknown shape parameter
    Heo, Jun-Haeng; Shin, Hongjoon; Nam, Woosung; Om, Juseong; Jeong, Changsam
  • Obstacles in worst-case execution time analysis
    Kirner, R.; Puschner, P.
  • Sulla determinazione empírica di uma legge di distribuzione
    Kolmogorov, A.
  • Measurement-based probabilistic timing analysis and its impact on processor architecture
    Kosmidis, L.; Quińones, E.; Abella, J.; Vardanega, T.; Broster, I.; Cazorla, F. J.
  • Extreme value theory for estimating task execution time bounds: A careful look
    Lima, G.; Dias, D.; Barros, E.
  • The Kolmogorov-Smirnov test for goodness of fit
    Jr, Frank J. Massey
  • Modeling the choice of residential location
    McFadden, Daniel
  • Challenges with probabilities in response-time analysis of real-time systems
    Nolte, Thomas; Liu, Meng; Lisper, Bjorn
  • Tail-restricted stochastic dominance
    Osuna, Edgar Elias
  • Comparison of trace generation methods for measurement based WCET analysis
    Petters, Stefan M.
  • Admissibility and measurable utility functions
    Quirk, James P.; Saposnik, Rubin
  • chronovise: Measurement-based probabilistic timing analysis framework
    Reghenzani, F.; Massari, G.; Fornaciari, W.
  • The misconception of exponential tail upper-bounding in probabilistic real-time
    Reghenzani, F.; Massari, G.; Fornaciari, W.
  • A probabilistic approach to energy-constrained mixed-criticality systems
    Reghenzani, F.; Massari, G.; Fornaciari, W.
  • Probabilistic-WCET reliability: On the experimental validation of EVT hypotheses
    Reghenzani, F.; Massari, G.; Fornaciari, W.; Galimberti, A.
  • Statistical power estimation dataset for external validation GoF tests on EVT distribution
    Reghenzani, F.; Massari, G.; Santinelli, L.; Fornaciari, W.
  • Why statistical power matters for probabilistic real-time: Work-in-progress
    Reghenzani, Federico; Santinelli, Luca; Fornaciari, William
  • Statistical Analysis of Extreme Values with Applications to Insurance, Finance, Hydrology and Other Fields
    Reiss, Michael Thomas Rolf-Dieter
  • Revising measurement-based probabilistic timing analysis
    Santinelli, L.; Guet, F.; Morio, J.
  • On the criticality of probabilistic worst-case execution time models
    Santinelli, Luca; Guo, Zhishan
  • Oliveira
    Silva, K. P.; Arcaro, L. F.; d, R. S.
  • Stochastic ordering of extreme value distributions
    Wang, Ganghuai; Lambert, J. H.; Haimes, Y. Y.
  • Measurement-based probabilistic timing analysis: Lessons from an integrated-modular avionics case study
    Wartel, F.; Kosmidis, L.; Lo, C.; Triquet, B.; Quiñones, E.; Abella, J.; Gogonel, A.; Baldovin, A.; Mezzetti, E.; Cucu, L.; Vardanega, T.; Cazorla, F. J.