Volume 1, Issue 1

Abstract

Abstract

The objective of the study described in this paper is to define safety metrics that are based on the effectiveness of risk controls. Service providers define and implement such risk controls in order to prevent hazards developing into an accident. The background of this research is a specific need of the aviation industry where small and medium-sized enterprises lack large amounts of safety-related data to measure and demonstrate their safety performance proactively. The research department of the Aviation Academy has initiated a 4-year study, which will test the possibility to develop new safety indicators that will be able to represent safety levels proactively without the benefit of large data sets. As part of the development of alternative safety metrics, safety performance indicators were defined that are based on the effectiveness of risk controls. ICAO (2013) defines a risk control as “a defence with specific mitigation actions, preventive controls or recovery measures put in place to prevent the realization of a hazard or its escalation into an undesirable consequence”. Examples of risk controls are procedures, education and training, a piece of equipment etc. It is crucial for service providers to determine whether the introduced risk controls are indeed effective in reducing the targeted risk. ICAO (2013) describes the effectiveness of risk control as "the extent to which the risk control reduces or eliminates the safety risks”, but does not provide guidance on how to measure the effectiveness of risk control. In this study, a generic metrics for the effectiveness of risk controls based on their effectiveness was developed. The definition of the indicators allows, for each risk control, derivation of specific indicators based on the generic metrics. The suitability of the metrics will subsequently be tested in pilot studies within the aviation industry.

Loading

Article metrics loading...

/content/journals/10.5117/ADV2018.1.012.ROEL
2018-05-01
2024-03-29
Loading full text...

Full text loading...

/deliver/fulltext/25896725/1/1/12_ADV2018.1.ROEL.html?itemId=/content/journals/10.5117/ADV2018.1.012.ROEL&mimeType=html&fmt=ahah

References

  1. ARAMIS (2004). User Guide. Accidental Risk Assessment Methodology for Industries in the Context of the Seveso II Directive, Project under the 5th Framework Programme. Retrieved 14 November 2017 from: https://www.scribd.com/document/57458205/Aramis-Final-User-Guide.
    [Google Scholar]
  2. Aviation Academy (2014). Project Plan RAAK PRO: Measuring safety in aviation – developing metrics for Safety Management Systems, The Netherlands: Aviation Academy, Amsterdam University of Applied Sciences.
    [Google Scholar]
  3. Bellamy, L.J., Ale, B.J., Geyer, T.A., Goossens, L.H., Hale, A.R., Oh, J., Whiston, J.Y. (2007). Storybuilder—A tool for the analysis of accident reports. Reliability Engineering & System Safety, 92(6), 735–744.
    [Google Scholar]
  4. Brewer, D., List, W. (2004). Measuring the effectiveness of an internal control system. Gamma Secure Systems Limited. Retrieved 14 November 2017 from: http://www.gammassl.co.uk/research/time040317.pdf.
    [Google Scholar]
  5. De Dianous, V., Fiévez, C. (2006). ARAMIS project: A more explicit demonstration of risk control through the use of bow–tie diagrams and the evaluation of safety barrier performance. Journal of Hazardous Materials, 130(3), 220–233.
    [Google Scholar]
  6. Dekker, A. (2000). Poor long grass – low bird density ground cover for the runway environment. Proceedings of 25th Meeting of the International Bird Strike Committee, Amsterdam.
    [Google Scholar]
  7. Duijm, N.J. (2009). Safety-barrier diagrams as a safety management tool. Reliability Engineering & System Safety, 94(2), 332–341.
    [Google Scholar]
  8. EC. (2003). Commission Recommendation of 6 May 2003 concerning the definition of micro, small and medium-sized enterprises. 2003/361/EC. Brussels: European Commission.
    [Google Scholar]
  9. FAA. (2000). FAA System Safety Handbook. Federal Aviation Administration. Washington D.C., USA. Retrieved 14 November 2017 from: https://www.faa.gov/regulations_policies/handbooks_manuals/aviation/risk_management/ss_handbook/.
    [Google Scholar]
  10. Hauge, S., Håbrekke, S., Kråkenes, T., Lundteigen, M. A., Merz, M. (2012). Barriers to prevent and limit acute releases to sea, SINTEF A22763. Trondheim, Norway: SINTEF.
    [Google Scholar]
  11. Hollnagel, E. (2004). Barrier and accident prevention. UK: Aldershot.
    [Google Scholar]
  12. Hollnagel, E. (2008). Risk + Barrier = Safety?Safety Science, 46, 221–229.
    [Google Scholar]
  13. IAEA. (2000). Operational Safety Performance Indicators for Nuclear Power Plants. IAEA-TECDOC-1141. Vienna, Austria: International Atomic Energy Agency.
    [Google Scholar]
  14. ICAO. (2013). Safety Management Manual (3rd ed.), doc 9859. Montreal, Canada: International Civil Aviation Organization (ICAO).
    [Google Scholar]
  15. ICAO. (2016). Annex 19 to the Convention on International Civil Aviation - Safety Management (2nd ed). International Civil Aviation Organization. Montreal, Canada.
    [Google Scholar]
  16. Kang, J., Zhang, J., Gao, J. (2016). Analysis of the safety barrier function: Accidents caused by the failure of safety barriers and quantitative evaluation of their performance. Journal of Loss Prevention in the Process Industries, 43, 361–371.
    [Google Scholar]
  17. Kaspers, S., Karanikas, N., Roelen, A.L.C., Piric, S., de Boer, R. J. (2016a). Review of Existing Aviation Safety Metrics, RAAK PRO Project: Measuring Safety in Aviation, Project S10931. The Netherlands: Aviation Academy, Amsterdam University of Applied Sciences.
    [Google Scholar]
  18. Kaspers, S., Karanikas, N., Roelen, A.L.C., Piric, S., van Aalst, R., de Boer, R. J. (2016b). Results from Surveys about Existing Aviation Safety Metrics, RAAK PRO Project: Measuring Safety in Aviation, Project S10931. The Netherlands: Aviation Academy, Amsterdam University of Applied Sciences.
    [Google Scholar]
  19. Kaspers, S., Karanikas, N., Roelen, A., Piric, S., van Aalst, R., de Boer, R. J. (2016c). Exploring the Diversity in Safety Measurement Practices: Empirical Results from Aviation. Proceedings of the 1st International Cross-industry Safety Conference, Amsterdam, 3-4 November 2016, Journal of Safety Studies, 2(2), 18–29.
    [Google Scholar]
  20. Landucci, G., Argentini, F., Spadoni, G., Cozanni, V. (2016). Domino effect frequency assessment: The role of safety barriers. Journal of Loss Prevention in the Process Industries, 44, 706–717.
    [Google Scholar]
  21. Lees, F. (2012). Loss prevention in the process industries: Hazard identification, assessment and control (4th ed.). UK: Butterworth-Heinemann.
    [Google Scholar]
  22. Manuele, F. (2006). Achieving Risk Reduction, Effectively. Process Safety and Environmental Protection, 84(3): 184–190.
    [Google Scholar]
  23. Morgenroth, C. (2005). Bird deterrence at airports by means of long grass management – a strategic mistake?Proceedings of 27th Meeting of the International Bird Strike Committee, Athens.
    [Google Scholar]
  24. Muns, R. (2017). Indicators based on the effectiveness of risk control measures. (BSc graduation thesis). The Netherlands: Amsterdam University of Applied Sciences.
    [Google Scholar]
  25. Neogy, P., Hanson, A.L., Davis, P.R., Fenstermacher, T.E. (1996). Hazard and Barrier analysis guidance document, Rev. 0. USA: Office of Operating Experience Analysis and Feedback, US Department of Energy.
    [Google Scholar]
  26. Neubauer, K., Fleet, D., Ayres Jr, M. (2015). A Guidebook for Safety Risk Management for Airports. ACRP Report 131. Airport Cooperative Research Program. Washington D.C., USA: Transport Research Board of the National Academies.
    [Google Scholar]
  27. OED. (2017). Oxford English Dictionary online. Retrieved 14 November 2017 from: http://www.oed.com/.
    [Google Scholar]
  28. OSHA. (2016). Recommended practices for safety & health programs in construction. Washington D.C., USA: Occupational Health and Safety Administration.
    [Google Scholar]
  29. Rausand, M. (2013). Risk assessment: theory, methods, and applications. USA: John Wiley & Sons.
    [Google Scholar]
  30. Reason, J. (1997). Managing the risks of organizational accidents. UK: Ashgate.
    [Google Scholar]
  31. Sklet, S. (2006). Safety barriers: Definition, classification, and performance. Journal of Loss Prevention in the Process Industries, 19(5): 495–506.
    [Google Scholar]
  32. Svenson, O. (2000). Accident Analysis and Barrier Function (AEB) Method. SKI report 00:6. Stockholm, Sweden: Swedish Nuclear Power Inspectorate.
    [Google Scholar]
  33. Transport Canada. (2004). Sharing the Skies, an aviation industry guide to the management of wildlife hazards, TP 13549E (2nd ed.). Montreal, Canada: Transport Canada.
    [Google Scholar]
  34. Trbojevic, V.M. (2008). Optimising hazard management by workforce engagement and supervision. Research Report RR637. UK: Health and Safety Executive.
    [Google Scholar]
  35. Wahlström, B., Gunsell, L. (1998).Reaktorsäkerhet – and beskrivning och and värdering av säkerhetsarbetet i Norden, NKS/RAK-1(97)R8. Roskilde, Denmark: Nordic Nuclear Safety Research (NKS).
    [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.5117/ADV2018.1.012.ROEL
Loading
/content/journals/10.5117/ADV2018.1.012.ROEL
Loading

Data & Media loading...

Keyword(s): Effectiveness; Risk Controls; Risk Controls’; Safety Performance

Most Cited Most Cited RSS feed