Software quality assurance in the 1996 performance assessment for the Waste Isolation Pilot Plant
The US Department of Energy (DOE) Waste Isolation Pilot Plant (WIPP), located in southeast New Mexico, is a deep geologic repository for the permanent disposal of transuranic waste generated by DOE defense-related activities. Sandia National Laboratories (SNL), in its role as scientific advisor to t...
Saved in:
| Published in | Reliability engineering & system safety Vol. 69; no. 1; pp. 421 - 427 |
|---|---|
| Main Authors | , , |
| Format | Journal Article |
| Language | English |
| Published |
Elsevier Ltd
2000
|
| Subjects | |
| Online Access | Get full text |
| ISSN | 0951-8320 1879-0836 |
| DOI | 10.1016/S0951-8320(00)00041-7 |
Cover
| Abstract | The US Department of Energy (DOE) Waste Isolation Pilot Plant (WIPP), located in southeast New Mexico, is a deep geologic repository for the permanent disposal of transuranic waste generated by DOE defense-related activities. Sandia National Laboratories (SNL), in its role as scientific advisor to the DOE, is responsible for evaluating the long-term performance of the WIPP. This risk-based Performance Assessment (PA) is accomplished in part through the use of numerous scientific modeling codes, which rely for some of their inputs on data gathered during characterization of the site. The PA is subject to formal requirements set forth in federal regulations. In particular, the components of the calculation fall under the configuration management and software quality assurance aegis of the American Society of Mechanical Engineers (ASME) Nuclear Quality Assurance (NQA) requirements. This paper describes SNL's implementation of the NQA requirements regarding software quality assurance (SQA). The description of the implementation of SQA for a PA calculation addresses not only the interpretation of the NQA requirements, it also discusses roles, deliverables, and the resources necessary for effective implementation. Finally, examples are given which illustrate the effectiveness of SNL's SQA program, followed by a detailed discussion of lessons learned. |
|---|---|
| AbstractList | The US Department of Energy (DOE) Waste Isolation Pilot Plant (WIPP), located in southeast New Mexico, is a deep geologic repository for the permanent disposal of transuranic waste generated by DOE defense-related activities. Sandia National Laboratories (SNL), in its role as scientific advisor to the DOE, is responsible for evaluating the long-term performance of the WIPP. This risk-based Performance Assessment (PA) is accomplished in part through the use of numerous scientific modeling codes, which rely for some of their inputs on data gathered during characterization of the site. The PA is subject to formal requirements set forth in federal regulations. In particular, the components of the calculation fall under the configuration management and software quality assurance aegis of the American Society of Mechanical Engineers (ASME) Nuclear Quality Assurance (NQA) requirements. This paper describes SNL's implementation of the NQA requirements regarding software quality assurance (SQA). The description of the implementation of SQA for a PA calculation addresses not only the interpretation of the NQA requirements, it also discusses roles, deliverables, and the resources necessary for effective implementation. Finally, examples are given which illustrate the effectiveness of SNL's SQA program, followed by a detailed discussion of lessons learned. |
| Author | Froehlich, G.K Byle, K.A Ogden, H.C |
| Author_xml | – sequence: 1 givenname: G.K surname: Froehlich fullname: Froehlich, G.K email: gkfroeh@sandia.gov organization: Regulatory Compliance Department, Sandia National Laboratories, P.O. Box 5800, Albuquerque, NM 87185, USA – sequence: 2 givenname: H.C surname: Ogden fullname: Ogden, H.C organization: Technical Integration Department, Sandia National Laboratories, P.O. Box 5800, Albuquerque, NM 87185, USA – sequence: 3 givenname: K.A surname: Byle fullname: Byle, K.A organization: Quality Assurance Department, Sandia National Laboratories, P.O. Box 5800, Albuquerque, NM 87185, USA |
| BookMark | eNqFkF9LwzAUxYNMcJt-BCGP-lC9WdM2wQeR4Z_BwMEUH0OS3mKka2eSKfv2tpv44MvgwoXDOQfOb0QGTdsgIecMrhiw_HoJMmOJSCdwAXAJAJwlxREZMlHIBESaD8jwz3JCRiF89CaZFUOil20Vv7VH-rnRtYtbqkPYeN1YpK6h8R0pkzKna_RV61c7vXNgCCtsIu20nedNh4h0FtpaR9c2dOHqNtJFrZt4So4rXQc8-_1j8vpw_zJ9SubPj7Pp3TyxacZjUhjGdGqtyU1uOYg8EyB4hWCsKXMEmxohJtKwUgrIGDcVlFzqbFJw5Kbg6Zhk-17r2xA8Vmrt3Ur7rWKgek5qx0n1EBT013FSRZe7-ZezLu5WRK9dfTB9u09jN-3LoVfBOuwolc6jjaps3YGGH4vIhHw |
| CitedBy_id | crossref_primary_10_1016_S0951_8320_00_00023_5 crossref_primary_10_1016_S0951_8320_00_00032_6 crossref_primary_10_1016_S0951_8320_00_00028_4 crossref_primary_10_1016_S0951_8320_00_00018_1 crossref_primary_10_1016_S0951_8320_00_00019_3 crossref_primary_10_1016_j_pnucene_2024_105345 crossref_primary_10_1016_j_ress_2021_107580 |
| Cites_doi | 10.1126/science.263.5147.641 10.1016/S0951-8320(00)00023-5 10.1016/S0951-8320(00)00018-1 |
| ContentType | Journal Article |
| Copyright | 2000 Elsevier Science Ltd |
| Copyright_xml | – notice: 2000 Elsevier Science Ltd |
| DBID | AAYXX CITATION |
| DOI | 10.1016/S0951-8320(00)00041-7 |
| DatabaseName | CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 1879-0836 |
| EndPage | 427 |
| ExternalDocumentID | 10_1016_S0951_8320_00_00041_7 S0951832000000417 |
| GroupedDBID | --K --M .~1 0R~ 123 1B1 1~. 1~5 29P 4.4 457 4G. 5VS 7-5 71M 8P~ 9JN 9JO AABNK AACTN AAEDT AAEDW AAFJI AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAXUO ABEFU ABFNM ABJNI ABMAC ABMMH ABTAH ABXDB ABYKQ ACDAQ ACGFS ACIWK ACNNM ACRLP ADBBV ADEZE ADMUD ADTZH AEBSH AECPX AEKER AENEX AFKWA AFRAH AFTJW AGHFR AGUBO AGYEJ AHHHB AHJVU AIEXJ AIKHN AITUG AJBFU AJOXV AKYCK ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOMHK ASPBG AVARZ AVWKF AXJTR AZFZN BJAXD BKOJK BLXMC CS3 DU5 EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 FDB FEDTE FGOYB FIRID FNPLU FYGXN G-2 G-Q GBLVA HVGLF HZ~ IHE J1W JJJVA KOM LY7 M41 MO0 N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. PRBVW Q38 R2- RIG ROL RPZ SDF SDG SES SET SEW SPC SPCBC SSB SSO SST SSZ T5K TN5 WUQ XPP ZMT ZY4 ~G- AATTM AAXKI AAYWO AAYXX ABWVN ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFJKZ AFPUW AFXIZ AGCQF AGQPQ AGRNS AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP BNPGV CITATION SSH |
| ID | FETCH-LOGICAL-c354t-7b11a3ccb6b6c408658084fe0bcbd6e0c3b8829b1d980514bf0d49a5274e4b743 |
| IEDL.DBID | .~1 |
| ISSN | 0951-8320 |
| IngestDate | Tue Jul 01 01:46:04 EDT 2025 Thu Apr 24 23:03:56 EDT 2025 Fri Feb 23 02:23:56 EST 2024 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Keywords | Software testing Radioactive waste Software QA Quality assurance Performance assessment Software validation Waste Isolation Pilot Plant Software verification Software quality assurance Software life-cycle Transuranic waste |
| Language | English |
| License | https://www.elsevier.com/tdm/userlicense/1.0 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c354t-7b11a3ccb6b6c408658084fe0bcbd6e0c3b8829b1d980514bf0d49a5274e4b743 |
| OpenAccessLink | https://www.osti.gov/biblio/755542 |
| PageCount | 7 |
| ParticipantIDs | crossref_primary_10_1016_S0951_8320_00_00041_7 crossref_citationtrail_10_1016_S0951_8320_00_00041_7 elsevier_sciencedirect_doi_10_1016_S0951_8320_00_00041_7 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2000-00-00 |
| PublicationDateYYYYMMDD | 2000-01-01 |
| PublicationDate_xml | – year: 2000 text: 2000-00-00 |
| PublicationDecade | 2000 |
| PublicationTitle | Reliability engineering & system safety |
| PublicationYear | 2000 |
| Publisher | Elsevier Ltd |
| Publisher_xml | – name: Elsevier Ltd |
| References | American Society of Mechanical Engineers (ASME) Nuclear Quality Assurance (NQA) Standards, ASME NQA-1-1989 edition, Quality Assurance Program Requirements for Nuclear Facilities; ASME NQA-2a-1990 addenda, part 2.7, to ASME NQA-2-1989 edition, Quality Assurance Requirements for Nuclear Facility Applications; and ASME NQA-3-1989 edition, Quality Assurance Program Requirements for the Collection of Scientific and Technical Information for Site Characterization of High-Level Nuclear Waste Repositories; American Society of Mechanical Engineers, Fairfield, NJ, 1989–1992. Myers (BIB11) 1979 US Environmental Protection Agency. 40 CFR Part 194: Criteria for the certification and re-certification of the Waste Isolation Pilot Plant's compliance with the disposal regulations: certification decision; final rule. Federal Register 1998;63:27354–27406. WIPP Land Withdrawal Act, Public Law 102-579, 30 October 1992. (BIB10) 1986 Rechard RP, Roache PJ, Blaine RL, Gilkey AP, Rudeen DK. Quality assurance procedures for computer software supporting performance assessments of the Waste Isolation Pilot Plant, SAND90-1240, Sandia National Laboratories, Albuquerque, NM, April 1991. Spinney K, Ogden HC. Waste Isolation Pilot Plant quality assurance procedure (QAP), QAP 19-1, WIPP Computer Software Requirements, rev. 2, Sandia WIPP Central Files, WPO#37202, Sandia National Laboratories, Albuquerque, NM, August 1995. Oreskes, Shrader-Frechette, Belitz (BIB9) 1994; 263 US Environmental Protection Agency. 40 CFR Part 191: Environmental radiation protection standards for the management and disposal of spent nuclear fuel, high-level and transuranic radioactive wastes; final rule. Federal Register 1993;58:66398–66416. Froehlich, Williamson, Ogden (BIB6) 2000; 69 Rechard (BIB1) 2000; 69 US Department of Energy, Title 40 CFR Part 191 compliance certification application for the Waste Isolation Pilot Plant, DOE/CAO-1996-2184, US Department of Energy, Carlsbad Area Office, Carlsbad, NM, 1996. US Environmental Protection Agency. 40 CFR Part 194: Criteria for the certification and re-certification of the Waste Isolation Pilot Plant's compliance with the 40 CFR Part 191 disposal regulations; final rule. Federal Register 1996;61:5224–5245. 10.1016/S0951-8320(00)00041-7_BIB13 10.1016/S0951-8320(00)00041-7_BIB8 10.1016/S0951-8320(00)00041-7_BIB12 Rechard (10.1016/S0951-8320(00)00041-7_BIB1) 2000; 69 (10.1016/S0951-8320(00)00041-7_BIB10) 1986 Myers (10.1016/S0951-8320(00)00041-7_BIB11) 1979 Oreskes (10.1016/S0951-8320(00)00041-7_BIB9) 1994; 263 10.1016/S0951-8320(00)00041-7_BIB7 10.1016/S0951-8320(00)00041-7_BIB5 10.1016/S0951-8320(00)00041-7_BIB4 Froehlich (10.1016/S0951-8320(00)00041-7_BIB6) 2000; 69 10.1016/S0951-8320(00)00041-7_BIB3 10.1016/S0951-8320(00)00041-7_BIB2 |
| References_xml | – reference: WIPP Land Withdrawal Act, Public Law 102-579, 30 October 1992. – reference: American Society of Mechanical Engineers (ASME) Nuclear Quality Assurance (NQA) Standards, ASME NQA-1-1989 edition, Quality Assurance Program Requirements for Nuclear Facilities; ASME NQA-2a-1990 addenda, part 2.7, to ASME NQA-2-1989 edition, Quality Assurance Requirements for Nuclear Facility Applications; and ASME NQA-3-1989 edition, Quality Assurance Program Requirements for the Collection of Scientific and Technical Information for Site Characterization of High-Level Nuclear Waste Repositories; American Society of Mechanical Engineers, Fairfield, NJ, 1989–1992. – reference: Rechard RP, Roache PJ, Blaine RL, Gilkey AP, Rudeen DK. Quality assurance procedures for computer software supporting performance assessments of the Waste Isolation Pilot Plant, SAND90-1240, Sandia National Laboratories, Albuquerque, NM, April 1991. – reference: US Department of Energy, Title 40 CFR Part 191 compliance certification application for the Waste Isolation Pilot Plant, DOE/CAO-1996-2184, US Department of Energy, Carlsbad Area Office, Carlsbad, NM, 1996. – volume: 69 start-page: 429 year: 2000 end-page: 436 ident: BIB6 article-title: Computational environment and software configuration management of the 1996 performance assessment for the Waste Isolation Pilot Plant publication-title: Reliability Engineering and System Safety – reference: US Environmental Protection Agency. 40 CFR Part 194: Criteria for the certification and re-certification of the Waste Isolation Pilot Plant's compliance with the disposal regulations: certification decision; final rule. Federal Register 1998;63:27354–27406. – reference: US Environmental Protection Agency. 40 CFR Part 191: Environmental radiation protection standards for the management and disposal of spent nuclear fuel, high-level and transuranic radioactive wastes; final rule. Federal Register 1993;58:66398–66416. – volume: 69 start-page: 5 year: 2000 end-page: 46 ident: BIB1 article-title: Historical background on performance assessment for the Waste Isolation Pilot Plant publication-title: Reliability Engineering and System Safety – volume: 263 start-page: 641 year: 1994 end-page: 646 ident: BIB9 article-title: Verification, validation, and confirmation of numerical models in the earth sciences publication-title: Science – year: 1986 ident: BIB10 publication-title: IEEE standard for software verification and validation plans – year: 1979 ident: BIB11 publication-title: The art of software testing – reference: Spinney K, Ogden HC. Waste Isolation Pilot Plant quality assurance procedure (QAP), QAP 19-1, WIPP Computer Software Requirements, rev. 2, Sandia WIPP Central Files, WPO#37202, Sandia National Laboratories, Albuquerque, NM, August 1995. – reference: US Environmental Protection Agency. 40 CFR Part 194: Criteria for the certification and re-certification of the Waste Isolation Pilot Plant's compliance with the 40 CFR Part 191 disposal regulations; final rule. Federal Register 1996;61:5224–5245. – volume: 263 start-page: 641 year: 1994 ident: 10.1016/S0951-8320(00)00041-7_BIB9 article-title: Verification, validation, and confirmation of numerical models in the earth sciences publication-title: Science doi: 10.1126/science.263.5147.641 – volume: 69 start-page: 5 issue: 1–3 year: 2000 ident: 10.1016/S0951-8320(00)00041-7_BIB1 article-title: Historical background on performance assessment for the Waste Isolation Pilot Plant publication-title: Reliability Engineering and System Safety doi: 10.1016/S0951-8320(00)00023-5 – year: 1979 ident: 10.1016/S0951-8320(00)00041-7_BIB11 – ident: 10.1016/S0951-8320(00)00041-7_BIB7 – ident: 10.1016/S0951-8320(00)00041-7_BIB8 – year: 1986 ident: 10.1016/S0951-8320(00)00041-7_BIB10 – volume: 69 start-page: 429 issue: 1–3 year: 2000 ident: 10.1016/S0951-8320(00)00041-7_BIB6 article-title: Computational environment and software configuration management of the 1996 performance assessment for the Waste Isolation Pilot Plant publication-title: Reliability Engineering and System Safety doi: 10.1016/S0951-8320(00)00018-1 – ident: 10.1016/S0951-8320(00)00041-7_BIB2 – ident: 10.1016/S0951-8320(00)00041-7_BIB3 – ident: 10.1016/S0951-8320(00)00041-7_BIB5 – ident: 10.1016/S0951-8320(00)00041-7_BIB4 – ident: 10.1016/S0951-8320(00)00041-7_BIB13 – ident: 10.1016/S0951-8320(00)00041-7_BIB12 |
| SSID | ssj0004957 |
| Score | 1.6044383 |
| Snippet | The US Department of Energy (DOE) Waste Isolation Pilot Plant (WIPP), located in southeast New Mexico, is a deep geologic repository for the permanent disposal... |
| SourceID | crossref elsevier |
| SourceType | Enrichment Source Index Database Publisher |
| StartPage | 421 |
| SubjectTerms | Performance assessment Quality assurance Radioactive waste Software life-cycle Software QA Software quality assurance Software testing Software validation Software verification Transuranic waste Waste Isolation Pilot Plant |
| Title | Software quality assurance in the 1996 performance assessment for the Waste Isolation Pilot Plant |
| URI | https://dx.doi.org/10.1016/S0951-8320(00)00041-7 |
| Volume | 69 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LSwMxEA6lXvQgPrG-yMGDHrbNdrPJ7rEUS6tYhFrsbUmyWVgobSlbxIu_3Zl9uBVEQdhTyIQwM0y-WeabIeSmq7nQMoa0hKsAEhQZOtqYwEk8q5XvG5skyB1-GovhlD_M_FmD9CsuDJZVlrG_iOl5tC5XOqU2O6s07UwQHIA_sgLnusgo51yir7c_6jIPSABkNU4ed9csnuKEfPGWsbv8EEf-_D5tvTmDA7JfgkXaK-5zSBp2cUT2tloIHhM1gTj6ptaWFvTIdwpoeIPTMixNFxTgHcUKYLqqCQK4o-zGSWEt3_OqwNp0BI6YW4o-p_NlRnGiUXZCpoP7l_7QKccmOMbzeeZI7brKM0YLLQyHlMUPWMATy7TRsbDMeBpgdajdOAyw-7lOWMxD5UN-arkGRHFKmovlwp4Ryo0HKlJCdg3niieqK7GzNQZIK7gRLcIrZUWm7CmOoy3mUV08BgdEqOOI4Qc6jmSLtL_EVkVTjb8EgsoS0TfviCDw_y56_n_RC7JbEO_xh8slaWbrjb0CCJLp69zHrslOb_Q4HH8C_SHUKg |
| linkProvider | Elsevier |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LS8NAEF5qPagH8Yn1uQcPeki7aTa7yVGKpdW2CG2xt7C72UCgpKWkiBd_u7N5mAqiIOQ07AzLzDD7TZgHQrdtSZnkIaQlVHiQoHDfkkp5VuRoKVxX6SgyvcPDEetN6dPMndVQp-yFMWWVRezPY3oWrQtKq9BmaxnHrbEBB-CPJMe5Nt9C29R1uKnra35UdR6QAfByn7w5XrXx5CIy4h0h95kUi__8QG08Ot0DtF-gRfyQX-gQ1XRyhPY2ZggeIzGGQPomVhrn_ZHvGODw2qzL0DhOMOA7bEqA8bLqEDAninGcGGjZmVcB5sZ98MTMVPglni9SbFYapSdo2n2cdHpWsTfBUo5LU4tL2xaOUpJJpijkLK5HPBppIpUMmSbKkYCrfWmHvmfGn8uIhNQXLiSomkqAFKeoniwSfYYwVQ6oSDDeVpQKGok2N6OtTYTUjCrWQLRUVqCKoeJmt8U8qKrHQEBgdBwQ84GOA95AzS-2ZT5V4y8Gr7RE8M09Aoj8v7Oe_5_1Bu30JsNBMOiPni_Qbt6Fb_6-XKJ6ulrrK8AjqbzO_O0TED3VvQ |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Software+quality+assurance+in+the+1996+performance+assessment+for+the+Waste+Isolation+Pilot+Plant&rft.jtitle=Reliability+engineering+%26+system+safety&rft.au=Froehlich%2C+G.K&rft.au=Ogden%2C+H.C&rft.au=Byle%2C+K.A&rft.date=2000&rft.issn=0951-8320&rft.volume=69&rft.issue=1-3&rft.spage=421&rft.epage=427&rft_id=info:doi/10.1016%2FS0951-8320%2800%2900041-7&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_S0951_8320_00_00041_7 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0951-8320&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0951-8320&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0951-8320&client=summon |