驗證及確認

维基百科,自由的百科全书

驗證及確認(Verification and validation)兩者是独立的过程,若兩者一起使用,可以用來检查产品、服务或系统滿足需求英语Requirement规格英语Specification (technical standard)并且符合其原來预期的目的[1]。这些是品質管理系統(例如ISO 9000)的关键组件。有时會在「驗證及確認」前面加上「独立」(independent)一詞,表示驗證及確認是由公正的第三方执行的。「独立驗證及確認」可以简称为“IV&V”。

在實務上,在质量管理方面,驗證及確認的定義可以不一致。有時甚至可以交换使用[2][3][4]

电气电子工程师学会(IEEE)采用的标准PMBOK指南中在第 4 版中的定义如下 [5]

  • “確認(Validation):保证产品、服务或系统满足客户和其他已識別的利益相关者的需求。它通常涉及外部客户的接受度和适应性。与驗證形成对比。”
  • “驗證(Verification):評估产品、服务或系统是否符合规定、需求、规格或其他附加条件。多半是組織内部的流程。与確認形成对比。”

簡介

驗證(Verification)的目的是要確認產品、服務或系統(或其中的一部份,或是多個形成的組合)是否符合一系列的設計規範[6][7]。在開發階段的驗證包括對產品、服務或系統(或其中的一部份)的專門測試,可能是針對樣品測試,也可能是用模擬的方式測試。再針對測試結果進行分析或檢查。在開發階段後的驗證是定期性進行的測試,確認當時的產品、服務或系統符合原始的設計需求、規格及法規要求[7][8]。驗證是確認產品、服務或系統符合在法規、規格化,或是其他在開發初期提出的條件。驗證可以在開發階段進行、批量進行,也可以在量產時進行。驗證多半是內部流程。

確認(Validation)的目的是要確認產品、服務或系統(或其中的一部份,或是多個形成的組合)是否符合使用者的操作需求[7][9]。針對新的開發流程或是驗證流程,確認程序是針這兩個流程建模,用模擬方式來預測是否有錯誤或是不足之處,可能會造成產品、服務或系統的開發或是驗證出現失效或是不完整的情形。一組的確認需求(由客戶定義)、規格以及法規就可以做為評估產品、服務或系統(或其中的一部份,或是多個形成的組合)的開發流程或是驗證流程是否有效時的基準。另外也可能會有確認過程中的變更、開發流程或是驗證流程的變更是否仍可以讓產品、服務或系統(或其中的一部份,或是多個形成的組合)符合原始的設計需求、規格以及法規。確認流程有助於讓開發流程或是驗證流程符合相關規定[來源請求]。確認流程可以建立高度準確的證據,確保產品、服務或系統符合原始的需求。這常常和終端客戶或其他產品利益相關者的接受程度及適用性有關。確認多半是外部流程。

可以將確認描述為這個問句「你做的是正確的事嗎?」(Are you building the right thing?)[10],而驗證則是「你有把事情做正確嗎?」(Are you building it right?)[10]。「做正確的事?」是回歸到客戶的需要,而「把事情做正確」則是檢查系統是否有正確的實現規格中的內容。有些情形下,需要在判定是否相容的正式程序或是協定上有明文列出的需求。

有可能一個產品通過驗證(符合規格),但無法通過確認(不符合客戶需求)。例如產品是依規格所建立,但規格沒有充份說明客戶的需求。

活動

機械及設備的驗證一般會包括設計驗證(design qualification、DQ)、安裝驗證(installation qualification、IQ)、操作驗證(operational qualification、OQ)及性能驗證(performance qualification、PQ)。設計驗證可以由製造商或是客戶來進行,透過審核及測試來確認設備符合書面的採購規格。若機械及設備的相關文件是由製造商提供的,後面的三個驗證需要由熟悉工業法規的用戶,完整的進行驗證。不然,IQ, OQ及PQ的程序就是確認相關的任務。常見的例子是針對一些沒有製造商文件(或文件已遺失)的老舊設備,或是一些DIY的組件(例如車輛配件、電腦等),若是可以,使用者需設法找到製造商的文件。DQ、IQ、OQ及PQ程序的樣本多半都可以在網路上找到,而機械及設備的DIY驗證資料可能可以透過製造商的訓練課程教材及指南中取得,或是已發行的指導書。這類DIY的作法也適用於軟體驗證、電腦作業系統的驗證,以及生產程序的驗證。活動的最後一步,也是最重要也最關鍵的步驟,是產生機械及設備的驗證報告,並且歸檔,若是有相關法規強制要求的話,此報告是之後審核的依據。

機械及設備的驗證也和其所在的場所有關,特別是一些對振動敏感,需要調整平衡或是校正的設備,這類設備若進行了位置的移動,需要再重新驗證。若一些消耗品(例如濾網)需更換,或是已使用一定的期間,可能需要進行完整的驗證[11][12]。若有進行零件更換,和其他設備耦合使用、安裝新的應用軟體或是重新調整電腦,影響到預設定資料時(例如BIOS注册表GUID磁碟分割表、動態連結資料庫、或是INI文件等),也需要再重新驗證。這些情形下,不論零件/設備/軟體是否是原廠的,其規格以及重新調整的提案也應該附在驗證報告中。Torres和Hyman曾討論過在實務上,非原廠零件的適用性,並且提供了指南,讓用戶可以選擇適當的替代品,並且可以避免負面影響[13]。若是因為法規要求,需要使用原廠的零件/設備/軟體,就不能針對非原廠的零件進行重新驗證,而且該資產不符合法規要求,需要回收。

若機械及設備的驗證是由第三方的標準公證組織,例如針對特殊領域的國際標準化組織標準認證公司,此程序則稱為認證(certification)[14][15]

確認的分類

確認工作一般可以分為以下幾類:

  • 前瞻性確認:在新的產品發佈之前進行的確認,目的是確認所關注的特性可以正常運作,並且符合安全標準[16][17]。可以用在法規、指南以及提案[18][19][20]、方法[21]、原理/假說/模型[22][23]、產品以及服務[24][25]
  • 回顧性確認:針對已在使用、發佈或是正式生產的事物的確認。確認會針對書面規範或是預定決定的期望,依照其歷史資訊或事件的文件或記錄來進行。若有短少關鍵的資料,就無法進行完整的確認,可能只會進行局部的確認[16][26][27]。若在以下情形時,需要進行回顧性確認:
    • 沒有前瞻性確認的資料,之前的確認方式不適當,或是有造假。
    • 法規或是標準的變化,影響到已經發佈給大眾或是市場上的產品相容性。
    • 重新使用一些已不用的事物。
以下是一些可以進行回顧性確認的例子:
  • 完全確認
  • 局部確認:常用在時間受限時的研究以及先期計劃。會測試最重要以及最明顯的效應。若以分析化學的觀點,這些效應是選擇性、準確度、可重複性、線性以及其範圍。
  • 交叉確認英语Cross-validation (analytical chemistry)
  • 再確認/定位或是定期確認,針對已被淘汰、修復、和其他設備整合或是耦合的設備,更換過位置的設備,或是針對設備定期進行的確認。這類的例子有駕照的定期重新考核、重新認證過期或是有更動位置的分析天平、其至是專業人士的定期資格考核[33][34]。再確認也會發生在活動中出現變化的情形下,例如科學研究或是臨床試驗要進入下一個階段。這些變化可能包括
    • 樣本母群體(sample matrices)[35][36]
    • 生產規模[37][38]
    • 种群特點及數量[39][40]
    • 規格外(out-of-specification、OOS)檢測,可能是因為測試試劑、玻璃片的污染,儀器設備的老化,或是相關資產的折舊[41][42]
GLP認證的實驗室中,常常依照欧洲药典国际药典專著來進行驗證或再確認,以滿足不同國家的需求,也有可能只考慮單一國家的需求,以美国药典英国药典為準[43]。這些實驗室也需要進行方法的確認[44]
  • 並行確認:在服務、製造或工程進行中同時進行的確認,以下是一些例子
    • 化學檢定的雙重樣品分析。
    • 針對痕量不純物質,檢測極限英语detection limit或量化極限的邊際值時,進行的三重樣品分析。
    • 由熟練的技術員針對單一樣品分析,進行多次的在線系統適用性測試。

確認的項目

確認工作中最常需要確認的項目可能包括以下幾項:

  • 此方式密集的作業需求以及其消耗的時間[49][需要解释]
  • 會受到不同標準中對於詞語定義的不同所限制。
為了解決這種問題,有些監管機構或是方法會建議何時應該要進行特定系統的系統適用性測試。

產業標準

這些詞語廣泛的用在不同的產業及組織中。針對不同的產品、法規以及產業,也可能會有不同的意義以及需求。以下是一些例子:

相關條目

參考資料

  1. ^ Global Harmonization Task Force - Quality Management Systems - Process Validation Guidance (GHTF/SG3/N99-10:2004 (Edition 2) page 3
  2. ^ Ad Sparrius. Everything You Thought You Knew about Validation and Verification is Probably Dodgy (PDF). 12th INCOSE SA Systems Engineering Conference. 2016 [2018-04-30]. (原始内容 (PDF)存档于2018-08-06). There are some authors who apparently regard these two terms as synonymous, others who seem to be only vaguely aware of the differences. Some even appear to believe that V&V is one word! ... There is such a fundamental difference between these models that the term validation has many years ago been selected to be different from the term verification. Nevertheless, it is debatable whether the distinction between validation and verification should be continued. 
  3. ^ James D. McCaffrey. Validation vs. Verification. 2006-04-28 [2018-04-30]. (原始内容存档于2018-08-06). Two terms that sometimes confuse software test engineers are "validation" and "verification". ... Obviously the two IEEE definitions are so close to each other it’s hard to determine the difference. 
  4. ^ Difference between Verification and Validation. Software Testing Class. [2018-04-30]. (原始内容存档于2018-04-26). In interviews most of the interviewers are asking questions on “What is Difference between Verification and Validation?” Lots of people use verification and validation interchangeably but both have different meanings. 
  5. ^ IEEE. IEEE Guide--Adoption of the Project Management Institute (PMI®) Standard A Guide to the Project Management Body of Knowledge (PMBOK® Guide)--Fourth Edition: 452. [28 March 2017]. doi:10.1109/IEEESTD.2011.5937011 (不活跃 2019-07-11). (原始内容存档于2019-04-19). 
  6. ^ "Systems and software engineering - Vocabulary," ISO/IEC/IEEE std 24765:2010(E), 2010. | verification 5. ...product, service, or system complies with a regulation, requirement, specification, or imposed condition.
  7. ^ 7.0 7.1 7.2 IEEE 1012-2004, IEEE: 9, 2004 
  8. ^ "Systems and software engineering - Vocabulary," ISO/IEC/IEEE std 24765:2010(E), 2010. | verification 6. ...comply with requirements (e.g., for correctness, completeness, consistency, and accuracy) for all life cycle activities during each life cycle process (acquisition, supply, development, operation, and maintenance)
  9. ^ "Systems and software engineering - Vocabulary," ISO/IEC/IEEE std 24765:2010(E), 2010. | validation (especially 1. & 2.)
  10. ^ 10.0 10.1 Barry Boehm, Software Engineering Economics, 1981
  11. ^ Analytical & Precision Balance Co. Welcome. [18 March 2008]. (原始内容存档于2008-04-12). 
  12. ^ Scientech. External Calibration. [18 March 2008]. (原始内容存档于2020-01-29). 
  13. ^ Torres, Rebecca E.; William A. Hyman. Replacement Parts-Identical, Suitable, or Inappropriate?. 2007 [29 March 2008]. 
  14. ^ AppLabs. ISV, IHV Certification Programs. [26 March 2008]. (原始内容存档于16 February 2008). 
  15. ^ AppLabs. AppLabs attains ISO27001:2005 accreditation. [26 March 2008]. (原始内容存档于2008-03-12). 
  16. ^ 16.0 16.1 Guideline on general principles of process validation. U.S. Food and Drug Administration. [12 July 2008]. (原始内容存档于6 June 2009). 
  17. ^ Prospective validation. Groupe Novasep. [24 September 2008]. (原始内容存档于2008-11-15). 
  18. ^ Quinn, James; McDermott, D; Stiell, I; Kohn, M; Wells, G; et al. Prospective Validation of the San Francisco Syncope Rule to Predict Patients With Serious Outcomes. Annals of Emergency Medicine (Elsevier). 2006, 47 (5): 448–454. PMID 16631985. doi:10.1016/j.annemergmed.2005.11.019. 
  19. ^ Sangiovanni, A.; Manini, M; Iavarone, M; Fraquelli, M; Forzenigo, L; Romeo, R; Ronchi, G; Colombo, M; et al. Prospective validation of AASLD guidelines for the early diagnosis of epatocellular carcinoma in cirrhotic patients. Digestive and Liver Disease (Elsevier). 2007, 40 (5): A22–A23. doi:10.1016/j.dld.2007.12.064. 
  20. ^ Germing, U.; et al. Prospective validation of the WHO proposals for the classification of myelodysplastic syndromes. Haematologica. 2006, 91 (12): 1596–1604 [24 September 2008]. PMID 17145595. (原始内容存档于2010-11-12). 
  21. ^ Sciolla, Rossella; Melis, F; Sinpac, Group; et al. Rapid Identification of High-Risk Transient Ischemic Attacks: Prospective Validation of the ABCD Score. Stroke (American Heart Association). 2008, 39 (2): 297–302. PMID 18174479. doi:10.1161/STROKEAHA.107.496612. 
  22. ^ Pfisterer, Matthias; et al. Drug-eluting or bare-metal stents forlarge coronary vessel stenting? The BASKET-PROVE (PROspective Validation Examination) trial: Study protocol and design. American Heart Journal (Mosby-Year Book Inc.). 2008, 115 (4): 609–614. PMID 18371466. doi:10.1016/j.ahj.2007.11.011. 
  23. ^ Van Geest-Daalderop, Johanna H. H.; Hutten, Barbara A.; Péquériaux, Nathalie C. V.; Levi, Marcel; Sturk, Augueste; et al. Improvement in the regulation of the vitamin K antagonist acenocoumarol after a standard initial dose regimen: prospective validation of a prescription model. Journal of Thrombosis and Thrombolysis (Springer). 2008, 27 (2): 207–14. PMID 18270659. doi:10.1007/s11239-008-0203-4. 
  24. ^ Ames, D.; Keogh, A.M.; Adams, J.; Harrigan, S.; Allen, N.; et al. Prospective validation of the EBAS-DEP – A short sensitive screening instrument for depression in the physically ill elderly. European Psychiatry (Elsevier). 1996, 11 (Supplement 4): 361s. doi:10.1016/0924-9338(96)89148-6. 
  25. ^ Kidwell, Chelsea S.; Starkman, S; Eckstein, M; Weems, K; Saver, JL; et al. Identifying Stroke in the Field: Prospective Validation of the Los Angeles Prehospital Stroke Screen (LAPSS). Stroke (American Heart Association). 2000, 31 (1): 71–76 [24 September 2008]. PMID 10625718. doi:10.1161/01.str.31.1.71. [永久失效連結]
  26. ^ U.S. Food and Drug Administration. Ch. 4 PROCESS VALIDATION in Medical Device Quality Systems Manual. [6 August 2009]. (原始内容存档于2013-09-27). 
  27. ^ Groupe Novasep. Retrospective validation. [24 September 2008]. (原始内容存档于2008-11-15). 
  28. ^ Vieth, Erich. Who changed the Bible and why? Bart Ehrman's startling answers. [28 August 2013]. (原始内容存档于2013-10-10). 
  29. ^ Arlandson, James M. Domestic violence in Islam. [17 October 2008]. (原始内容存档于2020-02-29). 
  30. ^ Hart, D.; S.W. Smith. Retrospective Validation of a Clinical Decision Rule to Safely Rule Out Subarachnoid Hemorrhage in Emergency Department Headache Patients. Annals of Emergency Medicine. 2007, 50 (3): S102–S103. doi:10.1016/j.annemergmed.2007.06.388. 
  31. ^ Kluger, Michael D.; et al. Retrospective Validation of a Surveillance System for Unexplained Illness and Death: New Haven County, Connecticut. American Journal of Public Health. 2001, 91 (8): 1214–1219. PMC 1446748可免费查阅. PMID 11499106. doi:10.2105/AJPH.91.8.1214. 
  32. ^ Fine, Leon G.; et al. How to evaluate and improve the quality and credibility of an outcomes database: validation and feedback study on the UK Cardiac Surgery Experience. BMJ. 2003, 326 (7379): 25–28 [26 September 2008]. PMC 139501可免费查阅. PMID 12511458. doi:10.1136/bmj.326.7379.25. (原始内容存档于2003-06-27). 
  33. ^ Department of Health. The White Paper Trust, assurance and safety: The regulation of health professionals. [30 September 2008]. (原始内容存档于2012-10-05). 
  34. ^ Merkur, Sherry. Physician revalidation in Europe. Clinical Medicine (Royal College of Physicians). 2008, 8 (4): 371–6. PMC 4952927可免费查阅. PMID 18724601. doi:10.7861/clinmedicine.8-4-371. 
  35. ^ Australian Pesticides & Veterinary Medicines Authority. Guidelines for the Validation of Analytical Methods for Active Constituent, Agricultural and Veterinary Chemical Products (PDF). 2004 [12 July 2009]. (原始内容 (PDF)存档于2011-02-20). 
  36. ^ Bressolle, Françoise; Brometpetit, M; Audran, M; et al. Validation of liquid chromatographic and gas chromatographic methods Applications to pharmacokinetics. Journal of Chromatography B. 1996, 686 (1): 3–10. PMID 8953186. doi:10.1016/S0378-4347(96)00088-6. 
  37. ^ Peptisyntha S.A. Commercial scale production. 2009 [12 July 2009]. (原始内容存档于31 May 2009). 
  38. ^ del Rosario Alemán, María. Downstream Processing: A Revalidation Study of Viral Clearance in the Purification of Monoclonal Antibody CB.Hep-1. 2007 [12 July 2009]. (原始内容存档于2011-07-11). 
  39. ^ El Eman, Khaled; Brown, A; Abdelmalik, P; et al. Evaluating Predictors of Geographic Area Population Size Cut-offs to Manage Re-identification Risk. Journal of the American Medical Informatics Association. 2009, 16 (2): 256–266. PMC 2649314可免费查阅. PMID 19074299. doi:10.1197/jamia.M2902. 
  40. ^ Tollman, Stephen M; Kahn, Kathleen; Sartorius, Benn; Collinson, Mark A; Clark, Samuel J; Garenne, Michel L; et al. Implications of mortality transition for primary health care in rural South Africa: a population-based surveillance study. Journal of the American Medical Informatics Association. 2008, 372 (9642): 893–901. PMC 2602585可免费查阅. PMID 18790312. doi:10.1016/S0140-6736(08)61399-9. 
  41. ^ United States Department of Health & Human Services. Warning Letter (WL No. 320-08-04) (PDF). 2009 [12 July 2009]. (原始内容存档 (PDF)于2017-02-22). 
  42. ^ Health Canada. Validation Guidelines for Pharmaceutical Dosage Forms (GUIDE-0029). 2004 [12 July 2009]. (原始内容存档于2017-01-21). 
  43. ^ Food and Drug Administration. Guidance for Industry: Bioanalytical Method Validation (PDF). May 2001 [12 July 2009]. (原始内容存档 (PDF)于2019-01-19). 
  44. ^ Method Validation; Archived copy. [19 September 2011]. (原始内容存档于11 September 2011). 
  45. ^ Health Sciences Authorit. Guidance Notes on Analytical Method Validation: Methodology (PDF). [29 September 2008]. (原始内容 (PDF)存档于2012-02-18). 
  46. ^ Heyden, Y. Vander; S.W. Smith; et al. Guidance for robustness/ruggedness tests in method validation. Journal of Pharmaceutical and Biomedical Analysis (Elsevier). 2001, 24 (5–6): 723–753. PMID 11248467. doi:10.1016/S0731-7085(00)00529-X. 
  47. ^ Ermer, Joachim; John H. McB. Miller. Method Validation in Pharmaceutical Analysis: A Guide to best Practice. Wiley-VCH. 2005: 418. ISBN 978-3-527-31255-9. 
  48. ^ Calibration of dissolution test apparatus (USP apparatus 1 and 2) – SOP. 
  49. ^ 日本药局方. Japanese Pharmacopoeia. [29 June 2009]. (原始内容存档于2008-04-09). 
  50. ^ 50.0 50.1 GUIDELINE ON GENERAL PRINCIPLES OF PROCESS VALIDATION. FDA. May 1987. (原始内容存档于6 June 2009). 
  51. ^ Nash, Robert A.; et al. Pharmaceutical Process Validation: An International Third Edition. Informa Healthcare. 2003: 860. ISBN 978-0-8247-0838-2. 
  52. ^ De Caris, Sandro; et al. Risk-based equipment qualification: a user/supplier cooperative approach (PDF). [15 June 2008]. (原始内容存档 (PDF)于2016-10-25). 
  53. ^ Ocampo, Arlene; Lum, Steven; Chow, Frank; et al. Current challenges for FDA-regulated bioanalytical laboratories for human (BA/BE) studies. Part I: defining the appropriate compliance standards – application of the principles of FDA GLP and FDA GMP to bioanalytical laboratories. The Quality Assurance Journal (John Wiley & Sons). 2007, 11 (1): 3–15. doi:10.1002/qaj.399. 
  54. ^ Guidance for Industry: Investigating Out-of-Specification (OOS) Test Results for Pharmaceutical Production (PDF). Food and Drug Administration -->美国食品药品监督管理局. 2006 [12 July 2009]. (原始内容存档 (PDF)于2017-08-30). 
  55. ^ Guidance for Industry: Cybersecurity for Networked Medical Devices Containing Off-the Shelf (OTS) Software (PDF). Food and Drug Administration. 14 January 2005 [12 July 2009]. (原始内容存档 (PDF)于2018-12-30). 
  56. ^ General Principles of Software validation; Final Guidance for Industry and FDA Staff (PDF). Food and Drug Administration. 11 January 2002 [12 July 2009]. (原始内容存档 (PDF)于2019-03-02). 
  57. ^ Guidance for Industry and FDA Staff: Medical Device User Fee and Modernization Act of 2002, Validation Data in Premarket Notification Submissions (510(k)s) for Reprocessed Single-Use Medical Devices (PDF). Food and Drug Administration. 25 September 2006 [12 July 2009]. (原始内容存档 (PDF)于2019-01-11). 
  58. ^ Guideline on general principles of process validation. Food and Drug Administration. May 1987 [12 July 2009]. (原始内容存档于20 July 2009). 
  59. ^ Guide to inspections validation of cleaning processes. Food and Drug Administration. July 1993 [12 July 2009]. (原始内容存档于2019-04-23). 
  60. ^ Nassani, Mowafak. Cleaning validation in the pharmaceutical industry. [20 March 2008]. (原始内容存档于2012-05-31). 
  61. ^ Bharadia, Praful D.; Jignyasha A. Bhatt. A review of current implementation strategies for validation of cleaning processes in the pharmaceutical industry. [20 March 2008]. (原始内容存档于2012-05-31). 
  62. ^ Discussion Paper on Proposed Draft Guidelines for the Validation of Food Hygiene Control Measures (PDF). [10 February 2011]. (原始内容 (PDF)存档于2010-10-11). 
  63. ^ Archived copy (PDF). [14 June 2008]. (原始内容 (PDF)存档于12 October 2007). 
  64. ^ Archived copy (PDF). [7 September 2007]. (原始内容 (PDF)存档于27 September 2007). 
  65. ^ Service Unavailable. (原始内容存档于13 October 2007). 
  66. ^ Manzo, M.A.; Strawn, D.M.; Hall, S.W. Aerospace nickel-cadmium cell verification-final report. Sixteenth Annual Battery Conference on Applications and Advances. Proceedings of the Conference (Cat. No.01TH8533). 7 August 2002: 59–66. ISBN 978-0-7803-6545-2. doi:10.1109/BCAA.2001.905101. 
  67. ^ Improving the efficiency of verification and validation. Inderscience.com. [19 September 2011]. (原始内容存档于2012-02-12). 
  68. ^ Masako, Tsujimoto. Verification of genetic recombination by hypha fusion of Pyricularia oryzas using transducing gene as marker. (the Ministry of Agriculture, Forestry and Fisheries Natl. Agricultural Res. Center S).. [20 March 2008]. (原始内容存档于2012-02-17). 
  69. ^ Vollmer-Sanders, Carrie Lynn; et al. Implications of the Voluntary Michigan Agriculture Environmental Assurance Program (MAEAP) Verification on Livestock Operations, 2000–2004. [20 March 2008]. (原始内容存档于2011-07-11). 
  70. ^ Haboudane, Driss; et al. Hyperspectral vegetation indices and novel algorithms for predicting green LAI of crop canopies: Modeling and validation in the context of precision agriculture. Accreditation and Quality Assurance (愛思唯爾). 2004, 90 (3): 337–352. Bibcode:2004RSEnv..90..337H. doi:10.1016/j.rse.2003.12.013. 
  71. ^ Thorp, Kelly; et al. Using cross-validation to evaluate ceres-maize yield simulations within a decision support system for precision agriculture. [20 March 2008]. (原始内容存档于2016-08-28). 
  72. ^ Randolph, Susan; et al. Monitoring the Realization of the Right to Food: Adaptation and Validation of the U.S. Department of Agriculture Food Insecurity Module to Rural Senegal. [20 March 2008]. (原始内容存档于2016-01-21). 
  73. ^ Pruitt, Kirk; Ryan Paul Chamberlain. Method and system for authenticating appraisal reports. [15 September 2008]. (原始内容存档于2011-06-29). 

延伸閱讀

  • Majcen, N.; Taylor, P. Practical examples on traceability, measurement uncertainty and validation in chemistry 1. European Union. 2010: 217. ISBN 978-92-79-12021-3. 

外部連結