Perbandingan Efektivitas Pengujian Manual dan Otomatis Menggunakan System Testing dengan Pendekatan AHP

KURNIA RAMADHAN PUTRA; MOCHAMAD FAQIH FAIZAL; SOFIA UMAROH

doi:10.26760/mindjournal.v11i1.127-143

Perbandingan Efektivitas Pengujian Manual dan Otomatis Menggunakan System Testing dengan Pendekatan AHP

KURNIA RAMADHAN PUTRA, MOCHAMAD FAQIH FAIZAL, SOFIA UMAROH

Sari

Abstrak

Pemilihan strategi pengujian seringkali subjektif tanpa mempertimbangkan karakteristik sistem. Penelitian ini mengevaluasi efektivitas pengujian manual dan otomatis menggunakan Analytic Hierarchy Process (AHP) pada studi kasus SIM SKK dan RPL untuk mengatasi subjektivitas pemilihan metode uji dan menentukan prioritas kriteria yang digunakan untuk membandingkan pengujian manual dan otomatis tersebut. Evaluasi diukur secara objektif melalui teknik Checklist-based Testing berdasarkan empat kriteria utama: waktu pengujian, cakupan pengujian, biaya pengujian berbasis Time-Driven Activity-Based Costing (TDABC), dan kuantitas penemuan bug. Pengujian otomatis menggunakan Katalon Studio terbukti menjadi strategi paling optimal pada kedua studi kasus karena mendominasi kriteria penemuan bug (33 pada SIM SKK dan 40 pada RPL) serta efisiensi waktu, sehingga menghasilkan Skor Global yang mengungguli metode manual baik pada SIM SKK (0,9697 berbanding 0,8986) maupun Sistem RPL (0,9379 berbanding 0,9002). Pengujian otomatis unggul karena dominasi mutlak pada aspek penemuan bug dan kecepatan eksekusi yang memiliki bobot kepentingan tertinggi dalam model keputusan AHP.

Kata kunci: Software Quality, Automated Testing, Manual Testing, TDABC, AHP

Abstract

The selection of testing strategies is often subjective and may overlook system characteristics. This study evaluates manual and automated testing using the Analytic Hierarchy Process (AHP) on SIM SKK and RPL systems. Evaluation was conducted through Checklist-based Testing based on four criteria: testing time, test coverage, testing cost, and bug detection. Automated testing using Katalon Studio proved to be the most effective approach due to better bug detection and higher time efficiency. As a result, automated testing achieved higher Global Scores than manual testing in both SIM SKK (0.9697 vs. 0.8986) and RPL (0.9379 vs. 0.9002). Its superiority is mainly attributed to bug detection capability and execution speed, which received the highest weights in the AHP model.

Keywords: Software Quality, Automated Testing, Manual Testing, TDABC, AHP

Teks Lengkap:

PDF

Referensi

Abdulwareth, A. J., & Al-shargabi, A. A. (2021). Towards a Multi-Criteria Framework for Selecting Software Testing Tools. IEEE Access, XX. https://doi.org/10.1109/ACCESS.2021.3128071

Ahmad, Y., & Hinchey, M. (2023). Optimizing Manual Testing Processes in Software Development : A Manual Tester ’ s Perspective Submitted to the University of Limerick , August 2023 in Partial Science in Software Engineering Supervised By : University of Limerick Ollscoil Luimnigh, August.

Ardic, B., Brandt, C., Khatami, A., Swillus, M., & Zaidman, A. (2025). The Journal of Systems & Software The qualitative factor in software testing : A systematic mapping study of. The Journal of Systems & Software, 227(October 2024), 112447. https://doi.org/10.1016/j.jss.2025.112447

Honest, N. (2019). Role of Testing in Software Development Life Cycle. International Journal of Computer Sciences and Engineering, 7(5), 886–889.

Hossain, M. I. (2023). Software Development Life Cycle ( SDLC ) Methodologies for Information Systems Project Management. International Journal for Multidisciplinary Research (IJFMR), 5(5), 1–36.

Huda, B., Hananto, A. L., Studi, P., Informasi, S., Komputer, F. I., Buana, U., Karawang, P., Framework, R., & Life, S. T. (2023). Penerapan Software Testing Life Cycle Pada Pengujian Otomatisasi Platform Dzikra. CSRID Journal, 15(1), 1–11.

Kumari, B., Chauhan, N., & Vedpal. (2018). A Comparison Between Manual Testing and Automated Testing. Journal of Emerging Technologies and Innovative Research, 5(12), 323–332.

Min, J. L., Istiqomah, A., & Rahmani, A. (2020). Evaluasi Penggunaan Manual dan Automated Software Testing pada Pelaksanaan End-to-End Testing. JTT (Jurnal Teknologi Terapan), 6(1).

Putri, Y. F., Irianto, A. B. P., & Sharma, S. (2025). Comparison of Automatic and Manual Regression Testing on Mobile Application Health Technology with Black Box Testing Method. Indonesian Journal of Information Systems (IJIS), 7(2), 218–230.

Riski, M., & Renanti, M. D. (2024). Analisis Perbandingan Manual Testing dan Automation Testing Pada Sistem Informasi Human Resource. KURAWAL Jurnal Teknologi, Informasi Dan Industri, 7(October), 1–11.

Rochimah, S., Laili, U., & Balqis, S. (2023). Software Quality Measurement for Functional Suitability , Performance Efficiency , and Reliability Characteristics Using Analytical Hierarchy Process. International Journal On Informatics Visualization, 7(December), 2421–2426.

Thant, K. S., & Tin, H. H. K. (2023). The Impact of Manual and Automatic Testing on Sofware Testing Efficiency and Effectiveness. Indian Journal of Science and Research, 3(3), 88–93.

Yusuf, A. A. (2022). University of Ibadan Qualitative Comparative Analysis of Software Integration Testing Techniques. Journal of Science and Logics in ICT Research, 7(2), 67–82.

Zafar, M. N., & Enoiu, E. (2022). Evaluating System-Level Test Generation for Industrial Software : A Comparison between Manual , Combinatorial and Model-Based Testing. In In IEEE/ACM3rd form concerning both structural and system-level metrics such as International Conference on Automation of Software Test (AST ’22) (Vol. 1, Issue 1). Association for Computing Machinery. https://doi.org/10.1145/3524481.3527235

DOI: https://doi.org/10.26760/mindjournal.v11i1.127-143