Process for Unattended Execution of Test Components

 

Emma Torres Orue¹, Martha D. Delgado Dapena,² Jorge Lodos Vigil¹, and Ezequiel Sevillano Fernández¹

 

¹ Centro Habana, Zanja 651, Havana, Cuba (e-mail: emma@segurmatica.com, lodos@segurmatica.com, ezequiel@segurmatica.com).

² Marta D. Delgado Dapena is with the Informatics Studies and Systems Center in the Polytechnic Institute "José Antonio Echevarría," Marianao, 114 Ave. 11909, Havana, Cuba (e-mail: marta@ceis.cujae.edu.cu).

 

Manuscript received on February 25, 2013
Accepted for publication on May 3, 2013
Final version received on June 19, 2014.

 

Abstract

We describe the process to perform software tests. In an enterprise that produces a product line, even if they all have the same goal, they may differ with regard to its development platform, programming language, layer architecture or communication strategies. The process allows standardizing, coordinating and controlling the test execution for all workgroups, no matter their individual characteristics. We present roles, phases, activities and artifacts to address the centralization, reusing and publication of the test scripts and the results of their execution. Additionally, it involves the virtualization for creating test environments, defining steps for its management and publication. Also is presented a tool that supports the process and allow the unattended execution of test components. Finally, we describe two pilot projects demonstrating the applicability of the proposed solution.

Key words: Software test process, testing tools, unattended test execution, virtual laboratories.

 

DESCARGAR ARTÍCULO EN FORMATO PDF

 

References

[1] R. S. Pressman and J. E. Murrieta, Ingeniería del software, un enfoque práctico, 6^th ed., Mexico, McGraw-Hil Interamericana, 2006, ch.13, pp. 383-414        [ Links ]

[2] J. Barnes, Implementing the IBM® Rational Unified Process® and Solutions: A Guide to Improving Your Software Development Capability andMaturity. Mexico City, IBM Press, 2007        [ Links ]

[3] Software engineering ó Product quality ó Part 1: Quality model, ISO/IEC 9126-1, 2001        [ Links ]

[4] R. Pinheiro, K. M. Oliveira, and W. Pereira. "Evaluating the service quality of software providers appraised in CMM / CMMI, Software Quality Journal, vol. 17, no. 3, 2009, pp. 283-301; http://link.springer.com/article/10.1007%2Fs11219-008-9065-4        [ Links ]

[5] P. Abrahamsson, N. Oza, and M. T. Siponen, "Agile Software Development Methods: A Comparative Review," in Agile Software Development Current Research and Future Directions, T. Dingseyr, T. Dybá and N. Brede, (eds.), Springer, 2010, pp. 31-53        [ Links ]

[6] E. Bagheri, F. Ensan, and D. Gasevic, "Decision support for the software product line domain engineering lifecycle," Automated Software Engineering, vol. 19, no. 3, 2012 pp. 335-377; link.springer.com/article/10.1007/s10515-011-0099-7        [ Links ]

[7] G. K. Hanssen, "Opening Up Software Product Line Engineering," PLEASE'2010 International Workshop, 2010; http://www.idi.ntnu.no/grupper/su/publ/geirkjetil/hanssen-openprodline-please10.pdf        [ Links ]

[8] P. A. da Mota Silveira, P. Runeson, I. do C. Machado, E. Santana, S.R. de Lemos, and E. Engstrom, "Testing Software Product Lines," IEEE, vol. 28, no. 5, 2011, pp. 16-20; http://www.computer.org/csdl/mags/so/2011/05/mso2011050016-abs.html        [ Links ]

[9] J. Dehlinger and R. R. Lutz, "PLFaultCAT: A Product-Line Software Fault Tree Analysis Tool," Automated Software Engineering, vol. 13, no. 1, 2006, pp. 169-193; http://www.cs.iastate.edu/~dehlinge/papers/ehlinger_lutz_AUSE_2006.pdf        [ Links ]

[10] A. Bertolino and S. Gnesi, "PLUTO: A Test Methodology for Product Families," Lecture Notes in Computer Science, vol. 3014, 2004, pp.181-197; www.inf.ufpr.br/silvia/topicos/artigostrab10/Bertolino.pdf        [ Links ]

[11] E. Uzuncaova, D. Garcia, S. Khurshid, and D. Batory, "Testing Software Product Lines Using Incremental Test Generation," in Proc. 19thISSRE, Washington, DC, 2008, pp. 249-258        [ Links ]

[12] A. Edwards, S. Tucker, and B. Demsky, "AFID: an automated approach to collecting software," Automated Software Engineering, vol. 17, no. 3, 2010, pp. 347-372. http://link.springer.com/article/10007%2Fs10515-010-0068-6#        [ Links ]

[13] M. S. Feather and B. Smith, "Automatic Generation of Test Oracles From Pilot Studies to Application," Automated Software Engineering, vol. 8 no. 1, 2001, pp. 31-61. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.29.7101&rep=rep1&type=pdf        [ Links ]

[14] C. Schwarzl and B. Peischl. "Generation of executable test cases based on behavioral UML system models," in Proc. 5th Workshop on AST 10, New York, NY, 2010, pp. 31-34        [ Links ]

[15] Q. Xie and A. M. Memon, "Designing and comparing automated test oracles for GUI-based software applications," ACM TOSEM, vol, 16, no. 1, 2007, pp. 4. http://dl.acm.org/citation.cfm?id=1189752        [ Links ]

[16] F. Bouquet, C. Grandpierre, B.Legeard, and F. Peureux, "A Test Generation Solution to Automate Software Testing," in Proc. 3rd International Workshop on AST '08, New York, NY, 2008, pp. 45-48        [ Links ]

[17] C. Davis, D. Chirillo, D. Gouveia, F. Saracevic, J. B. Bocarsley, L. Quesada, L. B. Thomas, and M. van Lint, Software Test Engineering with IBM Rational Functional Tester: The Definitive Resource, 1^st ed. Upper Saddle River, N.J: IBM Press, 2009        [ Links ]

[18] J. Levinson, Software Testing with Visual Studio® 2010, 1st ed. Redwood City, CA: Addison-Wesley Professional, 2011        [ Links ]

[19] L. Chang. "Platform-Independent and Tool-Neutral Test Descriptions for Automated Software Testing," in Proc. ICSE, New York, NY, 2000, pp. 713-715        [ Links ]

[20] S. D. Burd, G. Gaillard, E. Rooney, and A. F. Seazzu, "Virtual Computing Laboratories Using VMware Lab Manager," in Proc. 44th HICSS, Washington, DC, 2011, pp. 1-9.         [ Links ]

[21] J. N. Matthews, T. Deshane, W. Hu, E. M. Dow, J. Bongio, P. F. Wilbur, and B. Johnson. Running Xen: A Hands-On Guide to the Art of Virtualization, 1^st ed. Upper Saddle River, NJ: Prentice Hall, 2008        [ Links ]

[22] N. Rice and S.Trefethen, TestComplete Version 8 Made Easier: Keyword Testing, Falafel Software Inc., 2012        [ Links ]

[23] R. Walters, G. Fritchey, and C. Taglienti. "Common Database Maintance Tasks," in: Beginning SQL Server 2008 Administration, New York, NY: Apress L.P., 2009, pp. 225-233        [ Links ]

[24] M. Reddy. "Testing," in API Design for C++. Burlington, MA: Morgan Kaufmann (Ed), 2011, ch. 10. pp. 218-328        [ Links ]