Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Optimal Software Release Using Time and Cost Benefits via Fuzzy Multi-Criteria and Fault Tolerance

  • Srivastava, Praveen Ranjan (Dept. of Computer Science & Information System, Birla Institute of Technology and Science Pilani, Pilani Campus)
  • Received : 2011.02.16
  • Accepted : 2012.01.25
  • Published : 2012.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

As we know every software development process is pretty large and consists of different modules. This raises the idea of prioritizing different software modules so that important modules can be tested by preference. In the software testing process, it is not possible to test each and every module regressively, which is due to time and cost constraints. To deal with these constraints, this paper proposes an approach that is based on the fuzzy multi-criteria approach for prioritizing several software modules and calculates optimal time and cost for software testing by using fuzzy logic and the fault tolerance approach.

Keywords

References

  1. Roger S Pressman, "Software Engineering: A Practitioner's Approach", TMH sixth Edition 2006.
  2. Aditya P. Mathur, "Foundations of Software Testing. perason education, First edition 2008.
  3. Harrold M, Testing: A Roadmap, In Future of Software Engineering, 22nd International Conference on Software Engineering, Limerick, Ireland, 2000.
  4. Beizer, B, Software Testing Techniques, 2nd. Edition, US, 2000.
  5. Nageswaran Suresh, Test Effort Estimation Using Use Case Points. Quality Week 2001, San Francisco, California, USA, available at http://www.cognizant.com/html/content/cogcommunity/Test_ Effort_Estimation.pdf.
  6. Dalal and McIntosh, "When to Stop Testing for Large Software Systems with Changing Code," IEEE Transaction On Software Engineering, Vol.20, No.4, April, 1994.
  7. FuLi Jin, Guisheng Yin and Dekun Yang, "Fuzzy Integrated Evaluation for Measuring Quality of Feature Space-Based Component Model", Proceedings of International Conference on Internet Computing in Science and Engineering, 2008, pp.349-354.
  8. Souheil Khaddaj and G Horgan, "The Evaluation of Software Quality Factors in Very Large Information Systems", Electronic Journal of information system Evaluation, Vol.7, Issue 1, 2004.
  9. Sandra A. Slaughter, Donald E Harter and Mayuram S Krishnan, "Evaluation the cost of software quality" Communications of the ACM Vol.41, Issue 8, 1998, pp.67-73.
  10. J. E. Gaffney,"Metrics in Software Quality Assurance", ACM Annual Conference/Annual Meeting, 1981, pp.126-130.
  11. Joseph P. CavaNo.and James A. McCall," A Framework for the Measurement of Software Quality", Proceedings of the software quality assurance workshop on Functional and performance, 1978, pp.133-139.
  12. Roy, B,"Multi-criteria Methodology for Decision Aiding", Dordrecht, Kluwer Academic Publishers, 1996.
  13. Lily Lin and Huey-Ming Lee, "A Fuzzy Software Quality Assessment Model to Evaluate User Satisfaction", Proceedings of the Second International Conference on Innovative Computing, Information and Control, IEEE Computer Society, 2007, pp.1-4.
  14. Bo Yang, Lan Yao and Hong-Zhong Huang, "Early Software Quality Prediction Based on a Fuzzy Neural Network Model", ICNC, Vol.1, 2007, pp.760-764.
  15. Klir, G., & Folger T.,"Fuzzy Sets, Uncertainty and Information", Prentice Hall, 1988.
  16. Yager, R.R, "Fuzzy decision making including unequal objectives", Fuzzy Sets and Systems Vol.1, 1978, pp.87-95. https://doi.org/10.1016/0165-0114(78)90010-6
  17. Baas, S.M. and Kwakernaak, H, "Rating and Ranking of Multiple - Aspect Alternatives Using Fuzzy Sets", Automatica Vol.13, 1977, pp.47-58. https://doi.org/10.1016/0005-1098(77)90008-5
  18. Dong, W.M. and Wong, F.S, "Fuzzy weighted averages and implementation of the extension principle", Fuzzy Sets and Systems Vol.21, 1987, pp.183-199. https://doi.org/10.1016/0165-0114(87)90163-1
  19. Carlsson, C and Fuller, R "Fuzzy multiple criteria decision making", Recent developments Fuzzy Sets and Systems Vol.78, 1996, pp.139-153. https://doi.org/10.1016/0165-0114(95)00165-4
  20. Singh Ajit Pratap and A. K. Vidarthi, "Optimal allocation of landfill disposal site: A fuzzy multicriteria approach", Iranian Journal of Environmental Health Science & Engineering, Vol.5 No.1, 2008, pp.25-34.
  21. Ribeiro, R.A, "Fuzzy multiple attribute decision making: A review and new preference elicitation techniques", Fuzzy Sets and Systems Vol.78, 1996, pp.155-181. https://doi.org/10.1016/0165-0114(95)00166-2
  22. Radojevic, D. and Petrovic, S,"A Fuzzy Approach to Preference Structure in Mult-criteria Ranking", International Transactions in Operational Research Vol.4, No.5/6, 1997, pp.419-430. https://doi.org/10.1111/j.1475-3995.1997.tb00096.x
  23. Srivastava Praveen Ranjan,Singh Ajit Pratap,V Vagesh,Chapter name : Assessment of software quality: a fuzzy multi criteria approach (as a book chapter) Chapter No.11, pp200-219. http://www.igi-global.com/bookstore/Chapter.aspx?TitleId=44377.
  24. Hamer Peter G. & Frewin Gillian D,"M.H. Halstead's Software Science - a critical examination", International Conference on Software Engineering, Tokyo, Japan, 1982, pp.197-206.
  25. M. H. Halstead,"Software Science-A progress report", Second Software Life Cycle Management Workshop, Atlanta, sponsored by the IEEE and the U.S. Army Computer Systems Command, 1978.
  26. Kushwaha Dharmender Singh & Misra A.K. "Software Test Effort Estimation", ACM SIGSOFT Software Engineering Notes Vol.33, No.3, 2008.
  27. McCabe, T,"A Software Complexity Measure", IEEE Transactions on Software Engineering, Vol.2, No.4, 1976, pp.308-320. https://doi.org/10.1109/TSE.1976.233837
  28. Jones, Capers,"Applied software measurement", McGraw-Hill, 1996.
  29. Nagappan, N," Toward a software testing and reliability early warning metric suite", 26th International Conference on Software Engineering [ICSE], 2004, pp.60-62.
  30. Nageswaran Suresh," Test Effort Estimation Using Use Case Points". Quality Week 2001, San Francisco, California, USA, 2001, http://www.cognizant.com/html/content/cogcommunity/Test_Effort_Estimation.pdf
  31. Jorgensen, M.,"Realism in Assessment of Effort Estimation Uncertainty: It Matters How You Ask". IEEE Transactions on Software Engineering, Vol.30, No.4, 2004, pp.209-217. https://doi.org/10.1109/TSE.2004.1274041
  32. Eduardo Aranha, Paulo Borba, "an Estimation Model for Test Execution Effort", Empirical Software Engineering and Measurement [ESEM] conference, 2007, pp.107-116.
  33. Xu. S. and Rajlich. V, "Cognitive Process during Program Debugging", 3rd IEEE International Conference on Cognitive Informatics [ICCI], 2004, pp.176-182.
  34. Dawson Christian W," An Artificial Neural Network Approach to software testing effort estimation", Information and Communication Technologies, Vol.20, Transaction of the Wessex Institute, UK, 1998.
  35. Xishi Huang, Danny Ho, Jing Ren, Luiz F. Capretz. "Improving the COCOMO model using a neurofuzzy approach", Applied Soft Computing, Vol.7, 2007, pp.29-40. https://doi.org/10.1016/j.asoc.2005.06.007
  36. Pressman, R.S.,"Software engineering: A Practitioner's Approach", 6th Ed, India: TMH, 2005.
  37. Abhishek Chintala, Kumar Pavan Veginati, Vitta Harish, Srivastava Ranjan Praveen, "Test Effort Estimation using Neural network", journal of Software Engineering and Applications, Vol.3 No.4, Scientific Research Publishing, Inc. USA, 2010, pp.331-340. https://doi.org/10.4236/jsea.2010.34038
  38. Srivastava Ranjan Praveen,Singh A.P., Saggar Suresh, Raghurama G." Optimization of Software Testing Effort using Fuzzy logic", International journal of Computer Sciences and Engineering Systems, Vol.3, No.3, ISSN 0973-4406, 2009, pp.179-184.
  39. Srivastava Ranjan Praveen, "Estimation of Software Testing Effort: An Intelligent Approach", Accepted in IEEE ISSRE 2009, Bangalore. (Under Fast Abstract), available in supplementary proceeding http://www.issre2009.org/papers/issre2009_179.pdf,
  40. McDaid Kevin and Wilson Simon P, "Deciding How Long to Test Software," The Statistician, Royal Statistical Society, Part 2, 50, 2001, pp.117-134. https://doi.org/10.1111/1467-9884.00265
  41. Dalal S.R.and Mallows C.L., "When Should One StopTesting Software?" Journal of the American Statistical Association, Vol.83, No.403, 1988, pp.872-879. https://doi.org/10.1080/01621459.1988.10478676
  42. Musa, J.D., and Ackerman, A.F., "Quantifying software validation: when to stop testing?" IEEE Software,Vol.6, Issue 3, 1989, pp.19-27. https://doi.org/10.1109/52.28120
  43. Ehrlich, W., Prasanna, B., Stampfel, J., and Wu, J., "Determining the cost of a stop-test decision [software reliability]," IEEE Software, Vol.10, Issue 2, 1993, pp.33-42. https://doi.org/10.1109/52.199726
  44. Goel, A.L., and Okumoto, K., "When to stop testing and start using software?" Proc. of ACM, 1981, pp.131-137.
  45. Goel, A.L., and Okumoto, K., "A Time Dependent Error Detection Rate Model for Software Performance Assessment with Applications", Proc. National Computer Conference, RADC-TR-80-179, May, 1980.
  46. Goel, A.L., and Okumoto, K., "A Time Dependent Error Detection Rate Model for Software Reliability and Other Performance Measures," IEEE Transactions on Reliability, Vol.R-28, No.3, August, 1979, 1979, pp.206-211. https://doi.org/10.1109/TR.1979.5220566
  47. Hongyu Zhang, "On The Distribution Of Software Faults "IEEE Transactions on Software Engineering, Vol.34, No.2, 2008, pp.301-302. https://doi.org/10.1109/TSE.2007.70771
  48. Srivastava Praveen Ranjan, Pareek Deepak, Sati Kailash, Pujari Dinesh C, Raghurama G, "Non - Homogenous Poisson Process Based Cumulative Priority Model for Determining Optimal Software Testing Period," ACM SIGSOFT Software Engineering Notes, Vol.33, Issue 2, March, 2008.
  49. Srivastava Ranjan Praveen, "Model for Optimizing Software Testing Period using Non Homogenous Poisson Process based on Cumulative Test Case Prioritization," IEEE TENCON, Hyderabad, India, 18-21 November, 2008.
  50. Srivastava Ranjan Praveen, Gupta Abhishek, Mathur Pulkit, Tiwari Kumar Sushil,"When to stop testing Using Non Homogenous Poisson Process Based Cumulative priority Based Model", International journal of Computer Sciences and Engineering Systems., Vol.3, No.4, ISSN 0973-4406, 2009, pp.345-350.
  51. Srivastava Ranjan Praveen, Mittal Chetan, Rungta Ajay, Malhotra Vaibhav, Raghurama ."Non homogeneous Poisson process model for optimal software testing using fault tolerance", MIS Review: An International Journal,Vol.15, No.2, ISSN: 10181393, National Chengchi University & Airiti Press Inc., Tiwan, 2010, pp.77-92.
  52. Srivastava Praveen Ranjan, Pareek Deepak, "Component Prioritization Schema for Achieving Maximum Time and Cost Benefits from Software Testing," IEEE Region 10 Colloquium and the Third ICIIS, Kharagpur, INDIA December, 8-10, 2008.
  53. Yang, M.C.K.; Chao, A. Reliability-estimation and stopping-rules for software testing, based on repeated appearances of bugs; IEEE Transactions on Reliability, Vol.44, No.2, 1995, pp.315-21. https://doi.org/10.1109/24.387388
  54. Zeleny, M.,"Multiple Criteria Decision Making", McGraw-Hill, NewYork, 1982.
  55. L. A. Zadeh, "Fuzzy Sets," in Information and Control, Vol.8. Issue 3, Academic Press, 1965, pp.338-353. https://doi.org/10.1016/S0019-9958(65)90241-X
  56. R. E. Bellman and L. A. Zadeh, "Decision-making in a fuzzy environment," Management Science, Vol.17, 1970, pp.141-164. https://doi.org/10.1287/mnsc.17.4.B141
  57. Vania Peneva, Ivan Popchev, "Fuzzy Multicriteria Decision Making", cybernetics and Information technologies 1, Sofia, 2002.
  58. Boehm Barry,"Software Engineering Economics", USA: Prentice-Hall, 1981.
  59. Somerville Ian, "Software Engineering", 7th Edition, India: Pearson Education, 2005.
  60. Boehm Barry and Ellis Harrowith," Software cost estimation with COCOMO II", Englewood Cliffs: Prentice-Hall, 2000.
  61. Bennatan, E. M, "so what is the state of software Estimation?" The cutter Edge, 2003.
  62. Kaner Cem, "Exploratory Testing", Worldwide Annual Software Testing Conference, Florida Institute of Technology, Quality Assurance Institute Orlando, 2006.
  63. Novak, V., Perfilieva, Mockor, J., "Mathematical principles of fuzzy logic", Dodrecht/Kluwer Academic press, 1999.
  64. Driankov, D., Hellendoor, H., & Reinfark, M., "an Introduction to Fuzzy Control", New York: Springer, 1994.
  65. Peter, B., Stephan, N., Roman, W, "A brief course in Fuzzy logic and Fuzzy Control", Department of knowledge-based Mathematical systems, 1996.
  66. Srivastava Ranjan Praveen,Jain Puneet,Sing Ajit Pratap,Raghurama G,"Software quality factors evaluation using fuzzy multi-criteria approach", in 4th Indian International Conference on Artificial Intelligence (IICAI), Bangalore, INDIA, ISBN:978-0-9727412-7-9, 2009, pp.1012-1029.
  67. Srivastava Ranjan Praveen, Kumar Sirish,Singh Ajit Pratap,Raghurama G,"Software Testing Effort: An Assessment Through fuzzy criteria approach, in Journal of Uncertain Systems, Vol.5, No.3, World Academic Press, UK,ISSN: 1752-8909, 2011, pp.183-201.
  68. Padhy N.P, "Artificial Intelligence and Intelligent System", oxford press, 2005.
  69. M.Ganesh, "Introduction to Fuzzy sets and Fuzzy logic", Prentice Hall, 2006.

Cited by

  1. Design of Test-Effort Estimation Model vol.14, pp.1, 2013, https://doi.org/10.7472/jksii.2013.14.23
  2. Optimal stopping time in software testing based on failure size approach vol.235, pp.1, 2015, https://doi.org/10.1007/s10479-015-1959-5
  3. Optimal test sequence generation using firefly algorithm vol.8, 2013, https://doi.org/10.1016/j.swevo.2012.08.003