WO2003096191A3 - Automated software testing system and method - Google Patents

Automated software testing system and method Download PDF

Info

Publication number
WO2003096191A3
WO2003096191A3 PCT/EP2003/004904 EP0304904W WO03096191A3 WO 2003096191 A3 WO2003096191 A3 WO 2003096191A3 EP 0304904 W EP0304904 W EP 0304904W WO 03096191 A3 WO03096191 A3 WO 03096191A3
Authority
WO
WIPO (PCT)
Prior art keywords
results
test case
modules
data
application
Prior art date
Application number
PCT/EP2003/004904
Other languages
French (fr)
Other versions
WO2003096191A2 (en
Inventor
Margaret Moya Barry
John Charles Mcevoy
Matthew Phillip Stewart
Christine Ann Bowman
Original Assignee
Accenture Global Services Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Accenture Global Services Gmbh filed Critical Accenture Global Services Gmbh
Priority to AU2003233316A priority Critical patent/AU2003233316B2/en
Priority to DE60308505T priority patent/DE60308505T2/en
Priority to EP03727464A priority patent/EP1504347B1/en
Priority to CA002483287A priority patent/CA2483287C/en
Publication of WO2003096191A2 publication Critical patent/WO2003096191A2/en
Publication of WO2003096191A3 publication Critical patent/WO2003096191A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3688—Test management for test execution, e.g. scheduling of test suites
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management

Abstract

A system and method for testing an application includes modules capable of reading data from one or more data tables and providing the data as input to the application. The input data is correlated by test case, so that each module may provide different input data for each test case. The system also includes a controller that executes the modules. The controller is capable of determining an execution order for the modules by reading a flow table. The flow table correlates each test case with one or more modules, and further correlates each module within the test case with an execution order. The system may read results that the application generates in response to the input data, and correlate the results with the test case and module in a results table. The results table may also contain expected results, and the system may compare the actual results with the expected results to determine whether the application is functioning properly.
PCT/EP2003/004904 2002-05-11 2003-05-08 Automated software testing system and method WO2003096191A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
AU2003233316A AU2003233316B2 (en) 2002-05-11 2003-05-08 Automated software testing system and method
DE60308505T DE60308505T2 (en) 2002-05-11 2003-05-08 METHOD AND SYSTEM FOR AUTOMATIC TESTING OF SOFTWARE
EP03727464A EP1504347B1 (en) 2002-05-11 2003-05-08 Automated software testing system and method
CA002483287A CA2483287C (en) 2002-05-11 2003-05-08 Automated software testing system and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US37993402P 2002-05-11 2002-05-11
US60/379,934 2002-05-11

Publications (2)

Publication Number Publication Date
WO2003096191A2 WO2003096191A2 (en) 2003-11-20
WO2003096191A3 true WO2003096191A3 (en) 2004-06-24

Family

ID=29420581

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2003/004904 WO2003096191A2 (en) 2002-05-11 2003-05-08 Automated software testing system and method

Country Status (7)

Country Link
US (2) US7373636B2 (en)
EP (1) EP1504347B1 (en)
AT (1) ATE340386T1 (en)
AU (1) AU2003233316B2 (en)
CA (1) CA2483287C (en)
DE (1) DE60308505T2 (en)
WO (1) WO2003096191A2 (en)

Families Citing this family (92)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030208542A1 (en) * 2002-05-01 2003-11-06 Testquest, Inc. Software test agents
US6898704B2 (en) * 2002-05-01 2005-05-24 Test Quest, Inc. Method and apparatus for making and using test verbs
CA2483287C (en) * 2002-05-11 2009-10-13 Accenture Global Services Gmbh Automated software testing system and method
US7340650B2 (en) * 2002-10-30 2008-03-04 Jp Morgan Chase & Co. Method to measure stored procedure execution statistics
US7386839B1 (en) 2002-11-06 2008-06-10 Valery Golender System and method for troubleshooting software configuration problems using application tracing
US20040199818A1 (en) * 2003-03-31 2004-10-07 Microsoft Corp. Automated testing of web services
US7178063B1 (en) * 2003-07-22 2007-02-13 Hewlett-Packard Development Company, L.P. Method and apparatus for ordering test cases for regression testing
WO2005041039A1 (en) * 2003-10-24 2005-05-06 Electronic Arts Inc. System and method for testing human interactive applications and devices
EP1562120A1 (en) * 2004-02-09 2005-08-10 Sap Ag Data processing system with display of test data
DE102004014290A1 (en) * 2004-03-24 2005-10-06 Iav Gmbh Ingenieurgesellschaft Auto Und Verkehr Method for creating procedures for testing software
US7797680B2 (en) * 2004-06-17 2010-09-14 Sap Ag Method and framework for test case management
US8615738B2 (en) * 2004-07-16 2013-12-24 International Business Machines Corporation System and method for software product test modularization
CN100337216C (en) * 2004-09-04 2007-09-12 华为技术有限公司 Software test method
US20060064570A1 (en) * 2004-09-07 2006-03-23 Di Savoia Luigi Alberto Pio Method and apparatus for automatically generating test data for code testing purposes
US7823132B2 (en) * 2004-09-29 2010-10-26 Microsoft Corporation Automated test case verification that is loosely coupled with respect to automated test case execution
US8141043B2 (en) * 2005-01-11 2012-03-20 Worksoft, Inc. Automated business process testing that spans multiple platforms or applications
US7600220B2 (en) * 2005-01-11 2009-10-06 Worksoft, Inc. Extensible execution language
US7793269B2 (en) * 2005-02-15 2010-09-07 Ebay Inc. Parallel software testing based on a normalized configuration
JP2006275986A (en) * 2005-03-30 2006-10-12 Advantest Corp Diagnosis program, switch program, test device, and diagnosis method
US20060230320A1 (en) * 2005-04-07 2006-10-12 Salvador Roman S System and method for unit test generation
US20070028217A1 (en) * 2005-07-29 2007-02-01 Microsoft Corporation Testing software using verification data defined independently of the testing code
US8046746B2 (en) * 2005-08-04 2011-10-25 Microsoft Corporation Symbolic execution of object oriented programs with axiomatic summaries
US7587636B2 (en) * 2005-08-04 2009-09-08 Microsoft Corporation Unit test generalization
US7797687B2 (en) * 2005-08-04 2010-09-14 Microsoft Corporation Parameterized unit tests with behavioral purity axioms
US20070101196A1 (en) * 2005-11-01 2007-05-03 Rogers William A Functional testing and verification of software application
US7730452B1 (en) * 2005-11-01 2010-06-01 Hewlett-Packard Development Company, L.P. Testing a component of a distributed system
US8291387B2 (en) 2005-11-22 2012-10-16 International Business Machines Corporation Method and system for testing a software application interfacing with multiple external software applications in a simulated test environment
US7908590B1 (en) 2006-03-02 2011-03-15 Parasoft Corporation System and method for automatically creating test cases through a remote client
US8000952B2 (en) * 2006-03-09 2011-08-16 International Business Machines Corporation Method and system for generating multiple path application simulations
CN101443732A (en) * 2006-05-12 2009-05-27 皇家飞利浦电子股份有限公司 Method for changing over from a first adaptive data processing version to a second adaptive data processing version
US7640470B2 (en) * 2006-08-21 2009-12-29 Microsoft Corporation Meta-data driven test-data generation with controllable combinatorial coverage
US9064038B2 (en) * 2006-08-29 2015-06-23 International Business Machines Corporation Method and system for combining multiple benchmarks
WO2008045117A1 (en) * 2006-10-06 2008-04-17 Nielsen Media Research, Inc. Methods and apparatus to analyze computer software
US20080115114A1 (en) * 2006-11-10 2008-05-15 Sashank Palaparthi Automated software unit testing
US7996816B2 (en) * 2006-11-15 2011-08-09 International Business Machines Corporation Method and apparatus for dynamically binding service component implementations for specific unit test cases
US8266624B2 (en) * 2006-11-30 2012-09-11 Red Hat, Inc. Task dispatch utility coordinating the execution of tasks on different computers
US7793154B2 (en) * 2006-11-30 2010-09-07 International Business Machines Corporation Method and implementation for automating processes using data driven pre-recorded transactions
WO2008074526A2 (en) 2006-12-18 2008-06-26 International Business Machines Corporation Method, system and computer program for testing software applications based on multiple data sources
US7783927B2 (en) * 2007-03-09 2010-08-24 International Business Machines Corporation Intelligent processing tools
JP4941040B2 (en) * 2007-03-26 2012-05-30 富士通株式会社 Test specification generation program and test specification generation device
US7958400B2 (en) * 2007-04-16 2011-06-07 International Business Machines Corporation Detecting unexpected impact of software changes using coverage analysis
US8448130B1 (en) * 2007-08-20 2013-05-21 The Mathworks, Inc. Auto-generated code validation
JP5352990B2 (en) * 2007-11-22 2013-11-27 株式会社リコー Zoom lens, camera device, and portable information terminal device
US20090210748A1 (en) * 2008-02-18 2009-08-20 Ita Software, Inc. Methods and systems to test airline information systems
US8305910B2 (en) * 2008-02-27 2012-11-06 Agilent Technologies, Inc. Method and apparatus for configuring, and compiling code for, a communications test set-up
US8527965B2 (en) * 2008-04-14 2013-09-03 Oracle America, Inc. Layered static program analysis framework for software testing
US20090300587A1 (en) * 2008-05-27 2009-12-03 Microsoft Corporation Determining domain data coverage in testing database applications
US9111030B1 (en) 2008-10-03 2015-08-18 Federal Home Loan Mortgage Corporation Systems and methods for testing a software application
KR20100041447A (en) * 2008-10-14 2010-04-22 삼성전자주식회사 Apparatus and method for automatic testing of softwares or digital divices
US20100114939A1 (en) * 2008-10-24 2010-05-06 Schulman Elad Software test management system and method with facilitated reuse of test components
US9575878B2 (en) * 2009-03-16 2017-02-21 International Business Machines Corporation Data-driven testing without data configuration
EP2246789A1 (en) * 2009-04-27 2010-11-03 Siemens Aktiengesellschaft Method and system for verifying a system operation
US8739125B2 (en) * 2009-06-16 2014-05-27 Red Hat, Inc. Automated and unattended process for testing software applications
US8694966B2 (en) * 2010-03-04 2014-04-08 Oracle International Corporation Identifying test cases to be run after changes to modules of a software application
US20110224939A1 (en) * 2010-03-10 2011-09-15 Jayaswal Manish K Integrated tool for persisting development environment test scenario information
WO2011151419A1 (en) * 2010-06-03 2011-12-08 International Business Machines Corporation Test operation
KR101132560B1 (en) * 2010-06-09 2012-04-03 강원대학교산학협력단 System and method for automatic interface testing based on simulation for robot software components
KR101106595B1 (en) * 2010-07-29 2012-01-20 강원대학교산학협력단 Method and apparatus for automated testing for software program
US20120041989A1 (en) * 2010-08-16 2012-02-16 Tata Consultancy Services Limited Generating assessment data
US8566794B2 (en) * 2010-10-19 2013-10-22 Sap Ag Checkpoint entry insertion during test scenario creation
US20120124558A1 (en) * 2010-11-17 2012-05-17 Microsoft Corporation Scenario testing composability across multiple components
US8566718B1 (en) * 2010-12-10 2013-10-22 Google Inc. Live demonstration of computing device applications
US9098633B2 (en) * 2011-09-07 2015-08-04 Hewlett-Packard Indigo B.V. Application testing
US9087153B2 (en) 2011-11-04 2015-07-21 International Business Machines Corporation Code coverage framework
US8776025B2 (en) 2011-11-04 2014-07-08 International Business Machines Corporation Integrated debugger and code coverage tool
CN102662846B (en) * 2012-04-24 2014-12-10 广东欧珀移动通信有限公司 Testing method combining automatic tool and testing case
JP5961471B2 (en) * 2012-07-27 2016-08-02 株式会社日立製作所 Output comparison method in multiple information systems
US9274936B2 (en) * 2013-05-29 2016-03-01 Sap Portals Israel Ltd Database code testing framework
US20140364970A1 (en) * 2013-06-07 2014-12-11 General Electric Company System and method for application development and deployment
US9361211B2 (en) * 2014-03-07 2016-06-07 Ca, Inc. Automated generation of test cases for regression testing
WO2015157470A1 (en) 2014-04-08 2015-10-15 Turnkey Solutions Corp. Software test automation system and method
US11294665B1 (en) 2014-04-23 2022-04-05 William Knight Foster Computerized software version control with a software database and a human database
US9535664B1 (en) * 2014-04-23 2017-01-03 William Knight Foster Computerized software development process and management environment
CN104915293B (en) * 2015-06-12 2017-10-20 北京邮电大学 Method for testing software and system based on Affine arithmetic
US9965533B2 (en) * 2015-08-28 2018-05-08 6Connect, Inc. Reverse application programming interface (API) endpoint creation process and standardized schema
US9959197B2 (en) * 2015-08-31 2018-05-01 Vmware, Inc. Automated bug detection with virtual machine forking
US10282283B2 (en) 2016-01-28 2019-05-07 Accenture Global Solutions Limited Orchestrating and providing a regression test
US10521735B2 (en) * 2016-02-22 2019-12-31 Fair Isaac Corporation System for round trip engineering of decision metaphors
CN106528419B (en) * 2016-11-07 2019-04-09 优酷网络技术（北京）有限公司 A kind of test method and device of operation system
US10445217B2 (en) * 2018-02-19 2019-10-15 Harness, Inc. Service regression detection using real-time anomaly detection of application performance metrics
US11086919B2 (en) * 2018-02-19 2021-08-10 Harness Inc. Service regression detection using real-time anomaly detection of log data
US11645467B2 (en) 2018-08-06 2023-05-09 Functionize, Inc. Training a system to perform a task with multiple specific steps given a general natural language command
US10802950B2 (en) * 2018-09-19 2020-10-13 Servicenow, Inc. Automated webpage testing
JP7116671B2 (en) * 2018-11-28 2022-08-10 株式会社日立製作所 System development support device and system development support method
CN109558328B (en) * 2018-12-04 2022-04-22 郑州云海信息技术有限公司 Method, system and device for testing code coverage rate and readable storage medium
CN109933521A (en) * 2019-01-23 2019-06-25 平安科技（深圳）有限公司 Automated testing method, device, computer equipment and storage medium based on BDD
US10956203B2 (en) * 2019-03-29 2021-03-23 International Business Machines Corporation Quality assurance for a context driven hybrid transaction processing system
US11023361B1 (en) * 2019-12-03 2021-06-01 Sap Se Intelligent automated way of baselining integration content using messages from historical tests to be used for regression testing
CN113760771A (en) * 2021-09-14 2021-12-07 中国农业银行股份有限公司 Execution method and device of integrated test case
DE102021132827A1 (en) 2021-12-13 2023-06-15 Continental Automotive Technologies GmbH Procedure for the automatic investigation of states and transitions of a human-machine interface (HMI)
US20230208744A1 (en) * 2021-12-23 2023-06-29 Red Hat, Inc. Consensus driven service promotion
CN117453576B (en) * 2023-12-25 2024-04-09 企迈科技有限公司 DXM model-based SaaS software test case construction method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5572668A (en) * 1995-02-07 1996-11-05 Oracle Corporation Method and apparatus for universal national language support program testing
WO2001093043A1 (en) * 2000-03-27 2001-12-06 Accenture Llp System, method, and article of manufacture for an automated scripting solution for enterprise testing
WO2001095662A2 (en) * 2000-06-08 2001-12-13 Fujitsu Network Communications, Inc. Integrated multiple services switch testing system

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4803683A (en) * 1985-08-30 1989-02-07 Hitachi, Ltd. Method and apparatus for testing a distributed computer system
US4696003A (en) * 1986-03-10 1987-09-22 International Business Machines Corporation System for testing interactive software
US4803686A (en) * 1987-08-03 1989-02-07 Trw Inc. Spatial filter with gain
US5233611A (en) * 1990-08-20 1993-08-03 International Business Machines Corporation Automated function testing of application programs
US5335342A (en) * 1991-05-31 1994-08-02 Tiburon Systems, Inc. Automated software testing system
AU722149B2 (en) * 1996-02-29 2000-07-20 Bt Financial Group Pty Limited Determination of software functionality
US5892947A (en) * 1996-07-01 1999-04-06 Sun Microsystems, Inc. Test support tool system and method
US5943497A (en) * 1997-04-30 1999-08-24 International Business Machines Corporation Object-oriented apparatus and method for controlling configuration of object creation
US6622299B1 (en) * 1999-07-06 2003-09-16 International Business Machines Corporation Computer system, program product and method for dynamically providing an indication to a programmer of the efficiency of a program that is being written
US7139999B2 (en) * 1999-08-31 2006-11-21 Accenture Llp Development architecture framework
US6959433B1 (en) * 2000-04-14 2005-10-25 International Business Machines Corporation Data processing system, method, and program for automatically testing software applications
JP2002202899A (en) * 2000-12-28 2002-07-19 Toshiba Corp Method for extending function of debugger and debug system and recording medium with debugger program recorded
US6804709B2 (en) * 2001-02-20 2004-10-12 Microsoft Corporation System uses test controller to match different combination configuration capabilities of servers and clients and assign test cases for implementing distributed testing
US6993748B2 (en) * 2001-10-26 2006-01-31 Capital One Financial Corporation Systems and methods for table driven automation testing of software programs
US6951013B1 (en) * 2002-03-01 2005-09-27 Lozins Neal N Method for facilitating development and testing of relational database application software
CA2483287C (en) 2002-05-11 2009-10-13 Accenture Global Services Gmbh Automated software testing system and method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5572668A (en) * 1995-02-07 1996-11-05 Oracle Corporation Method and apparatus for universal national language support program testing
WO2001093043A1 (en) * 2000-03-27 2001-12-06 Accenture Llp System, method, and article of manufacture for an automated scripting solution for enterprise testing
WO2001095662A2 (en) * 2000-06-08 2001-12-13 Fujitsu Network Communications, Inc. Integrated multiple services switch testing system

Also Published As

Publication number Publication date
AU2003233316B2 (en) 2009-01-22
US7373636B2 (en) 2008-05-13
CA2483287C (en) 2009-10-13
US20080222609A1 (en) 2008-09-11
US8312436B2 (en) 2012-11-13
DE60308505D1 (en) 2006-11-02
EP1504347B1 (en) 2006-09-20
CA2483287A1 (en) 2003-11-20
AU2003233316A1 (en) 2003-11-11
EP1504347A2 (en) 2005-02-09
US20030229825A1 (en) 2003-12-11
DE60308505T2 (en) 2007-01-18
ATE340386T1 (en) 2006-10-15
WO2003096191A2 (en) 2003-11-20

Similar Documents

Publication Publication Date Title
WO2003096191A3 (en) Automated software testing system and method
CN103149526B (en) PCBA board test macro and method
ATE426897T1 (en) SYSTEM AND METHOD FOR SELF-CHECKING AND REPAIR OF MEMORY MODULES
TW200611115A (en) Method and apparatus to preserve trace data
WO2008074526A3 (en) Method, system and computer program for testing software applications based on multiple data sources
WO2007044965A3 (en) System and method for testing business process configurations
WO2006099634A3 (en) Software and hardware analysis test
TW200720968A (en) System and method for performing deterministic processing
ATE408152T1 (en) TESTING CIRCUITS WITH MULTIPLE CLOCK DOMAIN
TW200719140A (en) Automatic testing system and method
TWI592798B (en) Inspection system adjusting the sequence of testing items in diagnostic program through log file and method thereof
TW200725349A (en) Assertion tester
CN104635141B (en) A kind of integrated circuit detection method, apparatus and system
KR100618870B1 (en) A method for data training
TW200512632A (en) Method and system for graphical pin assignment and/or verification
TW200611118A (en) Testing simulator, testing simulation program and record medium
CN102521454A (en) Processing craft data evaluating method and device
CN101131663A (en) Method for detecting installation correctness of computer PCI/PCI Express devices
CN2874503Y (en) Chip detection circuit board
WO2005017648A3 (en) System and method for processing and identifying errors in data
TW200627258A (en) Medium transfer-recording control method and the embedded system using the same
CN101551427A (en) Substrate detecting method
CN105468527A (en) Test method and device of assembly in application
DE502006008253D1 (en) SYSTEM AND METHOD FOR THE AUTOMATIC TESTING OF PLANNING RESULTS
CN100458714C (en) Smart card emulator

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 548/MUMNP/2004

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 2003233316

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 2483287

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 2003727464

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2003727464

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Ref document number: JP

WWG Wipo information: grant in national office

Ref document number: 2003727464

Country of ref document: EP