Skip to content
Smart Scholars🛡 Scholar Shield🏛 Research Integrity Desk🧩 Portfolio Console📰 Journals🔧 DOI MembersTools🔎 Journal AuditGI GetIndexedDr DOI Doctor

10.46243/jst.2022.v7.i02.pp395-422 registered

A Survey of Controlled Experiments in Software Engineering

Resolves to https://www.jst.org.in/index.php/pub/article/view/559

Held by Longman Publishers (India) · prefix 10.46243 live · DOI address https://doi.org/10.46243/jst.2022.v7.i02.pp395-422

Registered 29 Sep 2026 via crossref · record version 2 · last change 29 Sep 2026, 11:59 PM · record sha256 91df6658a7d08d4f…

Resolve ⬇ Record (JSON) ⬇ Kernel Metadata Declaration (XML) Compare with Crossref Cite (APA · BibTeX · RIS · CSL)

Also as schema.org JSON-LD · Turtle · RDF/XML · DataCite XML · Crossref UNIXREF · Crossref UNIXSD — the formats of the DOI content-negotiation service, from this record (which carries what).

What the DOI identifies

JournalArticle — an article in a journal · Digital · Visual · en

A Survey of Controlled Experiments in Software Engineering (PrincipalTitle · en)

Published 2022-07-03

Part of Journal of Science & Technology · ISSN 2456-5660 · volume 7 · issue 2 · pages 395–422

Agents

  • Dr.M.V Siva Prasad Dr.M.V Siva Prasad (author)
  • Longman Publishers (publisher)

Identifiers DOI 10.46243/jst.2022.v7.i02.pp395-422

Abstract · en

The classical method for identifying cause-effect relationships is to conduct controlled experiments. This paper reports upon the present state of how controlled experiments in software engineering are conducted and the extent to which relevant information is reported. Among the 5,453 scientific articles published in 12 leading software engineering journals and conferences inthe decade from 1993 to 2002, 103 articles (1.9 percent) reported controlled experiments in which individuals or teams performed one or more software engineering tasks. This survey quantitatively characterizes the topics of the experiments and their subjects (number of subjects, students versus professionals, recruitment, and rewards for participation), tasks (type of task, duration, and type and size of application) and environments (location, development tools). Furthermore, the survey reports on how internal and external validity is addressed and the extent to which experiments are replicated. The gathered data reflects the relevance of software engineering experiments to industrial practice and the scientific maturity of software engineering research

Licence https://creativecommons.org/licenses/by/4.0/

System metadata — ISO 26324:2025, Annex B · DOI Handbook 10.1

Each element by the standard's name (Annex B: reference elements, then administrative) and the Handbook's (in grey), read off the record above.

ElementValueIn the record
DOI Name
DOI name
10.46243/jst.2022.v7.i02.pp395-422doi
Referent Type
referentType
Creationreferent
Referent Sub-Type
referentSubType
JournalArticle — an article in a journaltype
Referent Name(s)
referentName(s)
A Survey of Controlled Experiments in Software Engineering (PrincipalTitle, en)titles
Basic Metadata
basicMetadata
author: Dr.M.V Siva Prasad Dr.M.V Siva Prasad
publisher: Longman Publishers
published: 2022-07-03
part of: Journal of Science & Technology · ISSN 2456-5660 · vol. 7 · no. 2 · pp. 395–422
language: en
form: Digital · Visual · Language
agents, dates, container, language, structural_type, modes, characters
Referent Identifier(s)
alternateIdentifier(s)
none besides the DOIidentifiers, relations (IsSameAs)
Registration Authority
registrationAuthorityCode
Crossref — issued by Crossref (member 25296); held here as a copyrecord.source_agency (our code, ra_doi_name, for names issued here once appointed)
Created Date
issueDate
2024-02-16record.registered (when the DOI name was first registered)
relatedIdentifiersnone needed — the descriptive metadata is in this recordcontainer, relations (only where the descriptive metadata lives at another identifier)

complete Every System Metadata element is here, with the basic metadata a journal article needs.

The System Metadata Declaration (JSON) · the Kernel Metadata Declaration (XML) · what each sub-type needs

Cited by — in this registry

No record held in this registry cites this DOI.

Counts only records held in this registry; a citation from a work held elsewhere is not seen here. The list as JSON

References with DOIs

The record lists 52 references; 41 carry a DOI.

#ReferenceDOIHeld here
3ref3 E. Arisholm and D.I.K. Sjøberg, “Evaluating the Effect of a Delegated versus Centralized Control Style on the Maintainability of Object-Oriented Software,” IEEE Trans. Software En…10.1109/tse.2004.43not held here
4ref4 V.R. Basili, “The Experimental Paradigm in Software Engineer- ing,” Experimental Eng. Issues: Critical Assessment and Future Directions, Proc. Int’l Workshop, vol. 706, pp. 3-12, …10.1007/3-540-57092-6_91not held here
5ref5 V.R. Basili, “The Role of Experimentation in Software Engineering: Past, Current, and Future,” Proc. 18th Int’l Conf. Software Eng., pp. 442- 449, 199610.1109/icse.1996.493439not held here
6ref6 V.R. Basili, R.W. Selby, and D.H. Hutchens, “Experimentation in Software Engineering,” IEEE Trans. Software Eng., pp. 733-743, July 198610.1109/tse.1986.6312975not held here
7ref7 V.R. Basili, F. Shull, and F. Lanubile, “Building Knowledge through Families of Experiments,” IEEE Trans. Software Eng., vol. 25, pp. 456- 473, July/Aug. 199910.1109/32.799939not held here
8ref8 D.M. Berry and W.F. Tichy, “Response to ‘Comments on Formal Methods Application: An Empirical Tale of Software Develop- ment,’” IEEE Trans. Software Eng., vol. 29, no. 6, pp. 572-…10.1109/tse.2003.1205183not held here
9ref9 D.T. Campbell and J.C. Stanley, “Experimental and Quasi-Experimental Designs for Research on Teaching,” Handbook of Research on Teaching, N.L. Cage, ed., Chicago: Rand McNally, 19…10.1177/001316446702700247not held here
12ref12 B. Curtis, “Measurement and Experimentation in Software Engineering,” Proc. IEEE, vol. 68, no. 9, pp. 1144-1157, Sept. 198010.1109/proc.1980.11813not held here
14ref14 I.S. Deligiannis, M. Shepperd, S. Webster, and M. Roumeliotis, “A Review of Experimental Investigations into Object-Oriented Technology,” Empirical Software Eng., vol. 7, no. 3, p…10.1023/a:1016392131540not held here
15ref15 A. Endres and D. Rombach, A Handbook of Software and Systems Engineering: Empirical Observations, Laws, and Theories, Fraunhofer IESE series on software engineering. Pearson Educa…10.1002/0471028959.sof135not held here
16ref16 N. Fenton, “How Effective Are Software Engineering Methods?” J. Systems and Software, vol. 22, no. 2, pp. 141-146, 199310.1016/0164-1212(93)90092-cnot held here
17ref17 R. Ferber, “Editorial: Research by Convenience,” J. Consumer Research, vol. 4, pp. 57-58, June 197710.1086/208679not held here
18ref18 R.L. Glass and T.Y. Chen, “An Assessment of Systems and Software Engineering Scholars and Institutions (1998-2002),” J. Systems and Software, vol. 68, no. 1, pp. 77-84, 200310.1016/s0164-1212(03)00232-2not held here
19ref19 R.L. Glass, V. Ramesh, and I. Vessey, “An Analysis of Research in Computing Disciplines,” Comm. ACM, vol. 47, no. 6, pp. 89-94, June 200410.1145/990680.990686not held here
20ref20 R.L. Glass, I. Vessey, and V. Ramesh, “Research in Software Engineering: An Analysis of the Literature,” J. Information and Software Technology, vol. 44, no. 8, pp. 491-506, June …10.1016/s0950-5849(02)00049-6not held here
21ref21 S. Greenland, J.M. Robins, and J. Pearl, “Confounding and Collapsibility in Causal Inference,” Statistical Science, vol. 14, no. 1, pp. 29-46, 199910.1214/ss/1009211805not held here
22ref22 W. Hayes, “Research Synthesis in Software Engineering: A Case for Meta-Analysis,” Proc. Sixth Int’l Symp. Software Metrics, pp. 143- 151, 200310.1109/metric.1999.809735not held here
23ref23 M. Ho¨ st, C. Wohlin, and T. Thelin, “Experimental Context Classification: Incentives and Experience of Subjects,” Proc. 27th Int’l Conf. Software Eng., pp. 470-478, 200510.1109/icse.2005.1553590not held here
25ref25 M. Jørgensen, “A Review of Studies on Expert Estimation of Software Development Effort,” J. Systems and Software, vol. 70, nos. 1,2, pp. 37-60, 200410.1016/s0164-1212(02)00156-5not held here
26ref26 M. Jørgensen and D.I.K. Sjøberg, “Generalization and Theory Building in Software Engineering Research,” Empirical Assessment in Software Eng. Proc., pp. 29-36, 200410.1049/ic:20040396not held here
27ref27 M. Jørgensen, K.H. Teigen, and K. Moløkken, “Better Sure than Safe? Over-Confidence in Judgement Based Software Develop- ment Effort Prediction Intervals,” J. Systems and Software…10.1016/s0164-1212(02)00160-7not held here
28ref28 N. Juristo, A.M. Moreno, and S. Vegas, “Reviewing 25 Years of Testing Technique Experiments,” Empirical Software Eng., vol. 9, pp. 7-44, Mar. 200410.1023/b:emse.0000013513.48963.1bnot held here
30ref30 B.A. Kitchenham, S.L. Pfleeger, L.M. Pickard, P.W. Jones, D.C. Hoaglin, K. El-Emam, and J. Rosenberg, “Preliminary Guidelines for Empirical Research in Software Engineering,” IEEE…10.1109/tse.2002.1027796not held here
31ref31 R.M. Lindsay and A.S.C. Ehrenberg, “The Design of Replicated Studies,” The Am. Statistician, vol. 47, pp. 217-228, Aug. 199310.1080/00031305.1993.10475983not held here
32ref32 C. Lott and D. Rombach, “Repeatable Software Engineering Experiments for Comparing Defect-Detection Techniques,” Em- pirical Software Eng., vol. 1, pp. 241-277, 199610.1007/bf00127447not held here
33ref33 J.W. Lucas, “Theory-Testing, Generalization, and the Problem of External Validity,” Sociological Theory, vol. 21, pp. 236-253, Sept. 200310.1111/1467-9558.00187not held here
34ref34 T.R. Lunsford and B.R. Lunsford, “The Research Sample, Part I: Sampling,” J. Prosthetics and Orthotics, vol. 7, pp. 105-112, 199510.1097/00008526-199500730-00008not held here
35ref35 Experimental Software Engineering Issues: Critical Assessment and Future Directions, Int’l Workshop Dagstuhl Castle (Germany), Sept. 14- 18, 1992, Proc., H.D. Rombach, V.R. Basili…10.1007/3-540-57092-6not held here
37ref37 W.R. Shadish, T.D. Cook, and D.T. Campbell, Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Hought- on Mifflin, 200210.1086/345281not held here
38ref38 M. Shaw, “Writing Good Software Engineering Research Papers: Minitutorial,” Proc. 25th Int’l Conf. Software Eng., pp. 726-736, 200310.1109/icse.2003.1201262not held here
39ref39 D.I.K. Sjøberg, B. Anda, E. Arisholm, T. Dyba˚, M. Jørgensen, A. Karahasanovi´c, E. Koren, and M. Voka´ˇc, “Conducting Realistic Experiments in Software Engineering,” Proc. 18th I…10.1109/isese.2002.1166921not held here
40ref40 D.I.K. Sjøberg, B. Anda, E. Arisholm, T. Dyba˚, M. Jørgensen, A. Karahasanovi´c, and M. Voka´ˇc, “Challenges and Recommenda- tions when Increasing the Realism of Controlled Softwa…10.1007/978-3-540-45143-3_3not held here
41ref41 W.F. Tichy, “Should Computer Scientists Experiment More? 16 Excuses to Avoid Experimentation,” Computer, vol. 31, no. 5, pp. 32-40, May 199810.1109/2.675631not held here
42ref42 W.F. Tichy, “Hints for Reviewing Empirical Work in Software Engineering,” Empirical Software Eng., vol. 5, no. 4, pp. 309-312, 200010.1023/a:1009844119158not held here
43ref43 W.F. Tichy, P. Lukowicz, L. Prechelt, and E.A. Heinz, “Experi- mental Evaluation in Computer Science: A Quantitative Study,” J. Systems and Software, vol. 28, no. 1, pp. 9-18, Jan…10.1016/0164-1212(94)00111-ynot held here
45ref45 R. Weber, “Editor’s Comments,” MIS Quarterly, vol. 27, no. 3, pp. iii-xii, Sept. 200310.2307/30036536not held here
46ref46 C. Wohlin, P. Runeson, M. Ho¨ st, M.C. Ohlsson, B. Regnell, and A. Wesslen, Experimentation in Software Eng.: An Introduction. John Wiley & Sons Inc., 199910.1007/978-1-4615-4625-2_1not held here
48ref48 E.A. Youngs, “Human Errors in Programming,” Int’l J. Man-Machine Studies, vol. 6, no. 3, pp. 361-376, 197410.1016/s0020-7373(74)80027-1not held here
49ref49 M.V. Zelkowitz and D. Wallace, “Experimental Validation in Software Engineering,” J. Information and Software Technology, vol. 39, pp. 735- 743, 199710.1016/s0950-5849(97)00025-6not held here
50ref50 M.V. Zelkowitz and D. Wallace, “Experimental Models for Validating Technology,” Theory and Practice of Object Systems, vol. 31, no. 5, pp. 23-31, May 199810.1109/2.675630not held here
51ref51 A. Zendler, “A Preliminary Software Engineering Theory as Investigated by Published Experiments,” Empirical Software Eng., vol. 6, no. 2, pp. 161-180, 200110.1023/a:1011489321999not held here

The references as JSON

Relations

The record states no relation, and no record held here states one with this DOI.

The relations as JSON

Funding

The record names no funder.

Each funder's page lists every work held here that names it. ROR IDs open at ror.org; Funder Registry IDs resolve at doi.org.

History — the ledger

Every change to this DOI, in order, as it was recorded. Entries are only ever added, never changed or removed.

#WhenWhatByChanges
129 Sep 2026, 10:00 PMregister
registered at Crossref; record read from api.crossref.org
Administrator (admin) 199 fields set · sha256 8735a192e69d…
229 Sep 2026, 11:59 PMupdate
record re-read from api.crossref.org
Administrator (admin)
agents.0.name.family:  Dr.M.V Siva Prasad → Dr.M.V Siva Prasad
agents.0.name.given:  Dr.M.V Siva Prasad → Dr.M.V Siva Prasad
container.titles.0.value: Journal of Science & Technology → Journal of Science & Technology

Machine-readable: the history as JSON, with the full record after each change.

Changes made at Crossref through DOI Doctor

Every deposit Smart Scholars' DOI Doctor made for this DOI, oldest first, with Crossref's own answer. Each fingerprint is the SHA-256 of its entry and of the fingerprint before it, so a change to any earlier entry changes every fingerprint after it.

WhenWhat changedCrossrefFingerprint
11 Sep 2026, 05:18Address updated
from https://jst.org.in/index.php/pub/article/view/559/506 to https://www.jst.org.in/index.php/pub/article/view/559
● accepted by Crossref1422326e6504…
13 Sep 2026, 01:40Read back: the DOI resolves to the new address● confirmed55134cd32d97…
07 Oct 2026, 07:37Metadata completed
abstract (150 words) · licence
● accepted by Crossref73856264b10d…
07 Oct 2026, 08:48Read back: Crossref's record shows it● confirmede2f4b5e65d08…

4 entries · the last fingerprint e2f4b5e65d08a94bb5addff442eee384c0efacffbacee1a4554b86c5e00dded8 · the history as JSON, each entry with the fingerprint before it, to check them yourself.

Share this page

Share this page

Ask AI about this page

Everything Smart Scholars runs

Nine sites, one account. A journal starts at the audit; an author starts at Scholar Shield.

What we do: DOIs registered from what a journal already has · Crossref records completed — references, abstracts, licences, ORCID iDs, affiliations and ROR IDs, funding · DOIs that resolve · articles preserved · journals rated on the public record · see everything we do →

Book a free call

For journals & publishers

Start with the audit — ₹4,999 per journal, and the gate to everything else.

DOI care

Every service on one journal profile — each previews first and acts only on your approval.

  • DOI Doctor — check & repairevery DOI tested at doi.org and Crossref; dead links, abstracts, licences, ORCIDs
  • Smart Deposita new DOI from your PDF, Word file, article page, JATS XML or spreadsheet — every value shown with its source, deposited once you confirm it
  • DOI census (Excel)site against Crossref, both directions, with a copy-paste fix per article
  • Backfile DOIsDOIs for older articles that never had one — no per-DOI fee of ours
  • DOIs for conference proceedingsthe conference, the volume and every paper — registered in the organiser's own name
  • Scopus indexing guidethe minimum criteria, the 14 CSAB criteria and how a title is suggested — from Elsevier's own page
  • Embase indexing guidewhat Embase asks of a biomedical journal and how to suggest it
  • Write DOIs into OJSthe verified DOIs pushed onto your article pages through your own API
  • Silent-failure monitorweekly checks of site, OAI-PMH, Scholar tags, ISSN, preservation, hijack lists
  • Journal Radarevery journal, every day: SSL, DNS, redirects, robots.txt, OJS, DOIs, Crossref metadata, broken links — what broke since yesterday first
  • Verified metrics & badgesa public, dated, source-linked metrics page and a "cited by" badge
  • Quality dossier (PDF)one PDF for universities, authors and reviewers
  • Author citation enginethe citation steps emailed to each author from the journal's own mailbox
  • JATS XMLmachine-readable JATS per article
  • Duplicate articlesthe same paper published twice — you choose which copy stays

For authors & researchers

Free to use. Nothing you check is shared with the journal.

For institutions, sponsors & DOI operators

Smart Scholars

Mon–Sat, 10:00–19:00 IST. The Ask AI button on every page answers about our services at any hour.

News

Policies

What we can register a DOI for

20 kinds of record, one account, one place. Every one gets a DOI that resolves, metadata that indexes read, and a record that stays correct afterwards.

Journals

  • Journal articles
  • Journal titles
  • Pending publications
  • Peer reviews
  • Preprints & posted content

Books & conferences

  • Books
  • Book chapters
  • Book series
  • Book sets
  • Conference proceedings
  • Proceedings series
  • Conference papers

Other research output

  • Theses & dissertations
  • Reports & working papers
  • Report series
  • Standards
  • Databases
  • Datasets
  • Figures, tables & supplements

Funding

  • Grants & funding awards

Elsewhere

The same company, in the places our publishers already read.
Add Smart Scholars as a preferred source on GoogleSee more of our newsroom in Google’s Top Stories.
Smart Scholars · Every service on one pageNewsroom posts CC BY 4.0 · DOI metadata CC0 · everything else ©Data from OpenAlex (openalex.org), CC0 · Crossref · ISSN Portal · DOAJContact
WhatsApp