Exploring data management challenges and solutions in agile software development: a literature review and practitioner survey

Simple item page
dc.citation.issue3
dc.citation.volume30
dc.contributor.authorFawzy A
dc.contributor.authorTahir A
dc.contributor.authorGalster M
dc.contributor.authorLiang P
dc.contributor.editorZimmermann T
dc.contributor.editorFeldt R
dc.date.accessioned2025-04-01T21:42:52Z
dc.date.available2025-04-01T21:42:52Z
dc.date.issued2025-05
dc.description.abstractContext: Managing data related to a software product and its development poses significant challenges for software projects and agile development teams. These include integrating data from diverse sources and ensuring data quality amidst continuous change and adaptation. Objective: The paper systematically explores data management challenges and potential solutions in agile projects, aiming to provide insights into data management challenges and solutions for both researchers and practitioners. Method: We employed a mixed-methods approach, including a systematic literature review (SLR) to understand the state-of-research followed by a survey with practitioners to reflect on the state-of-practice. The SLR reviewed 45 studies, identifying and categorizing data management aspects along with their associated challenges and solutions. The practitioner survey captured practical experiences and solutions from 32 industry practitioners who were significantly involved in data management to complement the findings from the SLR. Results: Our findings identified major data management challenges in practice, such as managing data integration processes, capturing diverse data, automating data collection, and meeting real-time analysis requirements. To address these challenges, solutions such as automation tools, decentralized data management practices, and ontology-based approaches have been identified. These solutions enhance data integration, improve data quality, and enable real-time decision-making by providing flexible frameworks tailored to agile project needs. Conclusion: The study pinpointed significant challenges and actionable solutions in data management for agile software development. Our findings provide practical implications for practitioners and researchers, emphasizing the development of effective data management practices and tools to address those challenges and improve project success.
dc.description.confidentialfalse
dc.edition.editionMay 2025
dc.identifier.citationFawzy A, Tahir A, Galster M, Liang P. (2025). Exploring data management challenges and solutions in agile software development: a literature review and practitioner survey. Empirical Software Engineering. 30. 3.
dc.identifier.doi10.1007/s10664-025-10630-4
dc.identifier.eissn1573-7616
dc.identifier.elements-typejournal-article
dc.identifier.issn1382-3256
dc.identifier.number77
dc.identifier.urihttps://mro.massey.ac.nz/handle/10179/72713
dc.languageEnglish
dc.publisherSpringer Nature
dc.publisher.urihttps://link.springer.com/article/10.1007/s10664-025-10630-4
dc.relation.isPartOfEmpirical Software Engineering
dc.rights(c) 2025 The Author/s
dc.rightsCC BY 4.0
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.titleExploring data management challenges and solutions in agile software development: a literature review and practitioner survey
dc.typeJournal article
pubs.elements-id500183
pubs.organisational-groupOther
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
500183 PDF.pdf
Size:
1.86 MB
Format:
Adobe Portable Document Format
Description:
Published version.pdf
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
9.22 KB
Format:
Plain Text
Description:
Download
Collections
Journal Articles