publications: - title: "Systematic literature reviews in software engineering: Preliminary results from interviews with researchers" author: - name: "Muhammad Ali Babar" link: "http://www.itu.dk/people/maba" - name: "Zhang, He" link: "https://researchr.org/alias/zhang%2C-he" year: "2009" doi: "http://dx.doi.org/10.1109/ESEM.2009.5314235" abstract: " Systematic Literature Reviews (SLRs) have been gaining significant attention from software engineering researchers since 2004. Several researchers have reported their experiences of and lessons learned from applying systematic reviews to different subject matters in software engineering. However, there has been no attempt at independently exploring experiences and perceptions of the practitioners of systematic reviews in order to gain an in-depth understanding of various aspects of systemic reviews as a new research methodology in software engineering. We assert that there is a need of evidence-based body of knowledge about the application of systematic reviews in software engineering. To address this need, we have started an empirical research program that aims to contribute to the growing body of knowledge about systematic reviews in software engineering. This paper reports the design, logistics, and results of the first phase empirical study carried out in this program. The results provide interesting insights into different aspects of systematic reviews based on the analysis of the data gathered from 17 interviewees with varying levels of knowledge of and experiences in systematic reviews. The findings from this study are expected to contribute to the existing knowledge about using systematic reviews and help further improve the state-of-the-practice of this research methodology in software engineering. " links: doi: "http://dx.doi.org/10.1109/ESEM.2009.5314235" tags: - "empirical" - "object-oriented programming" - "rule-based" - "program analysis" - "literature review" - "design research" - "analysis" - "data-flow programming" - "data-flow" - "software engineering" - "reviewing" - "aspect oriented programming" - "subject-oriented programming" - "data-flow analysis" - "design" - "systematic-approach" - "systematic review" - "feature-oriented programming" researchr: "https://researchr.org/publication/Babar2009" cites: 0 citedby: 1 booktitle: "ESEM '09: Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement" address: "Washington, DC, USA" publisher: "IEEE Computer Society" isbn: "978-1-4244-4842-5" kind: "inproceedings" key: "Babar2009" - title: "Evaluating guidelines for reporting empirical software engineering studies" author: - name: "Barbara A. Kitchenham" link: "http://www.scm.keele.ac.uk/staff/b_kitchenham/" - name: "Hiyam Al-Kilidar" link: "https://researchr.org/alias/hiyam-al-kilidar" - name: "Muhammad Ali Babar" link: "http://www.itu.dk/people/maba" - name: "Mike Berry" link: "https://researchr.org/alias/mike-berry" - name: "Karl Cox" link: "https://researchr.org/alias/karl-cox" - name: "Jacky Keung" link: "https://researchr.org/alias/jacky-keung" - name: "Felicia Kurniawati" link: "https://researchr.org/alias/felicia-kurniawati" - name: "Mark Staples" link: "https://researchr.org/alias/mark-staples" - name: "He Zhang" link: "https://researchr.org/alias/he-zhang" - name: "Liming Zhu" link: "http://cgi.cse.unsw.edu.au/~limingz/home/" year: "2008" doi: "http://dx.doi.org/10.1007/s10664-007-9053-5" abstract: "Background Several researchers have criticized the standards of performing and reporting empirical studies in software engineering. In order to address this problem, Jedlitschka and Pfahl have produced reporting guidelines for controlled experiments in software engineering. They pointed out that their guidelines needed evaluation. We agree that guidelines need to be evaluated before they can be widely adopted. Aim The aim of this paper is to present the method we used to evaluate the guidelines and report the results of our evaluation exercise. We suggest our evaluation process may be of more general use if reporting guidelines for other types of empirical study are developed. Method We used a reading method inspired by perspective-based and checklist-based reviews to perform a theoretical evaluation of the guidelines. The perspectives used were: Researcher, Practitioner/Consultant, Meta-analyst, Replicator, Reviewer and Author. Apart from the Author perspective, the reviews were based on a set of questions derived by brainstorming. A separate review was performed for each perspective. The review using the Author perspective considered each section of the guidelines sequentially. Results The reviews detected 44 issues where the guidelines would benefit from amendment or clarification and 8 defects. Conclusions Reporting guidelines need to specify what information goes into what section and avoid excessive duplication. The current guidelines need to be revised and then subjected to further theoretical and empirical validation. Perspective-based checklists are a useful validation method but the practitioner/consultant perspective presents difficulties. " links: doi: "http://dx.doi.org/10.1007/s10664-007-9053-5" tags: - "empirical" - "rule-based" - "meta-model" - "software engineering" - "model-driven engineering" - "reviewing" - "Meta-Environment" - "systematic-approach" - "systematic review" - "meta-objects" researchr: "https://researchr.org/publication/KitchenhamABBCKKSZZ08" cites: 0 citedby: 0 journal: "Empirical Software Engineering" volume: "13" number: "1" pages: "97-121" kind: "article" key: "KitchenhamABBCKKSZZ08" - title: "Reporting Empirical Research in Open Source Software: The State of Practice" author: - name: "Klaas-Jan Stol" link: "http://www.lero.ie" - name: "Muhammad Ali Babar" link: "http://www.itu.dk/people/maba" year: "2009" doi: "http://dx.doi.org/10.1007/978-3-642-02032-2_15" links: doi: "http://dx.doi.org/10.1007/978-3-642-02032-2_15" tags: - "empirical" - "source-to-source" - "open-source" researchr: "https://researchr.org/publication/StolB09" cites: 0 citedby: 0 pages: "156-169" booktitle: "Open Source Ecosystems: Diverse Communities Interacting, 5th IFIP WG 2.13 International Conference on Open Source Systems, OSS 2009, Skövde, Sweden, June 3-6, 2009. Proceedings" editor: - name: "Cornelia Boldyreff" link: "https://researchr.org/alias/cornelia-boldyreff" - name: "Kevin Crowston" link: "https://researchr.org/alias/kevin-crowston" - name: "Björn Lundell" link: "https://researchr.org/alias/bj%C3%B6rn-lundell" - name: "Anthony I. Wasserman" link: "https://researchr.org/alias/anthony-i.-wasserman" volume: "299" series: "IFIP" publisher: "Springer" isbn: "978-3-642-02031-5" kind: "inproceedings" key: "StolB09"