11/22 IRB Feedback

<aside> 📌 Note: The Survey Instruments and Interview Instruments documents were not changed. The file submission dates were updated to today as I inadvertently updated those documents with the consent documents, but the PDFs were reverted back to the original files.

</aside>

In your response to question A of the Research Design section, please clarify how Bucknell University is involved in this research.
- Added text in question A of the Research Design section
  
  Bucknell University's involvement with the research is only through Dr. Brian King and his course, CSCI205.
In your response to question A of the Research Design section, please clarify how Dr. Brian King is involved in this research.
- Added text in question A of the Research Design section
  
  Dr. Brian King is the professor for the Bucknell CSCI205 course. His involvement beyond normal instruction of the course includes distributing survey and interview links. He will not have access to any raw research data other than what is normally accessible as a part of the course.
In your response to question A of the Research Design section, please clarify if the surveys are part of the course (will be conducted without the research) or are only being conducted for research purposes. The way compensation information reads is that tool the usage data and the surveys will be collected whether someone wants to be in the study or not and that consenting to be in the study will only allow the data to be used for research purposes.
- Old text in question A of the Research Design section
  
  Students and Instructors will be asked to complete three different surveys at various points of their final project (at the beginning, weekly and at the end. Surveys will be slightly different for the Spring versus Fall semesters. There is no recruiting for surveys as the participants are all students of the same course. Participation will be voluntarily and not required to complete the course. Extra credit will be provided for completion.
- New text in question A of the Research Design section
  
  Students and Instructors will be asked to complete three different surveys at various points of their final project (at the beginning, weekly and at the end. Surveys will be slightly different for the Spring versus Fall semesters. There is no recruiting for surveys as the participants are all students of the same course. Participation will be voluntarily and not required to complete the course. These surveys are only being conducted for research purposes. Extra credit will be provided for completion. Students who wish to earn the extra credit but not participate in the study may participate but opt out of having any data persisted for research purposes.
In your response to question A of the Research Design section, please provide examples of the tools that are being used and the data that is being collected from these tools. The current information regarding this is too vague to properly conduct a review of what is being collected from the participants.
- Added text in question A of the Research Design section
  
  The two tools used in the course relevant to this research for the Fall course include the university hosted GitLab and Agile-GitLabCE https://lilyheart.github.io/agile-gitlabce/. Both of these tools are the standard tools used as a part of this class and has been for the past several semesters. GitLab is similar to Georgia Tech's GitHub and is a platform used in CSCI205 to manage a programming project. Agile-GitLabCE is reporting tool that summarizes the information stored in GitLab. Students input information into GitLab data such as time spent working on a portion of their project into GitLab and Agile-GitLabCE produces a chart summarizing this data (burndown chart) and summarize the hours spent by all team members. Any team member can access this information at any time. In the Spring course the Agile-GitLabCE tool will be replaced with a new, to be developed tool. The new tool will act as an interface to GitLab. The tool will perform the same actions in GitLab via the GitLab API that the students would have with hopefully less frustrations. The data being collected is no more than what the students and instructors already have access to. The information will be summarized to points such as how frequently the students use the tools provided to them and how frequently they needed to make corrections in the system.
Your response to questions C and D of the Subjects, Inclusion, and Exclusion Criteria section in the submission and the Exclusion/Inclusion Criteria section in both consent forms does not specify that participants must be 18 years or older. Are you enrolling students who are younger than 18 in this study?
- Questions C and D of the Subjects, Inclusion, and Exclusion Criteria section
  - Old text
    
    All students and instructors in the Bucknell CSCI205 course will be allowed to participate.
    
    Anyone not in the Bucknell CSCI205 course will be allowed to participate.
  - New text
    
    All students and instructors in the Bucknell CSCI205 course, 18 years or older, will be allowed to participate.
    
    Any students and instructors not in the Bucknell CSCI205 course or under 18 years old* will be allowed to participate.
    - Due to the level of this course there is very rarely students under 18 years old. For Fall '21, all students are 18 or older.
- Consent forms
  - Old text
    
    Participants in this study must be a current student in the Bucknell CSCI205 course not located in an EU country at the time of completing this survey.
  - New text
    
    Participants in this study must be a current student or instructor in the Bucknell CSCI205 course, 18 years or older, and not located in an EU country at the time of completing this survey.
The "What Is This Study About and What Procedures Will You be Asked to Follow?" Section in Key Information page of the Survey Consent form only discusses how long one of the surveys will take to complete. This is inaccurate as you are asking these participants to complete multiple surveys throughout the semester, and this activity will take longer than 30 minutes to complete as a whole. Please reconcile.
- The consent form has been split into two consent forms. A progress consent for the shorter surveys and a final consent for the longer surveys.
- Text changes:
  - Old Text
    
    Your participation in this survey is expected to last no more than 30 minutes.
  - New Text
    
    Progress:
    
    Your participation in this survey is expected to last no more than 10 minutes. All surveys combined are expected to last no more than 90 minutes.
    
    Final:
    
    Your participation in this survey is expected to last no more than 30 minutes. All surveys combined are expected to last no more than 90 minutes.
The Exclusion/Inclusion Criteria section of the Survey Consent does not include information about the instructors who are also being enrolled in this study. Please reconcile.
- Old text:
  
  Participants in this study must be a current student in the Bucknell CSCI205 course not located in an EU country at the time of completing this survey.
- New text:
  
  Participants in this study must be a current student or instructor in the Bucknell CSCI205 course, 18 years or older, and not located in an EU country at the time of completing this survey.
The Compensation section of the Survey Consent does not state that instructors will not be compensated. Please reconcile.
- Added text:
  
  Instructors will not receive compensation.
The information provided in the current Compensation section in both the Survey Consent form and the submission states that those who do not want to participate can still complete the surveys for extra credit. As the participant's are not signing the consent form, how will you know who enrolled in this study and who did not. Please clarify.
- Added text:
  
  At the end of the survey, you will be presented a web-link to a separate survey if you wish to receive course credit. The two surveys are not linked together through key codes or id values. The second survey will ask for your student id in order to receive credit.
Please make the following revision to Participants Rights section in the Survey Consent. -- Current: You do not waive any of your legal rights by signing this consent form. -- Change to: You do not waive any of your legal rights by agreeing to this consent form
- Done
The Exclusion/Inclusion Criteria section of the Interview Consent does not include information about the instructors who are also being enrolled in this study. Please reconcile.
- Old text:
  
  Participants in this study must be a current student in the Bucknell CSCI205 course not located in an EU country at the time of completing this survey.
- New text:
  
  Participants in this study must be a current student or instructor in the Bucknell CSCI205 course, 18 years or older, and not located in an EU country at the time of completing this survey.
The Compensation section of the Interview Consent does not state that instructors will not be compensated. Please reconcile.
- Added text:
  
  Instructors will not receive compensation.
Are you consenting the class to collect the tool usage data from them? Or should this be included in one of the current consent forms? Currently, students and instructors are not providing consent for their data to be used for research purposes.
- An additional consent form was added
Please provide permission from the Bucknell IRB to conduct this study on campus during class time.
- A letter of permission from the Bucknell IRB has been attached. The letter states:
  
  The Bucknell IRB approves you for data collection, interviewing, and surveying on Bucknell’s campus as part of a research project approved by Georgia Tech’s IRB during the Fall 2021 and Spring 2022 semesters.