General Evaluation of the Computational Biophysics Workshop at Urbana, Illinois

November 1-5, 2010

Questionnaire: Gila Budescu, TCB Group, UIUC, and modified by David Brandon, TCB Group, UIUC
Analysis and report: David Brandon, TCB Group, UIUC

The NIH Resource for Macromolecular Modeling and Bioinformatics is headed by Klaus Schulten, and Co-PIs Z. Luthey-Schulten, L. Kale, E. Tajkhorshid, and A. Aksimentiev. As part of its outreach, the Resource offers workshops to introduce and transfer its programs and technological solutions to the biomedical community. The Resource presented a five-day (November 1-5, 2010) workshop at the Beckman Institute for Advanced Science and Technology at the University of Illinois in Urbana-Champaign, Illinois. Resource faculty provided morning lectures, and teaching assistants and faculty led afternoon hands-on sessions using Resource software, and tutorials consisting of text and computer files.

Workshop lectures were provided by K. Schulten, E. Tajkhorshid, Z. Luthey-Schulten, and C. Chipot. Teaching assistants were graduate students from TCBG and the Luthey-Schulten group. Tutorials and preparation of the laptops was provided by the graduate students and by other Resource staff, and on-site the tutorial sessions were led by the graduate students.  The program of the workshop consisted of lectures and hands-on sessions, with an emphasis on the latter. On the last day of the workshop, participants were asked to complete a general evaluation form consisting of questions about the lectures, hands-on tutorial sessions, outcomes, and overall satisfaction. A copy of the form is available here, with results described below.

In the summary below, participant 'agreement' with a statement is calculated by adding together the 'agree' and 'strongly agree' percentages from the tables below, e.g., in the first item of the first table below agreement is assessed at 100% (26% agree + 74% strongly agree). Due to rounding, some cumulative percentages in the table exceed 100%. The number of participants responding to each question is indicated by the 'N' count in each table. Attendance varied during the workshop, with some attending lectures but not tutorials, and with some days more popular than others. At a maximum the workshop drew 28 participants, hence we will place the response rate for the general evaluation form at about 82%.

I. Outcomes

With regards to outcomes, all participants (100%) indicated that the workshop broadened their understanding of concepts and principles in computational and theoretical biophysics. Nearly all participants (96%) responded that the workshop taught them techniques directly applicable to their career, and that the workshop improved their ability to carry out original research in theoretical and computational biophysics. A majority of participants (91%) also indicated that the material presented in the workshop was relevant to their research, and a majority (74%) felt the workshop significantly improved their computational skills.


N Strongly Disagree Disagree Unsure Agree Strongly Agree
1. The Workshop broadened my understanding of concepts and principles in the field of Computational and Theoretical Biophysics. 23       26% 74%
2. The Workshop improved my ability to carry out original research in the field of Theoretical and Computational Biophysics. 23     4% 35% 61%
3. The Workshop improved significantly my computational skills. 23     22% 39% 35%
4. The Workshop taught me techniques directly applicable to my career. 23     4% 26% 70%
5. The material presented in the Workshop was relevant to my research. 23     9% 26% 65%

II. Lectures

All participants (100%) found that the instructor's subject knowledge was good, that instructors explained the material well, that the instructors stimulated their intellectual curiosity, and that the daily Q & A period was beneficial. A majority of participants (96%) indicated that the range of lectures captured the overall essentials of the field, and that the underlying rationale of the techniques presented was clear. Most participants (91%) found that that instructors provided real-world examples, that lectures were coordinated between instructors, and that lectures incorporated recent developments in the field. A slightly smaller majority (83%) found that the level of the lectures was appropriate.


N Strongly Disagree Disagree Unsure Agree Strongly Agree
1. The instructors’ knowledge of the subjects was good. 23         100%
2. The instructors explained the material well. 23       35% 65%
3. The instructors provided real-world examples. 23     9% 30% 61%
4. The lectures were coordinated between instructors. 23     9% 43% 48%
5. Lectures incorporated recent developments in the field. 23     9% 26% 65%
6. The range of lectures captured the overall essentials of the field. 23     4% 35% 61%
7. The level of the lectures was appropriate. 23     17% 26% 57%
8. The underlying rationale of the techniques presented was clear. 23     4% 35% 61%
9. The instructors stimulated my intellectual curiosity. 23       22% 78%
10. The daily noon Q&A period was beneficial. 23       30% 70%

III. Hands-on Sessions

The hands-on sessions refers to the afternoon tutorial sessions, during which participants completed work on their own laptops. All participants (100%) found that the concrete examples in the tutorials increased understanding of the lectures, that teaching assistants were well-prepared to answer questions, that there were sufficient instructions for the hands-on work, that tutorial options accommodated differing interests of participants, and that tutorial options accommodated differing expertise levels of participants. Nearly all particpants (96%) indicated that hands-on sessions were coordinated with lectures, and that there were enough teaching assistants and instructional staff for participants. Most participants felt that hands-on sessions were an important for the learning process of the workshop (91%), and that the hands-on sessions were long enough (83%).

N Strongly Disagree Disagree Unsure Agree Strongly Agree
1. The hands-on sessions were important for the learning process in the Workshop. 23     9% 13% 78%
2. The concrete examples in the hands-on tutorials increased my understanding of the lectures. 23       30% 70%
3. The hands-on sessions were long enough. 23 4   13% 30% 52%
4. The hands-on sessions were coordinated with the lectures. 23     4% 39% 57%
5. TAs were well-prepared to answer questions. 23       48% 52%
6. There were sufficient instructions to proceed with the hands-on assignments. 23       30% 70%
7. There were enough TAs / instructional staff to help the participants. 23     4% 26% 70%
8. The tutorial options accommodated the differing interests of participants. 23       30% 70%
9. The tutorial options accommodated the differing expertise levels of participants. 23       52% 48%

IV. Environment & Technical Resources

Questions about environment and technical resources refer to the physical context of the workshop (housing, conference room, etc.) and technologies needed to carry off the workshop (computing hardware, software, projection systems, other). All participants (100%) agreed that the software used in the workshop ran well on their laptop, that the lecture room was conducive to learning, and that the conference room projection system was sufficient for lectures. Nearly all those participants (95%) who stayed at the workshop hotel workshop (the Hampton Inn) indicated it provided sufficient accommodations.

N Strongly Disagree Disagree Unsure Agree Strongly Agree
1. The software used in the Workshop ran well on my (circle one: Windows/Mac/Linux) laptop. 23   39% 61%
2. The lecture room was conducive to learning. 23   9% 91%
3. The projection system was sufficient for the lectures. 23   17% 83%
4. The Hamton Inn provided sufficient accommodations (hotel guests only). 19   5%   95%

 
V. Communication and Dissemination

Items about communication and dissemination refer to how TCBG communicates with participants before and during the workshop. All participants (100%) found that instructors were readily available for questions and answers outside of the lecture periods, and that organizational emails before the workshop were helpful. Nearly all participants indicated that the emails about setting up laptops for the workshop were helpful (95%), and that the worskhop website was informative about the event (91%).

N Strongly Disagree Disagree Unsure Agree Strongly Agree
1. Instructors were readily available for Q&A outside the lecture periods. 22       27% 73%
2. The Workshop web site was informative about the event. 23       35% 57%
3. The emails about setting up laptops for the Workshop were helpful. 22 5%     23% 73%
4. The organizational emails before the Workshop were helpful. 22       18% 82%

 

VI. Overall Satisfaction

A final set of questions asked participants about their overall satisfaction with the workshop. All participants (100%) agree that the workshop was well organized, that the workshop addressed their research needs, that the workshop met their expectations, and that they would recommend the workshop to others. A majority of participants (96%) also indicated that the balance between lectures and hands-on work was optimal.


N Strongly Disagree Disagree Unsure Agree Strongly Agree
1. The Workshop was well organized. 23       13% 87%
2. The balance between lectures and hands-on sessions was optimal. 23     4% 26% 70%
3. The Workshop addressed my research needs. 23       52% 48%
4. Overall, the Workshop met my expectations. 23       26% 74%
5. I would recommend this Workshop to others. 23       4% 96%