University of Maryland Extension (UME) 4-H Needs Assessment Tool Kit Overview (FS-2022-0636)

A needs assessment is a systematic research method used to drive community development (Walker et al., 2017). Needs assessments are usually conducted at the start of a new program or after data-informed initiatives have been conducted. Barker et al. (2006) stated that the needs assessment contributed to an educator’s ability to respond to the needs of a county more effectively.

Types of Data to Collect

Needs assessments can be conducted by using data sets from various sources, which can be called “primary data” and “secondary data.” Primary data is gathered from a variety of stakeholder audiences using a formal research approach. Stakeholders can include youth members, youth non-members, volunteers, club leaders, community members, elected officials, administrators, and other interested parties. Secondary data is gathered from sources that have already been collected, analyzed, and shared. This type of data can include population data, school enrollment, census data, and health statistics. According to McCawley (2009), needs assessments can make use of secondary data to support decision-making regarding priority programming needs. The County 4-H Needs Assessment can be adapted by educators for many county-based programs and provides tools to support primary data collection. Additionally, educators can later add secondary source data to create programmatic priority designations.

Educators at the University of Maryland Extension (UME) designed the County 4-H Needs Assessment Tool Kit as a primary data collection tool that can be implemented by 4-H programs in any county using a formal, research-based approach. Maryland is made up of rural, suburban, and urban areas. 4-H educators from three Maryland counties with a mixture of urban, suburban and rural populations developed the needs assessment tool kit to answer the questions, “What are the youth development needs in my county? How can those needs be met with the resources available?” The tool kit combines the use of both quantitative and qualitative data collection processes. This allows the educator to use multiple data sources inform programming decisions. The tool kit has undergone Institutional Review Board (IRB) approval at the University of Maryland to ensure that each included document has a formal data collection protocol with appropriate informed consent.

Audiences and Data Collection Methodology

Youth: As developers and presenters of positive youth development programs, 4-H program educators must gather input from both 4-H member youth and non-member youth regarding topics of interest to them for programming. Therefore, the tool kit contains a paper-based survey that gathers quantitative data from youth regarding topics of interest. The tool kit provides instructions for how educators can assist youth in completing the survey, and includes the verbal consent process that is required for the IRB protocol. The completed surveys can then be entered into a Qualtrics ® survey for data analysis and filtering.

Volunteers: Volunteers serve as the backbone of 4-H, making their perspectives and input regarding county-wide programming extremely important. Specifically, 4-H educators should obtain the volunteers’ perspectives regarding important programs for youth; volunteer professional development needs; how to attract the best and retain 4-H members and volunteers; challenges they face working with 4-H programs; and how the 4-H program should expand within the county.

In order to gain volunteer input on each of these items, the tool kit contains both a quantitative electronic survey instrument to gather input from as many volunteers as possible, as well as a qualitative appreciative inquiry workshop protocol (Fields 2011) that can be used when working with groups of volunteers. The electronic survey protocol includes language that educators can use in email communications to volunteers regarding the survey, as well as the informed consent process. The appreciative inquiry workshop protocol also includes a template invitation and directions on how to conduct the workshop.

Partners and Advisory Councils: Educators should also gain programmatic insights from community partners, advisors, school officials, and other stakeholders regarding youth development priorities when determining programming needs (McCawley 2009). The County 4-H Needs Assessment Tool Kit contains a key informant interview protocol that educators can use during one-on-one interviews or with a focus group to gather qualitative data from these audiences.

Gathering Data

As mentioned above, it is important to gather both qualitative and quantitative data during a needs assessment. It is also important to understand the differences between primary and secondary data sources. Utilizing these different types of methods and data types allows for a more comprehensive needs assessment. The following charts outline each, and explain which tools included in the tool kit collect which types of data.

The tools included in this tool kit were developed in order to standardize data collection over several counties across Maryland. The standardized development of these tools ensures that completeness, validity, consistency, timeliness, and accuracy are of utmost importance when collecting data.

• Barker, W., Reagan, M., & Clyde, J. (2011). Clark County 4-H Needs Assessment and Program Review. Retrieved from http://epubs.nsla.nv.gov/statepubs/epubs/31428003035322.pdf
• Fields, N. I. Strategies for 4-H Youth Development Educators on Outreach Programming. Retrieved from https://extension.umd.edu/resource/strategies-4-h-youth-development-educators-outreach-programming-fs-927
• McCawley, P. (2009). Methods for conducting an educational needs assessment: Guidelines for cooperative extension system professionals. University of Idaho Extension. Retrieved April 12, 2011, from https://www.uidaho.edu/extension/publications/publication-detail?id=bul0870
• Teuteberg, D. and Cummins, M. (2017). Using Community Assessments to Improve 4-H Youth Development Programming Efforts. Journal of Extension, 55(4), 4TOT9.
• Worker, S. M., Schmitt-McQuitty, L., Ambrose, A., Brian, K., Shoenfelder, E., &
  Smith, M. (2017). Multiple-methods needs assessment of California 4-H science
  education programming. Journal of Extension, 55(2), Article 2RIB4. Available at:
  https://www.joe.org/joe/2017april/rb4.php

• Needs Assessment Survey Key
• Informant Interviews
• Appreciative Inquiry Workshops

Thank you for taking time to complete these questions. The purpose of this study is to improve the quality and relevancy of 4-H programming to youth and other future program participants, as well as provide high-quality training to our volunteer workforce.

All of your responses are confidential. If we write a report or article about this research project, the data will be aggregated to protect the identity of individual respondents. There are no known risks associated with participating in this research project. Your participation in this research is completely voluntary. You may choose not to take part at all or answer certain questions. If you decide to participate in this research, you may stop participating at any time. If you decide not to participate in this study or if you stop participating at any time, you will not be penalized or lose any benefits for which you otherwise qualify. This research is being conducted by [insert county educator name and contact information]. If you have any questions about the research study itself, please contact [county educator] at [email address], or at [telephone number].

This research has been reviewed according to the University of Maryland, College Park, Institutional Review Board procedures for research involving human subjects. University of Maryland College Park Institutional Review Board Office, 1204 Marie Mount Hall, College Park, Maryland, 20742 E-mail: irb@umd.edu Telephone: 301-405-0678. The IRBnet Package number is 1138597-1.

By clicking on/answering the following questions you are indicating that you are at least 18 years of age; the research has been explained to you; your questions have been fully answered; and, you freely and voluntarily choose to participate in this research project.

Partnering for Success

Each partner in a pair should ask the other person:

• On a scale of 1 to 5 with “1” being “not at all” and “5” being “exceptional,” how successful would you say the program is at fulfilling its purpose?
• What do you need from the program to help you fulfill the organization’s purpose?
• What do you need from the program to help you fulfill the organization’s purpose?
• How can the program help you achieve our goals?

Envisioning the Future

Each pair should imagine 10 years have passed and the program is exceeding expectations. Each member of the pair should ask the other person:

• How have things changed?
• What new opportunities exist?
• What challenges are you experiencing?

After each of the volunteers have been interviewed, have the pairs find one or two other pairs to form a larger group. This will lead into the next segment.

Combined Pairings for Group Reflection (15 minutes)

During this segment, the group should receive three sheets of newsprint that are individually labeled: inspired service (what’s working; positive impact), partnering for success (do more of or better), and envisioning the future (creating the best path).

Each group member should take no more than a minute to introduce their partner by sharing his/her best experience in the program. Group members should then identify a recorder and a reporter and take 15 minutes to generate a list of items for the categories written on each of the three newsprint pages by using the data generated from the interview sheets. Once the group has completed this process, they will transition to the final segment.

Energizing for the Future (15 minutes)

During this segment, volunteers will review the items on their group’s newsprint lists and decide what statements make them feel the most energized. Give each volunteer nine sticky dots to place next to the statements they feel most strongly about (energy). Ask the volunteers to place three dots next to statements on each newsprint list. Volunteers may place more than one dot on a statement if it is particularly important to them.

Once all the group member’s dots are placed on the three newsprint lists, tabulate the dots to identify the top three statements on each list.
Each group should share the top three statements on their newsprint lists with the larger audience.

A final report generated from the AI session can be shared with the volunteer constituent base and used to enhance the program quality in the future.

Appreciative Inquiry material developed by Dr. Nia Imani Fields (nfields@umd.edu). Fact Sheet FS-997, January 2015

Youth Assent

We would like to invite you to participate in a short survey that will help the program leaders learn more about what you are interested in learning from 4-H programs. This information will also help us better plan and prepare activities for next year.

You do not have to participate in this study if you do not want to. During the survey, you may decide to stop at any time and there will be no issue with your club or University of Maryland.

This survey covers topics that you may be interested in learning about. It will only take you a couple of minutes. We are really interested in which of these topics you would like to learn more about.
If you have any questions at any time, please ask me or one of the other 4-H adults here at the event.

BY COMPLETING THE SURVEY, YOU HAVE DECIDED TO PARTICIPATE AND HAVE LISTENED TO THESE INSTRUCTIONS.

Youth Recruitment & Assent Script For Educator Use

Hi, there! Thanks for stopping by today.

The [Name of County/City] University of Maryland Extension wants to know what types of 4-H programs you are interested in. We would like for you to participate in this needs assessment so we can have programs that will help you develop the skills needed for college and future careers.

I am telling you about this needs assessment study to help you decide whether or not you want to answer these questions. You can ask any questions you have before making up your mind. It is okay to say “No” if you don’t want to be in the study. If you say “Yes”, you can change your mind and quit being in the study at any time.

We are not going to tell anybody what you have to say because your information is confidential. Your participation as a member of Maryland 4-H will not be affected if you participate or decide that you do not want to participate.

OK, if you agree, let’s get this filled out. It will only take you about two minutes.

Youth Survey

1. Are you a current 4-H member?  ☐ Yes  ☐ No
2. How old are you? ______
3. What grade are you in? ______
4. What area / community of [name of County] do you live in? ________
5. I am a [name of County/City] Youth that would be interested in the following 4-H programs:
   ☐ Robotics & Engineering Projects & Contests
   ☐ Filmmaking & Photography
   ☐ Career Planning
   ☐ Animal Science (Goat, Rabbit, Horse, Dairy, etc.)
   ☐ ATV/Bicycle Safety
   ☐ [Name] County 4-H Camp
   ☐ [Name] County 4-H Fair
   ☐ Chemistry Experiments
   ☐ Shooting Sports
   ☐ Community Service/Leadership
   ☐ GPS Technology/Geocaching
   ☐ Science Experiments
   ☐ Arts & Crafts
   ☐ Financial Literacy
   ☐ Public Speaking
   ☐ Helping the Environment/Wildlife
   ☐ Leadership Training (teens)
   ☐ Horticulture (Growing plants)
   ☐ Cooking/Food Science
   ☐ Agriculture Education
   ☐ Healthy Living & Food Preparation
   ☐ Welding/Agriculture Mechanics
   ☐ Genes, DNA and Biotechnology
   ☐ Fashion Design and Show
   ☐ Soil Science & Technology
   ☐ Microbiology
   ☐ Forestry/Tree Identification
   ☐ Scrapbooking
   ☐ Coding/Computer Science

Note: There are several ways to obtain paper format, either by requesting access to the Microsoft© Publisher files or downloading the PDF. Qualtrics survey template: If you are a UME employee with a Qualtrics account, the template is available in the UME Library 4-H folder. If you are not, you can request template access by contacting Vernelle Mitchell-Hawkins at vmh@umd.edu.

Appreciative Inquiry (AI) Protocol

Informed Consent:

Read the informed 4-H Adult Volunteer Consent statement to the group. Have copies available for participants to take with them. Please answer any questions they may have about the research.

Instructions for Educator:

One way to engage volunteers in program assessment is to integrate Appreciative Inquiry (AI) sessions into volunteer development and training opportunities. You can facilitate an AI session during volunteer development training by dividing the session into three segments:

1. paired groupings for individual program reflection;
2. combined pairings for group reflection; and
3. energizing for the future.

Paired Groupings for Individual Program Reflection (20 minutes)

Within this segment, volunteers divide into pairs for reflective interviews. Both volunteers should have about 10 minutes each to serve as interviewer and interviewee. Potential topics and questions for this reflective survey include:

Inspired Service – Recalling a Best Experience

Each participant should ask the other member of his/her pair to think about their interactions and engagements with 4-H. The interviewer should ask their partner to tell a story about his/her best experience with 4-H. Suggested questions are:

• What were you doing?
• Who were you volunteering with?
• What made it successful?
• What was the impact on you and/or your community?

Appreciative Inquiry Workshop Participant Recruitment Letter

Dear Volunteer:

As part of our volunteer training workshop on [date], we are going to have an Appreciative Inquiry session to focus on inspired service, partnering for success, and envisioning the future. During this interactive session, we are going to solicit your ideas about best practices that we should be engaged in with our volunteer development strategies. This Appreciative Inquiry session is one part of our overall needs assessment research study for 4-H adult volunteers.

We would like to invite you to attend this workshop and participate in this research study. This will help our 4-H Educators and Specialists learn more about you are interested in learning from 4-H programs. This information will also help us better plan and prepare activities for next year.

You do not have to attend this Appreciative Inquiry workshop and be in this study if you do not want to. If you elect to participate, you may decide to stop at any time and there will be no issue with your volunteer work or participating in the rest of the training. We are sending to you the informed consent statement that gives you more information.

Please be sure to indicate on your registration that you want to be part of the Appreciative Inquiry workshop and research study. If you have any questions, please contact:

[Educator Name, Address, Email, Telephone]

Interview Protocol

Introductory Text

Good Morning/Afternoon!

Again, let me thank you for taking your valuable time to talk with me about the needs, challenges, and opportunities of 4-H in [Name of County].

Let me go over the informed consent statement with you (please read and give a copy to the interviewee).

As a reminder, I am recording the session only to help me take notes of our conversation. As soon as I complete the transcription of our conversation, I will destroy this audio recording. If, for any reason, you do not want me to record, please let me know.

Let’s get started.

Existing Partner Questions:

1. What do you see as the biggest challenges facing [insert county/city name] youth in the past 5 years?
2. What has 4-H been doing well to help youth meet these challenges?
3. What else should 4-H be doing to help youth meet these challenges?
4. If you had $100,000 to grow a 4-H youth development program/youth development program in [insert county/city name], what would it look like?
   1. Probe: Where would you get started?
   2. Probe: Who would be involved?
   3. Probe: Where should the program expand in order to remain relevant?
   4. Probe: What’s emerging and how do we adapt to meet those needs?
   5. Probe: Is there a larger community need that we should be addressing in our work with youth?
   6. Probe: Do you think there are groups of youth that are under-served in our county? Who are they?
5. How important do you think these topics are for youth in [insert county/city name]?
   1. Building community and civic engagement 
      1  2  3  4
   2. Development leadership skills for life
      1  2  3  4
   3. Nurturing social empowerment and resilience
      1  2  3  4
   4. Improving college and workforce readiness
      1  2  3  4
   5. Fostering exploration and creativity in arts and sciences
      1  2  3  4
   6. Promoting healthy lifestyle and self-acceptance
      1  2  3  4
6. What are the barriers that you see pertaining to youth development in [Insert County/City name]?
7. Is there another key person you would recommend that I should talk to?
8. Is there anything else that you want to tell me that I haven’t asked you about?
9. What organizations/corporations could we approach for sponsorship and assistance?

New Partner Questions:

1. Could you tell me a little bit about what your organization is doing (in regards to youth issues) in [County/City name]?
2. What do you see as the biggest challenges facing [County/City name] youth in the past 5 years?
3. Tell me what you know about the [County/City name] 4-H program.
4. If you had $100,000 to grow a 4-H youth development program/youth development program in [County/City name], what would it look like?
   1. Probe: Where would you get started?
   2. Probe: Who would be involved?
   3. Probe: Where should the program expand in order to remain relevant?
   4. Probe: What’s emerging and how do we adapt to meet those needs?
   5. Probe: Is there a larger community need that we should be addressing in our work with youth?
5. On a scale of 1 to 4, with 1 being not important, 2 being a little important, 3 being important, and 4 being very important, how would you rate the importance of the following topics for youth in [County/City name]?
   1. Building community and civic engagement
      1  2  3  4
   2. Development leadership skills for life
      1  2  3  4
   3. Nurturing social empowerment and resilience
      1  2  3  4
   4. Improving college and workforce readiness
      1  2  3  4
   5. Fostering creativity in arts and sciences
      1  2  3  4
   6. Promoting healthy lifestyle and self-acceptance
      1 2 3 4
6. What are the barriers that you see pertaining to youth development in [County/City name]?
7. Is there another key person you would recommend that I should talk to?
8. Is there anything else that you want to tell me that I haven’t asked you about?
9. What organizations/corporations could we approach for sponsorship and assistance?

Recruitment Email

Dear [Participant name],

University of Maryland Extension (UME) is working to better understand the needs of youth in [name of county]. I am interviewing key stakeholders (either existing or potential) like you who can or will be critical partners in youth development programs.

I would like to schedule an interview/focus group with you during the month of [month] that would only take 30-45 minutes. I would be happy to come to your office. Please let me know via a reply to this email whether you are or are not willing to be interviewed. If you say yes, I will follow up to find the best date and time for you.

Thanks for your consideration, and I hope you are willing to help with this important research in UME 4-H Youth Development.

[Name]
[Contact Information]

Pre-Notification Letter

Dear [County/City name] 4-H Volunteer,

Thank you for the work that you provide for the 4-H youth in [County/City name]. We know from the research that young people significantly benefit from having caring adults in their lives.

Within the next week, you will be receiving a letter and survey from me that seeks to determine program priority areas and the training topics that you consider most important for your own professional development. We also want to know what strategies you think will help us attract and retain youth in 4-H, as well as to help recruit and retain 4-H adult leaders.

The survey will only take about 5 minutes of your time. You will also have the option to complete it on line. Your answers are confidential and, in no way, will your individual responses be identified with you.

By providing us with your feedback, we will be better able to strengthen 4-H programs in [County/city name].

Sincerely,

Name of County/City Educator
Address
Telephone Number
Email Address

Notification Letter

Dear [County/City name] 4-H Volunteer,

About one week ago, you received a letter from me letting you know that we would be sending this survey to you.

This is a research study to find out what types of 4-H programs you are interested in offering, what your professional development needs are, and strategies that can attract and retain both 4-H members and adult volunteers.

The survey will only take about 5 minutes of your time. Your answers are confidential and, in no way, will your individual answers be identified with you. All of your responses are confidential. Please complete the survey by [date].

You have the option to complete this survey on-line if you prefer. The link to the survey is: [LINK]

[If paper based]: Please read the consent statement on the back of this letter. [If electronic based, the words “consent statement” will be a link to the file]: Please read this consent statement before you click on next.

Once again, thank you for the hard work that you provide for the 4-H youth in [County/City name]. By providing us with your feedback, we will be better able to strengthen 4-H programs in [County/City name].

Sincerely,

Name of County/City Educator
Address
Telephone Number
Email Address

Reminder Letter

Dear [County/City name] 4-H Volunteer,

Approximately two weeks ago, you received a 4-H Club Leader Needs Assessment Survey. Several have completed the survey, but we have not heard from you.

This is a research study to find out what types of 4-H programs you are interested in offering, what your professional development needs are, and strategies that can attract and retain both 4-H members and adult volunteers.

The survey will only take about 5 minutes of your time. Your answers are confidential and, in no way, will your individual answers be identified with you. All of your responses are confidential. You have the option to complete this survey on-line if you prefer. The link to the survey is: [LINK]

If you need another paper copy, please call our [County/City name] office at [telephone number] and we will send one to you.

Your feedback is important to us. Please complete the online survey by [date]. Thank you for your help.

Sincerely,

Name of County/City Educator
Address
Telephone Number
Email Address

Volunteer Survey Instrument

What strategies do you think will help us to attract youth and keep them interested in 4-H programs?

☐ Use social media sites hosted by the kids
☐ Involve parents
☐ Ask the kids for feedback on a regular basis
☐ Ask the kids about what is important to them
☐ Contact schools about the benefits of 4-H
☐ Contact local organizations to promote 4-H

What types of strategies do you think will help us to attract and keep valuable volunteers in [insert county/city name] 4-H programs?

☐ Have paperwork done in a timely fashion
☐ Make the volunteer feel valued
☐ Make sure that the volunteer is not overwhelmed
☐ Make a personal connection with each volunteer
☐ Encourage volunteer buy-in by asking volunteers what is important to them with regards to the 4-H program

What strategies do you think will help us to attract youth and keep them interested in 4-H programs?

☐ Use social media sites hosted by the kids
☐ Involve parents
☐ Ask the kids for feedback on a regular basis
☐ Ask the kids about what is important to them
☐ Contact schools about the benefits of 4-H
☐ Contact local organizations to promote 4-H

What do you see as the challenges or problems when working with 4-H youth development programs in [County/City name]?

☐ Kids today are very busy with activities other than 4-H
☐ Parents don't get involved with 4-H
☐ People don't know what 4-H can offer to youth
☐ On-line materials are not easy to use
☐ Current 4-H event information is not accurate
☐ Registration system is not intuitive to use
☐ Youth are unable to travel long distances for events/programs

Which of the following strategies do you think 4-H needs to do in order to expand programs in areas that you think are important?

☐ Recruit more volunteers to help
☐ Expand clubs in the county
☐ Recruit volunteers for specific topic areas in which they are interested
☐ Enhance on-line tracking system
☐ Mentor adult volunteers who are new to 4-H
☐ Get 4-H alumni involved

What other comments, concerns, and/or ideas would you like to share with us about how to develop a strong 4-H youth development program in [County/City name]?  _________________

Note: There are several ways to obtain paper format, either by requesting access to the Microsoft© Publisher files or downloading the PDF. Qualtrics survey template: If you are a UME employee with a Qualtrics account, the template is available in the UME Library 4-H folder. If you are not, you can request template access by contacting Vernelle Mitchell-Hawkins at vmh@umd.edu.