Building Alaska's Science and Engineering Pipeline: Evaluation of the Alaska Native Science & Engineering Program

ERIC Educational Resources Information Center

Bernstein, Hamutal; Martin, Carlos; Eyster, Lauren; Anderson, Theresa; Owen, Stephanie; Martin-Caughey, Amanda

2015-01-01

The Urban Institute conducted an implementation and participant-outcomes evaluation of the Alaska Native Science & Engineering Program (ANSEP). ANSEP is a multi-stage initiative designed to prepare and support Alaska Native students from middle school through graduate school to succeed in science, technology, engineering, and math (STEM)…

Integrating design science theory and methods to improve the development and evaluation of health communication programs.

PubMed

Neuhauser, Linda; Kreps, Gary L

2014-12-01

Traditional communication theory and research methods provide valuable guidance about designing and evaluating health communication programs. However, efforts to use health communication programs to educate, motivate, and support people to adopt healthy behaviors often fail to meet the desired goals. One reason for this failure is that health promotion issues are complex, changeable, and highly related to the specific needs and contexts of the intended audiences. It is a daunting challenge to effectively influence health behaviors, particularly culturally learned and reinforced behaviors concerning lifestyle factors related to diet, exercise, and substance (such as alcohol and tobacco) use. Too often, program development and evaluation are not adequately linked to provide rapid feedback to health communication program developers so that important revisions can be made to design the most relevant and personally motivating health communication programs for specific audiences. Design science theory and methods commonly used in engineering, computer science, and other fields can address such program and evaluation weaknesses. Design science researchers study human-created programs using tightly connected build-and-evaluate loops in which they use intensive participatory methods to understand problems and develop solutions concurrently and throughout the duration of the program. Such thinking and strategies are especially relevant to address complex health communication issues. In this article, the authors explore the history, scientific foundation, methods, and applications of design science and its potential to enhance health communication programs and their evaluation.

A Review of Resources for Evaluating K-12 Computer Science Education Programs

ERIC Educational Resources Information Center

Randolph, Justus J.; Hartikainen, Elina

2004-01-01

Since computer science education is a key to preparing students for a technologically-oriented future, it makes sense to have high quality resources for conducting summative and formative evaluation of those programs. This paper describes the results of a critical analysis of the resources for evaluating K-12 computer science education projects.…

Miramar College Program Evaluation: Fire Science.

ERIC Educational Resources Information Center

Moriyama, Bruce; Brumley, Leslie

Qualitative and quantitative data are presented in this evaluation of the curricular, personnel, and financial status of Miramar College's program in fire sciences. The report first provides the results of an interview with the program chairperson, which sought information on program objectives and goals and their determination, the extent to…

The Student-to-Student Chemistry Initiative: Training High School Students To Perform Chemistry Demonstration Programs for Elementary School Students

NASA Astrophysics Data System (ADS)

Voegel, Phillip D.; Quashnock, Kathryn A.; Heil, Katrina M.

2004-05-01

The Student-to-Student Chemistry Initiative is an outreach program started in the fall of 2001 at Midwestern State University (MSU). The oncampus program trains high school science students to perform a series of chemistry demonstrations and subsequently provides kits containing necessary supplies and reagents for the high school students to perform demonstration programs at elementary schools. The program focuses on improving student perception of science. The program's impact on high school student perception is evaluated through statistical analysis of paired preparticipation and postparticipation surveys. The surveys focus on four areas of student perception: general attitude toward science, interest in careers in science, science awareness, and interest in attending MSU for postsecondary education. Increased scores were observed in all evaluation areas including a statistically significant increase in science awareness following participation.

Working with Science Teachers to Transform the Opportunity Landscape for Regional and Rural Youth: A Qualitative Evaluation of the Science in Schools Program

ERIC Educational Resources Information Center

Sheehan, Grania R.; Mosse, Jennifer

2013-01-01

This article reports on a qualitative evaluation of the Science in Schools program; a suite of science based activities delivered by staff of a regional university campus and designed to provide professional development for science teachers working in non-metropolitan schools in a socioeconomically disadvantaged region of Australia. The research…

From Implementation to Outcomes to Impacts: Designing a Comprehensive Program Evaluation

NASA Astrophysics Data System (ADS)

Shebby, S.

2015-12-01

Funders are often interested in learning about the impact of program activities, yet before the impacts are determined, educational evaluations should first examine program implementation and outcomes. Implementation evaluation examines how and the extent to which program activities are delivered as intended, including the extent to which activities reached the targeted participants. Outcome evaluation is comprised of a systematic examination of the effects that a program has on program participants, such as changes in knowledge, attitudes, beliefs, values, and behaviors. In this presentation, presenters will share insights on evaluating the implementation, outcomes, and impacts associated with an online science curriculum for K-2 students. The science curriculum was designed to provide students with access to science concepts and skills in an interactive and innovative environment, and teachers with embedded, aligned, and on-demand professional development. One of the most important—and challenging—steps in this evaluation was to select outcomes that were well-defined, measurable, and aligned to program activities, as well as relevant to program stakeholders. An additional challenge was to measure implementation given limited access to the classroom environment. This presentation will include a discussion of the process evaluators used to select appropriate implementation indicators and outcomes (teacher and student), design an evaluation approach, and craft data collection instruments. Although examples provided are specific to the K-2 science intervention, the best practices discussed are pertinent to all program and event evaluations. Impact evaluation goes beyond implementation and outcome evaluation to inform whether a program is working or not. It requires a comparison group to inform what outcomes would have been in the absence of the intervention. As such, this presentation will also include a discussion of impacts, including how impacts are defined and measured, and some common challenges in evaluating program impact.

The Australian Science Facilities Program: A Study of Its Influence on Science Education in Australian Schools.

ERIC Educational Resources Information Center

Ainley, John G.

This report is a study conducted by the Australian Council for Educational Research to evaluate the influence of science material resources, provided under the Australian Science Facilities Program, on science education in Australia. Under the Australian Science Facilities Program some $123 million was spent, between July 1964 and June 1975, on…

Grassroots Engagement and the University of Washington: Evaluating Science Communication Training Created by Graduate Students for Graduate Students

NASA Astrophysics Data System (ADS)

Rohde, J. A.; Clarkson, M.; Houghton, J.; Chen, W.

2016-12-01

Science graduate students increasingly seek science communication training, yet many do not have easy access to training programs. Students often rely on a "do it yourself" approach to gaining communication skills, and student created science communication programs are increasingly found at universities and institutions across the U.S. In 2010, graduate students at the University of Washington led a grassroots effort to improve their own communication and outreach by creating "The Engage Program." With a focus on storytelling and public speaking, this graduate level course not only trains students in science communication but also gives them real world experience practicing that training at a public speaker series at Town Hall Seattle. The Engage Program was fortunate in that it was able to find institutional champions at University of Washington and secure funding to sustain the program over the long-term. However, many grassroots communication programs find it difficult to gain institutional support if there is a perceived lack of alignment with university priorities or lack of return on investment. In order to justify and incentivize institutional support for instruction in science communication, student leaders within the program initiated, designed and carried out an evaluation of their own program focused on assessing the impact of student communication, evaluating the effectiveness of the program in teaching communication skills, and quantifying the benefits of communication training to both the students and their institution. Project leaders created the opportunity for this evaluation by initiating a crowdfunding campaign, which has helped to further engage public support of science communication and incentivized student participation in the program, and may also inspire future program leaders to pursue similar program optimizations.

Development and Implementation of Science and Technology Ethics Education Program for Prospective Science Teachers

ERIC Educational Resources Information Center

Rhee, Hyang-yon; Choi, Kyunghee

2014-01-01

The purposes of this study were (1) to develop a science and technology (ST) ethics education program for prospective science teachers, (2) to examine the effect of the program on the perceptions of the participants, in terms of their ethics and education concerns, and (3) to evaluate the impact of the program design. The program utilized…

Evaluation of the Alaska Native Science & Engineering Program (ANSEP). Research Report

ERIC Educational Resources Information Center

Bernstein, Hamutal; Martin, Carlos; Eyster, Lauren; Anderson, Theresa; Owen, Stephanie; Martin-Caughey, Amanda

2015-01-01

The Urban Institute conducted an implementation and participant-outcomes evaluation of the Alaska Native Science & Engineering Program (ANSEP). ANSEP is a multi-stage initiative designed to prepare and support Alaska Native students from middle school through graduate school to succeed in science, technology, engineering, and math (STEM)…

Bilingual Mathematics and Science Achievement, 1988-89. Evaluation Section Report.

ERIC Educational Resources Information Center

Berney, Tomi D.; Barrera, Marbella

This report documents the evaluation of the Bilingual Mathematics and Science Achievement Program (Project BMSA) for students of limited English proficiency. The bilingual program was designed to provide intensive mathematics and science instruction, using mastery level concepts, in the native language and to incorporate mathematics and science…

Science: It's Elementary. Year Two Evaluation Report

ERIC Educational Resources Information Center

Banilower, Eric R.; Fulp, Sherri L.; Warren, Camille L.

2008-01-01

This report summarizes the activities and findings of the external evaluation of the "Science: It's Elementary" (SIE) program in the period June 2007 through May 2008. The SIE program is managed by ASSET Inc. and overseen by the Pennsylvania Department of Education. SIE is an initiative aimed at improving elementary science instruction…

A Field-Based Curriculum Model for Earth Science Teacher-Preparation Programs.

ERIC Educational Resources Information Center

Dubois, David D.

1979-01-01

This study proposed a model set of cognitive-behavioral objectives for field-based teacher education programs for earth science teachers. It describes field experience integration into teacher education programs. The model is also applicable for evaluation of earth science teacher education programs. (RE)

The contributions and future direction of Program Science in HIV/STI prevention.

PubMed

Becker, Marissa; Mishra, Sharmistha; Aral, Sevgi; Bhattacharjee, Parinita; Lorway, Rob; Green, Kalada; Anthony, John; Isac, Shajy; Emmanuel, Faran; Musyoki, Helgar; Lazarus, Lisa; Thompson, Laura H; Cheuk, Eve; Blanchard, James F

2018-01-01

Program Science is an iterative, multi-phase research and program framework where programs drive the scientific inquiry, and both program and science are aligned towards a collective goal of improving population health. To achieve this, Program Science involves the systematic application of theoretical and empirical knowledge to optimize the scale, quality and impact of public health programs. Program Science tools and approaches developed for strategic planning, program implementation, and program management and evaluation have been incorporated into HIV and sexually transmitted infection prevention programs in Kenya, Nigeria, India, and the United States. In this paper, we highlight key scientific contributions that emerged from the growing application of Program Science in the field of HIV and STI prevention, and conclude by proposing future directions for Program Science.

Ethnographic Evaluation of the MESA Program at a South-Central Phoenix High School.

ERIC Educational Resources Information Center

Jaramillo, James A.

MESA (Mathematics, Engineering, and Science Achievement) is a program designed to increase the number of underrepresented ethnic groups in professions related to mathematics, engineering, and the physical sciences. This paper describes and evaluates the MESA program at Jarama High School, Phoenix (Arizona), using informal interviews and…

Charting the Impact of Federal Spending for Education Research: A Bibliometric Approach

ERIC Educational Resources Information Center

Milesi, Carolina; Brown, Kevin L.; Hawkley, Louise; Dropkin, Eric; Schneider, Barbara L.

2014-01-01

Impact evaluation plays a critical role in determining whether federally funded research programs in science, technology, engineering, and mathematics are wise investments. This paper develops quantitative methods for program evaluation and applies this approach to a flagship National Science Foundation-funded education research program, Research…

Evaluating the Effectiveness of the 2001-2002 NASA CONNECT(tm) Program

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Frank, Kari Lou; Lambert, Matthew A.; Williams, Amy C.

2002-01-01

NASA CONNECT(tm) is a research and standards-based, integrated mathematics, science, and technology series of 30-minute instructional distance learning (television and web-based) programs for students in grades 6-8. Respondents who evaluated the programs in the 2001-2002 NASA CONNECT(tm) series reported that (1) they used the programs in the series; (2) the goals and objectives for the series were met; (3) the programs were aligned with the national mathematics, science, and technology standards; (4) the program content was developmentally appropriate for grade level; and (5) the programs in the series enhanced and enriched the teaching of mathematics, science, and technology.

Evaluating the Effectiveness of the 2002-2003 NASA CONNECT(TM) Program

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Lambert, Matthew A.; Williams, Amy C.

2004-01-01

NASA CONNECT is a research-, inquiry-, and standards-based, integrated mathematics, science, and technology series of 30-minute instructional distance learning (television and web-based) programs for students in grades 6 8. Respondents who evaluated the programs in the 2002 2003 NASA CONNECT series reported that (1) they used the programs in the series; (2) the goals and objectives for the series were met; (3) the programs were aligned with the national mathematics, science, and technology standards; (4) the program content was developmentally appropriate for grade level; and (5) the programs in the series enhanced and enriched the teaching of mathematics, science, and technology.

Evaluation of the Long-Term Impact of a University High School Summer Science Program on Students' Interest and Perceived Abilities in Science

ERIC Educational Resources Information Center

Markowitz, Dina G.

2004-01-01

Many biomedical research universities have established outreach programs for precollege students and teachers and partnerships with local school districts to help meet the challenges of science education reform. Science outreach programs held in university research facilities can make science more exciting and innovative for high school students…

Identfying the Needs of Pre-Service Classroom Teachers about Science Teaching Methodology Course in Terms of Parlett's Illuminative Program Evaluation Model

ERIC Educational Resources Information Center

Çaliskan, Ilke

2014-01-01

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

Identfying the Needs of Pre-Service Classroom Teachers about Science Teaching Methodology Courses in Terms of Parlett's Illuminative Program Evaluation Model

ERIC Educational Resources Information Center

Çaliskan, Ilke

2014-01-01

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

Steps toward a Formative Evaluation of NSDL. Technical Report

ERIC Educational Resources Information Center

Bikson, Tora K.; Kalra, Nidhi; Galway, Lionel A.; Agnew, Grace

2011-01-01

The National Science Foundation's (NSF) National Science Digital Library/Distributed Learning (NSDL) program turned 10 years old in 2010. This report presents results of a preliminary program evaluation carried out by RAND and is organized around three principal goals: (1) Provide an initial evaluation of NSDL based on existing information…

The Stanford Medical Youth Science Program: educational and science-related outcomes.

PubMed

Crump, Casey; Ned, Judith; Winkleby, Marilyn A

2015-05-01

Biomedical preparatory programs (pipeline programs) have been developed at colleges and universities to better prepare youth for entering science- and health-related careers, but outcomes of such programs have seldom been rigorously evaluated. We conducted a matched cohort study to evaluate the Stanford Medical Youth Science Program's Summer Residential Program (SRP), a 25-year-old university-based biomedical pipeline program that reaches out to low-income and underrepresented ethnic minority high school students. Five annual surveys were used to assess educational outcomes and science-related experience among 96 SRP participants and a comparison group of 192 youth who applied but were not selected to participate in the SRP, using ~2:1 matching on sociodemographic and academic background to control for potential confounders. SRP participants were more likely than the comparison group to enter college (100.0 vs. 84.4 %, p = 0.002), and both of these matriculation rates were more than double the statewide average (40.8 %). In most areas of science-related experience, SRP participants reported significantly more experience (>twofold odds) than the comparison group at 1 year of follow-up, but these differences did not persist after 2-4 years. The comparison group reported substantially more participation in science or college preparatory programs, more academic role models, and less personal adversity than SRP participants, which likely influenced these findings toward the null hypothesis. SRP applicants, irrespective of whether selected for participation, had significantly better educational outcomes than population averages. Short-term science-related experience was better among SRP participants, although longer-term outcomes were similar, most likely due to college and science-related opportunities among the comparison group. We discuss implications for future evaluations of other biomedical pipeline programs.

Evaluating a National Science and Technology Program Using the Human Capital and Relational Asset Perspectives

ERIC Educational Resources Information Center

Hung, Chia-Liang; Chou, Jerome Chih-Lung; Roan, Hung-Wei

2010-01-01

The purpose of this research is to evaluate the performance of the National Science and Technology Program (NSTP) by targeting the Taiwan National Telecommunication Program (NTP) initiated in 1998. The Taiwan telecommunications industry has prospered, currently occupying key positions in global markets even though NTP seldom contributes positively…

Integrated Science in the Seychelles: An Evaluation.

ERIC Educational Resources Information Center

Brophy, Michael; Pillay, Patrick

1986-01-01

Provides an overview of the educational program of the Seychelles and focuses on an evaluation of the final phase (P7-P9) of the nine-year school program. Reports how findings from content analyses of materials, teacher and student interviews, and student test results were used to develop the new Seychelles Integrated Science program. (ML)

Students' Reactions to the Use of Animals as Instructional Tools for Science

ERIC Educational Resources Information Center

Gurzau, Vickie Anne

2013-01-01

Teaching science to students with special needs requires different approaches. A program at the study site supplemented packaged science kits with animal-assisted instruction, but such an approach was never evaluated. The purpose of this study was to provide a formative program evaluation documenting students' reactions to the use of animals…

Factors in the Admissions Process Influencing Persistence in a Master's of Science Program in Marine Science

ERIC Educational Resources Information Center

Dore, Melissa L.

2017-01-01

This applied dissertation was conducted to provide the graduate program in marine sciences a valid predictor for success in the admissions scoring systems that include the general Graduate Record Exam. The dependent variable was persistence: successfully graduating from the marine sciences master's programs. This dissertation evaluated other…

Evaluation of the Academy of Math, Science, and Engineering at Luther Burbank High School During the 1984-85 School Year. Evaluation Report No. 21.

ERIC Educational Resources Information Center

Sacramento City Unified School District, CA.

The Academy of Math, Science, and Engineering was established at the Luther Burbank High School of Sacramento, California as a rigorous and competitive academic alternative program. This report contains an evaluation of the second year (1984-85) of the program. Program accomplishments are reviewed in the categories of: (1) student enrollment; (2)…

Evaluation of the Science, Technology, and Engineering Leadership Program, Year Three

ERIC Educational Resources Information Center

Wolanin, Natalie; Wade, Julie

2014-01-01

The Office of Shared Accountability conducted an evaluation of the implementation of the third and final year (2012-2013) of the "Science, Technology, and Engineering Leadership Program" (STELP) in Montgomery County (Maryland) Public Schools (MCPS). Funding for STELP, including the evaluation study, is provided by a grant from the Howard…

Evaluating a Graduate Professional Development Program for Informal Science Educators

ERIC Educational Resources Information Center

Lake, Jeremy Paul

2017-01-01

This study is an examination and evaluation of the outcomes of a series of courses that I helped build to create a graduate certificate. Specifically, I wanted to evaluate whether or not the online iteration of the "Informal Science Institutions Environmental Education Graduate Certificate Program" truly provided the long term…

Evaluation of the Science, Technology, and Engineering Leadership Program, Year Two

ERIC Educational Resources Information Center

Wolanin, Natalie L.; Wade, Julie H.

2013-01-01

The Office of Shared Accountability (OSA) conducted an evaluation of the implementation of the second year (2011-2012) of the Science, Technology, and Engineering Leadership Program (STELP) in Montgomery County (Maryland) Public Schools (MCPS). Funding for STELP, including the evaluation study, is provided by a grant from the Howard Hughes Medical…

Girls' Science Investigations (GSI) New Haven: Evaluating the Impact

NASA Astrophysics Data System (ADS)

Knodell, Claire; Fleming, Bonnie

2009-05-01

Girls' Science Investigations (GSI) New Haven seeks to empower the girls of today to shape the science of tomorrow. Funded by the NSF and Yale University and held at Yale, this program was designed to motivate, empower, and interest middle school girls in developing the skills required to pursue a career in science during a day-long investigation of the session's featured topic in science. Yale students and female professors act as mentors and guide younger girls through an environment for understanding and exploring various disciplines of science through hands-on activities in a laboratory setting. GSI strives to close the gap between males and females one action-packed Saturday at a time. This paper evaluates the success of the program. Student participant evaluations over the past 2 years coupled with student testimony and GSI coordinator, instructors', and volunteers' interviews allowed for an analysis of GSI's ability to inspire girls to pursue careers in science. The data indicates that a majority of girls who attended the program were more inclined to continue their study of science. The positive results are detailed in the following paper which points to the hands-on activities and enthusiasm of instructors as integral to the program's success.

Evaluating a Systemic Reform Project at the School District Level. Interim Report for the Fresno Systemic Program.

ERIC Educational Resources Information Center

Calhoun, Dave

Systemic reform of mathematics and science education in K-12 schools, sponsored by the National Science Foundation (NSF), was instituted in 1991. Built into the initiatives were guidelines for local (internal) evaluation of programs. This paper is a summary of the evaluation conceptualizations and efforts of one evaluator at the Fresno Unified…

Evaluation of the National Science Foundation Graduate Teaching Fellows in K-12 Education (GK-12) Program.

ERIC Educational Resources Information Center

Mitchell, Julia; Levine, Roger; Gonzalez, Raquel; Bitter, Catherine; Webb, Norman; White, Paul

The GK-12 program of the National Science Foundation is an innovative program for enriching the value of graduate and advanced undergraduate students' education while simultaneously enriching science and mathematics teaching at the K-12 level. GK-12 is a fellowship program that offers graduate students and advanced undergraduates the opportunity…

The development and validation of The Inquiry Science Observation Coding Sheet.

PubMed

Brandon, P R; Taum, A K H; Young, D B; Pottenger, F M

2008-08-01

Evaluation reports increasingly document the degree of program implementation, particularly the extent to which programs adhere to prescribed steps and procedures. Many reports are cursory, however, and few, if any, fully portray the long and winding path taken when developing evaluation instruments, particularly observation instruments. In this article, we describe the development of an observational method for evaluating the degree to which K-12 inquiry science programs are implemented, including the many steps and decisions that occurred during the development, and present evidence for the reliability and validity of the data that we collected with the instrument. The article introduces a method for measuring the adherence of inquiry science implementation and gives evaluators a full picture of what they might expect when developing observation instruments for assessing the degree of program implementation.

Evaluation of the Science Enrichment Activities (SEA) Program: A Decision Oriented Model.

ERIC Educational Resources Information Center

Linn, Marcia C.

1978-01-01

Three questions guided an evaluation of sixth and eighth grade science enrichment activities: (1) Does a free choice interactive program affect cognitive abilities? (2) Do students in a free choice program make predictable selections of activities based on their age, sex, or ability level? and (3) Are specific student choices associated with…

Evaluation of a District-wide Inservice Professional Development Program for Teaching Science: Challenges Faced and Lessons Learned.

ERIC Educational Resources Information Center

Dass, Pradeep Maxwell

1999-01-01

Nationwide dissemination of the Iowa Chautauqua Model for inservice professional development of K-12 science teachers has led to new professional development programs in many states. Discusses a formative evaluation of the implementation of the Collier Chautauqua Program (CCP) which focuses on teacher enhancement resulting from participation in…

Evaluation of a District-Wide Inservice Professional Development Program for Science Teachers: Challenges Faced and Lessons Learned.

ERIC Educational Resources Information Center

Dass, Pradeep Maxwell

Nation-wide dissemination of the Iowa Chautauqua Model for inservice professional development of K-12 science teachers has led to new professional development programs in many states. The Collier Chautauqua Program (CCP) implemented the Iowa Chautauqua model at the district level in Collier County, Florida. A formative evaluation of the…

A Controlled Evaluation of a High School Biomedical Pipeline Program: Design and Methods

ERIC Educational Resources Information Center

Winkleby, Marilyn A.; Ned, Judith; Ahn, David; Koehler, Alana; Fagliano, Kathleen; Crump, Casey

2014-01-01

Given limited funding for school-based science education, non-school-based programs have been developed at colleges and universities to increase the number of students entering science- and health-related careers and address critical workforce needs. However, few evaluations of such programs have been conducted. We report the design and methods of…

The Inquiry Based Science and Technology Education Program (IN-STEP): The Evaluation of the First Year

ERIC Educational Resources Information Center

Corcoran, Thomas B.

2008-01-01

This is the first report on the evaluation of the Inquiry Based Science and Technology Education Program (IN-STEP), an innovative and ambitious science education initiative for lower secondary schools being undertaken by a public-private partnership in Thailand funded by MSD-Thailand, an affiliate of Merck & Co. IN-STEP is a public-private…

Evaluation and capacity building to improve precollege science and mathematics achievement in the US: 10 CFR, Part 605. Technical progress report, June--December 1992

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1992-12-31

The National Center for Improving Science Education has undertaken activities to achieve evaluation goals for DOE`s Precollege programs: develop means to determine program quality; develop means for determining the contribution of DOE precollege programs to both teacher enhancement and student achievement; provide evaluation designs and instruments and reports of program quality and impact; and strengthen both DOE`s and the Labs` capacity to do both short- and long-term planning as well as deliver effective programs and evaluation. Appendices include evaluation/technical assistance report, profiling teacher research participation and teacher development programs, teacher surveys, impact assessment design, and teacher research participation programs anecdotesmore » for 8 labs.« less

77 FR 38336 - Agency Information Collection Activities: Proposed Collection; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-06-27

... of Collection: Monitoring for the National Science Foundation's Math and Science Partnership (MSP... evaluation of the Math and Science Partnership (MSP) program. The goals for the program are to (1) Ensure...

77 FR 65908 - Agency Information Collection Activities: Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-10-31

...: Monitoring for the National Science Foundation's Math and Science Partnership (MSP) Program. OMB Control No... instruments to be used in the evaluation of the Math and Science Partnership (MSP) program. The goals for the...

Knowledge Engineering for Young Scholars. Evaluation Report.

ERIC Educational Resources Information Center

Nye, Gloria T.

The Knowledge Engineering for Young Scholars (KEYS) Program was a National Science Foundation (NSF) program conducted at Louisiana State University during 1989 and 1990. The program's goals were to increase 8th-12th grade students' exposure to science, acquaint them with university research, stimulate interest in science, and build their…

Evaluating the Effectiveness of the 2001-2002 NASA "Why?" Files Program

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Frank, Kari Lou; Lambert, Matthew A.

2002-01-01

This report contains the results of the evaluation conducted for the 2001-2002 NASA 'Why?' Files program that was conducted in March 2002. The analysis is based on the results of 139 surveys collected from educators registered for the program. Respondents indicated that (1) the programs in the series are aligned with the national mathematics, science, and technology standards; (2) the programs are developmentally (grade level) appropriate; and (3) the programs enhance and enrich the teaching and learning of mathematics, science, and technology.

Evaluation of a clinical medical librarianship program at a university Health Sciences Library.

PubMed Central

Schnall, J G; Wilson, J W

1976-01-01

An evaluation of the clinical medical librarianship program at the University of Washington Health Sciences Library was undertaken to determine the benefits of the program to patient care and to the education of the recipients of the service. Results of a questionnaire reflected overwhelming acceptance of the clinical medical librarianship program. Guidelines for the establishment of a limited clinical medical librarianship program are described. A statistical cost analysis of the program is included. PMID:938773

Evaluation of NSF's Program of Grants and Vertical Integration of Research and Education in the Mathematical Sciences (VIGRE)

ERIC Educational Resources Information Center

National Academies Press, 2009

2009-01-01

In 1998, the National Science Foundation (NSF) launched a program of Grants for Vertical Integration of Research and Education in the Mathematical Sciences (VIGRE). These grants were designed for institutions with PhD-granting departments in the mathematical sciences, for the purpose of developing high-quality education programs, at all levels,…

Using insects for STEM outreach: Development and evaluation of the UA Insect Discovery Program

NASA Astrophysics Data System (ADS)

Beal, Benjamin D.

Science and technology impact most aspects of modern daily life. It is therefore important to create a scientifically literate society. Since the majority of Americans do not take college-level science courses, strong K-12 science education is essential. At the K-5 level, however, many teachers lack the time, resources and background for effective science teaching. Elementary teachers and students may benefit from scientist-led outreach programs created by Cooperative Extension or other institutions. One example is the University of Arizona Insect Discovery Program, which provides short-duration programing that uses insects to support science content learning, teach critical thinking and spark interest in science. We conducted evaluations of the Insect Discovery programming to determine whether the activities offered were accomplishing program goals. Pre-post tests, post program questionnaires for teachers, and novel assessments of children's drawings were used as assessment tools. Assessments were complicated by the short duration of the program interactions with the children as well as their limited literacy. In spite of these difficulties, results of the pre-post tests indicated a significant impact on content knowledge and critical thinking skills. Based on post-program teacher questionnaires, positive impacts on interest in science learning were noted as much as a month after the children participated in the program. New programming and resources developed to widen the potential for impact are also described.

Trenholm State (AL) Technical College High School Science Enrichment Program 1996-1997 Evaluation Report

NASA Technical Reports Server (NTRS)

Ross, Elizabeth G.

1997-01-01

This document presents findings based on a third-year evaluation of Trenholm State (AL) Technical College's National Aeronautics and Space Administration (NASA) - supported High School Science Enrichment Program (HSSEP). HSSEP is an external (to school) program for area students from groups that are underrepresented in the mathematics, science, engineering and technology (MSET) professions. In addition to gaining insight into scientific careers, HSSEP participants learn about and deliver presentations that focus on mathematics applications, scientific problem-solving and computer programming during a seven-week summer or 10-week Academic-Year Saturday session.

Program of Policy Studies in Science and Technology, supplement to seven year review

NASA Technical Reports Server (NTRS)

Mayo, L. H.

1975-01-01

The activities of the Program of Policy Studies are described and evaluated. Awards, seminars, publications are included along with student researcher profiles, graduate program in science, technology, and public policy, and a statement of program capability.

The who, what, and how of evaluation within online nursing education: state of the science.

PubMed

Russell, Bedelia H

2015-01-01

The resource capacity in nursing programs has a direct impact on student admissions and number of graduates who enter the nursing workforce. Online delivery of nursing education is identified as a solution to expand nursing program capacity. As nursing programs continue to address capacity with online course delivery, it is essential that nurse educators maintain consistent evaluation practices to ensure successful and positive outcomes, compared with traditional models. Evaluation is a central component to determine program quality and mastery of learning outcomes. This article examines the state of the science around the current evaluation of educational practices, instructional strategies, and outcomes within the context of online nursing education. Thirty-six articles met the inclusion criteria. Despite substantive contributions to the state of the science, the findings reflect evaluation practices that are diffuse and superficial and serve as the basis for future recommendations and research opportunities. Copyright 2015, SLACK Incorporated.

Evaluation of a health sciences internship for Latino and Native American library students.

PubMed

Keselman, Alla; Quasem, Sanjana; Kelly, Janice E; Dutcher, Gale A

2016-10-01

This paper presents a qualitative evaluation of a graduate-level internship for Latino and Native American library science students or students who are interested in serving those populations. The authors analyzed semi-structured interviews with thirteen internship program graduates or participants. The analysis suggests that the program increased participants' interest in health sciences librarianship and led to improved career opportunities, both in health sciences libraries and other libraries with health information programming. It also highlights specific factors that are likely to contribute to the strength of career pipeline programs aiming to bring Latino and Native American students and students who are interested in serving those communities into health librarianship. Exposing graduate-level interns to a broad range of health sciences librarianship tasks, including outreach to Latino and Native American communities and formal mentorship, is likely to maximize interns' interests in both health sciences librarianship and service to these communities.

Redesigning and aligning assessment and evaluation for a federally funded math and science teacher educational program.

PubMed

Hardré, Patricia L; Slater, Janis; Nanny, Mark

2010-11-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.

Evaluating the Effectiveness of the 2000-2001 NASA CONNECT(TM) Program

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Frank, Kari Lou; Lambert, Matthew A.

2002-01-01

This report contains the results of the evaluation conducted for the 2000-2001 NASA CONNECT(TM) program conducted in March 2001. The analysis is based on the results collected from 154 surveys collected from educators registered for the program. Respondents indicated that the objectives for each program were met; the programs were aligned with the national (mathematics, science, and technology) standards; the programs were developmentally (grade level) appropriate; and the programs in the 2000-2001 NASA CONNECT(TM) series enhanced/enriched the teaching of mathematics, science, and technology.

Using a Non-Equivalent Groups Quasi Experimental Design to Reduce Internal Validity Threats to Claims Made by Math and Science K-12 Teacher Recruitment Programs

NASA Astrophysics Data System (ADS)

Moin, Laura

2009-10-01

The American Recovery and Reinvestment Act national policy established in 2009 calls for ``meaningful data'' that demonstrate educational improvements, including the recruitment of high-quality teachers. The scant data available and the low credibility of many K-12 math/science teacher recruitment program evaluations remain the major barriers for the identification of effective recruitment strategies. Our study presents a methodology to better evaluate the impact of recruitment programs on increasing participants' interest in teaching careers. The research capitalizes on the use of several control groups and presents a non-equivalent groups quasi-experimental evaluation design that produces program effect claims with higher internal validity than claims generated by current program evaluations. With this method that compares responses to a teaching career interest question from undergraduates all along a continuum from just attending an information session to participating (or not) in the recruitment program, we were able to compare the effect of the program in increasing participants' interest in teaching careers versus the evolution of the same interest but in the absence of the program. We were also able to make suggestions for program improvement and further research. While our findings may not apply to other K-12 math/science teacher recruitment programs, we believe that our evaluation methodology does and will contribute to conduct stronger program evaluations. In so doing, our evaluation procedure may inform recruitment program designers and policy makers.

A program evaluation of Protovation Camp at an elementary school in North Carolina

NASA Astrophysics Data System (ADS)

Cavoly, Denise Y.

The purpose of this program evaluation was to investigate the impact over time teachers' self-efficacies and the outcome expectancies of those who participated in an inquiry-based, hands-on, constructivist professional development program to learn science content. The hope was that after active participation in this inquiry-based professional development program that provides science inquiry experiences, the teachers, graduate students and elementary students would gain content knowledge, increase self-efficacies, and provide the outcome expectancies of the learning development program that provides science inquiry experiences. The mixed-methods approach used quantitative and qualitative data for campers, which consisted of pre-test and post-test scores on the Test of Science-Related Attitudes (TOSRA), the Draw-A-Scientist Test, Science Process Skills Inventory (SPSI) and content tests based on the camp activities. Additionally, TOSRA scores, Teacher Sense of Efficacy Scale (TSES), and Thinking about Science Survey (TSSI) results for the graduate students and elementary teachers were used along with qualitative data collected from plusdelta charts and interviews to determine the impact of participation in Protovation Camp on teachers and students. Results of the program evaluation indicated that when students were taught inquiry-based lessons that ignite wonder, both their attitudes toward science and their knowledge about science improved. An implication for teacher preparation programs was that practicing inquiry-based lessons on actual elementary students was an important component for teachers and graduate students as they prepare to positively impact student learning in their own classrooms. The findings of this study suggest that it is not just the length of the professional development program that is crucial, but the need for an implementation period while teachers work to transfer the learning to the classroom to their own students is critical to the success of process.

The Effect of a Collaborative Mentoring Program on Beginning Science Teachers' Inquiry-Based Teaching Practice

ERIC Educational Resources Information Center

Nam, Jeonghee; Seung, Eulsun; Go, MunSuk

2013-01-01

This study investigated how a collaborative mentoring program influenced beginning science teachers' inquiry-based teaching and their reflection on practice. The one-year program consisted of five one-on-one mentoring meetings, weekly science education seminars, weekly mentoring group discussions, and self-evaluation activities. The participants…

The Effects of Activity-Based Elementary Science Programs on Student Outcomes and Classroom Practices: A Meta Analysis of Controlled Studies.

ERIC Educational Resources Information Center

Bredderman, Ted

A quantitative synthesis of research findings on the effects of three major activity-based elementary science programs developed with National Science Foundation support was conducted. Controlled evaluation studies of the Elementary Science Study (ESS), Science-A Process Approach (SAPA), or The Science Curriculum Improvement Study (SCIS) were used…

Definition of Life Sciences laboratories for shuttle/Spacelab. Volume 1: Executive summary

NASA Technical Reports Server (NTRS)

1975-01-01

Research requirements and the laboratories needed to support a Life Sciences research program during the shuttle/Spacelab era were investigated. A common operational research equipment inventory was developed to support a comprehensive but flexible Life Sciences program. Candidate laboratories and operational schedules were defined and evaluated in terms of accomodation with the Spacelab and overall program planning. Results provide a firm foundation for the initiation of a life science program for the shuttle era.

Assessment of the Forensic Sciences Profession. A Survey of Educational Offerings in the Forensic Sciences. Volume I.

ERIC Educational Resources Information Center

Field, Kenneth S.; And Others

This survey of the educational offerings in the Forensic Sciences was initiated to identify institutions and agencies offering educational courses and/or programs in the forensic sciences and to evaluate the availability of these programs. The information gathered by surveying members of the American Academy of Forensic Sciences reveals that…

Evaluation of an Inservice Program for Earth Science Teachers

ERIC Educational Resources Information Center

Mayer, Victor J.; And Others

1975-01-01

Reports on the evaluation of an earth science inservice program designed to (1) improve teachers' understandings of principles and concepts, (2) assist teachers in the use of investigatory techniques for teaching, (3) assist teachers in developing and implementing laboratory-oriented courses and (4) instruct teachers in techniques of self…

Science: It's Elementary. Year Four Evaluation Report

ERIC Educational Resources Information Center

Banilower, Eric R.; Fulp, Sherri L.; Warren, Camille L.

2010-01-01

This report summarizes the activities and findings of the external evaluation of the "Science: It's Elementary" (SIE) program during the period from July 2009 through June 2010. The SIE program is managed by ASSET Inc. and overseen by the Pennsylvania Department of Education (PDE). SIE is an initiative aimed at improving elementary…

Science: It's Elementary. Year Three Evaluation Report

ERIC Educational Resources Information Center

Fulp, Sherri L.; Warren, Camille L.; Banilower, Eric R.

2009-01-01

This report summarizes the activities and findings of the external evaluation of the "Science: It's Elementary" (SIE) program during the period from July 2008 through June 2009. The SIE program is managed by ASSET Inc. and overseen by the Pennsylvania Department of Education. SIE is an initiative aimed at improving elementary science…

The Center for Informal Learning and Schools' Informal Learning Certificate (ILC) Program: Professional Development and Community for Informal Science Educators Working with Schools. An Evaluation Report

ERIC Educational Resources Information Center

Smith, Anita; Helms, Jenifer V.; St. John, Mark

2007-01-01

Inverness Research Associates served as external evaluators for the Center for Informal Learning and Schools (CILS) from its inception in 2002 as a National Science Foundation (NSF)-funded Center for Learning and Teaching. One of the programs that CILS developed was the Informal Learning Certificate (ILC) for informal science educators (mostly…

Assessing the Effectiveness of a Mathematics-Focused, Instructional Technology Program for Grades 6-8: A 5-Year Trend Analysis of NASA CONNECT(tm) Evaluation Data

NASA Technical Reports Server (NTRS)

Glassman, Nanci A.; Perry, Jeannine B.; Giersch, Christopher E.; Lambert, Matthew A.; Pinelli, Thomas E.

2004-01-01

NASA CONNECT is a research-, inquiry, and standards-based, integrated mathematics, science, and technology series of 30-minute instructional distance learning (television and web-based) programs for students in grades 6 8. Respondents who evaluated the programs in the series over the first five seasons (1998-99 through 2002-03) reported that (1) they used the programs in the series; (2) the goals and objectives for the series were met; (3) the programs were aligned with the national mathematics, science, and technology standards; (4) the program content was developmentally appropriate for the grade level; and (5) the programs in the series enhanced and enriched the teaching of mathematics, science, and technology.

Effects of NIGMS Training Programs on Graduate Education in the Biomedical Sciences. An Evaluative Study of the Training Programs of the National Institute of General Medical Sciences 1958-1967.

ERIC Educational Resources Information Center

National Inst. of General Medical Sciences (NIH), Bethesda, MD.

This report was prepared by the National Research Council, at the request of the National Institutes of Health, in an attempt to evaluate the Graduate Research Training Grant Program and Fellowship Program in bioscience. One of the purposes of the study was to collect objective data that would provide answers to such questions as: What have been…

Tools to Assess the Impact of Teacher Enhancement Programs

NASA Astrophysics Data System (ADS)

Heatherly, S. A.; Maddalena, R. J.; Govett, A.; Hemler, D.

1997-05-01

Beginning in 1994, the NRAO has hosted an NSF-funded program, ``Research Experience in Teacher Preparation (RETP),'' in which inservice and preservice science teachers participate in residential institutes lasting one or two weeks. While on site, they conduct open-ended investigations using a 40-foot diameter working radio telescope. The aim of RETP has been to deepen and personalize participants' understanding of the nature of science, and to assist them in applying their newfound knowledge to their classroom teaching. So far RETP, and the teacher enhancement programs from which it evolved, have trained 434 inservice and 69 preservice teachers. The impact of the research experience on teachers' perceptions of themselves as professionals and their views of science was initially assessed through open-ended questionnaires and participant journals. From teachers' responses we learned that the research experience has a profound, positive influence on participants' views of science and increased their confidence in using research-based teaching methods. However, determining what actually happens in the classroom is harder to evaluate and requires a more structured approach. Therefore, to determine what changes occurred in teachers and their students, five survey instruments were developed. The instruments: 1) assess changes in teachers' perceptions of their ability to conduct research; 2) gauge teachers' perceptions of three aspects of the institute; 3) measure changes in teachers' concerns about implementing classroom research projects; 4) evaluate the development of teachers' understanding into the nature of science; and 5) determine changes in their students' perceptions of science and science class. To increase the reliability of the instruments, the survey questions were tested for internal consistency. Early results show that the RETP program has significantly affected participants and their students. These instruments are useful not only for evaluating this program but also for evaluating other teacher enhancement and preparation programs.

Successfully Engaging Family and Student Audiences in Climate Science Workshops in an Informal Learning Venue

NASA Astrophysics Data System (ADS)

DeFrancis, G.; Haynes, R.; Schroer, K.

2017-12-01

The Montshire Museum of Science, a regional science center serving families, teachers, and students in rural Vermont and New Hampshire, has been actively engaged in in climate literacy initiatives for over 10 years. The Museum's visitor evaluation data shows that before audiences can be engaged in conversations around climate change, they need to be introduced to the underlying earth processes that drive climate, and to the nature of how climate science is done. Through this work, the Museum has developed a suite of climate science programs that can be incorporated in informal science programming at museums, science centers, and libraries, and in the formal K-8 classroom environment. Front-end and formative evaluation data was used in the program design, and summative evaluation showed an increase in concept understanding in the topic presented. Family science and student workshops developed focused on Albedo and the Earth's energy budget, properties and characteristics of sea ice, sediment cores and ice cores to study changes in the climate over time, and the geography of the polar regions. We found that successful climate literacy learning experiences require meaningful hands-on, inquiry-based activities focused on a single earth process, and leads to an increase in science talk and conversation about climate change between the program instructor and audience members as learners begin to understand how these processes interact in the Earth's climate system.

NASA Citizen Science for Earth Systems Program: fusing public participation and remote sensing to improve our understanding of the planet

NASA Astrophysics Data System (ADS)

Whitehurst, A.; Murphy, K. J.

2017-12-01

The objectives of the NASA Citizen Science for Earth Systems Program (CSESP) include both the evaluation of using citizen science data in NASA Earth science related research and engaging the public in Earth systems science. Announced in 2016, 16 projects were funded for a one year prototype phase, with the possibility of renewal for 3 years pending a competitive evaluation. The current projects fall into the categories of atmospheric composition (5), biodiversity and conservation (5), and surface hydrology/water and energy cycle (6). Out of the 16, 8 of the projects include the development and/or implementation of low cost sensors to facilitate data collection. This presentation provides an overview of the NASA CSESP program to both highlight the diversity of innovative projects being funded and to share information with future program applicants.

The Critical Role of a Well-Articulated, Coherent Design in Professional Development: An Evaluation of a State-Wide Two-Week Program for Mathematics and Science Teachers

ERIC Educational Resources Information Center

Saderholm, Jon; Ronau, Robert N.; Rakes, Christopher R.; Bush, Sarah B.; Mohr-Schroeder, Margaret

2017-01-01

This evaluation study examined a state-wide professional development program composed of two institutes, one for mathematics teachers and one for science teachers, each spanning two weeks. The program was designed to help teachers transform their practice to align with Common Core State Standards for Mathematics and Next Generation Science…

Evaluation in STEM Online Graduate Degree Programs in Agricultural Sciences and Engineering

ERIC Educational Resources Information Center

Downs, Holly A.

2014-01-01

Demands for online graduate degrees have increased pressure on universities to launch web degrees quickly and, at times, without attending to their quality. Scarce research exists identifying what evaluation activities are being done by science, technology, engineering, and mathematics (STEM) online graduate degree programs that are accustomed to…

Future Think Program, San Jose City College, Spring Semester, 1974: Final Report of Evaluation.

ERIC Educational Resources Information Center

DCM Associates, San Francisco, CA.

San Jose City College's Future Think Program consists of the following courses: Language, Culture, and Change; Third World Since 1945; Marriage and Family; Ecology and Man; Science Fiction; Introduction to Literature: Science Fiction; Introduction to Sociology; and Sociology/Fiction of the Future. An evaluation by an independent consulting firm…

77 FR 47676 - Comment Request: Experimental Program to Stimulate Competitive Research Jurisdictional Survey

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-09

... Research Jurisdictional Survey AGENCY: National Science Foundation. ACTION: Notice. SUMMARY: Under the... Program to Stimulate Competitive Research Jurisdictional Survey Evaluation for the National Science... objective of the Foundation to strengthen science and engineering research potential and education at all...

The design and evaluation of a master of science program in anatomical sciences at Queen's University Canada.

PubMed

Kolomitro, Klodiana; MacKenzie, Leslie W; Wiercigroch, David; Godden, Lorraine

2018-05-15

The purpose of this study was to describe the design and evolution of a unique and successful Master of Science program in anatomical sciences at one Canadian post-secondary institution and to evaluate its long-term impact on student learning. This program prepares students to teach anatomy and design curricula in the anatomical sciences and is structured around three pillars of competency-content (disciplinary knowledge and transferable skills), pedagogy, and inquiry. Graduates of the program from the last ten years were surveyed, to better understand the knowledge, skills, and habits of mind they have adopted and implemented since completion. Interest was taken in identifying aspects of the program that students found particularly beneficial and areas that needed to be further developed. Based on the findings, this program has been a highly valuable experience for the graduates especially in helping them develop transferable skills, and grow as individuals. The hope is that other institutions that have similar programs in place or are considering developing them would benefit from this description of the program design and the sharing of the lessons learned. Anat Sci Educ. © 2018 American Association of Anatomists. © 2018 American Association of Anatomists.

The Effect of a Collaborative Mentoring Program on Beginning Science Teachers' Inquiry-based Teaching Practice

NASA Astrophysics Data System (ADS)

Nam, Jeonghee; Seung, Eulsun; Go, MunSuk

2013-03-01

This study investigated how a collaborative mentoring program influenced beginning science teachers' inquiry-based teaching and their reflection on practice. The one-year program consisted of five one-on-one mentoring meetings, weekly science education seminars, weekly mentoring group discussions, and self-evaluation activities. The participants were three beginning science teachers and three mentors at the middle school level (7-9th grades) in an urban area of South Korea. For each beginning teacher, five lessons were evaluated in terms of lesson design/implementation, procedural knowledge, and classroom culture by using the Reformed Teaching Observation Protocol. Five aspects of the beginning teachers' reflections were identified. This study showed that a collaborative mentoring program focusing on inquiry-based science teaching encouraged the beginning teachers to reflect on their own perceptions and teaching practice in terms of inquiry-based science teaching, which led to changes in their teaching practice. This study also highlighted the importance of collaborative interactions between the mentors and the beginning teachers during the mentoring process.

Evaluation of a health sciences internship for Latino and Native American library students

PubMed Central

Keselman, Alla; Quasem, Sanjana; Kelly, Janice E.; Dutcher, Gale A.

2016-01-01

Purpose This paper presents a qualitative evaluation of a graduate-level internship for Latino and Native American library science students or students who are interested in serving those populations. Methods The authors analyzed semi-structured interviews with thirteen internship program graduates or participants. Results The analysis suggests that the program increased participants' interest in health sciences librarianship and led to improved career opportunities, both in health sciences libraries and other libraries with health information programming. It also highlights specific factors that are likely to contribute to the strength of career pipeline programs aiming to bring Latino and Native American students and students who are interested in serving those communities into health librarianship. Conclusions Exposing graduate-level interns to a broad range of health sciences librarianship tasks, including outreach to Latino and Native American communities and formal mentorship, is likely to maximize interns' interests in both health sciences librarianship and service to these communities. PMID:27822159

75 FR 81611 - Submission for OMB Review; Comment Request; National Evaluation of the Clinical and Translational...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-12-28

... Patricia Newman, Program Analyst, Office of Science Policy, National Center for Research Resources, 6701...: December 20, 2010. Meryl Sufian, Supervisory Health Science Policy Analyst, Office of Science Policy, NCRR... Evaluation of the Clinical and Translational Science Awards (CTSA) Initiative SUMMARY: Under the provisions...

Final Project Report to NSF.

ERIC Educational Resources Information Center

National Inst. for Science Education, Madison, WI.

The National Institute for Science Education's (NISE) focused mission is to improve mathematics and science education from kindergarten through college. This document reports on NISE's research programs, dissemination programs, and organizational process programs. Contents include: (1) "Systemic Reform: Policy and Evaluation" (William H. Clune and…

The Science of Living Spaces: Women in the Environment of the 21st Century. An Evaluation and Guide Book.

ERIC Educational Resources Information Center

Greenlee, Shelia; Lambert, Lynn

The Science of Living Spaces program provides girls aged 11-13 increased access to and awareness of the possibilities inherent in pursuing careers in science, engineering, and mathematics. Objectives of the program include expanding career knowledge and opportunities; increasing participants' knowledge of and exposure to science, engineering, and…

Checklist for Excellence in Science Teaching and Learning

ERIC Educational Resources Information Center

Ediger, Marlow

2016-01-01

Science teachers need to evaluate their lessons and units of study, frequently, to stay abreast of recommended trends in the curriculum. Self evaluation is involved here. A quality science program must be implemented in order to assist learners to achieve as optimally as possible. Which guidelines should then serve in self evaluation?

Science and Science Education Go Hand-in-Hand: The Impact of the NASA Science Mission Directorate Education and Public Outreach Program

NASA Astrophysics Data System (ADS)

Smith, D. A.; Peticolas, L.; Schwerin, T.; Shipp, S.; Manning, J. G.

2014-07-01

For nearly two decades, NASA has embedded education and public outreach (EPO) in its Earth and space science missions and research programs on the principle that science education is most effective when educators and scientists work hand-in-hand. Four Science EPO Forums organize the respective NASA Science Mission Directorate (SMD) Astrophysics, Earth Science, Heliophysics, and Planetary Science EPO programs into a coordinated, efficient, and effective nationwide effort. The NASA SMD EPO program evaluates EPO impacts that support NASA's policy of providing a direct return-on-investment for the American public, advances STEM education and literacy, and enables students and educators to participate in the practice of science as embodied in the 2013 Next Generation Science Standards. Leads of the four NASA SMD Science EPO Forums provided big-picture perspectives on NASA's effort to incorporate authentic science into the nation's STEM education and scientific literacy, highlighting examples of program effectiveness and impact. Attendees gained an increased awareness of the depth and breadth of NASA SMD's EPO programs and achievements, the magnitude of its impacts through representative examples, and the ways current and future EPO programs can build upon the work being done.

African American perspectives: A qualitative study of an informal science enrichment program

NASA Astrophysics Data System (ADS)

Simpson, Jamila Rashida

The purposes of this study were to determine what program characteristics African American parents consider when they enroll their children into an informal science education enrichment program, the parents' evaluation of a program called Jordan Academy in which they enrolled their children, and the alignment of the parents' perspectives with Black Cultural Ethos (BCE). BCE refers to nine dimensions posited by Wade Boykin, a psychologist, as comprising African American culture. Participants were parents of students that attended Jordan Academy, an informal science enrichment program designed for third through sixth grade students from underserved populations. Qualitative methodologies were utilized to perform a thorough assessment of parents' perspectives. Data sources included classroom observations, student surveys, academy curriculum, photos and video-taped class sessions. Data included teachers and parents' responses to semi-structured, audio recorded interviews and students' written responses to open-ended items on the program's evaluation instrument. The data were analyzed for themes and the findings compared to Black Cultural Ethos. Findings revealed that the participants believed that informal science education offered their children opportunities not realized in the formal school setting - a means of impacting their children holistically. The parents expressed the academic, cultural, and personal development of their children in their characterizations of the ideal informal science education experience and in their evaluations of Jordan Academy. Overall, the parents' views emphasized the BCE values of harmony, affect, verve, movement, orality and communalism. The study has important implications for practices within and research on informal science education.

Evaluation of the National Science Foundation's Partnerships for International Research and Education (PIRE) Program, Volume 2: Supplementary Materials. Final Report

ERIC Educational Resources Information Center

Martinez, Alina; Epstein, Carter; Parsad, Amanda

2015-01-01

The National Science Foundation contracted with Abt Associates to conduct an evaluation of its Partnerships for International Research and Education (PIRE) program, which supports intellectually substantive collaborations between U.S. and foreign researchers in which the international partnership is essential to the research effort. The evaluation…

Evaluation of the National Science Foundation's Partnerships for International Research and Education (PIRE) Program, Volume 1: Final Report

ERIC Educational Resources Information Center

Martinez, Alina; Epstein, Carter; Parsad, Amanda

2015-01-01

The National Science Foundation contracted with Abt Associates to conduct an evaluation of its Partnerships for International Research and Education (PIRE) program, which supports intellectually substantive collaborations between U.S. and foreign researchers in which the international partnership is essential to the research effort. The evaluation…

Engaging underserved audiences in informal science education through community-based partnerships

NASA Astrophysics Data System (ADS)

Bouzo, Suzanne

This thesis explores the impact of the Science Education and Engagement of Denver (SEED) Partnership on three of its participant families. The partnership, consisting of large informal science organizations, as well as small community-based organizations, created its programming based on prior research identifying barriers to minority participation in informal science education programs. SEED aims to engage youth and families of emerging populations in science and nature. Three families were examined as a case study to have an in depth investigation about their involvement in the programs sponsored by the partnership. Findings suggest a positive impact on participant feelings and engagement in science and nature. Future recommendations are made for furthering programming as well as conducting a larger scale, more comprehensive program evaluation. This research addresses prior studies that have identified several barriers toward participation of underserved audiences in informal science education programs and how the SEED partnership has addressed specific identified barriers.

An Evaluation of the Impact of an Agricultural Science Outreach Program on the Attitudes of Rural Students

ERIC Educational Resources Information Center

Lewis, Jessica; Oliver, Richard; Oliver, Mary

2017-01-01

A "citizen science" outreach program was aimed at high school students in Western Australia with a focus on agricultural sciences. The program had two main objectives: the collection of samples and the mapping of the distribution of the leaf disease powdery mildew of barley across the state; and support for the teaching and learning of…

Adapting Science Materials for the Blind, Report of an Evaluation Planning Conference.

ERIC Educational Resources Information Center

Thier, Herbert D.; And Others

Persons from the field of science education and persons who had extensive experience working with visually handicapped children were brought together to establish some baselines and beginning ideas of approaches to the evaluation of a laboratory - centered science program (Science Curriculum Improvement Study) as it is being used with visually…

45 CFR 1706.110 - Self-evaluation.

Code of Federal Regulations, 2013 CFR

2013-10-01

... INFORMATION SCIENCE ENFORCEMENT OF NONDISCRIMINATION ON THE BASIS OF HANDICAP IN PROGRAMS OR ACTIVITIES CONDUCTED BY NATIONAL COMMISSION ON LIBRARIES AND INFORMATION SCIENCE § 1706.110 Self-evaluation. (a) The...

45 CFR 1706.110 - Self-evaluation.

Code of Federal Regulations, 2012 CFR

2012-10-01

... INFORMATION SCIENCE ENFORCEMENT OF NONDISCRIMINATION ON THE BASIS OF HANDICAP IN PROGRAMS OR ACTIVITIES CONDUCTED BY NATIONAL COMMISSION ON LIBRARIES AND INFORMATION SCIENCE § 1706.110 Self-evaluation. (a) The...

45 CFR 1706.110 - Self-evaluation.

Code of Federal Regulations, 2011 CFR

2011-10-01

... INFORMATION SCIENCE ENFORCEMENT OF NONDISCRIMINATION ON THE BASIS OF HANDICAP IN PROGRAMS OR ACTIVITIES CONDUCTED BY NATIONAL COMMISSION ON LIBRARIES AND INFORMATION SCIENCE § 1706.110 Self-evaluation. (a) The...

45 CFR 1706.110 - Self-evaluation.

Code of Federal Regulations, 2014 CFR

2014-10-01

... INFORMATION SCIENCE ENFORCEMENT OF NONDISCRIMINATION ON THE BASIS OF HANDICAP IN PROGRAMS OR ACTIVITIES CONDUCTED BY NATIONAL COMMISSION ON LIBRARIES AND INFORMATION SCIENCE § 1706.110 Self-evaluation. (a) The...

45 CFR 1706.110 - Self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-10-01

... INFORMATION SCIENCE ENFORCEMENT OF NONDISCRIMINATION ON THE BASIS OF HANDICAP IN PROGRAMS OR ACTIVITIES CONDUCTED BY NATIONAL COMMISSION ON LIBRARIES AND INFORMATION SCIENCE § 1706.110 Self-evaluation. (a) The...

PR^2EPS: Preparation, recruitment, retention and excellence in the physical sciences

NASA Astrophysics Data System (ADS)

Gallagher, Hugh; Labroo, Sunil; Schaumloffel, John; Bischoff, Paul; Bachman, Nancy

2007-04-01

The PR^2EPS program is a multidisciplinary effort to increase the number of majors attending (and graduating) from SUNY Oneonta with degrees in physics, chemistry, secondary physics or chemistry education and related areas. Components of the program include a walk-in tutoring center, a free, weeklong summer science camp, scholarship opportunities, professional conference experiences, and an equipment loan program for regional secondary science teachers. 2006 was the third year of this NSF-DUE funded program. Evaluation of our progress to date shows that the program is effective at steering students (or at least reinforcing their desire) to studying the sciences in college and retaining them in their science programs. A summary of our goals, challenges and accomplishments, including tutoring center operation and efficacy, activities and operational details for the summer camp, and the overall impact on science programs at a medium sized college will be presented.

In-Depth Science Research Experiences for Teens: The AMNH-ITEST High School Science Research Program. Summative Evaluation Report

ERIC Educational Resources Information Center

Smith, Anita

2008-01-01

In January 2005, the American Museum of Natural History (AMNH) was awarded a three-year ITEST grant (Innovative Technology Experiences for Students and Teachers) through the National Science Foundation (award #04-23417). This "AMNH-ITEST High School Science Research Program" aimed to target 120 urban high school youth, grades 10-12, from…

Evaluation of the NOAA CAREERS Weather Camp's Effectiveness in Promoting Atmospheric Science amongst High School Students

NASA Astrophysics Data System (ADS)

Olgin, J. G.; Fitzgerald, R. M.; Morris, V. R.

2013-12-01

The NOAA Center for Atmospheric Science (NCAS) sponsors the Channeling Atmospheric Research into Educational Experiences Reaching Students program (CAREERS); a program that manages a network of weather camps for students in secondary education with particular focus on increasing access for students from traditionally underrepresented backgrounds. Hosted by a college or university, the primary mission goals of the program are to engage students in discussions, lectures and interactive projects to better learn and comprehend a suite of atmospheric science disciplines (i.e. weather forecasting, environmental modeling, atmospheric data acquisition), and guide talented students towards higher education to pursue careers in atmospheric science primarily, or toward other STEM field professions. The need to evaluate and analyze the program's efficacy is crucial for continued growth and sustainability. Therefore a means to identify and measure the success of the program's initiatives will be addressed. Two Hispanic serving institutions, the University of Texas at El Paso (UTEP) and the University of Puerto Rico in Mayaguez (UPRM), both hosted the CAREER weather camps during the summers of 2012 and 2013, and provide the basis of this initial analysis. Participants performed entrance surveys of their knowledge of atmospheric science prior to the course. They were then re-evaluated through exit surveys over the topics covered during the weather camp. These data will be analyzed to correlate which program activities worked best in increasing participant awareness (i.e. geology tours of the local area, discussion on local climate variations, geophysical and geochemical demonstrations), and comprehension of atmospheric science. A comparison between the two universities on their uniqueness in program design and execution will also highlight those activities that best progressed CAREERS' program goals. Results from this analysis, along with possible new strategies for improved program sustainability will be explored. NOAA Center for Atmospheric Science (NCAS) sponsors the CAREERS Weather Camps

The historical path of evaluation as reflected in the content of Evaluation and Program Planning.

PubMed

Ayob, Abu H; Morell, Jonathan A

2016-10-01

This paper examines the intellectual structure of evaluation by means of citation analysis. By using various article attributes and citation counts in Google Scholar and (Social) Science Citation Index Web of Science, we analyze all articles published in Evaluation and Program Planning from 2000 until 2012. We identify and discuss the characteristics and development of the field as reflected in the history of those citations. Copyright © 2016 Elsevier Ltd. All rights reserved.

A program wide framework for evaluating data driven teaching and learning - earth analytics approaches, results and lessons learned

NASA Astrophysics Data System (ADS)

Wasser, L. A.; Gold, A. U.

2017-12-01

There is a deluge of earth systems data available to address cutting edge science problems yet specific skills are required to work with these data. The Earth analytics education program, a core component of Earth Lab at the University of Colorado - Boulder - is building a data intensive program that provides training in realms including 1) interdisciplinary communication and collaboration 2) earth science domain knowledge including geospatial science and remote sensing and 3) reproducible, open science workflows ("earth analytics"). The earth analytics program includes an undergraduate internship, undergraduate and graduate level courses and a professional certificate / degree program. All programs share the goals of preparing a STEM workforce for successful earth analytics driven careers. We are developing an program-wide evaluation framework that assesses the effectiveness of data intensive instruction combined with domain science learning to better understand and improve data-intensive teaching approaches using blends of online, in situ, asynchronous and synchronous learning. We are using targeted online search engine optimization (SEO) to increase visibility and in turn program reach. Finally our design targets longitudinal program impacts on participant career tracts over time.. Here we present results from evaluation of both an interdisciplinary undergrad / graduate level earth analytics course and and undergraduate internship. Early results suggest that a blended approach to learning and teaching that includes both synchronous in-person teaching and active classroom hands-on learning combined with asynchronous learning in the form of online materials lead to student success. Further we will present our model for longitudinal tracking of participant's career focus overtime to better understand long-term program impacts. We also demonstrate the impact of SEO optimization on online content reach and program visibility.

Linking the GLOBE Program With NASA and NSF Large-Scale Experiments

NASA Astrophysics Data System (ADS)

Filmer, P. E.

2005-12-01

NASA and the NSF, the sponsoring Federal agencies for the GLOBE Program, are seeking the participation of science teams who are working at the cutting edge of Earth systems science in large integrated Earth systems science programs. Connecting the GLOBE concept and structure with NASA and NSF's leading Earth systems science programs will give GLOBE schools and students access to top scientists, and expose them to programs that have been designated as scientific priorities. Students, teachers, parents, and their communities will be able to see how scientists of many disciplines work together to learn about the Earth system. The GLOBE solicitation released by the NSF targets partnerships between GLOBE and NSF/NASA-funded integrated Earth systems science programs. This presentation will focus on the goals and requirements of the NSF solicitation. Proponents will be expected to provide ways for the GLOBE community to interact with a group of scientists from their science programs as part of a wider joint Earth systems science educational strategy (the sponsoring agencies', GLOBE's, and the proposing programs'). Teams proposing to this solicitation must demonstrate: - A focus on direct connections with major NSF Geosciences and/or Polar Programs and/or NASA Earth-Sun research programs that are related to Earth systems science; - A demonstrable benefit to GLOBE and to NSF Geosciences and/or Polar Programs or NASA Earth-Sun education goals (providing access to program researchers and data, working with GLOBE in setting up campaigns where possible, using tested GLOBE or non-GLOBE protocols to the greatest extent possible, actively participating in the wider GLOBE community including schools, among other goals); - An international component; - How the existing educational efforts of the large science program will coordinate with GLOBE; - An Earth systems science education focus, rather than a GLOBE protocol-support focus; - A rigorous evaluation and assessment component that will collaborate with the Geosciences Education assessment contractor and with the GLOBE Office's evaluation and assessment activities; and - Contact and discussions with the GLOBE Office regarding understandings of roles and responsibilities. The following link is a PDF document with full explanation of the GLOBE Program's new direction.

77 FR 53888 - Statement of Organization, Functions, and Delegations of Authority

Federal Register 2010, 2011, 2012, 2013, 2014

2012-09-04

... title and functional statements for the Program Services Branch (CGCB), and Applied Science Evaluation... Branches during exercises or upon a federal deployment of DSNS assets. Applied Science and Evaluation..., translates, and leverages interdisciplinary preparedness science; (4) fosters innovation and efficiency in...

NASA Science Served Family Style

NASA Astrophysics Data System (ADS)

Noel-Storr, Jacob; Mitchell, S.; Drobnes, E.

2010-01-01

Family oriented innovative programs extend the reach of many traditional out-of-school venues to involve the entire family in learning in comfortable and fun environments. Research shows that parental involvement is key to increasing student achievement outcomes, and family-oriented programs have a direct impact on student performance. Because families have the greatest influence on children's attitudes towards education and career choices, we have developed a Family Science program that provides families a venue where they can explore the importance of science and technology in our daily lives by engaging in learning activities that change their perception and understanding of science. NASA Family Science Night strives to change the way that students and their families participate in science, within the program and beyond. After three years of pilot implementation and assessment, our evaluation data shows that Family Science Night participants have positive change in their attitudes and involvement in science.  Even after a single session, families are more likely to engage in external science-related activities and are increasingly excited about science in their everyday lives.  As we enter our dissemination phase, NASA Family Science Night will be compiling and releasing initial evaluation results, and providing facilitator training and online support resources. Support for NASA Family Science Nights is provided in part through NASA ROSES grant NNH06ZDA001N.

Earth Sciences Data and Information System (ESDIS) program planning and evaluation methodology development

NASA Technical Reports Server (NTRS)

Dickinson, William B.

1995-01-01

An Earth Sciences Data and Information System (ESDIS) Project Management Plan (PMP) is prepared. An ESDIS Project Systems Engineering Management Plan (SEMP) consistent with the developed PMP is also prepared. ESDIS and related EOS program requirements developments, management and analysis processes are evaluated. Opportunities to improve the effectiveness of these processes and program/project responsiveness to requirements are identified. Overall ESDIS cost estimation processes are evaluated, and recommendations to improve cost estimating and modeling techniques are developed. ESDIS schedules and scheduling tools are evaluated. Risk assessment, risk mitigation strategies and approaches, and use of risk information in management decision-making are addressed.

Implementing a centralized institutional peer tutoring program.

PubMed

Gaughf, Natalie White; Foster, Penni Smith

2016-01-01

Peer tutoring has been found to be beneficial to both students and peer tutors in health sciences education programs. This article describes the implementation of a centralized, institutional peer tutoring program at the University of Mississippi Medical Center, an academic health science center in the U.S. The Program: This multispecialty peer tutoring program paired students experiencing academic difficulties with peer tutors who showed prior academic success, professionalism and effective communication skills. The program allowed students and peer tutors to coordinate their own tutoring services. Evaluations by both students and peer tutors showed satisfaction with the program. Recommendations for developing and implementing an effective peer tutoring program are presented, including utilization of an online system, consistent program policy with high professionalism expectations, funding, program evaluation and data tracking.

Evaluation of the Alliance for Climate Education's national high school edutainment program (Invited)

NASA Astrophysics Data System (ADS)

Lappe, M.; Flora, J.; Saphir, M.; Roser-Renouf, C.; Maibach, E.; Leiserowitz, A.

2013-12-01

The Alliance for Climate Education educates high school students on the science of climate change and inspires them to create effective solutions. Since 2009, ACE has reached over 1.6 million students nationwide with its multi media assembly presentation. In this paper, we evaluate the climate science knowledge, beliefs, attitudes, behavior and communication impact of the ACE Assembly program in a random sample of 49 schools (from population of 779) and a panel of 1,241 high school students. Pre and post assembly surveys composed of questions from the Global Warming Six Americas segmentation and intervention specific questions were administered in classrooms. We demonstrate that exposure to climate science in an engaging edutainment format changes youths' beliefs, involvement, and behavior positively and moves them to more climate science literate audience segments. The net impact of scaled and engaging programs for youth could be a population shift in climate science literacy and positive engagement in the issue of climate change. In addition, such programs can empower youth for deeper engagement in school programs, personal action, political and consumer advocacy.

Tiered Internship Model for Undergraduate Students in Geospatial Science and Technology

ERIC Educational Resources Information Center

Kopteva, Irina A.; Arkowski, Donna; Craft, Elaine L.

2015-01-01

This article discusses the development, implementation, and evaluation of a tiered internship program for undergraduate students in geospatial science and technology (TIMSGeoTech). The internship program assists education programs in providing skill development that is relevant and useful, and it aligns graduates and their skills with industry…

Social Science at the Center for Adaptive Optics: Synergistic Systems of Program Evaluation, Applied Research, Educational Assessment, and Pedagogy

NASA Astrophysics Data System (ADS)

Goza, B. K.; Hunter, L.; Shaw, J. M.; Metevier, A. J.; Raschke, L.; Espinoza, E.; Geaney, E. R.; Reyes, G.; Rothman, D. L.

2010-12-01

This paper describes the interaction of four elements of social science as they have evolved in concert with the Center for Adaptive Optics Professional Development Program (CfAO PDP). We hope these examples persuade early-career scientists and engineers to include social science activities as they develop grant proposals and carry out their research. To frame our discussion we use a metaphor from astronomy. At the University of California Santa Cruz (UCSC), the CfAO PDP and the Educational Partnership Center (EPC) are two young stars in the process of forming a solar system. Together, they are surrounded by a disk of gas and dust made up of program evaluation, applied research, educational assessment, and pedagogy. An idea from the 2001 PDP intensive workshops program evaluation developed into the Assessing Scientific Inquiry and Leadership Skills (AScILS) applied research project. In iterative cycles, AScILS researchers participated in subsequent PDP intensive workshops, teaching social science while piloting AScILS measurement strategies. Subsequent "orbits" of the PDP program evaluation gathered ideas from the applied research and pedagogy. The denser regions of this disk of social science are in the process of forming new protoplanets as tools for research and teaching are developed. These tools include problem-solving exercises or simulations of adaptive optics explanations and scientific reasoning; rubrics to evaluate the scientific reasoning simulation responses, knowledge regarding inclusive science education, and student explanations of science/engineering inquiry investigations; and a scientific reasoning curriculum. Another applied research project is forming with the design of a study regarding how to assess engineering explanations. To illustrate the mutual shaping of the cross-disciplinary, intergenerational group of educational researchers and their projects, the paper ends with a description of the professional trajectories of some of the researchers involved in this complex solar system.

Double TNT: Targeting New Teachers and Teaching by Novel Techniques.

ERIC Educational Resources Information Center

Williams-Robertson, Lydia

A program developed by the Austin (Texas) Independent School District under a 2-year grant from the National Science Foundation is described and evaluated. The primary objectives of the program were to: interest minority and female students in science; attract these groups to the teaching of science; enrich the elementary school science…

Attracting Females to Science Careers: How Well Do Special Initiatives Work?

ERIC Educational Resources Information Center

Madill, Helen M.; Montgomerie, T. Craig; Armour, Margaret-Ann; Fitzsimmons, George W.; Stewin, Leonard L.; Tovell, Dorothy R.

Although there is considerable anecdotal evidence concerning the success of a large number of programs for women in science in Canada, no well-controlled studies had been conducted. This publication reports on results from an outcome evaluation of the Women in Scholarship, Engineering, Science and Technology (WISEST) Summer Research Program for…

EVALUATION REPORT SCIENCE APPLICATIONS INTERNATIONAL CORPORATION S-CAD CHEMICAL AGENT DETECTION SYSTEM

EPA Science Inventory

The USEPA's National Homeland Security Research Center (NHSRC)Technology Testing and Evaluation Program (TTEP) is carrying out performance tests on homeland security technologies. Under TTEP, Battelle recently evaluated the performance of the Science Applications International Co...

Evaluating a Graduate Professional Development Program for Informal Science Educators

NASA Astrophysics Data System (ADS)

Lake, Jeremy Paul

This study is an examination and evaluation of the outcomes of a series of courses that I helped build to create a graduate certificate. Specifically, I wanted to evaluate whether or not the online iteration of the Informal Science Institutions Environmental Education Graduate Certificate Program truly provided the long term professional development needed to enhance the skills of the formal and informal educators participating so that they could contribute meaningfully to the improvement of science literacy in their respective communities. My role as an internal evaluator provided an extraordinary opportunity to know the intent of the learning opportunities and why they were constructed in a particular fashion. Through the combination of my skills, personal experiences both within the certificate's predecessor and as an educator, I was uniquely qualified to explore the outcomes of this program and evaluate its effectiveness in providing a long-term professional development for participants. After conducting a literature review that emphasized a need for greater scientific literacy in communities across America, it was evident that the formal education enterprise needs the support of informal educators working on the ground in myriad different settings in ways that provide science as both content and process, learning science facts and doing real science. Through a bridging of informal science educators with formal teachers, it was thought each could learn the culture of the other, making each more fluent in accessing community resources to help make these educators more collaborative and able to bridge the classroom with the outside world. This bridge promotes ongoing, lifelong learning, which in turn can help the national goal of greater scientific literacy. This study provided insight into the thinking involved in the learners' growth as they converted theory presented in course materials into practice. Through an iterative process of reviewing the course generated content, I was able to piece through the many layers of this two year long program to examine the growth of these individuals over time. While all participants showed growth completing the certificate program, those who could fully invest themselves in the experiences seemed to have gained the most. These cases indicate the Informal Science Institutions Environmental Education Graduate Certificate Program was effective at enhancing the careers of formal and informal science educators. Additionally, it suggests informal science educators, although busy with their professional obligations and personal lives, can be successful in a formal graduate program designed to meet ISE needs as explicated in Learning Science in Informal Environments: People, Places, and Pursuits (Bell, Lewenstein, Shouse, & Feder, 2009). The emergent model indicating connections among a person's personal life, professional life, and graduate study may also have implications for other professionals desiring to enroll in graduate school. For example, science teachers in university graduate programs may also benefit from applying this model to their lives.

Enhancing programming logic thinking using analogy mapping

NASA Astrophysics Data System (ADS)

Sukamto, R. A.; Megasari, R.

2018-05-01

Programming logic thinking is the most important competence for computer science students. However, programming is one of the difficult subject in computer science program. This paper reports our work about enhancing students' programming logic thinking using Analogy Mapping for basic programming subject. Analogy Mapping is a computer application which converts source code into analogies images. This research used time series evaluation and the result showed that Analogy Mapping can enhance students' programming logic thinking.

Intervening in the Professional Development of Science Teachers: The Colorado Science Teaching Enhancement Program. Interim Report of the Formative Evaluation of CO-STEP.

ERIC Educational Resources Information Center

Ellis, James D.; Maxwell, Donald E.

The purposes of the Colorado Science Teaching Enhancement Program (CO-STEP) are to improve the background in science content and the instructional skills of teachers in grades four through six throughout Colorado and to support the implementation of effective instruction. A network of six Teacher Development Centers in Colorado coordinate teacher…

Development and Implementation of Science and Technology Ethics Education Program for Prospective Science Teachers

NASA Astrophysics Data System (ADS)

Rhee, Hyang-yon; Choi, Kyunghee

2014-05-01

The purposes of this study were (1) to develop a science and technology (ST) ethics education program for prospective science teachers, (2) to examine the effect of the program on the perceptions of the participants, in terms of their ethics and education concerns, and (3) to evaluate the impact of the program design. The program utilized problem-based learning (PBL) which was performed as an iterative process during two cycles. A total of 23 and 29 prospective teachers in each cycle performed team activities. A PBL-based ST ethics education program for the science classroom setting was effective in enhancing participants' perceptions of ethics and education in ST. These perceptions motivated prospective science teachers to develop and implement ST ethics education in their future classrooms. The change in the prospective teachers' perceptions of ethical issues and the need for ethics education was greater when the topic was controversial.

The Case for Evaluating Student Outcomes and Equity Gaps to Improve Pathways and Programs of Study

ERIC Educational Resources Information Center

Bragg, Debra D.

2017-01-01

When linked to program review and improvement, program evaluation can help practitioners to ensure that career-technical education (CTE) and science, technology, engineering, and mathematics (STEM) programs offer equitable access and outcomes for underserved student groups.

STFM Behavioral Science/Family Systems Educator Fellowship: Evaluation of the First 4 Years.

PubMed

Gorski, Victoria; Taylor, Deborah A; Fletcher, Jason; Burge, Sandra K

2015-01-01

The discipline of family medicine has long valued the behavioral sciences. Most residency training programs employ a clinical psychologist, social worker, or family therapist to deliver behavioral science curriculum to their residents. However, the cultures and content of training for behavioral sciences and medical professions are quite different, leaving the lone behavioral scientist feeling professionally isolated and unprepared to translate knowledge and skills into tools for the family physician. In response to this need, a group of family medicine educators developed an STFM-sponsored fellowship for behavioral science faculty. The goals of the program were to improve fellows' understanding of the culture of family medicine, provide a curricular toolbox for the behavioral sciences, promote scholarship, and develop a supportive professional network. Senior behavioral science faculty at STFM developed a 1-year fellowship program, featuring "classroom learning" at relevant conferences, mentored small-group interactions, and scholarly project requirements. Achievement of program goals was evaluated annually with pre- and post-fellowship surveys. From 2010 to 2014, 59 fellows completed the program; most were psychologists or social workers; two thirds were women. One month after graduation, fellows reported significant increases in understanding the culture of medicine, improved confidence in their curricula and scholarship, and expanded professional networks, compared to pre-fellowship levels. The program required many hours of volunteer time by leaders, faculty, and mentors plus modest support from STFM staff. Leaders in family medicine education, confronted by the need for inter-professional development, designed and implemented a successful training program for behavioral science faculty.

Exploring the Suitability of an English for Health Sciences Program: Model and Report of a Self-Evaluation Process

ERIC Educational Resources Information Center

Ferrer, Erica; Pérez, Yuddy

2017-01-01

Program evaluation is a process of carefully collecting information in order to make informed decisions to strengthen specific components of a given program. The type of evaluation an institution decides to undertake depends on the purpose as well as on the information the institution wants to find out about its program. Self-evaluation represents…

Preparing tomorrow's health sciences librarians: feasibility and marketing studies.

PubMed Central

Moran, B B; Jenkins, C G; Friedman, C P; Lipscomb, C E; Gollop, C J; Moore, M E; Morrison, M L; Tibbo, H R; Wildemuth, B M

1996-01-01

The University of North Carolina at Chapel Hill is devising and evaluating five curricular models designed to improve education for health sciences librarianship. These models fit into a continual learning process from the initial professional preparation to lifelong learning opportunities. Three of them enhance existing degree and certificate programs in the School of Information and Library Science (SILS) with a health sciences specialization, and two are new programs for working information professionals. The approaches involve partnerships among SILS, the Health Sciences Library, and the program in Medical Informatics. The planning process will study the feasibility of the proposed programs, test the marketability of the models to potential students and employers, and make recommendations about implementation. PMID:8913557

Interpreting Outcomes: Using Focus Groups in Evaluation Research

ERIC Educational Resources Information Center

Ansay, Sylvia J.; Perkins, Daniel F.; Nelson, John

2004-01-01

Although focus groups continue to gain popularity in marketing and social science research, their use in program evaluation has been limited. Here we demonstrate how focus groups can benefit evaluators, program staff, policy makers and administrators by providing an in-depth understanding of program effectiveness from the perspective of…

E-Basics: Online Basic Training in Program Evaluation

ERIC Educational Resources Information Center

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

Issues Surrounding the Evaluation of Teacher Internship Programs

NASA Astrophysics Data System (ADS)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

78 FR 26646 - Office of Health Assessment and Translation Evaluation of the State of the Science for...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-05-07

... and Translation Evaluation of the State of the Science for Transgenerational Inheritance of Health Effects; Request for Information SUMMARY: The Office of Health Assessment and Translation (OHAT) of the Division of the National Toxicology Program (DNTP), National Institute of Environmental Health Sciences...

Review of Final Year MSP Evaluations, Performance Period 2007. Analytic and Technical Support for Mathematics and Science Partnerships

ERIC Educational Resources Information Center

Bobronnikov, Ellen; Rhodes, Hilary; Bradley, Cay

2010-01-01

This final report culminates the evaluation and technical assistance provided for the U.S. Department of Education's Mathematics and Science Partnership (MSP) Program and its projects since 2005. As part of this support, Abt Associates looked across the portfolio of projects funded by the MSP program to draw lessons on best practices. This…

Quality of Subjective Experience in a Summer Science Program for Academically Talented Adolescents.

ERIC Educational Resources Information Center

Tuss, Paul

This study utilized the flow theory of intrinsic motivation to evaluate the subjective experience of 78 academically talented high school sophomores participating in an 8-day summer research apprenticeship program in materials and nuclear science. The program involved morning lectures on such topics as physics of electromagnetic radiation, energy…

A Learning Research Informed Design and Evaluation of a Web-Enhanced Object Oriented Programming Seminar

ERIC Educational Resources Information Center

Georgantaki, Stavroula C.; Retalis, Symeon D.

2007-01-01

"Object-Oriented Programming" subject is included in the ACM Curriculum Guidelines for Undergraduate and Graduate Degree Programs in Computer Science as well as in Curriculum for K-12 Computer Science. In a few research studies learning problems and difficulties have been recorded, and therefore, specific pedagogical guidelines and…

Human Research Program Science Management: Overview of Research and Development Activities

NASA Technical Reports Server (NTRS)

Charles, John B.

2007-01-01

An overview of research and development activities of NASA's Human Research Science Management Program is presented. The topics include: 1) Human Research Program Goals; 2) Elements and Projects within HRP; 3) Development and Maintenance of Priorities; 4) Acquisition and Evaluation of Research and Technology Proposals; and 5) Annual Reviews

Evaluation Guidelines for the Clinical and Translational Science Awards (CTSAs)

PubMed Central

Rubio, Doris M.; Thomas, Veronica G.

2013-01-01

Abstract The National Center for Advancing Translational Sciences (NCATS), a part of the National Institutes of Health, currently funds the Clinical and Translational Science Awards (CTSAs), a national consortium of 61 medical research institutions in 30 states and the District of Columbia. The program seeks to transform the way biomedical research is conducted, speed the translation of laboratory discoveries into treatments for patients, engage communities in clinical research efforts, and train a new generation of clinical and translational researchers. An endeavor as ambitious and complex as the CTSA program requires high‐quality evaluations in order to show that the program is well implemented, efficiently managed, and demonstrably effective. In this paper, the Evaluation Key Function Committee of the CTSA Consortium presents an overall framework for evaluating the CTSA program and offers policies to guide the evaluation work. The guidelines set forth are designed to serve as a tool for education within the CTSA community by illuminating key issues and practices that should be considered during evaluation planning, implementation, and utilization. Additionally, these guidelines can provide a basis for ongoing discussions about how the principles articulated in this paper can most effectively be translated into operational reality. PMID:23919366

The Exploratorium's XTech Program: Engaging STEM Experiences for Middle-School Youth. Summative Evaluation Report

ERIC Educational Resources Information Center

Carroll, Becky; Smith, Anita; Castori, Pam

2009-01-01

The Exploratorium is home to XTech, a science education program which began in 2006 and was primarily funded by a three-year National Science Foundation grant (Award # 05-25217) through its ITEST (Innovative Technology Experiences for Students and Teachers) initiative. XTech provided project-based afterschool activities in science, engineering,…

Evaluation of a Secondary School Science Program Inversion: Moving from a Traditional to a Modifified-PCB Sequence

ERIC Educational Resources Information Center

Gaubatz, Julie

2013-01-01

Studies of high-school science course sequences have been limited primarily to a small number of site-specific investigations comparing traditional science sequences (e.g., Biology-Chemistry-Physics: BCP) to various Physics First-influenced sequences (Physics-Chemistry-Biology: PCB). The present study summarizes a five-year program evaluation…

An Evaluation of an Elementary Science Methods Course with Respect to Preservice Teacher's Pedagogical Development

ERIC Educational Resources Information Center

Lee, Carole Kwan-Ping

2012-01-01

The science methods course is a requirement for the Bachelor of Science degree in elementary education licensure program in a mid-west state university in the U.S.A. In one semester, the author decided to evaluate the effectiveness of the science methods course in pedagogical content knowledge areas such as theory, planning and implementation.…

Evaluating the High School Lunar Research Projects Program

NASA Astrophysics Data System (ADS)

Shaner, A. J.; Shipp, S. S.; Allen, J.; Kring, D. A.

2012-12-01

The Center for Lunar Science and Exploration (CLSE), a collaboration between the Lunar and Planetary Institute and NASA's Johnson Space Center, is one of seven member teams of the NASA Lunar Science Institute (NLSI). In addition to research and exploration activities, the CLSE team is deeply invested in education and outreach. In support of NASA's and NLSI's objective to train the next generation of scientists, CLSE's High School Lunar Research Projects program is a conduit through which high school students can actively participate in lunar science and learn about pathways into scientific careers. The objectives of the program are to enhance 1) student views of the nature of science; 2) student attitudes toward science and science careers; and 3) student knowledge of lunar science. In its first three years, approximately 140 students and 28 teachers from across the United States have participated in the program. Before beginning their research, students undertake Moon 101, a guided-inquiry activity designed to familiarize them with lunar science and exploration. Following Moon 101, and guided by a lunar scientist mentor, teams choose a research topic, ask their own research question, and design their own research approach to direct their investigation. At the conclusion of their research, teams present their results to a panel of lunar scientists. This panel selects four posters to be presented at the annual Lunar Science Forum held at NASA Ames. The top scoring team travels to the forum to present their research. Three instruments have been developed or modified to evaluate the extent to which the High School Lunar Research Projects meets its objectives. These three instruments measure changes in student views of the nature of science, attitudes towards science and science careers, and knowledge of lunar science. Exit surveys for teachers, students, and mentors were also developed to elicit general feedback about the program and its impact. The nature of science instrument is an open-ended, modified version of the Views of Nature of Science questionnaire. The science attitudes Likert-scale instrument is a modified version of the Attitudes Toward Science Inventory. The lunar science content instrument was developed by CLSE education staff. All three of these instruments are administered to students before and after their research experience to measure the program's impact on student views of the nature of science, attitudes toward science, and knowledge of lunar science. All instruments are administered online via Survey Monkey®. When asked if the program changed the way they view the Moon, 77.4% of students (n=53) replied "yes" and described their increase in knowledge of the formation of the Moon, lunar surface processes, etc. Just under half (41.5%) of the students reported that their experience in the program has contributed to their consideration of a career in science. When asked about obstacles teams had to overcome, teachers described issues with time, student motivation and technology. However, every teacher enthusiastically agreed that the authentic research experience was worthwhile to their students. Detailed evaluation results for the 2011-2012 program will be presented.

Commentary: Teaching creativity and innovative thinking in medicine and the health sciences.

PubMed

Ness, Roberta B

2011-10-01

The National Academies of Science recently criticized the state of scientific innovation and competitiveness in the United States. Evaluations of already-established creativity training programs--examining a broad array of students, from school age to adult and with a wide range of abilities--have shown that such courses improve thinking skills, attitudes, and performance. Although academic medicine provides informal training in creativity and innovation, it has yet to incorporate formal instruction on these topics into medical education. A number of existing, thoughtfully constructed and evaluated creativity programs in other fields provide a pedagogical basis for developing creativity training programs for the health sciences. The content of creativity training programs typically includes instruction and application in (1) divergent thinking, (2) problem solving, and (3) creative production. Instructional formats that have been shown to elicit the best outcomes are an admixture of lectures, discussion, and guided practice. A pilot program to teach innovative thinking to health science students at the University of Texas includes instruction in recognizing and finding alternatives to frames or habitual cognitive patterns, in addition to the constructs already mentioned. As innovation is the engine of scientific progress, the author, founder of Innovative Thinking, the creativity training pilot program at the University of Texas, argues in this commentary that academic health centers should implement and evaluate new methods for enhancing science students' innovative thinking to keep the United States as a worldwide leader in scientific discovery.

A Qualitative Evaluation of Ethics Educational Program in Health Science.

PubMed

Ekmekci, Perihan Elif; Oral, Murat; Yurdakul, Eray Serdar

2015-06-01

This paper originates from a panel discussion on the evaluation of "Ethics Educational Program in Health Sciences" held during the IAEE Conference 2014 Ankara, Turkey. The participants of the panel had consultations to solidify the concepts about the topic. The qualitative data out of these antecedent discussions became mature with the contributions in the panel. The outcome of this qualitative study mainly focuses on the examples of two current curricula; one from PhD on History of Medicine and Medical Ethics, the other one from an elective course on medical ethics as a part of a PhD program on Pharmacy Management and History, followed by the major challenges the trainees face during their education, their expectations and whether the program was satisfactory, the aspects of the programs which are prone to improvement and their overall evaluations of the programs.

Development and Evaluation of Science and Technology Education Program Using Interferometric SAR

NASA Astrophysics Data System (ADS)

Ito, Y.; Ikemitsu, H.; Nango, K.

2016-06-01

This paper proposes a science and technology education program to teach junior high school students to measure terrain changes by using interferometric synthetic aperture radar (SAR). The objectives of the proposed program are to evaluate and use information technology by performing SAR data processing in order to measure ground deformation, and to incorporate an understanding of Earth sciences by analyzing interferometric SAR processing results. To draft the teaching guidance plan for the developed education program, this study considers both science and technology education. The education program was used in a Japanese junior high school. An educational SAR processor developed by the authors and the customized Delft object-oriented radar interferometric software package were employed. Earthquakes as diastrophism events were chosen as practical teaching materials. The selected events indicate clear ground deformation in differential interferograms with high coherence levels. The learners were able to investigate the ground deformations and disasters caused by the events. They interactively used computers and became skilled at recognizing the knowledge and techniques of information technology, and then they evaluated the technology. Based on the results of pre- and post-questionnaire surveys and self-evaluation by the learners, it was clarified that the proposed program was applicable for junior high school education, and the learners recognized the usefulness of Earth observation technology by using interferometric SAR. The usefulness of the teaching materials in the learning activities was also shown through the practical teaching experience.

Evaluating Student Success and Progress in the Maryland Sea Grant REU Program

NASA Astrophysics Data System (ADS)

Moser, F. C.; Allen, M. R.; Clark, J.

2012-12-01

The Maryland Sea Grant's Research Experiences for Undergraduate (REU) 12-week summer program is in its 24th year. This estuarine science-focused program has evolved, based in part on our use of assessment tools to measure the program's effectiveness. Our goal is to understand the REU program's effectiveness in such areas as improving student understanding of scientific research, scientific ethics and marine science careers. Initially, our assessment approach was limited to short surveys that used qualitative answers from students about their experience. However, in the last decade we have developed a more comprehensive approach to measure program effectiveness. Currently, we use paired pre- and post-survey questions to estimate student growth during the program. These matching questions evaluate the student's change in knowledge and perception of science research over the course of the summer program. Additionally, we administer several surveys during the 12 weeks of the program to measure immediate responses of students to program activities and to gauge the students' evolving attitudes to customize each year's program. Our 2011 cohort showed consistent improvement in numerous areas, including understanding the nature of science (pre: 4.35, post: 4.64 on a 5 point scale), what graduate school is like (3.71, 4.42), the job of a researcher (4.07, 4.50), and career options in science (3.86, 4.42). Student confidence also increased in numerous skills required for good scientists. To analyze the long-term impact of our program, we survey our alumni to assess graduate degrees earned and career choices. A large percentage (72%) of our tracked alumni have continued on to graduate school, with subsequent careers spanning the academic (51%), public (24%) and private (25%) sectors. These assessments demonstrate that our program is successful in meeting our key objectives of strengthening the training of undergraduates in the sciences and retaining them in marine science careers.

The Galileoscope project: community-based technology education in Arizona

NASA Astrophysics Data System (ADS)

Pompea, Stephen M.; Fine, Leonard W.; Sparks, Robert T.; Walker, Constance E.; Dugan, Charles L.; Dokter, Erin F. C.

2014-07-01

A program model has been developed and implemented over the last three years to provide a robust optical technologybased science education program to students aged 9-11 years (5th grade), a formative time in the development of a student's interest in science and engineering. We have created well-tested and evaluated teaching kits for the classroom to teach about the basics of image formation and telescopes. In addition we provide professional development to the teachers of these students on principles of optics and on using the teaching kits. The program model is to reach every teacher and every student in a number of mid-sized rural communities across the state of Arizona. The Galileoscope telescope kit is a key part of this program to explore optics and the nature of science. The program grew out of Module 3 of the NSF-Supported Hands-On Optics project (SPIE, OSA, and NOAO) and from the Science Foundation Arizona-supported Hands-On Optics Arizona program. NOAO has conducted this program in Flagstaff, Yuma, Globe, and Safford, Arizona and is being expanded to sites across the entire state of Arizona (295,254 square kilometers). We describe the educational goals, evaluations, and logistical issues connected to the program. In particular, we proposed that this model can be adapted for any rural or urban locations in order to encourage interest in science, astronomy and optics.-

Crossing boundaries: the design of an interdisciplinary training program to improve care for the frail elderly.

PubMed

Kolomitro, Klodiana; Stockley, Denise; Egan, Rylan; MacDonald, Michelle L

2015-01-01

The Technology Evaluation in the Elderly Network (TVN) was funded in July 2012 under the Canadian Networks of Centres of Excellence program. This article highlights the development and preliminary evaluation of the TVN Interdisciplinary Training Program. This program is based on an experiential learning approach that crosses a multitude of disciplines including health sciences, law, social sciences, and ethical aspects of working with the frail elderly. Opportunities within the program include mentorship, interdisciplinary online collaborative projects, external placements, academic products, pre-grant submission, trainee-driven requirements, Network meetings, online modules/webinars, and most importantly active involvement with patients, families, and their support systems. The authors have 120 trainees from approximately 23 different disciplines including law, ethics, public policy, social work, and engineering engaged in the program. Based on our evaluation this program has been perceived as highly valuable by the participants and the community.

METRO Achievement Program: Summer 1988. External Evaluation Report.

ERIC Educational Resources Information Center

Thompson, Denise R.

This document comprises an evaluation of the 1988 METRO Achievement Program, a summer educational program to help develop the academic potential of primarily Black and Hispanic girls entering the seventh and eighth grades in Chicago. The 5-week program included the following components: (1) mathematics, science, and communication skills classes;…

AAAS Communicating Science Program: Reflections on Evaluation

NASA Astrophysics Data System (ADS)

Braha, J.

2015-12-01

The AAAS Center for Public Engagement (Center) with science builds capacity for scientists to engage public audiences by fostering collaboration among natural or physical scientists, communication researchers, and public engagement practitioners. The recently launched Leshner Leadership Institute empowers cohorts of mid-career scientists to lead public engagement by supporting their networks of scientists, researchers, and practitioners. The Center works closely with social scientists whose research addresses science communication and public engagement with science to ensure that the Communicating Science training program builds on empirical evidence to inform best practices. Researchers ( Besley, Dudo, & Storkdieck 2015) have helped Center staff and an external evaluator develop pan instrument that measures progress towards goals that are suggested by the researcher, including internal efficacy (increasing scientists' communication skills and confidence in their ability to engage with the public) and external efficacy (scientists' confidence in engagement methods). Evaluation results from one year of the Communicating Science program suggest that the model of training yields positive results that support scientists in the area that should lead to greater engagement. This talk will explore the model for training, which provides a context for strategic communication, as well as the practical factors, such as time, access to public engagement practitioners, and technical skill, that seems to contribute to increased willingness to engage with public audiences. The evaluation program results suggest willingness by training participants to engage directly or to take preliminary steps towards engagement. In the evaluation results, 38% of trained scientists reported time as a barrier to engagement; 35% reported concern that engagement would distract from their work as a barrier. AAAS works to improve practitioner-researcher-scientist networks to overcome such barriers.

Assessment Tool Development for Extracurricular Smet Programs for Girls

NASA Astrophysics Data System (ADS)

House, Jody; Johnson, Molly; Borthwick, Geoffrey

Many different programs have been designed to increase girls' interest in and exposure to science, mathematics, engineering, and technology (SMET). Two of these programs are discussed and contrasted in the dimensions of length, level of science content, pedagogical approach, degree of self- vs. parent-selected participants, and amount of communitybuilding content. Two different evaluation tools were used. For one program, a modified version of the University of Pittsburgh's undergraduate engineering attitude assessment survey was used. Program participants' responses were compared to those from a fifth grade, mixed-sex science class. The only gender difference found was in the area of parental encouragement. The girls in the special class were more encouraged to participate in SMET areas. For the second program, a new age-appropriate tool developed specifically for these types of programs was used, and the tool itself was evaluated. The results indicate that the new tool has construct validity. On the basis of these preliminary results, a long-term plan for the continued development of the assessment tool is outlined.

A Controlled Evaluation of a High School Biomedical Pipeline Program: Design and Methods

NASA Astrophysics Data System (ADS)

Winkleby, Marilyn A.; Ned, Judith; Ahn, David; Koehler, Alana; Fagliano, Kathleen; Crump, Casey

2014-02-01

Given limited funding for school-based science education, non-school-based programs have been developed at colleges and universities to increase the number of students entering science- and health-related careers and address critical workforce needs. However, few evaluations of such programs have been conducted. We report the design and methods of a controlled trial to evaluate the Stanford Medical Youth Science Program's Summer Residential Program (SRP), a 25-year-old university-based biomedical pipeline program. This 5-year matched cohort study uses an annual survey to assess educational and career outcomes among four cohorts of students who participate in the SRP and a matched comparison group of applicants who were not chosen to participate in the SRP. Matching on sociodemographic and academic background allows control for potential confounding. This design enables the testing of whether the SRP has an independent effect on educational- and career-related outcomes above and beyond the effects of other factors such as gender, ethnicity, socioeconomic background, and pre-intervention academic preparation. The results will help determine which curriculum components contribute most to successful outcomes and which students benefit most. After 4 years of follow-up, the results demonstrate high response rates from SRP participants and the comparison group with completion rates near 90 %, similar response rates by gender and ethnicity, and little attrition with each additional year of follow-up. This design and methods can potentially be replicated to evaluate and improve other biomedical pipeline programs, which are increasingly important for equipping more students for science- and health-related careers.

A CONTROLLED EVALUATION OF A HIGH SCHOOL BIOMEDICAL PIPELINE PROGRAM: DESIGN AND METHODS.

PubMed

Winkleby, Marilyn A; Ned, Judith; Ahn, David; Koehler, Alana; Fagliano, Kathleen; Crump, Casey

2014-02-01

Given limited funding for school-based science education, non-school-based programs have been developed at colleges and universities to increase the number of students entering science- and health-related careers and address critical workforce needs. However, few evaluations of such programs have been conducted. We report the design and methods of a controlled trial to evaluate the Stanford Medical Youth Science Program's Summer Residential Program (SRP), a 25-year-old university-based biomedical pipeline program. This 5-year matched cohort study uses an annual survey to assess educational and career outcomes among four cohorts of students who participate in the SRP and a matched comparison group of applicants who were not chosen to participate in the SRP. Matching on sociodemographic and academic background allows control for potential confounding. This design enables the testing of whether the SRP has an independent effect on educational- and career-related outcomes above and beyond the effects of other factors such as gender, ethnicity, socioeconomic background, and pre-intervention academic preparation. The results will help determine which curriculum components contribute most to successful outcomes and which students benefit most. After 4 years of follow-up, the results demonstrate high response rates from SRP participants and the comparison group with completion rates near 90%, similar response rates by gender and ethnicity, and little attrition with each additional year of follow-up. This design and methods can potentially be replicated to evaluate and improve other biomedical pipeline programs, which are increasingly important for equipping more students for science- and health-related careers.

A Service-Based Program Evaluation Platform for Enhancing Student Engagement in Assignments

ERIC Educational Resources Information Center

Wu, Ye-Chi; Ma, Lee Wei; Jiau, Hewijin Christine

2013-01-01

Programming assignments are commonly used in computer science education to encourage students to practice target concepts and evaluate their learning status. Ensuring students are engaged in such assignments is critical in attracting and retaining students. To this end, WebHat, a service-based program evaluation platform, is introduced in this…

Compulsory Project-Level Involvement and the Use of Program-Level Evaluations: Evaluating the Local Systemic Change for Teacher Enhancement Program

ERIC Educational Resources Information Center

Johnson, Kelli; Weiss, Iris R.

2011-01-01

In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

Science: Promising and Exemplary Programs and Materials in Elementary and Secondary Schools. [Science Education Information Report.

ERIC Educational Resources Information Center

Helgeson, Stanley L.; And Others

This document contains 36 programs and/or material listings that were nominated by at least three persons and for which there was evidence of the quality of the program or materials. Reviewers looked for positive evaluation data on the impact of the materials on students, or other information that assessed the quality of the program or materials,…

Evaluation of the Correlated Science and Mathematics Professional Development Model, 2009-2010 Cohort

ERIC Educational Resources Information Center

Morlier, Rebecca

2012-01-01

The purpose of this paper is to evaluate the effectiveness of the 2009-2010 iteration of the Correlated Science and Mathematics (CSM) professional development program which provides teachers and principals experience with integrated and effective science and mathematics teaching strategies and content. Archival CSM data was analyzed via mixed…

Predictors of Student Success in Entry-Level Science Courses

ERIC Educational Resources Information Center

Singh, Mamta K.

2009-01-01

Although the educational evaluation process is useful and valuable and is supported by the Higher Education Act, a strong research base for program evaluation of college entry-level science courses is still lacking. Studies in science disciplines such as, biology, chemistry, and physics have addressed various affective and demographic factors and…

Transfer Entails Communication: The Public Understanding of (Social) Science as a Stage and a Play for Implementing Evidence-Based Prevention Knowledge and Programs.

PubMed

Bromme, Rainer; Beelmann, Andreas

2018-04-01

Many social science-based interventions entail the transfer of evidence-based knowledge to the "target population," because the acquisition and the acceptance of that knowledge are necessary for the intended improvement of behavior or development. Furthermore, the application of a certain prevention program is often legitimated by a reference to science-based reasons such as an evaluation according to scientific standards. Hence, any implementation of evidence-based knowledge and programs is embedded in the public understanding of (social) science. Based on recent research on such public understanding of science, we shall discuss transfer as a process of science communication.

The effect of the Advanced Placement Training and Incentive Program on increasing enrollment and performance on Advanced Placement science exams

NASA Astrophysics Data System (ADS)

Ramsey, Susan Brady

The purpose of this study is to examine the effectiveness of the National Math and Science Initiative's Advanced Placement Training and Incentive Program (APTIP) on the number of students taking AP science courses and their performance. The study evaluated 39 schools over a six-year period in six states that participate in the APTIP. The National Math and Science Initiative provided data for cohort I. A general linear model for repeated measures was used to evaluate the data. Data was evaluated three years prior to the intervention and three years during the intervention, which will actually continue for two more years (2012 and 2013) since cohort I schools were awarded five years of support. Students in APTIP schools enrolled in more AP science exams (AP Biology, AP Chemistry, AP Environmental Science, and AP Physics-B) over the course of the intervention. The quantity of students earning qualifying scores increased during the intervention years. APTIP is a multi-tiered program that includes seven days of teacher training, three six-hour student prep sessions, school equipment, reduced exam fees, and monetary incentives for students and teachers. This program positively impacted the quantity of enrollment and qualifying scores during the three years evaluated in this study. Increases in the number of female and African American students' test takers their and qualifying scores were seen in all three years of the APTIP intervention. This study supports the premise that the first step to increasing the Science, technology, engineering, and math (STEM) pipeline is giving access to advanced courses to more students in high schools.

Lessons from a Train-the-Trainer Professional Development Program: The Sustainable Trainer Engagement Program (STEP)

NASA Astrophysics Data System (ADS)

Shupla, Christine; Gladney, Alicia; Dalton, Heather; LaConte, Keliann; Truxillo, Jeannette; Shipp, Stephanie

2015-11-01

The Sustainable Trainer Engagement Program (STEP) is a modified train-the-trainer professional development program being conducted by the Lunar and Planetary Institute (LPI). STEP has provided two cohorts of 6-8th grade science specialists and lead teachers in the Houston region with in-depth Earth and Space Science (ESS) content, activities, and pedagogy over 15 days each, aligned with Texas science standards. This project has two over-arching goals: to improve middle school ESS instruction, and to create and test an innovative model for Train-the-Trainer.This poster will share details regarding STEP’s activities and resources, program achievements, and its main findings to date. STEP is being evaluated by external evaluators at the Research Institute of Texas, part of the Harris County Department of Education. External evaluation shows an increase after one year in STEP participants’ knowledge (cohort 1 showed a 10% increase; cohort 2 showed a 20% increase), confidence in teaching Earth and Space Science effectively (cohort 1 demonstrated a 10% increase; cohort 2 showed a 20% increase), and confidence in preparing other teachers (cohort 1 demonstrated a 12% increase; cohort 2 showed a 20% increase). By September 2015, STEP participants led (or assisted in leading) approximately 40 workshops for about 1800 science teachers in Texas. Surveys of teachers attending professional development conducted by STEP participants show very positive responses, with averages for conference workshop evaluations ranging from 3.6 on a 4 point scale, and other evaluations averaging from 4.1 to 5.0 on a 5 point scale.Main lessons for the team on the train-the-trainer model include: a lack of confidence by leaders in K-12 science education in presenting ESS professional development, difficulties in arranging for school or district content-specific professional development, the minimal duration of most school and district professional development sessions, and uncertainties in partnerships between scientists and educators.

Saturday Morning Science programs: a model to increase diversity in the biosciences.

PubMed

Phillips, James L; Harris, Toi Blakley; Ihedigbo, Kara M Green; Hawkins, Jacqueline

2012-01-01

To examine a pathway program for middle and high school students from underrepresented backgrounds designed to foster career interest in the biomedical sciences. In 2002, the Institute of Medicine released a report entitled Unequal Treatment, which examined the racial and ethnic disparities in health and health care within the United States and encouraged the development of a diverse health care workforce as a means to reduce health care disparities. Saturday Morning Science (SMS) is a program model presented as a pipeline strategy that addresses this specific recommendation. SMS is a 10-week program that emphasized the importance of science and math. Post-SMS evaluations were conducted to assess biomedical career knowledge, attitudes regarding future career plans, and the effectiveness of the program. A total of 87.5% of middle and high school students who were enrolled in SMS completed the program (113 of 130). Seventy percent of SMS participants were underrepresented minorities. Snapshot program evaluation data exposed new ideas about science (strongly agree/agree, 98%; 64 of 65), exposed new ideas about medicine (strongly agree/agree, 97%; 63 of 65, and increased desire to enter science related field (strongly agree/agree 82% (53 of 65). SMS was designed to motivate students of underrepresented ethnic backgrounds from middle through high school to attend college and prepare for careers in the health sciences. SMS students had the opportunity to interact with scientists, physicians, medical and graduate students, and other academicians. They provided direction and guidance to ensure that students had meaningful experiences specifically designed to expose them to opportunities in the biosciences.

College Admissions and Academic Ethic: How Context-Specific Evaluation within a Science-Based Compensatory Program Benefits African American Students

ERIC Educational Resources Information Center

Wooten, Melissa E.

2016-01-01

This study investigates how the college readiness of participants in a compensatory program designed to facilitate interest in science and engineering was determined. Archival data were used to qualitatively analyze the performance reports of 205 student participants during the compensatory program's first 5 years. Findings indicate participants…

Development of a Mathematics, Science, and Technology Education Integrated Program for a Maglev

ERIC Educational Resources Information Center

Park, Hyoung Seo

2006-01-01

The purpose of the study was to develop an MST Integrated Program for making a Maglev hands-on activity for higher elementary school students in Korea. In this MST Integrated Program, students will apply Mathematics, Science, and Technology principles and concepts to the design, construction, and evaluation of a magnetically levitated vehicle. The…

Correlated Curriculum Program: An Experimental Program. Science Level 1 (9A, 9B, 10A).

ERIC Educational Resources Information Center

Loebl, Stanley, Ed.; And Others

The unit plans in Correlated Science 1 are intended to be of use to the teacher in both lesson and team planning. The course in science was designed for optimum correlation with the work done in business, health, and industrial careers. Behavioral objectives, class routines, time allotments, student evaluation, and the design of the manual are…

A Unique Marine and Environmental Science Program for High School Teachers in Hawai'i: Professional Development, Teacher Confidence, and Lessons Learned

ERIC Educational Resources Information Center

Rivera, Malia Ana J.; Manning, Mackenzie M.; Krupp, David A.

2013-01-01

Hawai'i is a unique and special place to conduct environmental science inquiry through place based learning and scientific investigation. Here, we describe and evaluate a unique professional development program for science teachers in Hawai'i that integrates the traditional approach of providing training to improve content knowledge, with the…

Evaluation of the National Science Foundation's Integrative Graduate Education and Research Traineeship Program (IGERT): Follow-Up Study of IGERT Graduates. Final Report

ERIC Educational Resources Information Center

Carney, Jennifer; Martinez, Alina; Dreier, John; Neishi, Kristen; Parsad, Amanda

2011-01-01

The National Science Foundation's Integrative Graduate Education and Research Traineeship (IGERT) program supports students in science, technology, engineering, and mathematics (STEM) fields who participate in university-developed interdisciplinary graduate training experiences. Faculty members at each IGERT site develop a series of education…

Program evaluation of an Integrated Basic Science Medical Curriculum in Shiraz Medical School, Using CIPP Evaluation Model

PubMed Central

ROOHOLAMINI, AZADEH; AMINI, MITRA; BAZRAFKAN, LEILA; DEHGHANI, MOHAMMAD REZA; ESMAEILZADEH, ZOHREH; NABEIEI, PARISA; REZAEE, RITA; KOJURI, JAVAD

2017-01-01

Introduction: In recent years curriculum reform and integration was done in many medical schools. The integrated curriculum is a popular concept all over the world. In Shiraz medical school, the reform was initiated by stablishing the horizontal basic science integration model and Early Clinical Exposure (ECE) for undergraduate medical education. The purpose of this study was to provide the required data for the program evaluation of this curriculum for undergraduate medical students, using CIPP program evaluation model. Methods: This study is an analytic descriptive and triangulation mixed method study which was carried out in Shiraz Medical School in 2012, based on the views of professors of basic sciences courses and first and second year medical students. The study evaluated the quality of the relationship between basic sciences and clinical courses and the method of presenting such courses based on the Context, Input, Process and Product (CIPP) model. The tools for collecting data, both quantitatively and qualitatively, were some questionnaires, content analysis of portfolios, semi- structured interview and brain storming sessions. For quantitative data analysis, SPSS software, version 14, was used. Results: In the context evaluation by modified DREEM questionnaire, 77.75%of the students believed that this educational system encourages them to actively participate in classes. Course schedule and atmosphere of class were reported suitable by 87.81% and 83.86% of students. In input domain that was measured by a researcher made questionnaire, the facilities for education were acceptable except for shortage of cadavers. In process evaluation, the quality of integrated modules presentation and Early Clinical Exposure (ECE) was good from the students’ viewpoint. In product evaluation, students’ brain storming, students’ portfolio and semi-structured interview with faculties were done, showing some positive aspects of integration and some areas that need improvement. Conclusion: The main advantage of assessing an educational program based on CIPP evaluation model is that the context, input, process and product of the program are viewed and evaluated systematically. This will help the educational authorities to make proper decisions based on the weaknesses and strengths of the program on its continuation, cessation and revision. Based on the results of this study, the integrated basic sciences course for undergraduate medical students in Shiraz Medical School is at a desirable level. However, attempts to improve or reform some sections and continual evaluation of the program and its accreditation seem to be necessary. PMID:28761888

78 FR 37590 - Agency Information Collection Activities: Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-06-21

...: Program Evaluation of the Scholarships in Science, Technology, Engineering, and Mathematics (S-STEM... Mathematics (S-STEM) Program, which operates within NSF's Division of Undergraduate Education. The evaluation...

Excursions in technology policy

NASA Technical Reports Server (NTRS)

Archibald, Robert B.

1995-01-01

This technical report presents a summary of three distinct projects: (1) Measuring economic benefits; (2) Evaluating the SBIR program; and (3) A model for evaluating changes in support for science and technology. the first project deals with the Technology Applications Group (TAG) at NASA Langley Research Center. The mission of TAG is to assist firms interested in commercializing technologies. TAG is a relatively new group as is the emphasis on technology commercialization for NASA. One problem faced by TAG and similar groups at other centers is measuring their effectiveness. The first project this summer, a paper entitled, 'Measuring the Economic Benefits of Technology Transfer from a National Laboratory: A Primer,' focused on this measurement problem. We found that the existing studies of the impact of technology transfer on the economy were conceptually flawed. The 'primer' outlines the appropriate theoretical framework for measuring the economic benefits of technology transfer. The second project discusses, one of the programs of TAG, the Small Business Innovation Research (SBIR) program. This program has led to over 400 contracts with Small Business since its inception in 1985. The program has never been evaluated. Crucial questions such as those about the extent of commercial successes from the contracts need to be answered. This summer we designed and implemented a performance evaluation survey instrument. The analysis of the data will take place in the fall. The discussion of the third project focuses on a model for evaluating changes in support for science and technology. At present several powerful forces are combining to change the environment for science and technology policy. The end of the cold war eliminated the rationale for federal support for many projects. The new- found Congressional conviction to balance the budget without tax increases combined with demographic changes which automatically increase spending for some politically popular programs will make it difficult to find funding for science and technology. Also, the two political parties have very different conceptions of the appropriate future for research and development spending. All these changes create the potential for serious, perhaps unintended, consequences for the economic future of the country. In a paper entitled, 'A Conceptual Framework for Evaluating the Impact of Changes in Federal Support for Science and Technology,' we introduce a model to evaluate the effects of changes in federal spending for science and technology. This paper both provides a way of organizing informed discussions and points out important research topics for science and technology policy.

Evaluation Report III: The Robert Noyce Scholarship Program at CSUB

ERIC Educational Resources Information Center

Wang, Jianjun

2013-01-01

California State University, Bakersfield (CSUB) received funding from National Science Foundation's (NSF) Robert Noyce Teacher Scholarship Program to recruit Noyce Scholars from upper-division science, technology, engineering, and mathematics (STEM) majors, graduate students, and professionals switched to STEM teaching from other fields (NSF…

The 1977 Rankings of Programs for an In-Depth Evaluation. Research Note.

ERIC Educational Resources Information Center

Baratta, Mary Kathryne

Placement, unit cost, retention and attraction data for all programs at Moraine Valley Community College for which information was available were used to determine which programs needed in-depth evaluation. Four of the 24 associate degree programs (secretarial science, radiologic technology, power machine technology, and industrial supervision)…

Reaching Your Program Goals: The Secret to a Successful Relationship with Your Evaluator

NASA Astrophysics Data System (ADS)

Warburton, J.; Crowley, S.; Larson, A.

2012-12-01

PolarTREC (Teachers and Researchers Exploring and Collaborating) is a National Science Foundation (NSF) funded program in which K-12 teachers participate in hands-on field research experiences in the Polar Regions. PolarTREC has become a leader in the evaluation of teacher research experiences (TREs) and offers a model for outside evaluation for education and public outreach. Programs such as TRE's offer a direct package of outreach opportunities for effective broader impacts. This presentation offers a model for the evaluative process beginning with project design and goals, which involve an outside evaluator, and that provide funders with an outlined scope of projects as well as outcomes and products for use by the public to advance scientific understanding. Outcomes are determined before the program is developed to ensure that all components are striving for program efficacy. Formative and summative evaluations for all audiences ensure robust program reports via survey's, knowledge assessments, conference calls, outreach implementation plans for multiple diverse audiences and in-depth case studies with teachers back in their classrooms. PolarTREC has become part of a larger, international working group of evaluators and program managers on program assessment. As part of this working group, sharing best practices for effective evaluation to better support science efforts, inform funders, and communicate with the public, has been integral to the evolution and advancement of our successful evaluation model.

Increasing Mathematics and Science Achievement for Culturally Diverse Students through Teaching Training

NASA Technical Reports Server (NTRS)

Mahon, Lee

1997-01-01

The purpose of this proposal was to field test and evaluate a Teacher Training program that would prepare teachers to increase the motivation and achievement of culturally diverse students in the areas of science and mathematics. Designed as a three year program, this report covers the first two years of the training program at the Ronald McNair School in the Ravenswood School district, using the resources of the NASA Ames Research Center and the California Framework for Mathematics and Science.

Summative Evaluation Findings from the Interstellar Boundary Explorer (IBEX) Education and Public Outreach Program

NASA Astrophysics Data System (ADS)

Bartolone, L.; Nichols-Yehling, M.; Davis, H. B.; Davey, B.

2014-07-01

The Interstellar Boundary Explorer mission includes a comprehensive Education and Public Outreach (EPO) program in heliophysics that is overseen and implemented by the Adler Planetarium and evaluated by Technology for Learning Consortium, Inc. Several components of the IBEX EPO program were developed during the prime phase of the mission that were specifically designed for use in informal institutions, especially museums and planetaria. The program included a widely distributed planetarium show with accompanying informal education activities, printed posters, lithographs and other resources, funding for the development of the GEMS Space Science Sequence for Grades 6-8 curriculum materials, development of the IBEX mission website, development of materials for people with special needs, participation in the Heliophysics Educator Ambassador program, and support for the Space Explorers Afterschool Science Club for Chicago Public Schools. In this paper, we present an overview of the IBEX EPO program summative evaluation techniques and results for 2008 through 2012.

Building an Evaluation Framework for a Competency-Based Graduate Program at the University Of Southern Mississippi

ERIC Educational Resources Information Center

Gaudet, Cyndi H.; Annulis, Heather M.; Kmiec, John J., Jr.

2008-01-01

This article describes an ongoing project to build a comprehensive evaluation framework for the competency-based Master of Science in Workforce Training and Development (MSWTD) program at The University of Southern Mississippi (USM). First, it discusses some trends and issues in evaluating the performance of higher education programs in the United…

NASA Science Mission Directorate Science Education and Public Outreach Forums: A Six-Year Retrospective

NASA Astrophysics Data System (ADS)

Smith, Denise Anne; Peticolas, Laura; Schwerin, Theresa; Shipp, Stephanie; Lawton, Brandon L.; Meinke, Bonnie; Manning, James G.; Bartolone, Lindsay; Schultz, Gregory

2015-08-01

NASA’s Science Mission Directorate (SMD) created four competitively awarded Science Education and Public Outreach Forums (Astrophysics, Heliophysics, Planetary Science, Earth Science) in 2009. The NASA SMD education and public engagement community and Forum teams have worked together to share the science, the story, and the adventure of SMD's science missions with students, educators, and the public. In doing so, SMD's programs have emphasized collaboration between scientists with content expertise and educators with pedagogy expertise. The goal of the Education Forums has been to maximize program efficiency, effectiveness, and coherence by organizing collaborations that reduce duplication of effort; sharing best practices; aligning products to national education standards; creating and maintaining the NASA Wavelength online catalog of SMD education products; and disseminating metrics and evaluation findings. We highlight examples of our activities over the past six years, along with the role of the scientist-educator partnership and examples of program impact. We also discuss our community’s coordinated efforts to expand the Astro4Girls pilot program into the NASA Science4Girls and Their Families initiative, which partners NASA science education programs with public libraries to engage underrepresented audiences in science.

The Role of Ethnographic Interviewing in Climate Change Evaluation Research: Investigating Intended and Unintended program effects

NASA Astrophysics Data System (ADS)

Lloro-Bidart, T.

2012-12-01

Ethnographic interviewing is an under-utilized tool in climate change evaluation research, even though it has the potential to serve as a powerful method of data collection. The utility of the ethnographic interview lies in its ability to elicit responses from program participants describing what a program is in practice, shedding light on both intended and unintended program impacts. Drawing on evaluation work involving a federally-funded climate change grant at the University of California, Riverside, I will discuss how to design an ethnographic interview protocol in an effort to share "best practices" with other climate change evaluators. Particular attention will be given to applying ethnographic approaches to various program types, even those differing from the one discussed. I will share some of the concrete findings from my work on this grant, to serve as examples of the kinds of data evaluators can collect when employing an ethnographic approach to interviewing. UC Riverside's climate change grant is multi-faceted, however the component studied ethnographically was a science fair mentoring program. About twenty K-12 students from high poverty, ethnically diverse schools who expressed an interest in participating in science fair were paired up with graduate student mentors to simultaneously research climate change and design authentic science fair projects to compete at various levels. Since one of the stated goals of the grant is to "stimulate…students to consider climate science as a career track through experiential education activities" I was particularly interested in how student experiences with the project might differ from school science which has historically "pushed out" ethnically diverse students like those in many of Riverside's schools. (In the program students are able to interact one-on-one with a mentor and in school settings there is typically one teacher for more than thirty students). I also sought to understand student perceptions of the project design and implementation and how these perceptions might influence their thinking about science as a career. Further, I aimed to explore how mentor pedagogical philosophies might impact student experiences with the projects, since the scholarly literature supports the idea that teaching practices are linked to student success and interest in science. The key to ethnographic interviewing, which sets it apart from survey research and other interviewing styles is that the evaluator or researcher designs guided, yet open-ended questions, allowing informants to discuss what is important to them. This type of questioning affords the researcher the opportunity to ascertain whether or not the grant met some of its intended goals and impacts, while simultaneously granting participants the freedom to discuss unintended impacts not anticipated by the principal investigator and evaluator.

Training Families To Learn Science Together Using Astronomical Topics

NASA Astrophysics Data System (ADS)

Noel-Storr, Jacob; Wyllie, G.; Lierheimer, D.

2012-05-01

We present a collection of messages and lessons learned from a set of Family Science programs that have been developed, implemented and/or evaluated by the RIT Insight Lab over the past 5 years. The programs are connected by their use of astronomical topics to serve as the motivator for engagement and learning. The programs all focus on the development of inquiry skills and connecting family members to each other as science learning communities, rather than focusing on the development of specific content knowledge. We show how family science programs can increase engagement in STEM for parents and their children alike, and strengthen the pipeline of the next generation of scientists and engineers.

Impact of "Grassroots on Work" (GROW) Extension Program to the Bachelor of Arts in Political Science Students' Sense of Civic Responsibility

ERIC Educational Resources Information Center

Paga, Mark Leo Huit

2015-01-01

Purpose: The purpose of this study was to determine the medium term effect of service-learning program or "Grassroots on Work" extension program to civic responsibility of AB Political Science students. Methodology: This study employed an impact evaluation research design and both qualitative and quantitative. The data on goals and…

Big Bang! An Evaluation of NASA's Space School Musical Program for Elementary and Middle School Learners

NASA Astrophysics Data System (ADS)

Haden, C.; Styers, M.; Asplund, S.

2015-12-01

Music and the performing arts can be a powerful way to engage students in learning about science. Research suggests that content-rich songs enhance student understanding of science concepts by helping students develop content-based vocabulary, by providing examples and explanations of concepts, and connecting to personal and situational interest in a topic. Building on the role of music in engaging students in learning, and on best practices in out-of-school time learning, the NASA Discovery and New Frontiers program in association with Jet Propulsion Laboratory, Marshall Space Flight Center, and KidTribe developed Space School Musical. Space School Musical consists of a set of nine songs and 36 educational activities to teach elementary and middle school learners about the solar system and space science through an engaging storyline and the opportunity for active learning. In 2014, NASA's Jet Propulsion Laboratory contracted with Magnolia Consulting, LLC to conduct an evaluation of Space School Musical. Evaluators used a mixed methods approach to address evaluation questions related to educator professional development experiences, program implementation and perceptions, and impacts on participating students. Measures included a professional development feedback survey, facilitator follow-up survey, facilitator interviews, and a student survey. Evaluation results showed that educators were able to use the program in a variety of contexts and in different ways to best meet their instructional needs. They noted that the program worked well for diverse learners and helped to build excitement for science through engaging all learners in the musical. Students and educators reported positive personal and academic benefits to participating students. We present findings from the evaluation and lessons learned about integration of the arts into STEM education.

Science-based Framework for Environmental Benefits Assessment

DTIC Science & Technology

2013-03-01

ER D C/ EL T R -1 3 -4 Environmental Benefits Analysis Program Science-based Framework for Environmental Benefits Assessment E nv ir...acwc.sdp.sirsi.net/client/default. Environmental Benefits Analysis Program ERDC/EL TR-13-4 March 2013 Science-based Framework for Environmental Benefits ...evaluating ecosystem restoration benefits within the context of USACE Civil Works planning process. An emphasis is placed on knowledge gained from

A CONTROLLED EVALUATION OF A HIGH SCHOOL BIOMEDICAL PIPELINE PROGRAM: DESIGN AND METHODS

PubMed Central

Winkleby, Marilyn A.; Ned, Judith; Ahn, David; Koehler, Alana; Fagliano, Kathleen; Crump, Casey

2013-01-01

Given limited funding for school-based science education, non-school-based programs have been developed at colleges and universities to increase the number of students entering science- and health-related careers and address critical workforce needs. However, few evaluations of such programs have been conducted. We report the design and methods of a controlled trial to evaluate the Stanford Medical Youth Science Program’s Summer Residential Program (SRP), a 25-year-old university-based biomedical pipeline program. This 5-year matched cohort study uses an annual survey to assess educational and career outcomes among four cohorts of students who participate in the SRP and a matched comparison group of applicants who were not chosen to participate in the SRP. Matching on sociodemographic and academic background allows control for potential confounding. This design enables the testing of whether the SRP has an independent effect on educational- and career-related outcomes above and beyond the effects of other factors such as gender, ethnicity, socioeconomic background, and pre-intervention academic preparation. The results will help determine which curriculum components contribute most to successful outcomes and which students benefit most. After 4 years of follow-up, the results demonstrate high response rates from SRP participants and the comparison group with completion rates near 90%, similar response rates by gender and ethnicity, and little attrition with each additional year of follow-up. This design and methods can potentially be replicated to evaluate and improve other biomedical pipeline programs, which are increasingly important for equipping more students for science- and health-related careers. PMID:24563603

Creating a Research-Rich Curriculum at Miami University

NASA Astrophysics Data System (ADS)

Rauckhorst, William H.

2007-10-01

Miami University has attempted in recent years to build upon a collection of individual student research participation opportunities at the University, and develop a comprehensive ``research-rich'' undergraduate curriculum. A major step in this direction was the creation of the Undergraduate Summer Scholars (USS) program. This program provides 10-week summer research experiences with faculty mentors for 100 juniors or seniors each year. The USS Program is not limited to science and engineering areas, as approximately 30 academic departments participate annually. Development of the USS program at Miami was motivated by the University's prior experience with student research appointments funded by the National Science Foundation, the Howard Hughes Medical Institute, and other sponsoring agencies. The University's evaluation of these earlier student research experiences provided evidence that such experiences were at least as significant in a student's education as formal course work. A second important step in Miami's effort was obtaining a grant from the National Science Foundation's Comprehensive Reform of Undergraduate Education program. This funding enabled the University to enhance the Undergraduate Summer Scholars (USS) Program and evaluate student intellectual growth within the program. Two outcomes of this NSF-funded project are noteworthy: first, the USS program now is firmly established within the University's offerings; second, the evaluation ndicated profound student intellectual growth as a result of mentored research experiences. We will describe the development of the Undergraduate Summer Scholars Program, our evaluation of the Program, and ongoing efforts to extend the benefits of research experience to more students by incorporating research components within traditional coursework.

Evaluating the impact of geologic heritage on Earth science literacy: Adapting best practices from pedagogy and interpretation (Invited)

NASA Astrophysics Data System (ADS)

Semken, S. C.

2013-12-01

How might we authentically and practically evaluate the effects of a geologic heritage place or program on public Earth science literacy? This pedagogical form of evaluation is distinct from the evaluation of a place for its geological importance, heritage value, economic or cultural impact, and so on. Best evaluation practices from the realms of formal education, informal education, and interpretation start with a coherent set of evaluable learning outcomes, ideally recapitulated in one or more 'big ideas' that capture the essential attributes of the place or program. Learning outcomes may be classified as cognitive, affective, or psychomotor. Cognitive learning outcomes in a geoheritage context are the Earth-science concepts a visitor or student would be expected to uncover through on-site or virtual exploration of the stratigraphy, structure, landforms, and processes in a place. The Earth Science Literacy Principles (ESLP), and similar literacy documents relating to atmosphere, oceans, and climate; offer a template for mapping localized concepts onto more global ones. Quantitative instruments to evaluate understanding of the ESLP are in development, and the ESLP also map directly onto measures used in formal educational assessment, notably the Next Generation Science Standards in the USA. Nongeological place meanings (a component of sense of place) may suggest other cognitive outcomes. Affective learning outcomes for visitors and students in geoheritage sites are less readily defined, but may include place attachment (also a component of sense of place), attitudes, and interest. Multiple quantitative and qualitative methods of evaluating these outcomes exist. Psychomotor learning outcomes are even muddier, but accessibility (defined by statutes) offers a potential starting point. In practice, evaluation may be conducted synchronously or asynchronously with visitors' or students' interaction with the geoheritage place or program. Evaluation programs are typically constrained by access and practicality. Synchronous methods include observation, semi-structured interviews, rapid prototyping and surveys. Asynchronous methods include interviews, surveys, and tracking. Evaluation tools may require content or instrument validation for the specific context in which they are used. Illustrative examples from evaluation of public engagement with geoheritage places (National Parks) in the Southwest USA will be offered.

On track for success: an innovative behavioral science curriculum model.

PubMed

Freedy, John R; Carek, Peter J; Dickerson, Lori M; Mallin, Robert M

2013-01-01

This article describes the behavioral science curriculum currently in place at the Trident/MUSC Family Medicine Residency Program. The Trident/MUSC Program is a 10-10-10 community-based, university-affiliated program in Charleston, South Carolina. Over the years, the Trident/MUSC residency program has graduated over 400 Family Medicine physicians. The current behavioral science curriculum consists of both required core elements (didactic lectures, clinical observation, Balint groups, and Resident Grand Rounds) as well as optional elements (longitudinal patient care experiences, elective rotations, behavioral science editorial experience, and scholars project with a behavioral science focus). All Trident/MUSC residents complete core behavioral science curriculum elements and are free to participate in none, some, or all of the optional behavioral science curriculum elements. This flexibility allows resident physicians to tailor the educational program in a manner to meet individual educational needs. The behavioral science curriculum is based upon faculty interpretation of existing "best practice" guidelines (Residency Review Committee-Family Medicine and AAFP). This article provides sufficient curriculum detail to allow the interested reader the opportunity to adapt elements of the behavioral science curriculum to other residency training programs. While this behavioral science track system is currently in an early stage of implementation, the article discusses track advantages as well as future plans to evaluate various aspects of this innovative educational approach.

PR^2EPS: Preparation, Recruitment, Retention and Excellence in the Physical Sciences.

NASA Astrophysics Data System (ADS)

Labroo, Sunil; Schaumloffel, John; Gallagher, Hugh; Bischoff, Paul; Bachman, Nancy

2007-03-01

The PR^2EPS program is a multidisciplinary effort to increase the number of majors attending (and graduating) from SUNY Oneonta with degrees in chemistry, physics, biochemistry, astronomy, secondary chemistry or physics education and related areas. Components of the program include a walk-in tutoring center, a free, weeklong summer science camp, scholarship opportunities and an equipment loan program for regional secondary science teachers. 2006 was the third year of this NSF-DUE funded program. Evaluation of our progress to date shows that the program is effective at steering students (or at least reinforcing their desire) to studying the sciences in college. A summary of our goals, challenges and accomplishments, including tutoring center operation and efficacy, activities and operational details for the summer camp and other facets of the program will be presented.

Microgravity Science and Applications

NASA Technical Reports Server (NTRS)

1986-01-01

The report presents fifteen papers from a workshop on microgravity science and applications held at the Jet Propulsion Laboratory in Pasadena, California, on December 3 to 4, 1984. The workshop and panel were formed by the Solid State Sciences Committee of the Board on Physics and Astronomy of the National Research Council in response to a request from the Office of Science and Technology Policy. The goal was to review the microgravity science and applications (MSA) program of NASA and to evaluate the quality of the program. The topics for the papers are metals and alloys, electronic materials, ceramics and glasses, biotechnology, combustion science, and fluid dynamics.

NASA Space Science Days: An Out of School Program Using National Partnerships to Further Influence Future Scientists and Engineers.

NASA Technical Reports Server (NTRS)

Galindo, Charles; Allen, Jaclyn; Garcia, Javier; Hrrera, Stephanie

2012-01-01

The National Math and Science Initiative states that American students are falling behind in the essential subjects of math and science, putting our position in the global economy at risk a foreboding statement that has caused the U.S. to re-evaluate how we view STEM education. Developing science and engineering related out of school programs that expose middle school students to math and science in a nontraditional university environment has the potential to motivate young students to look at the physical sciences in an exciting out of the norm environment.

Effective Practices for Evaluating STEM Out-of-School Time Programs

ERIC Educational Resources Information Center

Wilkerson, Stephanie B.; Haden, Carol M.

2014-01-01

Science, technology, engineering, and mathematics (STEM) programs in out-of-school time (OST) are designed to supplement school work, ignite student interest, and extend STEM learning. From interactive museum exhibits to summer-long science camps, opportunities for informal student engagement in STEM learning abound. The differences these programs…

Footprints: Strategies for Non-Traditional Program Evaluation.

ERIC Educational Resources Information Center

Frechtling, Joy A., Ed.

Papers in this collection explore alternative and nontraditional approaches to evaluation. They provide options, speculations, and propositions that affect each thinker's ideas on how to trace the impact of National Science Foundation-supported programs. Organized around a central theme of footprints as evidence of a program's impact, the papers…

Community Psychology, Evaluation, and Social Critique

ERIC Educational Resources Information Center

Miller, Robin Lin

2015-01-01

Community psychology blends psychological science, a community-level perspective on social issues, and a social justice orientation. Despite important difference between community psychology and program evaluation, program evaluation is a key component of many community psychologists' practice and holds a central place in my own. In this…

Quantitative evaluation of space charge effects of laser-cooled three-dimensional ion system on a secular motion period scale

NASA Astrophysics Data System (ADS)

Du, Li-Jun; Song, Hong-Fang; Chen, Shao-Long; Huang, Yao; Tong, Xin; Guan, Hua; Gao, Ke-Lin

2018-04-01

Not Available Project supported by the National Key Research and Development Program of China (Grant No. 2017YFA0304401), the National Natural Science Foundation of China (Grant Nos. 11622434, 11474318, 91336211, and 11634013), the Strategic Priority Research Program of the Chinese Academy of Sciences (Grant No. XDB21030100), Hubei Province Science Fund for Distinguished Young Scholars (Grant No. 2017CFA040), and the Youth Innovation Promotion Association of the Chinese Academy of Sciences (Grant No. 2015274).

A Novel Assessment Tool for Quantitative Evaluation of Science Literature Search Performance: Application to First-Year and Senior Undergraduate Biology Majors

ERIC Educational Resources Information Center

Blank, Jason M.; McGaughey, Karen J.; Keeling, Elena L.; Thorp, Kristen L.; Shannon, Conor C.; Scaramozzino, Jeanine M.

2016-01-01

Expertise in searching and evaluating scientific literature is a requisite skill of trained scientists and science students, yet information literacy instruction varies greatly among institutions and programs. To ensure that science students acquire information literacy skills, robust methods of assessment are needed. Here, we describe a novel…

Intermediate Trends in Math and Science Partnership-Related Changes in Student Achievement with Management Information System Data

ERIC Educational Resources Information Center

Dimitrov, Dimiter M.

2009-01-01

This substudy in the evaluation design of the Math and Science Partnership (MSP) Program Evaluation examines student proficiency in mathematics and science for the MSPs' schools in terms of changes across three years (2003/04, 2004/05, and 2005/06) and relationships with MSP-related variables using Management Information System data with the…

Sciences Humaines Assessment, Manitoba 1991. Final Report: French Immersion Program = Evaluation en sciences humaines, Manitoba 1991. Rapport finale: Programme d'immersion francaise.

ERIC Educational Resources Information Center

Manitoba Dept. of Education and Training, Winnipeg. Curriculum Services Branch.

This document is the second of two reports of the findings of the 1991 "Sciences...humaines" Assessment for grades 8 and 10 conducted in Franco-Manitoban schools and in French immersion programs in Manitoba, Canada. The report on the French immersion course is presented in parallel French and English versions, and a separate report, in…

What good is a scientist in the classroom? Participant outcomes and program design features for a short-duration science outreach intervention in K-12 classrooms.

PubMed

Laursen, Sandra; Liston, Carrie; Thiry, Heather; Graf, Julie

2007-01-01

Many short-duration science outreach interventions have important societal goals of raising science literacy and increasing the size and diversity of the science workforce. Yet, these long-term outcomes are inherently challenging to evaluate. We present findings from a qualitative research study of an inquiry-based, life science outreach program to K-12 classrooms that is typical in design and excellent in execution. By considering this program as a best case of a common outreach model, the "scientist in the classroom," the study examines what benefits may be realized for each participant group and how they are achieved. We find that K-12 students are engaged in authentic, hands-on activities that generate interest in science and new views of science and scientists. Teachers learn new science content and new ways to teach it, and value collegial support of their professional work. Graduate student scientists, who are the program presenters, gain teaching and other skills, greater understanding of education and diversity issues, confidence and intrinsic satisfaction, and career benefits. A few negative outcomes also are described. Program elements that lead to these benefits are identified both from the research findings and from insights of the program developer on program design and implementation choices.

What Matters for Excellence in PhD Programs? Latent Constructs of Doctoral Program Quality Used by Early Career Social Scientists

ERIC Educational Resources Information Center

Morrison, Emory; Rudd, Elizabeth; Zumeta, William; Nerad, Maresi

2011-01-01

This paper unpacks how social science doctorate-holders come to evaluate overall excellence in their PhD training programs based on their domain-specific assessments of aspects of their programs. Latent class analysis reveals that social scientists 6-10 years beyond their PhD evaluate the quality of their doctoral program with one of two…

Bringing computational science to the public.

PubMed

McDonagh, James L; Barker, Daniel; Alderson, Rosanna G

2016-01-01

The increasing use of computers in science allows for the scientific analyses of large datasets at an increasing pace. We provided examples and interactive demonstrations at Dundee Science Centre as part of the 2015 Women in Science festival, to present aspects of computational science to the general public. We used low-cost Raspberry Pi computers to provide hands on experience in computer programming and demonstrated the application of computers to biology. Computer games were used as a means to introduce computers to younger visitors. The success of the event was evaluated by voluntary feedback forms completed by visitors, in conjunction with our own self-evaluation. This work builds on the original work of the 4273π bioinformatics education program of Barker et al. (2013, BMC Bioinform. 14:243). 4273π provides open source education materials in bioinformatics. This work looks at the potential to adapt similar materials for public engagement events. It appears, at least in our small sample of visitors (n = 13), that basic computational science can be conveyed to people of all ages by means of interactive demonstrations. Children as young as five were able to successfully edit simple computer programs with supervision. This was, in many cases, their first experience of computer programming. The feedback is predominantly positive, showing strong support for improving computational science education, but also included suggestions for improvement. Our conclusions are necessarily preliminary. However, feedback forms suggest methods were generally well received among the participants; "Easy to follow. Clear explanation" and "Very easy. Demonstrators were very informative." Our event, held at a local Science Centre in Dundee, demonstrates that computer games and programming activities suitable for young children can be performed alongside a more specialised and applied introduction to computational science for older visitors.

The Teachers Academy for Mathematics and Science. Executive summary and program activities update

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1992-09-01

In his State of the Union address on January 31, 1990, President Bush set a goal for US students to be number one in the world in mathematics and science achievement by the year 2000. The Teachers Academy for Mathematics and Science in Chicago is an experiment of unprecedented boldness and scale that can provide a means to the President`s goal, both for the Chicago area and as a national model. This document covers organization and governance, program activities, future training goals, and evaluation programs.

Examination of Attitude and Interest Measures for 4-H Science Evaluation

ERIC Educational Resources Information Center

Lewis, Kendra M.; Worker, Steven M.

2015-01-01

Science education research has demonstrated the influence of affect on learning. The National 4-H Science Logic Model outlines outcomes from youth participation in 4-H science programs, which includes attitude and interest outcomes. The associated measure, the National 4-H Science Common Measure, assesses these attitude constructs and not other…

Evaluation of Robotic Systems to Carry Out Traverse Execution, Opportunistic Science, and Landing Site Evaluation Tasks

NASA Technical Reports Server (NTRS)

Hoffman, Stephen J.; Leonard, Matther J.; Pacal, Lee

2011-01-01

This report covers the execution of and results from the activities proposed and approved in Exploration Analogs and Mission Development (EAMD) Field Test Protocol HMP2010: Evaluation of Robotic Systems to carry out Traverse Execution, Opportunistic Science, and Landing Site Evaluation Tasks. The field tests documented in this report examine one facet of a larger program of planetary surface exploration. This program has been evolving and maturing for several years, growing from a broad policy statement with a few specified milestones for NASA to an international effort with much higher fidelity descriptions of systems and operations necessary to accomplish this type of exploration.

Core Professionalism Education in Surgery: A Systematic Review.

PubMed

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-03-15

Professionalism education is one of the major elements of surgical residency education. To evaluate the studies on core professionalism education programs in surgical professionalism education. Systematic review. This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable.

NASA Applied Sciences' DEVELOP Program Fosters the Next Generation of Earth Remote Sensing Scientists

NASA Technical Reports Server (NTRS)

Childs, Lauren M.; Brozen, Madeline W.; Gleason, Jonathan L.; Silcox, Tracey L.; Rea, Mimi; Holley, Sharon D.; Renneboog, Nathan; Underwood, Lauren W.; Ross, Kenton W.

2009-01-01

Satellite remote sensing technology and the science associated with the evaluation of the resulting data are constantly evolving. To meet the growing needs related to this industry, a team of personnel that understands the fundamental science as well as the scientific applications related to remote sensing is essential. Therefore, the workforce that will excel in this field requires individuals who not only have a strong academic background, but who also have practical hands-on experience with remotely sensed data, and have developed knowledge of its real-world applications. NASA's DEVELOP Program has played an integral role in fulfilling this need. DEVELOP is a NASA Science Mission Directorate Applied Sciences training and development program that extends the benefits of NASA Earth science research and technology to society.

NASA’s Universe of Learning: Connecting Scientists, Educators, and Learners

NASA Astrophysics Data System (ADS)

Smith, Denise A.; Lestition, Kathleen; Squires, Gordon K.; Greene, W. M.; Biferno, Anya A.; Cominsky, Lynn R.; Goodman, Irene; Walker, Allyson; Universe of Learning Team

2017-01-01

NASA’s Universe of Learning (UoL) is one of 27 competitively awarded education programs selected by NASA’s Science Mission Directorate (SMD) in its newly restructured education effort. Through these 27 programs, SMD aims to infuse NASA science experts and content more effectively and efficiently into learning environments serving audiences of all ages. UoL is a unique partnership between the Space Telescope Science Institute, Chandra X-ray Center, IPAC at Caltech, Jet Propulsion Laboratory Exoplanet Exploration Program, and Sonoma State University that will connect the scientists, engineers, science, technology and adventure of NASA Astrophysics with audience needs, proven infrastructure, and a network of partners to advance SMD education objectives. External evaluation is provided through a partnership with Goodman Research Group and Cornerstone Evaluation Associates. The multi-institutional team is working to develop and deliver a unified, consolidated and externally evaluated suite of education products, programs, and professional development offerings that spans the full spectrum of NASA Astrophysics, including the Cosmic Origins, Physics of the Cosmos, and Exoplanet Exploration themes. Products and programs focus on out-of-school-time learning environments and include enabling educational use of Astrophysics mission data and offering participatory experiences; creating multimedia and immersive experiences; designing exhibits and community programs; and producing resources for special needs and underserved/underrepresented audiences. The UoL team also works with a network of partners to provide professional learning experiences for informal educators, pre-service educators, and undergraduate instructors. This presentation will provide an overview of the UoL team’s approach to partnering scientists and educators to engage learners in Astrophysics discoveries and data; progress to date; and pathways for science community involvement.

Impacting the Science Community through Teacher Development: Utilizing Virtual Learning.

PubMed

Boulay, Rachel; van Raalte, Lisa

2014-01-01

Commitment to the STEM (science, technology, engineering, math) pipeline is slowly declining despite the need for professionals in the medical field. Addressing this, the John A. Burns School of Medicine developed a summer teacher-training program with a supplemental technology-learning component to improve science teachers' knowledge and skills of Molecular Biology. Subsequently, students' skills, techniques, and application of molecular biology are impacted. Science teachers require training that will prepare them for educating future professionals and foster interest in the medical field. After participation in the program and full access to the virtual material, twelve high school science teachers completed a final written reflective statement to evaluate their experiences. Using thematic analysis, knowledge and classroom application were investigated in this study. Results were two-fold: teachers identified difference areas of gained knowledge from the teacher-training program and teachers' reporting various benefits in relation to curricula development after participating in the program. It is concluded that participation in the program and access to the virtual material will impact the science community by updating teacher knowledge and positively influencing students' experience with science.

The American Indian Summer Institute in Earth System Science (AISESS) at UC Irvine: A Two-Week Residential Summer Program for High School Students

NASA Astrophysics Data System (ADS)

Johnson, K. R.; Polequaptewa, N.; Leon, Y.

2012-12-01

Native Americans remain severely underrepresented in the geosciences, despite a clear need for qualified geoscience professionals within Tribal communities to address critical issues such as natural resource and land management, water and air pollution, and climate change. In addition to the need for geoscience professionals within Tribal communities, increased participation of Native Americans in the geosciences would enhance the overall diversity of perspectives represented within the Earth science community and lead to improved Earth science literacy within Native communities. To address this need, the Department of Earth System Science and the American Indian Resource Program at the University California have organized a two-week residential American Indian Summer Institute in Earth System Science (AISESS) for high-school students (grades 9-12) from throughout the nation. The format of the AISESS program is based on the highly-successful framework of a previous NSF Funded American Indian Summer Institute in Computer Science (AISICS) at UC Irvine and involves key senior personnel from the AISICS program. The AISESS program, however, incorporates a week of camping on the La Jolla Band of Luiseño Indians reservation in Northern San Diego County, California. Following the week of camping and field projects, the students spend a week on the campus of UC Irvine participating in Earth System Science lectures, laboratory activities, and tours. The science curriculum is closely woven together with cultural activities, native studies, and communication skills programs The program culminates with a closing ceremony during which students present poster projects on environmental issues relevant to their tribal communities. The inaugural AISESS program took place from July 15th-28th, 2012. We received over 100 applications from Native American high school students from across the nation. We accepted 40 students for the first year, of which 34 attended the program. The objective of the program is to introduce students to Earth System Science and, hopefully, inspire them to pursue Earth or Environmental Science degrees. Towards this end, we developed a fairly broad curriculum which will be presented here. Evaluation planning was conducted during the first quarter of 2012 during recruitment. A longitudinal database was established for the project to track college preparatory course-taking, GPA, school attendance, participation in earth science activities, and attitudes and interest in attending college and completing a degree after high school. Based on attendance during AISESS, schools and students will be selected as descriptive case studies. A pre-post design for evaluating the Summer Institute includes a survey about student background, attitudes, and knowledge about preparing to complete high school and attend college after graduation and focus groups of participants immediately after the Institute to capture qualitative data about their experiences in the field and at the University. Initial evaluation results will be presented here.

A study of science leadership and science standards in exemplary standards-based science programs

NASA Astrophysics Data System (ADS)

Carpenter, Wendy Renae

The purpose for conducting this qualitative study was to explore best practices of exemplary standards-based science programs and instructional leadership practices in a charter high school and in a traditional high school. The focus of this study included how twelve participants aligned practices to National Science Education Standards to describe their science programs and science instructional practices. This study used a multi-site case study qualitative design. Data were obtained through a review of literature, interviews, observations, review of educational documents, and researcher's notes collected in a field log. The methodology used was a multi-site case study because of the potential, through cross analysis, for providing greater explanation of the findings in the study (Merriam, 1988). This study discovered six characteristics about the two high school's science programs that enhance the literature found in the National Science Education Standards; (a) Culture of expectations for learning-In exemplary science programs teachers are familiar with a wide range of curricula. They have the ability to examine critically and select activities to use with their students to promote the understanding of science; (b) Culture of varied experiences-In exemplary science programs students are provided different paths to learning, which help students, take in information and make sense of concepts and skills that are set forth by the standards; (c) Culture of continuous feedback-In exemplary science programs teachers and students work together to engage students in ongoing assessments of their work and that of others as prescribed in the standards; (d) Culture of Observations-In exemplary science programs students, teachers, and principals reflect on classroom instructional practices; teachers receive ongoing evaluations about their teaching and apply feedback towards improving practices as outlined in the standards; (e) Culture of continuous learning-In exemplary science programs teachers value continuous personal development, teachers are provided on-going science professional development opportunities to improve instructional practices, teachers reflect and share professional practices, and teachers establish professional learning communities within their classrooms; and (f) Culture of shared leadership-In exemplary science programs instructional leadership purposes and values are consistently shared among all stakeholders which are outlined in the standards. These results are potentially useful for understanding exemplary standards-based science programs and science instructional leadership practices as a model for science programs trying to improve science education so that all students can have a true scientific learning experience.

Frontier Fields: A Cost-Effective Approach to Bringing Authentic Science to the Education Community

NASA Astrophysics Data System (ADS)

Eisenhamer, B.; Lawton, B.; Summers, F.; Ryer, H.

2015-11-01

For more than two decades, the Hubble EPO program has sought to bring the wonders of the universe to the education community and the public, and to engage audiences in the adventure of scientific discovery. Program components include standards-based, curriculum-support materials, exhibits and exhibit components, and professional development workshops. The main underpinnings of the program's infrastructure are scientist-educator development teams, partnerships, and an embedded program evaluation component. The Space Telescope Science Institute's Office of Public Outreach is leveraging this existing infrastructure to bring the Frontier Fields science program to the education community in a cost-effective way. Frontier Fields observations and results have been, and will continue to be, embedded into existing product lines and professional development offerings. We also are leveraging our new social media strategy to bring the science program to the public in the form of an ongoing blog.

Program Evaluation of a High School Science Professional Learning Community

ERIC Educational Resources Information Center

McLelland-Crawley, Rebecca

2014-01-01

Teachers may benefit more from a professional learning community (PLC) than from professional development initiatives presented in single day workshops. The purpose of this program evaluation study was to identify characteristics of an effective PLC and to determine how the members of the PLC have benefitted from the program. Fullan's educational…

Effects of a National Indicated Preventive Intervention Program

ERIC Educational Resources Information Center

Husler, Gebhard; Werlen, Egon; Blakeney, Ronny

2005-01-01

As there have been few science-based evaluations of secondary prevention programs, the Federal Office of Public Health in Switzerland carried out a national program evaluation at 12 sites in the French- and German-speaking parts of Switzerland to study the question, "What works in secondary prevention?" These 12 centers offer different…

The Evaluation of an Early Childhood Teacher Preparation Program: An Action Research Project

ERIC Educational Resources Information Center

Ragno, Kerry Sullivan

2013-01-01

The purpose of this dissertation was to evaluate the effectiveness of an Early Childhood Development Associate of Applied Science (AAS) degree program at one community college as part of an ongoing action research project. Prior to this dissertation study, external and internal barriers prevented the associate degree program stakeholders from…

The Upside of an Annual Survey in Light of Involvement and Use: Evaluating the Advanced Technological Education Program

ERIC Educational Resources Information Center

Toal, Stacie A.; Gullickson, Arlen R.

2011-01-01

In 1999, the National Science Foundation (NSF) awarded funds to the Evaluation Center at Western Michigan University to conduct an external evaluation of the Advanced Technological Education (ATE) program. ATE, a federally mandated program designed to increase the number and quality of skilled technicians in the U.S. workforce, has funded over 346…

Special Examination of the Institute of Food and Agricultural Sciences. Report.

ERIC Educational Resources Information Center

Houston, Rashada; King, Jeanine; McKee, Benny

In response to a legislative request, the efficiency of program operations of the University of Floridas Institute of Food and Agricultural Sciences (IFAS) was evaluated using data from multiple sources. IFAS is the entity responsible for carrying out the University of Floridas land grant mission. IFAS offers programs in agriculture, family and…

To the Planets, Comets, and Beyond: A Vision of Sustained Collaboration

NASA Astrophysics Data System (ADS)

Gaboardi, M.; Grauer, M.; Humayun, M.; Dixon, P.

2007-12-01

Our NASA-funded, E/PO partnership, the Student-Teacher Astronomy Resource (STAR) Program, has been successful in integrating current space science knowledge, scientific inquiry, and educational practices. With our focus on the recent NASA Stardust Mission, we engage teachers, students, and the general public in timely, research-based inquiry into space science. One such component of our program is "The Solar System: To the Planets, Comets, and Beyond," a new curricula that is accessible to, and comfortable for, primary educators, many of whom were previously uncomfortable teaching space science. This achievement is the result of ongoing collaboration between a formal primary educator (Grauer), the director of educational outreach for the National High Magnetic Field Laboratory (Dixon), a cosmochemist (Humayun) and a graduate student (Gaboardi), both researchers in the geochemistry program within the NHMFL. Indicators of success in our outreach program include the following: 1- Increased public awareness of research as evidenced by local television, newspaper, and radio coverage, 2- Requests from individual teachers, schools, and school districts for workshops specific to our program, 3- Overwhelmingly positive formal and informal responses from teachers, students, and parents participating in our program, 4- Requests from high-school students for advice involving science fair projects, 5- High level of performance of Grauer's primary students in space science curricula developed as a result of collaboration, and 6- Integration of a space science component into the sustained outreach program provided by the NHMFL. We are currently collecting formal questionnaires from teachers who have participated in our 2007 workshops to explore the following further indicators of success: 1- teachers' use of our curricula, 2- teachers' comfort levels in teaching space science both before and after attending our workshop, and 3- teachers' evaluation of their own space science content knowledge before and after attending our workshop. Based on formal responses from the 2006 cohort, and informal responses from the 2007 cohort, we expect evaluations to be strongly positive.

Considering Student Voices: Examining the Experiences of Underrepresented Students in Intervention Programs

PubMed Central

Gibau, Gina Sanchez

2015-01-01

Qualitative studies that examine the experiences of underrepresented minority students in science, technology, engineering, and mathematics fields are comparatively few. This study explores the self-reported experiences of underrepresented graduate students in the biomedical sciences of a large, midwestern, urban university. Document analysis of interview transcripts from program evaluations capture firsthand accounts of student experiences and reveal the need for a critical examination of current intervention programs designed to reverse the trend of underrepresentation in the biomedical sciences. Findings point to themes aligned around the benefits and challenges of program components, issues of social adjustment, the utility of supportive relationships, and environmental impacts. PMID:26163562

7 CFR 3402.24 - Evaluation of program.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3402.24 Section 3402.24 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE FOOD AND AGRICULTURAL SCIENCES NATIONAL NEEDS...

Public Science Education and Outreach as a Modality for Teaching Science Communication Skills to Undergraduates

NASA Astrophysics Data System (ADS)

Arion, Douglas; OConnell, Christine; Lowenthal, James; Hickox, Ryan C.; Lyons, Daniel

2018-01-01

The Alan Alda Center for Communicating Science at Stony Brook University is working with Carthage College, Dartmouth College, and Smith College, in partnership with the Appalachian Mountain Club, to develop and disseminate curriculum to incorporate science communication education into undergraduate science programs. The public science education and outreach program operating since 2012 as a partnership between Carthage and the Appalachian Mountain Club is being used as the testbed for evaluating the training methods. This talk will review the processes that have been developed and the results from the first cohort of students trained in these methods and tested during the summer 2017 education and outreach efforts, which reached some 12,000 members of the public. A variety of evaluation and assessment tools were utilized, including surveys of public participants and video recording of the interactions of the students with the public. This work was supported by the National Science Foundation under grant number 1625316.

A framework for evaluating and designing citizen science programs for natural resources monitoring.

PubMed

Chase, Sarah K; Levine, Arielle

2016-06-01

We present a framework of resource characteristics critical to the design and assessment of citizen science programs that monitor natural resources. To develop the framework we reviewed 52 citizen science programs that monitored a wide range of resources and provided insights into what resource characteristics are most conducive to developing citizen science programs and how resource characteristics may constrain the use or growth of these programs. We focused on 4 types of resource characteristics: biophysical and geographical, management and monitoring, public awareness and knowledge, and social and cultural characteristics. We applied the framework to 2 programs, the Tucson (U.S.A.) Bird Count and the Maui (U.S.A.) Great Whale Count. We found that resource characteristics such as accessibility, diverse institutional involvement in resource management, and social or cultural importance of the resource affected program endurance and success. However, the relative influence of each characteristic was in turn affected by goals of the citizen science programs. Although the goals of public engagement and education sometimes complimented the goal of collecting reliable data, in many cases trade-offs must be made between these 2 goals. Program goals and priorities ultimately dictate the design of citizen science programs, but for a program to endure and successfully meet its goals, program managers must consider the diverse ways that the nature of the resource being monitored influences public participation in monitoring. © 2016 Society for Conservation Biology.

Advanced High School Biology in an Era of Rapid Change: A Summary of the Biology Panel Report from the NRC Committee on Programs for Advanced Study of Mathematics and Science in American High Schools

ERIC Educational Resources Information Center

Wood, William B.

2002-01-01

A recently released National Research Council (NRC) report, "Learning and Understanding: Improving Advanced Study of Mathematics and Science in U.S. High Schools", evaluated and recommended changes in the Advanced Placement (AP), International Baccalaureate (IB), and other advanced secondary school science programs. As part of this study,…

The Teachers of Quality Academy: Evaluation of the Effectiveness and Impact of a Health Systems Science Training Program.

PubMed

Walsh, Danielle S; Lazorick, Suzanne; Lawson, Luan; Lake, Donna; Garrison, Herbert G; Higginson, Jason; Vos, Paul; Baxley, Elizabeth

2018-05-01

This project aimed to evaluate the effectiveness of a faculty development program in health systems science (HSS)-the Teachers of Quality Academy (TQA). Participants in TQA and a comparison group were evaluated before, during, and 1 year after the program using self-perception questionnaires, tests of HSS knowledge, and tracking of academic productivity and career advancement. Among program completers (n = 27), the mean self-assessed ratings of knowledge and skills of HSS topics immediately after the program, as compared to baseline, increased significantly compared to controls (n = 30). Participants demonstrated progressive improvement of self-perceived skills and attitudes, and retention of HSS knowledge, from baseline to completion of the program. Participants also demonstrated substantially higher HSS scholarly productivity, leadership, and career advancement compared to the comparison group. The TQA effectively created a faculty cadre able to role model, teach, and create a curriculum in HSS competencies for medical students, resident physicians, and other health professionals.

Structural equation model for the evaluation of national funding on R&D project of SMEs in consideration with MBNQA criteria.

PubMed

Sohn, S Y; Gyu Joo, Yong; Kyu Han, Hong

2007-02-01

Financial support on the R&D in Science & Technology for SMEs at the governmental level plays a crucial role on the improvement of the national competitiveness. Korea Science & Engineering Foundation (KOSEF) has supported the R&D projects of SMEs with the competitive technology ability by way of the Science and Technology Promotion Fund. In this paper, we propose a structural equation model (SEM) to evaluate the performance of such a funding program in terms of three aspects: output, outcome and impact under given funding inputs, R&D environment of a recipient company, and external evaluation programs of funding organization. We adopt Malcolm Baldrige National Quality Award (MBNQA) criteria to assess the R&D environmental factors of recipient companies. In addition, we test the effect of interim evaluation of the funded project. The proposed model is applied to the real case and is used to identify the best practices as well as to provide feedback information for the improvement of the government funding programs of the R&D projects of SMEs.

Evaluation of a High School Fair Program for Promoting Successful Inquiry-based Learning

NASA Astrophysics Data System (ADS)

Betts, Julia Nykeah

The success of inquiry-based learning (IBL) in supporting science literacy can be challenged when students encounter obstacles in the absence of proper support. This research is intended to evaluate the effectiveness of an Oregon public school district's regional science fair coaching program in promoting inquiry skills and positive attitudes toward science in participating high school students. The purpose of this study was to better understand students' perception of program support, obstacles or barriers faced by students, and potential benefits of IBL facilitated by the science fair program. Data included responses to informal and semi-structured interviews, an anonymous survey, a Skills assessment of final project displays, and an in-depth case study on three students' experiences. Results suggest that the science fair program can properly engage participants in authentic IBL. However, when assessing the participant's final project displays, I found that previous fair experience did not significantly increase mean scores as identified by the official Oregon Department of Education (ODE) scoring guides. Based on results from the case study, it is suggested that participants' low science self-concept, poor understanding of inquiry skills, and inability to engage in reflective discourse may reduce students' abilities to truly benefit. Recommendations to address this discrepancy include identifying specific needs of students through a pre--fair survey to develop more targeted support, and providing new opportunities to develop skills associated with science-self concept, understanding of inquiry and reflective discourse. In addition, results suggest that students would benefit from more financial support in the form of grants, and more connections with knowledgeable mentors.

The National Evaluation of NASA's Science, Engineering, Mathematics and Aerospace Academy (SEMAA) Program

ERIC Educational Resources Information Center

Martinez, Alina; Cosentino de Cohen, Clemencia

2010-01-01

This report presents findings from a NASA requested evaluation in 2008, which contains both implementation and impact modules. The implementation study investigated how sites implement Science, Engineering, Mathematics, and Aerospace Academy (SEMAA) and the contextual factors important in this implementation. The implementation study used data…

76 FR 18740 - Notice of Submission for OMB Review

Federal Register 2010, 2011, 2012, 2013, 2014

2011-04-05

... the Jacob K. Javits Fellowship Program for graduate study in the arts, humanities, and social sciences... meeting the program's objectives and allows program staff to monitor and evaluate time-to-degree...

Delaware Technical & Community College's response to the critical shortage of Delaware secondary science teachers

NASA Astrophysics Data System (ADS)

Campbell, Nancy S.

This executive position paper examines the critical shortage of Delaware high school science teachers and Delaware Technical & Community College's possible role in addressing this shortage. A concise analysis of economic and political implications of the science teacher shortage is presented. The following topics were researched and evaluated: the specific science teacher needs for Delaware school districts; the science teacher education program offerings at Delaware universities and colleges; the Alternative Route to Teacher Certification (ARTC); and the state of Delaware's scholarship response to the need. Recommendations for Delaware Tech's role include the development and implementation of two new Associate of Arts of Teaching programs in physics secondary science education and chemistry secondary science education.

A merged model of quality improvement and evaluation: maximizing return on investment.

PubMed

Woodhouse, Lynn D; Toal, Russ; Nguyen, Trang; Keene, DeAnna; Gunn, Laura; Kellum, Andrea; Nelson, Gary; Charles, Simone; Tedders, Stuart; Williams, Natalie; Livingood, William C

2013-11-01

Quality improvement (QI) and evaluation are frequently considered to be alternative approaches for monitoring and assessing program implementation and impact. The emphasis on third-party evaluation, particularly associated with summative evaluation, and the grounding of evaluation in the social and behavioral science contrast with an emphasis on the integration of QI process within programs or organizations and its origins in management science and industrial engineering. Working with a major philanthropic organization in Georgia, we illustrate how a QI model is integrated with evaluation for five asthma prevention and control sites serving poor and underserved communities in rural and urban Georgia. A primary foundation of this merged model of QI and evaluation is a refocusing of the evaluation from an intimidating report card summative evaluation by external evaluators to an internally engaged program focus on developmental evaluation. The benefits of the merged model to both QI and evaluation are discussed. The use of evaluation based logic models can help anchor a QI program in evidence-based practice and provide linkage between process and outputs with the longer term distal outcomes. Merging the QI approach with evaluation has major advantages, particularly related to enhancing the funder's return on investment. We illustrate how a Plan-Do-Study-Act model of QI can (a) be integrated with evaluation based logic models, (b) help refocus emphasis from summative to developmental evaluation, (c) enhance program ownership and engagement in evaluation activities, and (d) increase the role of evaluators in providing technical assistance and support.

Applied Information Systems Research Program (AISRP). Workshop 2: Meeting Proceedings

NASA Technical Reports Server (NTRS)

1992-01-01

The Earth and space science participants were able to see where the current research can be applied in their disciplines and computer science participants could see potential areas for future application of computer and information systems research. The Earth and Space Science research proposals for the High Performance Computing and Communications (HPCC) program were under evaluation. Therefore, this effort was not discussed at the AISRP Workshop. OSSA's other high priority area in computer science is scientific visualization, with the entire second day of the workshop devoted to it.

An Evaluation of the Computer Science 11E Course Offered During the Spring Semester of 1973.

ERIC Educational Resources Information Center

Durward, M. Lynne; Ellis, E. N.

The evaluation of Computer Science 11E, a locally-developed course offered in six Vancouver secondary schools, consisted of four parts: a questionnaire to teachers concerning all aspects of their courses, as well as their own evaluation of the program, a questionnaire to students designed to determine their attitude toward the course and what they…

Evaluation of Science Teacher Candidates' Level of Knowledge Regarding the Use of Microscopes

ERIC Educational Resources Information Center

Demir, Sibel

2015-01-01

This evaluation was conducted with 43 second-year students, or teacher candidates, attending the science education program of an education faculty in a Turkish university. In this study, students were asked to complete a single open-ended and gap-filling questionnaire, and their answers were evaluated according to a five-point Likert-type rubric.…

The Effect of Technical Assistance on Involvement and Use: The Case of a Research, Evaluation, and Technical Assistance Project

ERIC Educational Resources Information Center

Roseland, Denise; Volkov, Boris B.; Callow-Heusser, Catherine

2011-01-01

In contrast to typical National Science Foundation program evaluations, the Utah State Math Science Partnership-Research, Evaluation and Technical Assistance Project (MSP-RETA) provided technical assistance (TA) in two forms: direct TA for up to 10 projects a year, and professional development sessions for a larger number of project staff. Not…

Evaluating the Effectiveness of the 2003-2004 NASA SCIence Files(trademark) Program

NASA Technical Reports Server (NTRS)

Caton, Randall H.; Ricles, Shannon S.; Pinelli, Thomas E.; Legg, Amy C.; Lambert, Matthew A.

2005-01-01

The NASA SCI Files is an Emmy award-winning series of instructional programs for grades 3-5. Produced by the NASA Center for Distance Learning, programs in the series are research-, inquiry-, standards-, teacher- and technology-based. Each NASA SCI Files program (1) integrates mathematics, science, and technology; (2) uses Problem-Based Learning (PBL) to enhance and enrich the teaching and learning of science; (3) emphasizes science as inquiry and the scientific method; (4) motivates students to become critical thinkers and active problem solvers; and (5) uses NASA research, facilities, and personnel to raise student awareness of careers and to exhibit the "real-world" application of mathematics, science, and technology. In April 2004, 1,500 randomly selected registered users of the NASA SCI Files were invited to complete a survey containing a series of questions. A total of 263 surveys were received. This report contains the quantitative and qualitative results of that survey.

What Good Is a Scientist in the Classroom? Participant Outcomes and Program Design Features for a Short-Duration Science Outreach Intervention in K–12 Classrooms

PubMed Central

Liston, Carrie; Thiry, Heather; Graf, Julie

2007-01-01

Many short-duration science outreach interventions have important societal goals of raising science literacy and increasing the size and diversity of the science workforce. Yet, these long-term outcomes are inherently challenging to evaluate. We present findings from a qualitative research study of an inquiry-based, life science outreach program to K–12 classrooms that is typical in design and excellent in execution. By considering this program as a best case of a common outreach model, the “scientist in the classroom,” the study examines what benefits may be realized for each participant group and how they are achieved. We find that K–12 students are engaged in authentic, hands-on activities that generate interest in science and new views of science and scientists. Teachers learn new science content and new ways to teach it, and value collegial support of their professional work. Graduate student scientists, who are the program presenters, gain teaching and other skills, greater understanding of education and diversity issues, confidence and intrinsic satisfaction, and career benefits. A few negative outcomes also are described. Program elements that lead to these benefits are identified both from the research findings and from insights of the program developer on program design and implementation choices. PMID:17339394

Care management program evaluation: constituents, conflicts, and moves toward standardization.

PubMed

Long, D Adam; Perry, Theodore L; Pelletier, Kenneth R; Lehman, Gregg O

2006-06-01

Care management program evaluations bring together constituents from finance, medicine, and social sciences. The differing assumptions and scientific philosophies that these constituents bring to the task often lead to frustrations and even contentions. Given the forms and variations of care management programs, the difficulty associated with program outcomes measurement should not be surprising. It is no wonder then that methods for clinical and economic evaluations of program efficacy continue to be debated and have yet to be standardized. We describe these somewhat hidden processes, examine where the industry stands, and provide recommendations for steps to standardize evaluation methodology.

Grover Cleveland High School. Basic Bilingual Program. O.E.E. Evaluation Report, 1981-1982.

ERIC Educational Resources Information Center

Di Martino, Vincent James; And Others

This paper evaluates the bilingual educational program at Grover Cleveland High School, Queens, New York City. The program offered instruction in English as a second language (ESL) and native language skills in Italian and Spanish as well as courses in science, mathematics, and social studies to 142 students with limited English proficiency. The…

A Multi-Phased Evaluation of the Impact of a Non-School Science Exhibition.

ERIC Educational Resources Information Center

Fortner, Rosanne W.

The impact of "The Great Lake Erie," an outreach program that aimed to improve visitor knowledge and attitudes about Lake Erie, is discussed in this evaluative study. "The Great Lake Erie" was presented as a two-part program consisting of a lecture and demonstration stage presentation and a series of exhibits. The program was…

7 CFR 3402.24 - Evaluation of program.

Code of Federal Regulations, 2012 CFR

2012-01-01

... AGRICULTURE FOOD AND AGRICULTURAL SCIENCES NATIONAL NEEDS GRADUATE AND POSTGRADUATE FELLOWSHIP GRANTS PROGRAM... analyze both the institutional context and the impact of any supported project. ...

7 CFR 3402.24 - Evaluation of program.

Code of Federal Regulations, 2014 CFR

2014-01-01

... AGRICULTURE FOOD AND AGRICULTURAL SCIENCES NATIONAL NEEDS GRADUATE AND POSTGRADUATE FELLOWSHIP GRANTS PROGRAM... analyze both the institutional context and the impact of any supported project. ...

7 CFR 3402.24 - Evaluation of program.

Code of Federal Regulations, 2013 CFR

2013-01-01

... AGRICULTURE FOOD AND AGRICULTURAL SCIENCES NATIONAL NEEDS GRADUATE AND POSTGRADUATE FELLOWSHIP GRANTS PROGRAM... analyze both the institutional context and the impact of any supported project. ...

7 CFR 3402.24 - Evaluation of program.

Code of Federal Regulations, 2011 CFR

2011-01-01

... AGRICULTURE FOOD AND AGRICULTURAL SCIENCES NATIONAL NEEDS GRADUATE AND POSTGRADUATE FELLOWSHIP GRANTS PROGRAM... analyze both the institutional context and the impact of any supported project. ...

Applying Computer Technology to Substance Abuse Prevention Science Results of a Preliminary Examination

ERIC Educational Resources Information Center

Marsch, Lisa A.; Bickel, Warren K.; Badger, Gary J.

2007-01-01

This manuscript reports on the development and evaluation of a computer-based substance abuse prevention program for middle school-aged adolescents, called "HeadOn: Substance Abuse Prevention for Grades 6-8TM". This self-guided program was designed to deliver effective drug abuse prevention science to youth via computer-based educational…

Critical Thinking as Related to PSSC and Non-PSSC Physics Programs.

ERIC Educational Resources Information Center

Poel, Robert Herman

The three purposes of this study were (1) to evaluate a paper-pencil test of critical thinking skills using physical science content, (2) to compare the effectiveness of Physical Science Study Committee (PSSC) and non-PSSC physics programs in developing critical thinking skills, and (3) to identify teacher-pupil verbal interaction behaviors that…

The Effect of an Experiential Learning Program on Middle School Students' Motivation toward Mathematics and Science

ERIC Educational Resources Information Center

Weinberg, Andrea E.; Basile, Carole G.; Albright, Leonard

2011-01-01

A mixed methods design was used to evaluate the effects of four experiential learning programs on the interest and motivation of middle school students toward mathematics and science. The Expectancy-Value model provided a theoretical framework for the exploration of 336 middle school student participants. Initially, participants were generally…

Ladders to Success: Enhancing Transfer from Technical Associate in Science Degrees to Baccalaureates. AIR 1999 Annual Forum Paper.

ERIC Educational Resources Information Center

Pitter, Gita Wijesinghe

This paper describes the collaborative activities which have developed since 1998 Florida legislation that required stronger articulation between Associate in Science (AS) programs at state community colleges and baccalaureate programs at universities. Three major models of AS to baccalaureate articulation are evaluated: (1) a statewide career…

Managing Transitions, Building Bridges: An Evaluation of a Summer Bridge Program for African American Scientists and Engineers

ERIC Educational Resources Information Center

Johnson, Jennifer Michelle

2016-01-01

Purpose: This paper aims to highlight the potential of science, technology, engineering and mathematics (STEM) summer bridge programs to promote college persistence by fostering a positive science identity among participants that is culturally consistent with the values and experiences of African American students. Design/methodology/approach:…

Evaluating the Effectiveness of the 2003-2004 NASA CONNECT(trademark)Program

NASA Technical Reports Server (NTRS)

Caton, Randall H.; Pinelli, Thomas E.; Giersch, Christopher E.; Holmes, Ellen B.; Lambert, Matthew A.

2005-01-01

NASA CONNECT is an Emmy-award-winning series of instructional (distance learning) programs for grades 6-8. Produced by the NASA Center for Distance Learning, the nine programs in the 2003-2004 NASA CONNECT series are research-, inquiry-, standards-, teacher-, and technology-based and include a 30-minute program, an educator guide containing a hands-on activity, and a web-based component. The 1,500 randomly selected NASA CONNECT registered users were invited to complete an electronic (self-reported) survey that employed a 5-point Likert-type scale. Regarding NASA CONNECT, respondents reported that the programs (1) enhance the teaching of mathematics, science, and technology (4.53); (2) are aligned with the national mathematics, science, and technology standards (4.52); (3) raise student awareness of careers requiring mathematics, science, and technology (4.48); (4) demonstrate the application of mathematics, science, and technology (4.47); and (5) present women and minorities performing challenging engineering and science tasks (4.50).

Developing a Successful High School Science Research Program via Teacher Training, Student Internships, and Community Support

NASA Astrophysics Data System (ADS)

Danch, J. M.; Darytichen, F.

2004-12-01

The purpose of the Science Research Program is to allow students to perform authentic scientific research in disciplines of their choosing over a period of 3 years. The success of the program has allowed for expansion including community involvement, student mentorship, and a series of professional development programs. Through state and national competition and community symposia, student research is evaluated, showcased, and subsequently supported both idealistically and financially by local government and industrial partnerships. Student internships and university/industrial mentorship programs allow students to pursue research topics and utilize equipment exceeding the scope of the secondary science classroom. Involved teachers have developed and delivered professional development workshops to foster the successful implementation of scientific research programs at additional high schools throughout the state.

An evaluative study of the impact of the "Curriculum Alignment Toolbox" on middle school science achievement

NASA Astrophysics Data System (ADS)

Jones, Carol L.

The number of computer-assisted education programs on the market is overwhelming science teachers all over the Michigan. Though the need is great, many teachers are reluctant to procure computer-assisted science education programs because they are unsure of the effectiveness of such programs. The Curriculum Alignment Toolbox (CAT) is a computer-based program, aligned to the Michigan Curriculum Framework's Benchmarks for Science Education and designed to supplement science instruction in Michigan middle schools. The purpose of this study was to evaluate the effectiveness of CAT in raising the standardized test scores of Michigan students. This study involved 419 students from one urban, one suburban and one rural middle school. Data on these students was collected from 4 sources: (1) the 8th grade Michigan Education Assessment Program (MEAP) test, (2) a 9 question, 5-point Likert-type scale student survey, (3) 4 open-response student survey questions and (4) classroom observations. Results of this study showed that the experimental group of 226 students who utilized the CAT program in addition to traditional instruction did significantly better on the Science MEAP test than the control group of 193 students who received only traditional instruction. The study also showed that the urban students from a "high needs" school seemed to benefit most from the program. Additionally, though both genders and all identified ethnic groups benefited from the program, males benefited more than females and whites, blacks and Asian/Pacific Islander students benefited more than Hispanic and multi-racial students. The CAT program's success helping raise the middle school MEAP scores may well be due to some of its components. CAT provided students with game-like experiences all based on the benchmarks required for science education and upon which the MEAP test is based. The program also provided visual and auditory stimulation as well as numerous references which students indicated they enjoyed. Additionally, as best-practice, the questioning in all the gaming within CAT did not allow a student to continue until he/she had given the correct answer, thus reinforcing the correct response.

Actionable Science in the Gulf of Mexico: Connecting Researchers and Resource Managers

NASA Astrophysics Data System (ADS)

Lartigue, J.; Parker, F.; Allee, R.; Young, C.

2017-12-01

The National Oceanic and Atmospheric Administration (NOAA) RESTORE Science Program was established in the wake of the Deepwater Horizon oil spill to to carry out research, observation, and monitoring to support the long-term sustainability of the Gulf of Mexico ecosystem, including its fisheries. Administered in partnership with the US Fish and Wildlife Service, the Science Program emphasizes a connection between science and decision-making. This emphasis translated into an engagement process that allowed for resource managers and other users of information about the ecosystem to provide direct input into the science plan for the program. In developing funding opportunities, the Science Program uses structured conversations with resource managers and other decision makers to focus competitions on specific end user needs. When evaluating proposals for funding, the Science Program uses criteria that focus on applicability of a project's findings and products, end user involvement in project planning, and the approach for transferring findings and products to the end user. By including resource managers alongside scientific experts on its review panels, the Science Program ensures that these criteria are assessed from both the researcher and end user perspectives. Once funding decisions are made, the Science Program assigns a technical monitor to each award to assist with identifying and engaging end users. Sharing of best practices among the technical monitors has provided the Science Program insight on how best to bridge the gap between research and resource management and how to build successful scientist-decision maker partnerships. During the presentation, we will share two case studies: 1) design of a cooperative (fisheries scientist, fisheries managers, and fishers), Gulf-wide conservation and monitoring program for fish spawning aggregations and 2) development of habitat-specific ecosystem indicators for use by federal and state resource managers.

Science Development: An Evaluation Study. Technical Report No. 4.

ERIC Educational Resources Information Center

Drew, David E.

The National Science Foundation initiated the Science Development Program in 1965 in order to enable selected universities to improve the quality of their resources for science education and research. The specific purpose was to develop the competence of the funded institutions in preparing research scholars (as certified by their awarding of the…

Engaging youth of color in applied science education and public health promotion

NASA Astrophysics Data System (ADS)

Sprague Martinez, Linda; Bowers, Edmond; Reich, Amanda J.; Ndulue, Uchenna J.; Le, Albert An; Peréa, Flavia C.

2016-03-01

Participation in inquiry-based science education, which focuses on student-constructed learning, has been linked to academic success. Whereas the benefits of this type of science education are evident, access to such high-quality science curriculum and programming is not equitable. Black and Latino students in particular have less access to supplementary science programming, and fewer opportunities to engage in inquiry-based education. This paper describes outcomes associated with an inquiry-based out-of-school time science education program, Nuestro Futuro: Applied Science Education to Engage Black and Latino Youth (NFASE), which sought to build the capacity of middle school students of color to 'think' like health scientists from diverse disciplinary perspectives. The program was designed with the intent of (1) improving student attitudes toward and motivation for science and (2) increasing active and engaged citizenship (AEC). NFASE students explored health inequity and the social determinants of health locally and engaged in developing health promotion, outreach and education efforts targeted to their peers, parents/families, and community. Interest in the program was high overall, but implementation was not without challenges. Although evaluation outcomes indicate that there were no statistically significant changes in science-related attitudes or motivation, students reported significant increases in neighborhood social connection, as well as overall AEC.

Jump for the Sun II: can a Monthly Program Change Girls' and Women's Attitudes about Stem?

NASA Astrophysics Data System (ADS)

Crowe, Mary

The Environmental Institute of the Jump for the Sun II program was designed to change middle school girls' and teachers' attitudes about doing science and who does science and to increase interest in science, technology, engineering, and mathematics. The institute consisted of an intensive, 2-week summer congress followed by monthly sessions during the academic year. Female-friendly learning environments were created for middle school students and in-service educators, focusing on topics such as life expectancies, solid waste production, transportation gridlock, beach erosion, and biodiversity. In both 1998 and 1999, one group of participants completed the program, which was quantitatively and qualitatively evaluated. The quantitative results showed that the program did not improve girls' attitudes in any of the major categories under study; however, the posttest results indicated that in-service educators' attitudes improved significantly in three of the four categories (science experiences, perceptions of science and scientists, and science attitudes). The qualitative results indicated that the program positively affected some of the girls and in-service educators.

Integrating quantitative and qualitative evaluation methods to compare two teacher inservice training programs

NASA Astrophysics Data System (ADS)

Lawrenz, Frances; McCreath, Heather

Qualitative and quantitative evaluation procedures were used to compare two physical-science teacher inservice training programs. The two programs followed the master teacher training model espoused by NSF but used different types of master teachers and types of activities. The two evaluation procedures produced different results and together they provided a much clearer picture of the strengths and weaknesses of the two programs. Using only one approach or the other would have substantially altered the conclusions.

Ventures in science status report, Summer 1992. [Program description and Evaluation Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fredrick, Wayne C.

The Ventures in Science summer program is directed towards students who are from underrepresented minority groups in mathematics and science professions. The target group of 40 was drawn from eligible students who will be entering high school freshman in the fall of 1992. 450 students applied. The theme for the summer is Chicago as an Ecosystem. The students are instructed in integrated math and science (2 hours), English/ESL (1 1/2 hrs.), counseling (1 hr.) and, physical education (1 hr.) each day four days a week. Integrated math and science are team taught. Parents are invited to participate in two workshopsmore » that will be presented based on their input. Parents may also visit the program at any time and participate in any field trip.« less

A mentor development program for clinical translational science faculty leads to sustained, improved confidence in mentoring skills.

PubMed

Feldman, Mitchell D; Steinauer, Jody E; Khalili, Mandana; Huang, Laurence; Kahn, James S; Lee, Kathryn A; Creasman, Jennifer; Brown, Jeanette S

2012-08-01

Mentorship is crucial for academic productivity and advancement for clinical and translational (CT) science faculty. However, little is known about the long-term effects of mentor training programs. The University of California, San Francisco (UCSF), Clinical and Translational Science Institute launched a Mentor Development Program (MDP) in 2007 for CT faculty. We report on an evaluation of the first three cohorts of graduates from the MDP. In 2010, all Mentors in Training (MITs) who completed the MDP from 2007 to 2009 (n= 38) were asked to complete an evaluation of their mentoring skills and knowledge; all MITs (100%) completed the evaluation. Two-thirds of MDP graduates reported that they often apply knowledge, attitudes, or skills obtained in the MDP to their mentoring. Nearly all graduates (97%) considered being a mentor important to their career satisfaction. Graduates were also asked about the MDP's impact on specific mentoring skills; 95% agreed that the MDP helped them to become a better mentor and to focus their mentoring goals. We also describe a number of new initiatives to support mentoring at UCSF that have evolved from the MDP. To our knowledge, this is the first evaluation of the long-term impact of a mentor training program for CT researchers. © 2012 Wiley Periodicals, Inc.

Core Professionalism Education in Surgery: A Systematic Review

PubMed Central

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-01-01

Background: Professionalism education is one of the major elements of surgical residency education. Aims: To evaluate the studies on core professionalism education programs in surgical professionalism education. Study Design: Systematic review. Methods: This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Results: Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. Conclusion: It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable. PMID:29553464

Managerial Accounting in Library and Information Science Education.

ERIC Educational Resources Information Center

Hayes, Robert M.

1983-01-01

Explores meaning of managerial accounting in libraries and discusses instructional program for students of library and information science based on experience in School of Library and Information Science at University of California, Los Angeles. Management decision making (budgeting, performance evaluation, overhead, resource allocation,…

The effect of a science work experience program for teachers on the classroom environment: A qualitative program evaluation

NASA Astrophysics Data System (ADS)

Frazier, Wendy Michelle

Science Work Experience Programs for Teachers (SWEPTs) provide an opportunity for science and math teachers to work in research laboratories during the summer to experience science as it is practiced in the laboratory-setting. Through the use of interviews with teachers and students, classroom observations, and an analysis of printed student sheets and student work, the lived experience of a cohort of program participants in Columbia University's Summer Research Program for Secondary School Science Teachers was recorded in an effort to describe the effect of experience in a SWEPT on the classroom environment of teacher participants and student outcomes. Relying on Social Learning Theory and science education reform documentation as a theoretical framework the following dimensions of the classroom were examined: (1) emergent themes that include the participants' perceptions of the importance of technology in the classroom, (2) interpersonal relationships with the teachers at the participants' schools, fellow program participants, research scientists, and students, and (3) changes in epistemological structure, curriculum, instructional strategies, and classroom practices. Methodological and theoretical implications are addressed with respect to future studies, and suggestions for refinement of SWEPTs are provided.

Mentornet - E-Mentoring for Women Students in Engineering and Science

NASA Astrophysics Data System (ADS)

Single, Peg Boyle; Muller, Carol B.; Cunningham, Christine M.; Single, Richard M.; Carlsen, William S.

MentorNet www.MentorNet.net;, the E-Mentoring Network for Diversity in Engineering and Science, addresses the underrepresentation of women in science, technology, engineering, and mathematics "STEM". MentorNet offers a multiinstitutional, structured, electronic mentoring "e-mentoring" program that pairs undergraduate and graduate students, primarily women, with professionals and supports them through e-mentoring relationships of specified lengths. The program evaluations established that over 90% of the participants would recommend MentorNet to a friend or colleague. The e-mentoring program allowed participants to establish satisfactory and beneficial e-mentoring relationships based on investments of approximately 20 minutes per week - in between more serious exchanges, email exchanges that included light-hearted social interactions and jokes were an important aspect of sustaining e-mentoring relationships. Participation in MentorNet increased the students' self-confidence in their f elds - desire to obtain work in industry, national laboratories, or national agencies; and intent to pursue careers in their fields. Three years of evaluation results support the need for and efficacy of the program.

The effectiveness of a popular science promotion program on nanotechnology for elementary school students in I-Lan City

NASA Astrophysics Data System (ADS)

Lin, Show-Yu; Wu, Ming-Ta; Cho, Ya-I.; Chen, Hui-Huang

2015-01-01

Background:Nanotechnology education has become an urgent priority to nurture skilled human resources for the rapidly developing nanotechnology-related industries. The promotion of popular science education focusing on nanotechnology is an ideal approach to bridge the gaps in formal curricula, and to stimulate curiosity about and interest in nanotechnology among schoolchildren. Purpose:The objective of this study was to evaluate the effectiveness of the Nanotechnology-based Popular Science Education Promotion and Teaching (NPSEPT) program through camp activity that was implemented in elementary schools in I-Lan City, Taiwan. Program description:To create a competitive advantage, a human resources development program was implemented as one of the nanotechnology incubation projects in Taiwan and focused on developing an appropriately-skilled professional workforce as well as promoting popular science education. Sample:The volunteer research participants were 323 sixth grade students in four elementary schools in I-Lan City, Taiwan, who were evaluated at the beginning and the end of the nanotechnology-based popular science promotion camp activity. Design and methods:A research tool called the 'NPSEPT test' was designed specifically for this study and was approved by experts who evaluated its content and face validity. The questionnaire was divided into three aspects: 'Nanophenomena in the natural world'; 'Nanomaterials and their scaling effects'; and 'Definition, characteristics, and applications of nanotechnology.' The effectiveness of learning among the students was analyzed using descriptive statistics, a paired sample t-test, analysis of variance (ANOVA) and a post hoc comparison. Results:The results of the three-part 'NPSEPT test' revealed that NPSEPT significantly advanced nanotechnology learning performance and outcomes among students in the four participating elementary schools. Of the 15 questions included in the NPSEPT test, positive change for more than 30% of students was achieved for eight questions related to nanotechnology concepts.