Kimberle Kelly Email & Phone Number

Washington, Dc

As a founding member of a newly established Topical Interest Group (TIG) of the American Evaluation Association (AEA), Dr. Kelly and the TIG leadership team are bringing organizational focus to the evaluation of STEM (Science, Technology, Engineering, and Mathematics) education and training efforts across the lifespan. The leadership team promotes an intellectual presence among the 7700 members of the AEA and to the larger STEM education and training evaluation community. The TIG hosts a business meeting and conference strand during the annual AEA meeting.Activities include:-Advocating for the importance of high quality program evaluation in realizing national goals for STEM education-Cultivating connections among STEM education and training organizations-Serving as the TIG liaison with AEA’s leadership and management organization-Implementing TIG priorities and strategies, such as a website and STEM evaluation resources-Facilitating the ongoing business of the TIG, such as leading biweekly telecons-Managing annual leadership team elections-Sponsoring a TIG conference strand at the annual conference through a call for papers -Recruiting and assigning reviewers and confirming acceptance or rejection of proposals-Developing the TIG conference program based on accepted proposals -Overseeing the content of the annual TIG Business Meeting

Los Alamitos, Ca

As an independent evaluation consultant, Dr. Kelly has managed and directed research and evaluation outcome studies in education in collaboration with government agencies, major research universities, offices of education, school districts, and non-government and nonprofit organizations. Her specialties include mixed-methods research and evaluation designs for Science, Technology, Engineering, and Mathematics (STEM) education initiatives in early childhood, K-12, and higher education settings. These initiatives are focused on the development and implementation of curricula, professional development, informal education, and career pathways targeting technical and engineering fields, computer science, climate change, science and technology-assisted science education. The majority of these initiatives are supported by grant programs targeting traditionally underperforming and underrepresented groups (NSF, NASA, AAC&U, CA Dept. of Ed. (CDE)). Activities include: -External program evaluation (formative and summative) design and drafting at proposal stage-Collaboration with Principal Investigator(s) and Leadership Teams that allows the best implementation and use of program evaluation data-Development of program logic models, instruments and protocols as needed, and securing institutional IRB or other agency approvals-Use of mixed methods (qualitative and quantitative data from observations, artifacts, self-report surveys and assessments from participating role groups)-Recruitment, training and supervision of evaluation staff-Coordination and tracking of data collection, including database construction, management, and quality control -Application of appropriate statistical analysis and data displays using a variety of software platforms-Written and oral reports on evaluation findings to a range of stakeholders along with regular presentations and publicationsA list of funded projects and partners is available upon request.

Oak Ridge, Tennessee, United States

Directed STEM education research and formative, summative, and longitudinal evaluation of activities for corporate and government clients.Activities included:- Identified and secured program evaluation funding, working directly with sponsors and outside consultants.- Coordinated work of ORAU project staff to meet funded project milestones and deliverables including workplans, budget management, and customer deadlines- Developed program-specific survey instruments, interviews, and protocols, obtained required approvals- Conducted qualitative and quantitative data collection, processing, quality control, management and analysis using advanced statistical software, online applications and databases - Prepared results and reports by providing summary data tables, descriptive statistics, and relevant qualitative data in multiple formats targeting all project stakeholders- Served as a consultant to program staff for tracking and documenting findings for program improvement and future proposal preparation

Dept. Of Psychology, Academic Culture Initiative, Master'S Of Applied Psychology

Dr. Kelly has served for many years on a part to full-time basis in the Department of Psychology at USC, first as a teaching assistant and later a part to full-time lecturer for graduate and undergraduate laboratory and online courses in research methods and applied research methods, statistics, neuroscience, psychophysiology, psychobiology, human development and aging, and mental illness. Other activities include: -Faculty mentor and reader for two successive student cohorts in the Master's of Applied Psychology Program in the preparation of culminating degree treatises-Coordinated course-based marketing research projects with corporate client Coleman for the Masters’ in Applied Psychology Program-Initial course development and implementation for an online applied research methods course for the Master's in Applied Psychology Program-Research mentor for a McNair Scholar and honors student in Psychology who is blind; Karen Arcos received several fellowships and awards, including an NSF Graduate Fellowship in STEM, and is now in Graduate Studies at the University of California-Irvine-Research mentor for several undergraduate students in grant-funded education research projects as volunteer research assistants-Faculty adviser for the student organization Kyrie-Preparing letters of recommendation for students annually

Wisconsin Center For Education Research

Dr. Kelly served as Co-PI and Site Project Director on a longitudinal research and evaluation study of an elementary science reform initiative, funded by the National Science Foundation.Activities included: -External program evaluation (formative and summative) design and drafting-Collaboration with Principal Investigator(s) and Leadership Teams that allows the best implementation and use of program evaluation data-Coordination of research and evaluation budget and activities-Development of program logic models, instruments and protocols as needed, and securing institutional IRB or other agency approvals-Use of mixed methods (qualitative and quantitative data from observations, artifacts, self-report surveys, district assessment and demographic data from participating role groups)-Recruitment, training and supervision of evaluation staff-Coordination and tracking of data collection, including database construction, management, and quality control -Application of appropriate statistical analysis and data displays using a variety of software platforms-Written and oral reports on evaluation findings to a range of stakeholders along with regular presentations and publicationsA research brief prepared by Dr. Kelly on this funded project is available upon request.

Los Angeles, Ca

Dr. Kelly assumed the coordination of multiple research and evaluation studies of district systemic science initiatives in the Los Angeles Unified School District, many supported by state and federal grants and including extensive collaboration with institutions of higher education and educational research organizations. Employing a variety of experimental and quasi-experimental designs, these studies were collectively concerned with evaluating the effects of curriculum, instruction, and professional development reform initiatives on teacher content knowledge, classroom instructional practice, and student achievement.Activities included:-External program evaluation (formative and summative) design and drafting-Collaboration with Principal Investigator(s) and Leadership Teams that allows the best implementation and use of program evaluation data-Coordination of research and evaluation budget and activities across a complex network of university and district stakeholders-Development of program logic models, instruments and protocols as needed, and securing institutional IRB or other agency approvals-Use of mixed methods (qualitative and quantitative data from observations, artifacts, self-report surveys, district assessment and demographic data from participating role groups)-Recruitment, training and supervision of evaluation staff-Coordination and tracking of data collection, including database construction, management, and quality control -Application of appropriate statistical analysis and data displays using a variety of software platforms-Written and oral reports on evaluation findings to a range of stakeholders along with regular presentations and publications-Providing professional development in research and evaluation for K-12 science education teachers and administrators (such as science classroom observation protocol)

San Dimas, Ca

As a founding board member, Dr. Kelly served a nonprofit corporation focused on providing education and advocacy to community members seeking access to needed resources such as SSDI, SSI, and Medicare. Compassion in Action USA has produced extraordinary results in terms of the number of clients who successfully received critically-needed resources. Activities included: -Served on inaugural Board of Directors-Participated in grant writing, fundraising, and public relations in the nonprofit sector-Internal evaluation, strategic planning, and client database development to assist organizational growth-Volunteer recruitment and training-Client Advocacy services in securing critically-needed financial and medical resources for homeless and near-homeless citizens-Community education programs to bring awareness to the organization, the need for its services, and local agencies and resources that can provide assistance.

Los Angeles, Ca

Teaching and training in psychology and cognitive and brain sciences during her graduate studies prepared Dr. Kelly to step immediately into a project management role in the Aftercare Research Program, part of the UCLA Neuropsychiatric Institute from 1997 until 2004. In this role, Dr. Kelly coordinated research needs across multiple NIMH-funded longitudinal treatment and outcome studies in schizophrenia spectrum disorders. Dr. Kelly's research specialties include the integration of clinical, neurophysiological, and cognitive predictors of social and functional outcomes in schizophrenia spectrum disorders.Activities included:-Integration of research and clinical needs with a diverse treatment team and patient populations-Maintenance of project equipment, instruments and protocols needed for research, and securing institutional IRB or other agency approvals-Use of mixed methods (qualitative and quantitative data from a large range of cognitive, physiological, psychosocial, and functional outcome measures)-Recruitment, training and supervision of entry level research staff and volunteers-Coordination and tracking of data collection, including database construction, management, and quality control -Application of appropriate statistical analysis and data displays using a variety of software platforms-Written and oral reports on evaluation findings in regular presentations and publications.

Nrsa Postdoctoral Traineeship, Psychological Research On Schizophrenic Conditions

Training grant content areas: Cognitive and neurophysiological factors in clinical and functional outcome in recent onset schizophrenia.

Doctor Of Philosophy (Ph.D.), Psychology--Cognitive And Brain Sciences

Dissertation: Evaluating attentional influences on prepulse inhibition

Bachelor Of Science (B.S.), Experimental Psychology

Honors thesis: Performance, subjective, and metabolic measures of mental workload to manipulations of memory load and temporal demand.