SIF Funding Is Cut, i3 Level-funded in Budget Deal

Two Obama administration evidence-based programs whose funding had been targeted for elimination by congressional Republicans survived, although perhaps barely, in a final budget deal struck between Congress and the president Tuesday night.  The package is expected to be passed by Congress and signed into law in the coming days.

Funding for the Social Innovation Fund (SIF) was reduced from $70 million to $50 million in the final package (bill text), although provisions that allow SIF to set aside up to 20 percent of its funding for pay-for-success projects were retained.

Funding for SIF was cut even though funding for the portion of the bill covering health, education, and labor programs was increased by $5.4 billion. Funding for the Corporation for National and Community Service, of which SIF is part, was also increased.

The bill covers the rest of the fiscal year, which ends next September 30. SIF’s new funding may be enough to maintain existing projects, but it may not be sufficient for additional grants in the coming year.

There was better news for the Investing in Innovation (i3) program, which was level-funded at $120 million. The funding sets up what looks like a smooth transition to a new program that will come on line next year. The new Education Innovation and Research program, which will replace i3, was adopted as part of education legislation that President Obama signed into law earlier this month. The newly created program is only authorized at about $70 million starting in the next fiscal year, but advocates have expressed hope that they might be able to win an increase.

Another initiative, Performance Partnership Pilots (P3), was also maintained at existing levels. An initial round of nine projects was announced in late October. The legislation authorizes another ten projects in the coming year.

Congress also maintained or slightly increased funding for a variety of evidence-based pregnancy prevention programs, according to the National Campaign to Prevent Teen and Unplanned Pregnancy.


SIF’s National Assessment Rolls Out

The spending cuts for the Social Innovation Fund come just as reports from its national assessment are beginning to emerge. Two reports from the program’s evaluator, ICF International, were released earlier this month and both reinforced conclusions reached by SIRC’s own analysis, which was released over the summer.

One report, a review of subgrantee evaluations, found a wide range of evaluation results spanning from strong to weak. Like SIRC’s report, it also found that smaller regional grantmakers and their subgrantees faced the largest challenges due to constrained resources and low evaluation budgets. According to the report, none of this category of subgrantees has yet achieved a moderate or strong level of evidence in their evaluations.

A second report focused on capacity building, a strength of the SIF program. The report found that the capacity of SIF grantees improved on nearly every measure, but the greatest improvements were in evaluation — an unsurprising conclusion considering the woeful state of evaluation in the nonprofit sector more generally.

Both reports were a bit light on criticism. Neither significantly touched on intermediary transparency or the program’s burdensome match requirements, which were a major cause of funding shortfalls and evaluation problems for smaller, regional projects.

The reports also missed one of SIF’s critical program strengths: its oversight of local evaluations. Given that grantees and subgrantees were hiring their own evaluators, creating a potential conflict, such oversight is critical for ensuring evaluation credibility.

Although the two reports cast SIF in a generally favorable light, this year’s funding cuts suggest that the program’s future remains in doubt. Unless the program can find a way to win over congressional Republicans, its fate may depend less on its own effectiveness than on the outcome of the 2016 presidential election.

Update

Posted in Education, Evidence, Social Innovation Fund

Top Social Innovation Reads of 2015

With the holidays fast approaching, here are SIRC’s “Top Social Innovation Reads of 2015.”   Happy holidays everyone!


Evidence


Pay-for-Success


Performance Management


Scale

Want more?  Check out SIRC’s Top Reads of 2014.

Posted in Government Performance

AFSCME, Progressive Groups Criticize Pay for Success

One of the nation’s largest public sector unions, the American Federation of State, County and Municipal Employees (AFSCME), released a report on December 9 criticizing pay-for-success and social impact bonds. The report also listed a number of smaller progressive organizations as co-authors.

According to the report, its aim is “to help advocates identify the critical issues surrounding PFS contracts.”  It cites complexity, high cost, performance measurement difficulties, minimal innovation, and minimized investor risk as potential shortcomings.

The report’s release follows public sector union opposition to a number of local proposals across the country. A local AFSCME chapter opposed a bill before the Rhode Island state legislature. A project in Chicago was opposed by the Service Employees International Union (SEIU) and Chicago Teachers Union (CTU).

The report has drawn positive attention from the National Council of Nonprofits, which represents state associations of nonprofits. One of its members, the Minnesota Council of Nonprofits, was a co-author of the report and its director has written a parallel opinion piece in The Nonprofit Quarterly.

Opposition from progressives could undermine Democratic support for pay-for-success in the House and Senate, where stand-alone legislation has been stalled since it was introduced earlier this year.

However, other pay-for-success provisions have been enacted in other bills, including the recently enacted replacement for No Child Left Behind, a major transportation authorizing bill, and the Workforce Innovation and Opportunity Act last year. Pay-for-success provisions were also included in a bipartisan draft of welfare legislation released over the summer.

The Obama administration also remains strongly supportive of the concept. Last week, the Social Innovation Fund announced the availability of a second round of pay-for-success intermediary grants. (SIRC released a report on the first round winners last year).

Related

Posted in Social Impact Bonds / Pay for Success

Partisan Turn on Welfare Reform May Jeopardize Evidence Provisions

In what was billed as his first major policy speech since assuming leadership of the House, Speaker Paul Ryan on December 3 announced that welfare reform would be one of the chamber’s top priorities in the coming year and that evidence would play an important role.

Ryan’s vocal support may make House passage more likely, but it may also make its enactment less likely in the current session of Congress.

Coming just one day after the House passed a replacement for No Child Left Behind on a largely bipartisan vote, Ryan’s speech was seen as a major partisan shift, possibly marking the unofficial start of the 2016 campaign on Capitol Hill.

“We need a new president,” he said. “It’s just that simple. But even if we can’t move mountains, we can make moves in the right direction.”

He called on his Republican colleagues to pass a “complete alternative to the Left’s agenda” that includes welfare reform, tax reform, trade legislation, and passing a replacement for Obamacare.

Ryan’s welfare proposal would strengthen work requirements, combine funding from several federal programs, and give states and communities greater flexibility to “try different ideas” and “test the results.”

It drew a quick response from the Center on Budget and Policy Priorities, which criticized it as “block-granting the safety net.”  The organization said the Ryan proposal was likely to reduce assistance to needy families.


Promising Beginnings

Welfare reform had already taken a noticeably partisan turn before Ryan’s speech, but the year began on a more bipartisan note. In April, Congress passed extensions for two major evidence-based initiatives, home visiting and teen pregnancy prevention. By then, the House Ways and Means Committee had already begun holding hearings on reauthorizing the principal federal welfare law, Temporary Assistance for Needy Families (TANF).

Continue reading

Posted in Children and Families

K-12 Education Bill Advances Evidence-based Policy, Replaces i3

Evidence-based policy will soon receive a significant boost from a major K-12 education bill that is nearing the finish line.  This week the Senate is expected to pass a major rewrite of the Bush era No Child Left Behind Act, sending it to President Obama who is expected to sign it into law by the end of the year.

The legislation (S. 1177), dubbed the Every Student Succeeds Act (ESSA), includes several evidence-related provisions, including a replacement for one of the Obama administration’s signature evidence-based initiatives, the Investing in Innovation (i3) program.

The bill also shifts substantial authority away from Washington and back to states and local school districts. Some are calling the bill’s combination of greater flexibility and increased support for rigorous evidence a potentially powerful combination.

“For a lot of people this was about the past. It was about fixing the mistakes of No Child Left Behind,” said Jeremy Ayers, vice president for policy at Results for America, “but with the focus on evidence it’s just as much about looking to the future.”

Such sentiments were evident on both sides of the political aisle.  “It helps to support and grow local innovations,” said outgoing Education Secretary Arne Duncan in a statement issued shortly after the House passed the bill by a wide margin.  The Senate is expected to pass the bill by a similarly large margin later this week.

With enactment just around the corner, what will it mean for evidence-based policy?

Continue reading

Posted in Education

Early Pay for Success Results Prompt Debate over the Meaning of ‘Success’

An experiment in performance-based financing for government services, called pay for success, has raised questions about what should count as success after mixed results were announced at two demonstration sites in July and October.

The sites — one in Rikers Island, New York, and the other in Salt Lake County, Utah — are part of a growing bipartisan effort to tie social services funding to proven results. Legislation in the House and Senate that would expand the concept, also called social impact bonds, has drawn support from Democrats and Republicans, including President Obama and the new speaker of the House, Paul Ryan.

The idea has also drawn criticism from public sector unions and others who question their reliance on third-party financing and payments to private investors, including private foundations and commercial firms like Goldman Sachs. Supporters counter that such financing makes the projects possible and that when they are successful they often save taxpayers money.

So far, the earliest results have generated differing views about whether they were successful. The first project, the results of which were announced in July, focused on reducing recidivism among youth at a city jail on Rikers Island in New York City. Seemingly a failure, it was subsequently shut down after falling short of its goals. Proponents argued, however, that it was actually a success because it accomplished something that is generally rare but central to the pay for success model: honestly assessing a new initiative and, when it fails, closing it down.

A second project, an early education program for children in Utah intended to reduce the need for more expensive special education, announced exceptionally strong results in October. Those results, however, were subsequently criticized by an investigative story in The New York Times, which suggested that the success metrics were too easy to achieve, an assertion that drew sharp disagreement in Utah.

In each case, the project’s success or failure was a matter of debate largely because of performance information that is not normally available for most social programs.

For the Obama administration, the very existence of such information is a win. Last month it announced a package of public and private initiatives that includes the expanded use of pay for success.

“We continue to be optimistic about this work,” said David Wilkinson, director of the White House Office of Social Innovation and Civic Participation. “PFS helps overcome the barriers to implementing quality, innovative programs for those in need by enabling government to pay only when its standards are met. At the same time it builds evidence about what works.”

Continue reading

Posted in Social Impact Bonds / Pay for Success

The Other Pay for Success: The Promise and Peril of Paying for Outcomes

Social impact bonds and pay-for-success are often viewed as synonymous. They shouldn’t be. There is another version of pay-for-success that has been around much longer, is far more widespread, and may be the future of social impact bonds.

Outcomes-based funding – payments to social service and other providers based at least in part on the results they achieve – is an idea that has been around for decades. Unfortunately, the history of this other version of pay-for-success has been far from universally positive.

If the futures of these two very different forms of pay-for-success become increasingly intertwined, it will be important to understand their respective strengths and weaknesses. While the two ideas can be highly synergistic, there is also a substantial risk of recreating the failures of the past.


Two Approaches: Similar, but Different

On the surface, social impact bonds (SIBs) and more traditional outcomes-based funding systems are very similar. Both involve governments paying other (often nonprofit) entities for services that are based at least partly on results.

But there are also a number of important differences. SIBs, at least as they are commonly understood in the United States, typically involve third-party private financing and rely on rigorous external evaluations to determine their impact. By contrast, outcomes-based funding systems usually lack third-party financing and rely on validated administrative data to determine payments.

There is also a significant difference in scale. While SIBs are currently experiencing significant growth, fewer than a dozen are actually operational in the United States and only two have shown any results so far (in Rikers Island and Salt Lake County). By contrast, outcomes-based funding systems are already operating at scale, affecting perhaps hundreds of billions of dollars in annual public funding, including in education, job training, social services, and health care, the last of which by itself comprises a substantial portion of the U.S. economy.

While these differences are significant, they may not be destined to last. As SIBs grow, there are already signs that they may become more like their larger, more established sibling. First, the current financing mechanism for SIBs may not be scalable. Despite the increased availability of social investment capital, the risk-reward ratio may make them financially unattractive to profit-motivated investors, particularly after the failure of the Rikers Island project. Foundation funds, which have provided the bulk of the financing to date, may be too limited to provide sufficient scale. Second, the external impact evaluations used to judge success may be too expensive and impractical once SIBs advance beyond the demonstration stage.

If these limitations prove insurmountable, SIBs may become more like traditional performance-based contracts. At least one national SIB expert foresees such a future, while others have begun to raise questions. If such a convergence does occur, the history and lessons of outcomes-based funding will become increasingly important to understand.

Continue reading

Posted in Social Impact Bonds / Pay for Success

Report: Social Innovation Fund’s Early Results Are Promising

The Social Innovation Fund, an Obama administration initiative that funds promising community-based programs and subjects them to rigorous evaluations to determine their impact, has produced five project evaluations with positive, evidence-based findings, according to a report released today by the Social Innovation Research Center.

Enacted in 2009 as part of the Serve America Act, the Social Innovation Fund (SIF) is a centerpiece of a broader White House evidence agenda that would tie funding for social programs to results.

The report released today is based on a review of final and interim project reports obtained through a Freedom of Information Act (FOIA) request, interviews with current and former Social Innovation Fund staff, interviews with 17 of 20 grantmaking intermediaries from the first three years of the program, and interviews with several national experts in evaluation and philanthropy.


Promising Early Results

The five evaluated projects highlighted in the report cover a range of issues including early childhood reading, childhood obesity, low-income savings plans, social enterprise employment, and workforce development. They are:

The projects were evaluated by third-party firms such as MDRC and Mathematica Policy Research using a range of study designs that were rated as either moderate or strong in their rigor by the evaluation staff of the Social Innovation Fund.

Two, Reading Partners and SaveUSA, involved randomized controlled trials, often referred to as the “gold standard” of evidence and typically the most expensive form of evaluation. Of the five, the study of the Reading Partners initiative, which used volunteer tutors to provide literacy training for elementary school students, was the strongest in terms of rigor and reported results.

Caution should be taken with respect to some of the findings, particularly those that are rated as only moderate in their evaluation rigor.  Other final evaluations not reported above include a range of preliminary evidence and mixed results.

These early results are a promising first step. The studies are the first in a pipeline of evaluations that will roll out over the coming months and years.  These results may complement related efforts, such as the development of social impact bonds, which often rely upon evidence-based interventions in their design.


Other Findings

  • High-capacity Nonprofits:  Nonprofits with greater resources and capacities in areas such as performance management and evaluation were substantially more likely to produce positive results. The report found repeated instances where nonprofit capacity and resources spelled the difference between failure and success.
  • Grantmaking Intermediaries:  The program’s reliance on grantmaking intermediaries, a strategy rooted in the concept of venture philanthropy, appears to have played a central role. The grantmaking intermediaries conducted due diligence before selecting their subgrantees and then further invested in their capacities over time.  The program also heightened the capacity of the intermediaries themselves.
  • Federal Role: Federal resources and oversight of evaluations appear to have played a critical role in ensuring evaluation quality and independence.

The report also identified several areas for program improvement.

  • Matching Requirements: High financial matching requirements appear to have caused some projects to be underfunded, particularly those in small regional settings that are philanthropically underserved. As currently designed, the matching requirements also appear to discourage funding from public sources, such as federal, state and local governments, which may be the best source for sustainable support after SIF funding ends.
  • Regulations: Regulatory requirements, most of which are common to most federal grants, have been overly burdensome and should be reduced.
  • Transparency: The intermediary grantmaking process should be made more transparent.
  • Knowledge Dissemination: The program’s efforts to disseminate knowledge and lessons learned should be expanded.
  • Impact on Philanthropy: The program’s impact on philanthropy as a whole has so far been small, although it has had a very significant impact on participating grantmakers and subgrantees, particularly with respect their evaluation capabilities and other related capacities.

See the Full Report.


Media Coverage / Discussion

Posted in Social Innovation Fund

Senate Committee Passes Evidence Commission Bill, Congress Proposes Defunding i3 and SIF

By voice vote, the Senate Homeland Security and Governmental Affairs Committee today passed legislation (S. 991) that would create a bipartisan commission to recommend how Congress and the administration should expand the use of data to evaluate federal programs and tax expenditures.

“This bill will help give Congress more tools to make better policy decisions across the federal budget and tax code, and I am going to keep working until it gets signed into law,” said Sen. Patty Murray (D-WA).

A House committee passed a similar bill last month. “The bill is working its way through the legislative process, and all signs look good,” said Rep. Paul Ryan (R-WI) at a Results for America event held today in Washington, D.C.

In other news, the Investing in Innovation (i3) and Social Innovation Fund programs have both been defunded in appropriations legislation moving in the Republican-controlled House and Senate.

“We are extremely disappointed,” said Michele McLaughlin, president of the Knowledge Alliance, a coalition of education organizations that has been working to support innovation in education.

“Driving and scaling up evidence-based programs and policies, as i3 does, should be embraced by both sides of the aisle. The proposed Ryan-Murray evidence commission has shown that we can come together and embrace evidence in a bipartisan fashion if the political will exists.”

The bills are unlikely to be signed into law by President Obama as written. They are a starting point for negotiations that are likely to continue into the fall.

Posted in Education, Evidence, Social Innovation Fund