Privacy Concerns Threatens Survey Research

In previous posts I’ve called for courts and justice systems to be good stewards of performance data.  And, as an advocate of radical transparency, I’ve pushed for self-assessment and accountability by means of regular and continuous performance measurement and management instead of reliance on periodic third-party program evaluation and research.

Now comes another good reason for courts and other justice institutions to go that route.  As reported by Carl Bialik, Census Gets Questions on Mandatory Queries, the Wall Street Journal’s “Numbers Guy,” members of Congress are challenging the Census Bureau’s massive data-collection effort known as the American Community Survey.  The survey uses dozens of detailed questions – including the use of carpools, flush toilets, and wood fuel – to help determine the need for and distribution of funds of various government programs. The survey, which reaches 3.5 million households, is mandatory, a fact that gets close to 100% of the people to respond and a necessity for maintaining the survey’s validity, according to the Census Bureau and its supporters, including the American Association for Public Opinion Research and the American Statistical Association.  

The congressional challenge, including presidential candidate Ron Paul, rests on privacy concerns. “The freedom of the American people from unwanted government intrusion into the private lives and affairs is a higher priority than the quality of the government’s data,” the Wall Street Journal quoted a Ron Paul spokesperson as saying.

Good stewardship of performance data, in my view, requires courts and justice institutions not only to collect data on the right measures but, first and foremost, to integrate performance measurement and performance management with good governance.  They need to have the right delivery of the performance data, which means getting it into the hands of the right people in a totally transparent and accountable manner that ensures the right use of the data.   Privacy issues and non-disclosure of protected data are best determined and implemented by judicial branch policymakers as part of the development of an effective performance measurement and management system.  Unpleasant surprises, such as that facing the Census Bureau, might be minimized, if not avoided altogether, by such an approach.  

© Copyright CourtMetrics and the National Center for State Courts 2012. All rights reserved.

Popular posts from this blog

Top 10 Reasons for Performance Measurement

There is a growing demand of “show me the data” from citizens and taxpayers, legislators, executive agencies, oversight boards and communities – all of whom exchange money and other support (e.g., trust and confidence) for services -- that courts can ill afford to ignore. Courts need to measure their performance to meet the demand for public accountability. But the benefits of court performance extend beyond accountability including improved prediction, better understanding and control, influence, a sharpened focus on what is important, and discovery of better practices. Objective performance data is central to good management practices like strategic planning, performance-based budgeting, Balanced Scorecards, Total Quality Management (TQM), and Six Sigma. Performance measures allow court leaders and managers, policymakers, legislators and the public to evaluate court programs’ inputs (the resources allocated), outputs (direct results of program or service activities) and outcomes (bro...
Read more

Q & A: Outcome vs. Measure vs. Target vs. Standard

Q: Those of who write and speak about court performance measurement rely on their share of jargon -- and it's often confusing. What are the differences among the terms “outcome,” “measure,” “target” and “standard”? A: Socrates said that the beginning of wisdom is definition. We’ll see. Outcomes are the benefits or changes for the intended beneficiaries of a court’s programs and services. Outcomes may relate to knowledge, skills, attitudes, values, behavior, condition or status of the program participants or recipients of services. Examples include litigants' satisfaction with a court's courtesy and responsiveness, success of probation, time to case disposition, clarity of orders, integrity of case files, percent of mediation agreements, enforcement of orders, and perceived fairness of proceedings, as well as percent of expected expenditures and percent of revenues received. Outcomes should not be confused with the activities of those who run the court. (See the October 1...
Read more

Taming “Wild Problems”: Measure Everything That Matters

Every problem is not solvable, but every problem is measurable. This assertion is the key to tackling problems in public services including courts, business, and life in general. Surprising to me is that even astute scholars take exception to this, among them  is Russ Roberts, the John and Jean De Nault Research Fellow at Stanford University’s Hoover Institution, the president of Shalem College in Jerusalem, and host of the award-winning podcast EconTalk: Conversation for the Curious. The belief that certain things, dubbed “wild problems” by Professor Roberts, cannot be measured does a disservice to courts and other public and private organizations. There are many benefits to measuring everything that matters. It allows organizations to   focus on and to operationalize the most important problems and issues facing them,   to track progress over time and identify areas of improvement,   to compare their performance to that of other organizations and learn from the d...
Read more