Tribune study: Chicago's safety claims for camera enforcement are dubious

 

Chicago Tribune 12/19/2014:
"Chicago's red light cameras fail to deliver the dramatic safety benefits long claimed by City Hall, according to a first-ever scientific study that found the nation's largest camera program is responsible for increasing some types of injury crashes while decreasing others.

The state-of-the-art study commissioned by the Tribune concluded the cameras do not reduce injury-related crashes overall — undercutting Mayor Rahm Emanuel's primary defense of a program beset by mismanagement, malfunction and a $2 million bribery scandal.

Emanuel has credited the cameras for a 47 percent reduction in dangerous right-angle, or "T-bone," crashes. But the Tribune study, which accounted for declining accident rates in recent years as well as other confounding factors, found cameras reduced right-angle crashes that caused injuries by just 15 percent.

At the same time, the study calculated a corresponding 22 percent increase in rear-end crashes that caused injuries, illustrating a trade-off between the cameras' costs and benefits.

The researchers also determined there is no safety benefit from [40% of Chicago red light] cameras [which are] installed at intersections where there have been few crashes with injuries. Such accidents actually increased at those intersections after cameras went in, the study found, though the small number of crashes makes it difficult to determine whether the cameras were to blame."

Here's the full article which runs much longer, but it's behind a paywall:
http://www.chicagotribune.com/news/watchdog/redlight/ct-red-...

Chicago currently has "the largest automated enforcement program in the country," according to the Tribune, which had supported camera enforcement in editorials but turned against the program when it was revealed that bribery got the camera contract awarded. Mayor Emanuel did not respond to Tribune requests for comment.

Other pages

--
JMoo On

oft cited

dagarmin wrote:

...Emanuel has credited the cameras for a 47 percent reduction in dangerous right-angle, or "T-bone," crashes. But the Tribune study, which accounted for declining accident rates in recent years as well as other confounding factors, found cameras reduced right-angle crashes that caused injuries by just 15 percent.

At the same time, the study calculated a corresponding 22 percent increase in rear-end crashes that caused injuries, illustrating a trade-off between the cameras' costs and benefits.

The researchers also determined there is no safety benefit from [40% of Chicago red light] cameras [which are] installed at intersections where there have been few crashes with injuries. Such accidents actually increased at those intersections after cameras went in, the study found, though the small number of crashes makes it difficult to determine whether the cameras were to blame."

The seeming disparity in the amount of injury accidents is accounted for in a couple of different ways. What it comes down to is how you count the injury accidents. Not to say there aren't a lot of injuries resulting from rear-enders, but the question is of severity. Just counting accidents with injuries will give you one set of numbers while taking into account the severity of the injuries will yeild still a different number.

T-Bone crashes with injuries usually result in hospitalization, rear-enders rarely do even though someone may be transported, they are often released without checking into the hospital. So, it comes down to counting the medical costs of the injuries and the length of time a person was in care rather than just the raw number.

--
Illiterate? Write for free help.

Here's the report

Here's the report the researchers submitted to the Chicago Tribune which goes into a fair amount of statistical and modeling detail about how they analyzed the data.
http://www.chicagotribune.com/news/watchdog/redlight/chi-red...
I think this report is not behind a paywall, but I can't tell for sure.

One thing I can tell from the Tribune paywall article that leads the researchers and Tribune to conclude that the city overestimated the safety effect is that the city was counting reduction in crashes (and went back farther in time than the cameras were in place at some corners for the baseline accident rate), and that during the study period, injury accidents were declining in Chicago anyway. The city was attributing all of the injury accident reduction in this period to RLCs when the study data says only a much smaller portion of it can be attributed to RLCs.

In the interest of fairness, and tippo' the hat to jgermann for that, since I oppose the use of these cameras, nonetheless, one thing that could be argued to suggest that the Tribune study underestimates possible improvements in safety due to RLCs in Chicago is that the Tribune study control group consisted of other intersections in Chicago that did not have RLCs. But if RLCs were influencing drivers to make safer choices (such as by not gunning the accelerator to beat the red light) city-wide because there are so many cameras, then one could say that the cameras have helped promote safer driving than the study suggests. To really control for the influence of RLCs in traffic safety, it might have been better for the researchers to use random intersections from a different large midwestern city where these cameras are not used.

However the increase in rear-end injury accidents which opponents have long cited as a potential safety negative with these cameras-- some supporters of RLCs here have said, prove it--where's the data really showing this??--did in fact show up in the data. RLC opponents will argue that the increase in rear-end injury accidents attributed to RLCs more than compensated for any decrease in T-bone and right-angle injury accidents due to RLCs in the Chicago Tribune data.

And Box Car I get your point about severity, but they likely don't have data on that. Was an ambulance rolled? or was there a fatality? would be in the city accident data. but data on the medical cost, pain, and suffering to the victims and their friends and families are of course not there. I would not be too cavalier though about possible severity of a rear-end accident. I agree that on average T-bones are the worst, but whiplash is not just in the imagination of plaintiff attorneys; it does very negatively impact some peoples' lives long-term. Also rear-end accidents are fatal less often than T-bones but still can be fatal especially when there is a mismatch in vehicle size or when there is a multi-vehicle accident stopping motion of a vehicle in the middle of a line, and both these scenarios certainly do happen.

--
JMoo On

RE: Here's the report

I didn't mean to discount any injuries that may happen in a rear-ender. It's when taken on a whole, the injuries are typically not as severe as those in a T-Bone. There are a lot of instances where there are no injuries in a T-Bone, just as there are many more incidents of non-injury in the rear-enders.

None of these can be classified as "accidents" as there was nothing accidental about them. Someone wasn't paying attention or decided to chance the situation and lost.

Just this morning my wife witnessed a rear-ender at an intersection caused by a car not moving when the light turned green. The car behind saw the light change and went forward. There was damage but no injury. (And no, it wasn't an intersection with a camera.)

--
Illiterate? Write for free help.

Yup

Box Car wrote:

I didn't mean to discount any injuries that may happen in a rear-ender. It's when taken on a whole, the injuries are typically not as severe as those in a T-Bone. There are a lot of instances where there are no injuries in a T-Bone, just as there are many more incidents of non-injury in the rear-enders.

None of these can be classified as "accidents" as there was nothing accidental about them. Someone wasn't paying attention or decided to chance the situation and lost.

Agreed on both counts.

--
JMoo On

@dagarmin

dagarmin wrote:

...
In the interest of fairness, and tippo' the hat to jgermann for that, since I oppose the use of these cameras, nonetheless, one thing that could be argued to suggest that the Tribune study underestimates possible improvements in safety due to RLCs in Chicago is that the Tribune study control group consisted of other intersections in Chicago that did not have RLCs. But if RLCs were influencing drivers to make safer choices (such as by not gunning the accelerator to beat the red light) city-wide because there are so many cameras, then one could say that the cameras have helped promote safer driving than the study suggests. To really control for the influence of RLCs in traffic safety, it might have been better for the researchers to use random intersections from a different large midwestern city where these cameras are not used.

However the increase in rear-end injury accidents which opponents have long cited as a potential safety negative with these cameras-- some supporters of RLCs here have said, prove it--where's the data really showing this??--did in fact show up in the data. RLC opponents will argue that the increase in rear-end injury accidents attributed to RLCs more than compensated for any decrease in T-bone and right-angle injury accidents due to RLCs in the Chicago Tribune data.

...

@dagarmin, your comments were much appreciated. Our country needs more people looking critically at the facts and making their own judgments rather than just listening to their favorite "talking heads".

It has always been relatively easy to take any report/study and extract statements out of context to support one's position. thenewspaper.com has done this for years.

I appreciate your posting the link and taking the time to read the report.

I always like to look at the "abstract" and/or the Summary and Conclusions portions of reports to get a sense of what the authors concluded.

Quote:

In conclusion, similar to any research studies, the study is subjected to a few limitations. First, although the latest methodological tool was used for estimating the safety effects of RLCs, the EB estimate can still be biased, as documented in a recent research study (Lord and Kuo, 2012). The magnitude of the bias is very difficult to measure and further work is currently being conducted on this topic. Second, the regression models were estimated from observations that may have been influenced by the spillover effects. This means that the estimates calculated by the before-after study with reference group and the EB methods documented above may be underestimated. It is possible that using a different sample of signalized 4-legged intersections that is not influenced by the potential spillover effects could lead to different estimates. Despite these two limitations, the results nonetheless show that RLCs significantly reduce angle and turning injury collisions, but increase rear-end injury collisions as documented in the majority of the studies that examined the effects of RLCs on safety. Finally, the work done in this study only applies to signalized 4-legged intersections located within the City of Chicago. The results should not be generalized to other intersection types and outside the study area.

[emphasis added]

I have always been a proponent of Automated Traffic Enforcement (ATE) not because ATE significantly improves safety (although on balance I think it does) but because it produces revenue badly needed by municipalities. AND, this revenue is paid by law breakers rather than the general population.

Spillover effect

jgermann wrote:

@dagarmin, your comments were much appreciated. Our country needs more people looking critically at the facts and making their own judgments rather than just listening to their favorite "talking heads".

It has always been relatively easy to take any report/study and extract statements out of context to support one's position. thenewspaper.com has done this for years.

I appreciate your posting the link and taking the time to read the report.

I always like to look at the "abstract" and/or the Summary and Conclusions portions of reports to get a sense of what the authors concluded.

Quote:

In conclusion, similar to any research studies, the study is subjected to a few limitations. First, although the latest methodological tool was used for estimating the safety effects of RLCs, the EB estimate can still be biased, as documented in a recent research study (Lord and Kuo, 2012). The magnitude of the bias is very difficult to measure and further work is currently being conducted on this topic. Second, the regression models were estimated from observations that may have been influenced by the spillover effects. This means that the estimates calculated by the before-after study with reference group and the EB methods documented above may be underestimated. It is possible that using a different sample of signalized 4-legged intersections that is not influenced by the potential spillover effects could lead to different estimates.

I have always been a proponent of Automated Traffic Enforcement (ATE) not because ATE significantly improves safety (although on balance I think it does) but because it produces revenue badly needed by municipalities. AND, this revenue is paid by law breakers rather than the general population.

And that's a good point. Chicago's finances are in terrible shape.

I didn't pay enough attention to that limitations paragraph in the report. I suspect that what the study authors meant by "spillover effect" is along the lines of what I was suggesting about drivers in Chicago possibly being more generally careful even at intersections where there aren't any RLCs. Because the city put so many cameras up, drivers may feel like they can't be sure where all of them are and be more cautious than they might have been if no cameras had ever been installed. This could be a confounding factor that could mean RLCs have more of a positive effect on driver safety than was controlled for in the data or suggested in the study conclusions.

More researchers looking at effects of RLCs on driver safety scientifically and with an open mind should be appreciated by all who don't have an axe to grind... a rarity in Chicago politics BTW.

--
JMoo On

.

Ars Tech article

arstechnica.com/tech-policy/2014/12/major-chicago-study-finds-red-light-cameras-not-safer-cause-more-rear-end-injuries/

Terrible is an

Terrible is an understatement to describe our finances. You need a stronger word to describe a city that has $23 billion worth of unfunded liabilities. It was funny on the Sunday local news program watching the 2 mayoral challengers carefully dance around how they plan to come up with the money for the $1.2 billion pension payment due next year.

@telecomdigest2

telecomdigest2 wrote:

Ars Tech article

arstechnica.com/tech-policy/2014/12/major-chicago-study-finds-red-light-cameras-not-safer-cause-more-rear-end-injuries/

I was quite surprised that you submitted a link to an article that extracted statements out of context in order to mislead readers right after dagarmin and I had been discussing the entire report.

Let me requote the report's conclusions:

Quote:

In conclusion, similar to any research studies, the study is subjected to a few limitations. First, although the latest methodological tool was used for estimating the safety effects of RLCs, the EB estimate can still be biased, as documented in a recent research study (Lord and Kuo, 2012). The magnitude of the bias is very difficult to measure and further work is currently being conducted on this topic. Second, the regression models were estimated from observations that may have been influenced by the spillover effects. This means that the estimates calculated by the before-after study with reference group and the EB methods documented above may be underestimated. It is possible that using a different sample of signalized 4-legged intersections that is not influenced by the potential spillover effects could lead to different estimates. Despite these two limitations, the results nonetheless show that RLCs significantly reduce angle and turning injury collisions, but increase rear-end injury collisions as documented in the majority of the studies that examined the effects of RLCs on safety. Finally, the work done in this study only applies to signalized 4-legged intersections located within the City of Chicago. The results should not be generalized to other intersection types and outside the study area.

[emphasis added]

Let me note that the study applied only to "signalized 4-legged intersections" with the authors saying that their conclusions "should not be generalized to other intersection types and outside the study area."

Note particularly that the author's used the word "significantly reduce" when applied to angle and turning injury collisions but do not use any modifier when speaking of the increase in rear-end injury collisions.

Despite this, the article you linked to only noted " increase rear end injuries".

Bottom Line is...

if the city of Chicago does anything it is because someone(political cronies) ends up with a bunch of money in their pockets, and to hell with everyone else!

--
Garmin Nuvi 765T, Garmin Drive 60LM

Chicago

Anything done by the politicians in "Crook" County Illinois is Dubious.

--
Dudlee

Correction

dagarmin wrote:

One thing I can tell from the Tribune paywall article that leads the researchers and Tribune to conclude that the city overestimated the safety effect is that the city was counting reduction in crashes (and went back farther in time than the cameras were in place at some corners for the baseline accident rate), and that during the study period, injury accidents were declining in Chicago anyway. The city was attributing all of the injury accident reduction in this period to RLCs when the study data says only a much smaller portion of it can be attributed to RLCs.

I need to correct a statement I made in that paragraph from post three in this thread. I was inaccurate in saying that injury accidents were declining in Chicago during the study period comparing before RLCs to after RLCs.

Right around the time RLCs were installed in Chicago, the city loosened the standards by which accidents were counted as injury accidents. Injury accidents declined statistically in the following years. I don't see in the reporting the reason the standards were changed, but the Tribune did not charge the city with rigging things by changing the way injury accidents were counted. I infer that change may have been done by other city workers who had nothing to do with RLCs; it may have been coincidental.

The Tribune's objection was that the mayor attributed all of the decline in injury accidents to RLCs when most of it was really due to the change in the way incidents were counted as injury accidents. It was misleading analysis and spin, and the mayor should have known that.

--
JMoo On

Correction

dagarmin wrote:

One thing I can tell from the Tribune paywall article that leads the researchers and Tribune to conclude that the city overestimated the safety effect is that the city was counting reduction in crashes (and went back farther in time than the cameras were in place at some corners for the baseline accident rate), and that during the study period, injury accidents were declining in Chicago anyway. The city was attributing all of the injury accident reduction in this period to RLCs when the study data says only a much smaller portion of it can be attributed to RLCs.

I need to correct a statement I made in that paragraph from post three in this thread. I was inaccurate in saying that injury accidents were declining in Chicago during the study period comparing before RLCs to after RLCs. The reporting standards for traffic incidents had changed during the study period, so it becomes difficult in one quick glance without in-depth statistical analysis to say whether injury accidents were really declining at that time.

Right around the time RLCs were installed in Chicago, the city loosened the standards by which accidents were counted as injury accidents. Injury accidents declined statistically in the following years. I don't see in the reporting the reason the standards were changed, but the Tribune did not charge the city with rigging things by changing the way injury accidents were counted. I infer that change may have been done by other people, perhaps in a different jurisdiction than the city, who had nothing to do with Chicago's RLCs; that change may have been coincidental.

The Tribune's objection was that the mayor attributed all of the decline in injury accidents to RLCs when most of it was really due to the change in the way incidents were counted as injury accidents. It was misleading analysis and spin, and the mayor should have known that.

--
JMoo On

the tail wagging the dog

This whole discussion points out why many of us can advocate having safer roads and, at the same time, question the use of enforcement cameras. When the purpose of law enforcement is to generate revenue in the promotion of public safety, we've got it backwards.

Wow coming from Chicago

The City that rewards corruption, its amazing the Trib funded this study.

Chicago...

Dudlee wrote:

Anything done by the politicians in "Crook" County Illinois is Dubious.

the city that pushed and promoted YOUR current president's elections. Can you see why the entire country is in such a poor economic state?

--
Garmin Nuvi 765T, Garmin Drive 60LM

Ah, Statistics

dagarmin wrote:

The Tribune's objection was that the mayor attributed all of the decline in injury accidents to RLCs when most of it was really due to the change in the way incidents were counted as injury accidents. It was misleading analysis and spin, and the mayor should have known that.

I have taken a lot of statistics and biostatistics courses, and a number of risk communication courses.

Most people know the saying attributed to Mark Twain about "lies, damn lies and statistics". But I prefer the statement "Never criticize the statistics, attack the assumptions that the statistics are based on."

As a result, I try not to be overly swayed by numbers and try to identify the underlying assumptions that a study is based on.

Studies of red light cameras seem to bring out the "confirmation bias" in readers. That is why I like to see people like jgermann and dagarmin attempt to objectively assess these types of studies, and challenge over-generalizations.

I may not always agre with their position, but at least some thought goes into their commentary.

Thanks to all and Merry Christmas!