http://www.autoblog.com/2008/10/24/autol...n-mcelroy/
Autoline on Autoblog with John McElroy

Posted Oct 24th 2008 1:28PM by John Neff
Filed under: Autoline on Autoblog
QUALITY PROBLEMS WITH QUALITY RATINGS

Pity the poor car buyer who wants to be a smart consumer and reads all the quality studies before going to the showroom. How do you know what to believe?

For example, Consumer Reports' Reliability Survey gives props to the Scion xD. But Strategic Vision's Total Quality Award gives props to the Scion xB. And J.D. Power puts Scion near the bottom of the list of its Vehicle Dependability Survey. Who do you believe?

The problem is that these studies all measure different aspects of quality. Unfortunately, the mass media doesn't have time to delve into these distinctions and so all we get is their sound-bite analysis. Their favorite is that the Detroit Three are lagging behind the "foreign automakers" in quality.

John McElroy is host of the TV program "Autoline Detroit" and daily web video "Autoline Daily". Every week he brings his unique insights as an auto industry insider to Autoblog readers.

Actually, in terms of dependability, Mercury and Cadillac rank #2 and #3 behind #1 Lexus. Lincoln is just a fraction behind BMW and ahead of Honda. Ford is tied with Infiniti, and they're both ahead of the industry average. And yet, of the 10 worst brands in the J.D. Power survey, 8 of them are import brands. But you never hear about that.

Besides, calling them the "worst" brands is all relative. The bottom of the list today would have been close to the top of the list a decade ago. It's like saying Los Angeles has the worst pollution in the country even though LA's air is now cleaner than it's been in half a century.

Of the 10 worst brands in the J.D. Power survey, 8 of them are import brands.
Even if you just use one source to measure quality it can be hard to figure out if you're not familiar with the methodology being used. For example, J.D. Power ranks Acura in its 5th spot with 160 defects, while Buick is in 6th spot with 163 defects. Keep in mind that this is the number of defects per 100 vehicles, so the actual difference between any one car from these brands is only 0.03 defect. Should Buick knock its brains out to try and close that gap? Or is there really any gap at all? Couldn't this just be "noise" in the survey? Besides, are Buick's older buyers simply more forgiving than Acura's younger ones? We don't know.

Part of the reason we don't know is that J.D. Power & Associates does not show its results in a consistent fashion from year to year, making it difficult to compare results over time. Moreover, unless you have complete access to the full study you have no idea of the kind of defects that are being reported (they certainly do not make the full report available to journalists!). If one brand has a high preponderance of engines blowing up, and another has a rattle in the ashtray, all we see is that both brands has defects. J.D. Power does weight the severity of defects, but we never see what goes into that weighting.

Strategic Visions doesn't measure defects. It interviews consumers and translates their responses into groups of "feelings" that it uses to rank the quality of cars. I have no question this approach is worth while, but I'm also sure members of the media would laugh out loud if they knew they were reporting on "feelings."

Many CR subscribers dutifully report the new car they just bought is as unreliable as CR warned them it would be.
Consumer Reports surveys its subscribers for its quality ratings, so we're only getting an accurate read of what its readers think. I'm not convinced this is a statistically accurate sample of the total car-buying public.

And I can't comprehend why anyone would subscribe to the magazine, then go out and buy a car that CR rates as undependable. Yet every year, many CR subscribers dutifully report the new car they just bought is as unreliable as CR warned them it would be. Something doesn't add up here. But it doesn't matter since CR's ratings are so incredibly influential that perception becomes reality in what the media reports.

Don't get me wrong. I think all these quality ratings are extremely valuable. I pore over them in great detail when they're released. It's very valuable to measure the quality of vehicles and make that information available to the industry and the public. But to be a smart consumer, you better make sure you understand what's being measured and put it in its proper context.

I can't believe this crappy article. It seems in the comments that no one agrees with it at all. To me, I just see it as a ploy to try and sell more American cars. But wait... what's more american, A Ford or Chevy made in Mexico, or a Toyota, Kia, Hyundai, Mercedes, or Mazda made in the USA???

im not sure what to make of all that.

ive always been a big fan of CR, i read it front to back several time befor making any ideas.

i think someone should make a mag using reviews from service managers at machanic shops.
work 3 or 4 years in garage, you'll know what cars to stay away from!

alot of US cars have been made over seas for a long time.
i hade a 88 siverado that was built in Canida.
i saw an older dodge picup that had a bumper sticker that said "if we keep buying foren cars, were will all our kids work"
i wanted so bad to make them pull over and lift there hood so i could show them there DSM (diamond star motors, or better known as, Mitsubishi ) sticker.
i had an early escort that i was always tring to do work on, alot of part i had to serch under mazda to find.
the escort was a good car, ive owned 2 of them.
i totaled one, the other was a 94 that needed some work that i got i got for $500.
drove the crap out of it for 3 years and sold it to a close friend that needed a cheep car that ran good for $400. i could of sold it for more, but i was helping out a good friend that needed it.

the quality of a car is not based on were its bieng built.
toyota is doing it on our soil with our workers............... so............. whats the big 3s problem, engeneering!

i don't feal bad for the big 3. make a high quality car thats also cool at a price i can aford.

I really don't put too much weight on all these ratings. The article is correct in that unless you can see figures/issues from what's reported you really don't know exactly how to interpret the results.

I've also made that statement recently. I think the notion of import or domestic needs to be redifined. Chyrslers built in Canada and Nissan's built here in my town. The only true import I know of is my xb...100% Japanese.