September 10, 2006 to September 16, 2006
Test Scores and Economic Performance
Test Scores and Economic Performance-BECKER
One of the challenging paradoxes during the past several decades is that American teenagers have consistently performed below average on international tests in math and sciences, and not especially well on reading tests, yet the American economy is more productive than any other. Of course, an economy's productivity depends not only or even mainly on schooling, but also on its physical capital stock, institutions and laws, and various other variables as well. Even regarding human capital, however, the United States does better than suggested by its rankings in international tests.
Frequently cited are the results of tests in 2003 of 15-year-olds in math, sciences and reading. The U.S. ranked about 25th in math, 20th in science, and was above average in reading out of the about 40 countries that participated. I believe these results correctly reflect that most American elementary and high schools are much less challenging in math and science than are schools in Finland, Japanese, Hong Kong, and other high scoring countries. However, the creation of valuable human capital for an economy depends on much more than is measured by tests of fifteen year olds in different subjects.
The philosophy behind U.S. education is to build up, so that later levels of schooling are more challenging than earlier levels. This means that more is expected of students at college than was expected of them in the high schools they attended, even though both high schools and colleges vary greatly in their degree of difficulty. On the other hand, secondary schools in most countries that rank high in these test scores give a lot of home work and expect a lot, while their colleges are often easier. In Japan, for example, getting into the top universities is very hard, but these universities are easy compared to the secondary schools that their students attended. As it were, Japanese students rest in college after the exhausting demands of their high schools. Japan is an extreme version of a build down system, but less extreme versions are found in many of the other participating countries. This difference in education approach implies that a more relevant international comparison of the production of human capital would be to test not teenagers but young adults, say at age 22. The U. S. would probably still perform below average in math and science, and might not excel in reading, but the relative performance of older Americans would be, I expect, considerably higher than that of fifteen or eighteen year olds.
Another important consideration in international comparisons of human capital is that a larger fraction of Americans than is common in other countries continue their learning after high school at junior colleges, trade schools, non-profit four-year colleges and universities, for-profit online education and universities, such as the University of Phoenix, adult education classes, and in other ways. This vast array of learning opportunities allows young (and not so young!) persons to pick out programs that suit them, and to change where and what they are studying if they are dissatisfied. In most other countries, later as well as earlier schooling is not flexible. This again suggests that the human capital of Americans would look better in international comparisons if comparisons were not of teenagers but of adults in their late twenties and thirties.
U.S. education in junior colleges, many four-year colleges, at trade schools, and for-profit universities is more oriented toward improving job-relevant skills than is common in post secondary education in other countries. I refer not only to schools that teach how to drive a truck, use a computer, or cut and shape hair, but also to junior and four year colleges that provide instruction in landscape gardening, bookkeeping, and other practical subjects. This type of education may not help students know much about the world at large, but it does raise their productivity at work.
Another factor is intangible, but nevertheless is relevant in helping American men and women become innovative at work and in other parts of life. American schools are less oriented toward rote teaching than are schools in many other countries, and they are more oriented toward giving students practice in thinking through issues and expressing themselves in discussions. Japan and the United States are outliers at opposite ends among rich countries in the degree of emphasis that schools place on thinking for oneself rather than memorizing information. The United States may go too far in its emphasis on "self expression" at the expense of teaching valuable knowledge and skills, but still international tests of subject matter knowledge, such as the 2003 tests, do not even try to capture originality and related important aspects of human capital accumulation.
Note in this regard that despite the mediocre record on international tests, American trained scientists do extremely well in garnering Nobel prizes and other international awards. American CEO's and investment bankers are ranked very high in the international business world for their energy and creativity, which is why many foreign companies have chosen Americans to head their operations. American workers also rank high when international businesses rank the quality of the workforce in different countries.
To be sure, a significant number of prominent "American" scientists and some business leaders were born abroad and immigrated to this country. This attraction to skilled immigrants must be taken into account in assessing the quality of the human capital that enters the American economy, although it may reflect unfavorably on the quality of education provided to American students in math and the sciences. Still, if America allows India and other countries to pay the cost of training many of the engineers and other skilled workers who end up in the American economy, that is a pretty effective human capital production "system" when considered in its totality.
Our Bad Math Scores--Posner's Comment
The Program for Individual Student Achievement (PISA), the source of Becker's statistics, does triennial international comparative studies of 15-year-olds' educational achievements. The latest results to be reported are those of the 2003 survey. The United States came out in the middle of the European pack in reading literacy, but in math proficiency we were below the European average, as well as below several Asian countries in the sample.
There are three questions to ask about these results: (1) Are they meaningful, in the sense of providing an accurate picture of relative math proficiency? (2) If so, are there economic or other real-world consequences? (3) If there are, what if anything should be done to increase our rank score?
(1) The answer to the first question appears to be "yes," partly because of consistency with other studies. There is a good article on this issue by Paul E. Peterson, available on the Web, called "Ticket to Nowhere." See also an article by Mariann Lemke and colleagues in a recent issue of the Educational Statistics Quarterly, also available on the Web. Math skills appear to be deteriorating in the United States as well asto be inferior to the average of the 40 countries in the PISA sample; and this is true even if blacks and Hispanics, who on average do poorly (especially blacks) on these tests, are excluded from this comparison, although such exclusion does increase our international rank somewhat (but a proper comparison would require similar exclusions from some other countries in the sample). I agree with Becker that it would be interesting to see what difference it would make if college rather than high school students were tested. But I would not expect much difference, because little emphasis is placed nowadays on math in American colleges.
(2) But so what? Here I agree with Becker; perhaps I am even more emphatic than he, that better education in mathematics would not have substantial effects on social and economic welfare. Very few jobs nowadays require even simple math skills ("deskilling" is the story of modernity); almost all computation is automated. Even fewer jobs require advanced math skills--and kids cannot acquire those skills by education; they are innate.
What would be socially and even economically useful would be to instruct high school students in the rudiments of statistical theory. That would help them learn to think straight about a range of public policy issues, as well as to avoid certain recurrent mistakes in everyday life. People are terrible at handling probabilities. For example, most people, including otherwise quite intelligent and well educated people, don't understand that randomness is not regular alternation--that a typical random pattern is 1000110110001, not 101010101010. And this mistake leads them, for example, to give undue weight to the recent performance of a mutual fund (e.g., 1101). But whether to teach statistical theory in high school is an issue of educational policy rather than a matter of raising the scores on math tests.
It would also be helpful to the United States, mainly from a public policy standpoint, if more of our people were scientifically literate; and it would help them to be so if they knew some math, because modern science is heavily mathematical. In my book Catastrophe: Risk and Return (2004), I examined the issue of scientific literacy briefly, pointing out that only a third of American adults (adults, not 15-year-olds) know what a molecule is, that 39 percent believe that astrology is scientific, that 46 percent deny that human beings evolved from earlier animal species, and that almost 50 percent do not know that it takes a year for the earth to revolve around the sun (many do not know that the earth revolves around the sun). These are amazing statistics, and yet, according to the materials I consulted, the scientific literacy of the U.S. population actually exceeds that of the European Union, Japan, and Canada.
In the age of the computer and the Internet, school education probably has rather limited effect on job performance, marital stability, happiness, or other measures of welfare, except perhaps for elite people--but they attend elite educational institutions and probably get a better education than is available in any other country; our best colleges and universities are the envy of the world. And because of compulsory schooling, a very bright child almost always will be spotted even if he or she comes from a poor or educationally deprived home, and will be shunted onto the elite track.
So I do not think that the low quality of public education matters a great deal from an overall social standpoint, except that our public schools seem needlessly costly, and also unresponsive to the special needs of very poor students. These are reasons why I strongly support school voucher programs.
(3) If this is wrong and our poor international standing in math proficiency is hurting the United States, the solution is to teach more math and less of something else. It should not be to drill the kids in the 2003 PISA math test so that they can do better on the next one. It is always possible to improve scores on standardized tests by orienting instruction to the tests, by tutoring, or, if worse comes to worst, by withholding the test from the weakest students!
Response on Test and Economic Performance-BECKER
I will try to address a few of the various interesting comments.
The comments take very different positions on the importance of mathematics in a modern economy. A couple of things are pretty clear: most employees do not need a lot of math, but math is becoming more valuable for a larger fraction of the tasks in more advanced economies. For example, it is difficult to use regression analysis in ways that illuminates without understanding some of the basic mathematical concepts that lie behind regressions. The statistical theory of estimation need not be mastered, but someone limited to only cookbook knowledge of regressions can make serious mistakes.
The fear of math among many Americans is common, and this fear prevents them from reading simple figures, analyzing say the relation between housing prices and interest rates, understanding probabilities in medical and other areas, etc. Still, many jobs are designed such that only very basic math, even only arithmetic, is required.
The advantage of the American "build up" learning system is that people can more readily change their minds about what interests them as they try out different programs. It also implies that there are second and third chances as students can decide their interests are different than what they had believed, and workers can shift to entirely new lines of work. That flexibility is less common in the learning structures of many other countries.
Obviously, memorization is important to learning, and it is said, for example, that first year medical school is mainly about memorizing various pieces of information about the human body. Perhaps too I exaggerated the importance of rote learning in the Japanese and other educational systems. But Japanese businessmen and scientists frequently complain about an excessive emphasis on rote learning. My experience with Japanese students in the U.S. is that especially at the beginning they have difficulty in thinking on their own, and rely too much on what their teachers told them.
I believe schools systems should establish minimum standards for graduation that are meaningful, but not very difficult. Then individual high schools can top that up to an extent determined by their student bodies.
As I argued in previous posts, inequality in American earnings has grown greatly during past 25 years, in large measure because of increasing demands in a modern economy for workers who have considerable knowledge. Graduates of elite universities have benefited the most from the greater emphasis on knowledge, but all groups that invest in knowledge and information do better in modern knowledge-based economies. I believe America has adopted better than most other rich countries to these changes, in part because of the flexibility in its learning system, and in part because of its emphasis on lifelong learning.