Why Are We Simulating Anyway? Some Answers from Economics
Edmund Chattoe
Department of Sociology, University of Surrey, Guildford, GU2 5XH
Originally written, March 1995. Revised November 1995
This research is part of Project L122-251-013 funded by the ESRC under their Economic
Beliefs and Behaviour Programme
Abstract
This paper considers the meaning of the term ``simulation'' as it is commonly used in economics. A distinction is made between the relatively mechanical task of simulating a pre-existing mathematical model and the far more difficult task of building a simulation of some social process. It is argued that economists almost always use simulation in the first sense and, consequently, find it rather unimportant. Some economic objections to simulation are criticized, because they depend on a restricted understanding of the term, which has not itself been justified. Within a broader understanding of simulation, many of these objections can be shown to be unfounded. In addition, the paper describes a number of phenomena which are more amenable to simulation, in the broader sense, than to the usual type of mathematical economic modelling. The final part of the paper considers one particular, methodologically based, objection to simulation, that the process of developing deductive economic theories has a superior claim to ``scientific rigour''. It is argued that, even taking the economic definition of rigour as given, simulation is actually more rigourous than mathematical modelling in several important respects.
Simulating What?
The commonest form of economic modelling is deductive. Deductive
modelling involves following through the logical or mathematical
implications of a series of axioms to produce predictions about
behaviour that can be compared with what is observed in a social
process. Modification of the model involves altering or generalising
these axioms of behaviour in the light of failures of prediction or
``common sense'' objections to the axiom system. In practice, the
commonest deductive technique appears to be the solution of sets of
differential equations. Beginning with some initial conditions and a
set of equations, deduction, in the form of manipulation of the
equations, produces one or more solutions which are intended to
represent social behaviours. (1)
Following this approach to modelling, it is possible to use
``simulation'' for a purely instrumental purpose, to replace the
economist using pencil and paper with a computer program, thus
automating the process of deduction for a particular model. In this
case, the computer is not simulating a social process, but carrying
out a process of deduction. It is the axiom system or mathematical
model which is intended to represent the social process. The use of
the computer is instrumental because the choice between hand
calculation and computer calculation is irrelevant to the correct
answer. (Of course, it is unlikely to be irrelevant to whether we
obtain that answer and how long it takes, but that is a
different matter.) There are obvious practical advantages to the
instrumental use of computers in modelling. Automated deduction will
certainly be faster and possibly more reliable than that carried out
by hand. However, seen in this light, simulation can only serve as a
supportive tool for the ``main task'' of economics, the production of
mathematical models.(2)
Such a view of simulation seems to imply that mathematical models are
the most suitable representations for social processes. This position
is seldom defended explicitly. Instead, it tends to be argued that
although simulation may be capable of dealing with socially
important behaviours that cannot be described mathematically, it tends
to produce models that are either practically or methodologically
unsatisfactory when it does so. (In some cases, the economic theory
may also be used to disparage the importance of the behaviours
themselves, though seldom with reference to empirical data.) For this
reason, it appears that non instrumental simulations are seldom
accepted into the economic mainstream.(3)
In the course of this paper, I shall argue that all of these
implications are false. Firstly, there are a number of situations in
which mathematical representation of the dynamics of social action is
at least limiting, and in some cases impossible, given our current
level of mathematical knowledge. Secondly, computer simulation can
assist in the practical modelling of these social processes. Finally,
there need be nothing non rigorous or unscientific about the resulting
simulations. In fact, simulation may actually increase the amount of
``real'' or useful rigour in models. (One important difference between
simulation and mathematical representation is that difficulties with
simulation models often turn out to be ``practical'', involving the
need for more data or faster computers. By contrast, mathematical
models often reveal inherent tensions or inconsistencies at the
theoretical level which are far harder to resolve.) In the process of
rehearsing some of these arguments, the importance of posing and
answering methodological and practical objections separately should
become clear.
By contrast to the instrumental view, this paper urges that simulation
should be seen not simply as a tool for deduction in mathematical
models, but as a technique in its own right, capable of representing a
broader class of starting conditions and deductive rules than the sort
of mathematics commonly used in economic modelling. Instead of being
restricted to representing mathematical models of social processes,
there is no reason why simulation should not enable us to represent
the processes themselves. It seems appropriate to refer to simulations
of this sort as descriptive and contrast them with the
process of instrumental simulation discussed at the beginning of this
section.
In descriptive simulation, it is no longer merely a matter of
speed and convenience whether we use a system of equations or a
computer program to represent a social process. Not everything that
can be expressed in one way can be expressed in the
other. (This distinction takes the current level of knowledge as given. New mathematical
techniques for representing social processes will undoubtedly arise in future. Given a particular
level of mathematical knowledge, however, the distinction is between processes that can be
modelled faster or more competently by a program and those which cannot yet be modelled by
any other means. Doubtless, the representational capacity of programs will also continue to
increase.) If there are justifications for preferring the mathematical representation over the
computational (4) one, these need to be made more
explicit than they have been. In any event, they are not
justifications based on instrumental concerns of speed or efficiency
in achieving the same goal, but rather disputes over what the goals of
scientific modelling should be. The distinction between arguments
about means and arguments about ends is important and should not be
blurred. Towards the end of the paper, some of these traditional
disputes over the role of simulation are examined in more detail.
One possible explanation of the preference for instrumental simulation
in economics is the unusually resistant ``protective
belt'' (Lakatos, 1970, 1976) which insulates methodology and theory
from the continuing discrepancy between model predictions and
empirical data. At the methodological level, the discipline is still
committed to utilitarianism as a basis for modelling behaviour. At the
theoretical level, this commitment is almost invariably implemented by
designing models in which individual decision involves optimal choice
over a set of known alternatives. (It is interesting to trace the
course of generalisations to utility theory and observe the ways in
which they have retained this core assumption. Economics models risk,
but largely ignores uncertainty (Knight, 1921). In the same way, it
models routine technical progress, but largely ignores
innovation (Sahal, 1983). Neither of these choices appears to be
justified by empirical considerations, that is by the extent to which
research and uncertainty are significant features of economic
behaviour.) The class of models resulting from rational choice
theories can be represented and solved using differential calculus. In
cases where the calculus proves difficult, there is an instrumental
role for simulation, but it appears to have no descriptive role in
building models which reject the utilitarian framework, because such
models are still considered theoretically and methodologically
unacceptable. (5)
It is plain that the acceptability of such a subsidiary role for
simulation depends heavily on one's faith in the traditional economic
methodology. If one feels able to reject utilitarianism or optimising
choice as the sole basis for model building, then it is no longer
clear why simulation should be limited to the efficient solution of
equation systems. Indeed, it is even possible that simulation may
prove superior to mathematical representation in some respects.
Certainly, once one ceases to take the instrumental nature of
simulation for granted, possibly as a consequence of methodological
and theoretical preconceptions, the functional similarities between
equation systems and simulation programs become more apparent. In each
case, a combination of empirical observation and theory, structured by
methodology, is represented in a formal language. A set of
initial statements in that language undergo transformations according
a set of rules and the end result is either a ``solution'' to a static
system or an unfolding dynamic process in one or more variables. In
each case, the end results of the operation of the model can be
compared with some corresponding social process which the model is
intended to represent. In the case of a mathematical representation of
a model, the deductions are carried out by the theorist, according to
the ``rules of mathematics''. In the case of a computational
representation, they are carried out by the computer according to the
grammar of the programming language, or some grammar written by the
theorist in that language.
Having drawn a distinction between descriptive and instrumental uses
of simulation, and attempted to explain the dominance of instrumental
simulation in economics, we now turn to a more detailed consideration
of the task of representing theories so that they may be tested.
Different But Equal Representations of Theory
In the last section, it was suggested that economics regards
simulation as instrumental to mathematical modelling of social
processes, rather than as a (descriptive) modelling technique in its
own right. The explanation put forward for this view was that
economics had an unusually strong commitment to a single methodology
and approach to theory building, based on utilitarianism implemented
theoretically as individualistic rational
choice.(6) Given this methodological commitment,
simulation can only play a supporting role in the solution of
mathematical models. It cannot demonstrate its advantages, because the
sorts of models which this would require are themselves regarded as of
doubtful merit. In this section, the advantages and disadvantages of
computer simulation and mathematical modelling are discussed.
Once we have accepted that sets of equations and computer programs can
both be used to represent a social theory in a form suitable for
testing, we can ask what the advantages and shortcomings of the two
representations are. Having admitted that there are multiple
representations --- the verbal description of a model is another ---
we are by no means committed to saying that each is of equivalent
value for the tasks of social science, whatever these are taken to be.
There is a long tradition in economics which views the mathematical
representation as in all respects superior to the verbal
one. (7) This tradition, which values simplicity
and analytical solubility more highly than generality and complexity,
arose at a time when the verbal description of models was the only
alternative. Such verbal descriptions were even more subject to
incompleteness, errors and omissions than their mathematical
equivalents. It was all too easy to take advantage of the ambiguity of
everyday language to obscure the weaknesses of a poor argument. In
mathematical modelling, deduction is based on the manipulation of
fixed symbols according to fixed rules carried out by hand. In verbal
models, neither the symbols nor the rules have an agreed
interpretation. Thus the increasing standardisation of the rules of
deduction can be seen as a sort of progress towards greater
formalism. (8)
The reasons for the ``mathematical turn'' in economics are difficult
to trace, because the superiority of mathematical representation is
seldom justified explicitly. However, in addition to its relevance for
a utilitarian methodology, a number of other explanations have been
proposed for the continuing dominance of mathematical modelling. In
the early stages of economics, there was considerable enthusiasm for
the elegance of Newtonian mechanics as a scientific metaphor. This
seems to have resulted in the development of theories in which atomic
social actors, lacking any internal structure, collide only briefly in
trade, driven by the reversible and smoothly acting laws of supply and
demand. This Newtonian view seems to underpin mainstream economics
despite the impact of Quantum Mechanics, Thermodynamics and Relativity
which have fundamentally changed the understanding of physics on which
it was originally based. (9), but it is only recently that models
based on these ideas have taken new impetus from new developments in
the study of complexity, chaos and path dependent processes.
Interestingly, the resulting models are often even more abstract and
mathematical than other developments in
economics (Anderson, Arrow and Pines, 1988, Batten, Casti and Johansson, 1987).
Economics has also been obliged to carve itself a niche as a respectable academic discipline
and that purpose could also be served by increasing formality, for example, by
association with high status physics rather than the other low status
social sciences. Finally, there are a number of ``selection''
arguments asserting that if formal purity and mathematical precision
were favoured in the academic environment, for whatever reason, those
who were most mathematically able would advance themselves and also,
being inclined to value their own skills most highly in others,
perpetuate the process. The possibility of self selection by the
economics profession (Clander and brenner, 1992) and the socialisation of students
by the teaching process have both been remarked
upon (Frank, Gilovitch and regan, 1993, Marwell and Ames, 1981). (10)
In fact all of these explanations probably have a part to play, and
additional explanations are possible, but two important points should
be noted. Firstly, all the explanations provided address the value of
the mathematical representation to economics as a professional
discipline, rather than as a useful and realistic representation of
social behaviour. Secondly, and more importantly, where they
do relate to the task of producing realistic models, we may
question whether comparisons that were relevant in the past are still
relevant. An economics based on the Newtonian clockwork can be
challenged by pointing out that physics has itself moved on and no
longer regards such models as adequate or complete. Similarly, we may
challenge the superiority of mathematical representation, originally
contrasted to verbal representation, by asking whether additional
possibilities for representation are now available. I have already
suggested that mathematical representation could be seen as superior
to verbal representation because it made use of symbols with fixed
meanings and a broadly agreed set of transformational rules. Even in a
purely instrumental use, simulation of a particular model can be seen
to complete the process of formalisation by automating and formalising
deduction as well. However, in the remainder of this paper, I shall
consider a number of ways in which the descriptive use of simulation
can go still further in providing rigorous models of social processes.
Unfortunately, one obvious method of comparison between different
representations is surprisingly difficult to implement. It is by no
means straightforward to compare the predictive quality of models
based on the different representations. (11) There are a number of reasons for this.
One difficulty is that descriptive simulation is extremely new, and it
would be unreasonable to compare it with an approach that has had two
hundred years to develop and refine its methods. Even if descriptive
simulations were able to predict better, it could be argued that they
had simply adopted the mechanisms of traditional models in an
instrumental fashion and then developed them a little further. Of
course, there would be nothing to stop mathematical models from doing
the same thing using mechanisms arising from simulation. Although this
paper argues for the richness of simulation, it may turn out that
certain social processes can be described extremely well by simple
mathematical relationships. However, this fact needs to be discovered
rather than simply asserted. (12)
Even supposing that a comparison between predictions could
legitimately be made, it would be extremely hard to decide which
predictions to compare. Although certain economic models have improved
considerably in predictive power, the consumption function for
example (13), there are others which have not, such as prediction of
investment behaviour. There are even predictive relationships like the
Phillips Curve that seem to have collapsed altogether. (It is not
clear whether these relationships were spurious to begin with or have
simply broken down, but in either case the problem of comparison
remains.)
Finally, there are no straightforward criteria for comparing the
social or theoretical importance of predicting different variables and
no simple way of measuring the parsimony of a diverse set of different
models. How does one compare a model that predicts total consumption
badly, with one that predicts alcohol consumption very well, but
cannot be generalised to any other form of consumption? (In such
cases, the success of a representation might simply result from a
judicious choice of subject matter rather than any genuine insight.)
Simplistic approaches, such as counting explanatory variables, are not
only theoretically unsatisfactory, but may not be relevant to non
mathematical representations. (In fact, for a fair test we would need
to compare the same set of predictions for each model based on the
same data set. Then we would face the equally difficult problem of
measuring the relative parsimony of the two processes transforming
data into predictions. Such issues have also arisen in judging the
significance of comparing predictions by neural networks with those
made by other methods (Chattoe, 1993). Because the model is distributed
over the nodes of the network, one cannot count variables.)
If we cannot assess the relative merits of model representations by
comparing their predictive power, what other criteria can we use to
decide between them? One possibility is to show that simulation
encompasses (14) the mathematical representation. In this case, everything
which can be expressed in the mathematical representation can also be
expressed in simulation, but in addition, it is possible to express
things in the simulation which cannot be expressed mathematically. (Of
course, it would not be sufficient simply to define a mathematical
notation for a given situation. There would also have to be a set of
deductive rules available which could be applied to that notation to
produce testable deductions.)
In one sense, demonstrating this encompassing is trivial. Any computer
language contains many commands which are not arithmetic operators or
involved solely in the construction of those operators. However, for
the purposes of modelling social processes, this ``argument'' is
plainly not sufficient. Perhaps all the additional commands are simply
irrelevant to the modelling of social processes. In the next section I
shall provide examples which suggest that this is not the case.
One final point to bear in mind, is that although verbal descriptions
may be unsuitable for describing testable models, it does not follow
that they are unsuitable for describing theories or hypotheses. In
economics, it is relatively common for the credibility of a verbal
theory to be judged by the extent to which it can be translated into a
mathematical model. This is an effective technique for filtering out
behaviours which reveal the weaknesses or inconsistencies of
utilitarianism. (As has already been remarked, utility theory is
neutral on the issue of whether utility functions are individualistic
or not, but in practice there is almost no investigation of
non-individualistic functions. Such concepts as need and altruism have
also fallen foul of their unsuitability for utilitarian treatment.
Instead of arguing that such concepts are irrelevant to our
understanding of social processes, which might prove difficult,
economics simply disregards them without discussion.) It seems that
the verbal representation may be more compatible with the
computational than either is with the mathematical
representation. Everyday language is very good at dealing with many
different types of ambiguity, uncertainty, fuzziness, self-reference
and reflexivity. (15) Computer programs, like everyday languages, can express a rich variety of
ideas and describe complex chains of interaction and causation.
Because economics appears to be wary of hypotheses that cannot be
fitted into its methodology, it appears to be doubly wary of the
reports of economic actors who are not trained as economists.
(Qualitative analysis of everyday economic action is still
surprisingly rare. In cases where it has been carried out, the results
often differ considerably from the findings of the corresponding
theory (Hall and Hitch, 1939.) The practices of real economic actors are
often dismissed as ``rationalisations'', ``approximations'' or ``rules
of thumb'' even when the practices they are asserted to approximate
are almost impossible to carry out. Given the potential richness of
verbal representations, and a capability to simulate the descriptions
of economic actors directly, we may at least question the value of
mathematics as a suitable representation for models of social action.
Verbal descriptions, particularly by active participants in a social
practice, may reveal subtleties that are far beyond the scope of
mathematical formulation while proving tremendously important in the
determination of behaviour. In the next section I shall turn to some
practical illustrations of the hypothesis that simulation can
encompass mathematical modelling in a useful and revealing way.
Difficulties with Mathematical Representation
In this section, I will discuss some of the limitations of
mathematical representation which simulation is able to address, thus
supporting the claim that simulation encompasses mathematical
modelling.
The first difficulty in using sets of equations to represent social
processes is to clarify the relationship between the equations and
agents of causality in the world. Two obvious kinds of relationship
suggest themselves. (16), which simply assumes the relationship away,
arguing that appropriate mechanism is irrelevant if prediction
occurs. Firstly, it may be questioned how good this prediction needs
to be. Secondly, it appears that prediction in economics is seldom
good enough to justify such an approach, assuming any substantial
predictive power is required. Thirdly, such a view seems to deny all
descriptive relevance to social science. It is hard to see what use
a perfectly predictive, but completely non explanatory, model of the
economy would involve, if such a model can even be conceived of. It
would be rather like the Delphic Oracle.
To return to an earlier point, models must be explanatory as well as predictive otherwise we
cannot tell which situations they apply to. The first possibility is that the agents are themselves
using equations as the basis for their decisions. For example, one reason why total consumption
might be observed to be a linear function of total income would be that each
individual in the economy was determining their consumption as a
linear function of individual income. Such a view immediately
dispenses with the problem of aggregation as all variability is
restricted to the individual linear coefficients in the shared model.
However, the hypothesis that everyone uses the same decision process
is an extremely strong one, which ought really to receive equally
strong empirical support. Such support is not forthcoming. As a
result, the econometric testing of equation systems is actually
involves an enormous joint hypothesis: that all individuals have the
same model of the world, and that this model is the one that the
economist has chosen. It is not surprising that such models fail to
predict, or that such a complicated joint hypothesis provides little
information about what is wrong with the model and how it may be
corrected.
The second possibility is that individual agents do not use
the same model as their decision process, but that there is some
mechanism at work which means that it is ``as if'' they do. This is
not a claim that many agents follow the model approximately, that
would be a hypothesis of the first sort. Rather, it is supposed that
some higher level process organises the agents in such a way that
their behaviour appears to follow a simple model. An example is
provided by the argument that although firms may use very different
models of the market to decide their price setting behaviour,
selection pressure based on profitability will bankrupt all those
firms who are not in fact maximising their profits (Friedman, 1953).
Apart from the fact that this argument appears to be
mistaken (Chiappori, 1984, Witt, 1986), it does not provide much useful
support for the hypothesis of profit maximisation. Postulating a
universal higher level organizing principle like selection simply
pushes the problem of justification back a step, where it may be
harder to address. It is no longer sufficient to demonstrate that most
firms do profit maximise. That might be a relatively simple
empirical task, at least in principle. Instead, it must be shown that
the appropriate ordering mechanism is at work and, in fact, leads to
the hypothesised outcome. (Some selection mechanisms might select
firms that displayed other traits than profit maximisation. More
generally, experience of biological systems suggests that it would be
unusual to expect selection to result in the strict dominance of any
single behavioural trait.) If the outcome of the ordering mechanism
is conditional, for example, on the values of certain model
parameters, then it must also be shown that, empirically, these have
the relevant values.
In addition to the practical problems of aggregation, both of these
views involve deeper assumptions that can be questioned. To what
extent can agents acquire common knowledge of the ``correct''
model of the world? To what extent can an external organising
principle like selection legitimately be ``naturalised'' rather than
seen as a negotiable institution itself resulting from social
decisions. (The extent to which the market selects profit
maximisation is dependent on the political views of voters and
lawmakers who influence the rules by which competition is to take
place. Furthermore, it is well known that firms are often able to
circumvent the ``laws'' of the market.) One purpose of this paper is
to demonstrate that simulation has the potential to address these
issues by representing agents with genuinely differing models of the
world as well as the processes by which these models are
developed and shared.
Be all this as it may, it does not appear that either of these
positions adequately justifies the assumption that the behaviour of a
large number of individuals can be captured by a small number of
quasi-behavioural equations. Either strong evidence must be provided
that agents do in fact have extremely similar ways of making
decisions, or the mechanism by which the net result occurs should be
made explicit. (The burden of proof rests on the users of these models
because their predictive power has remained rather poor.) It does not
appear that agents with systematically different models of the world
can be represented using current mathematical techniques. If such
representations do exist, they have not, to my knowledge, been used in
economics. The relatively rare models which explicitly simulate a
mechanism of convergence for the behaviour of systematically different
agents are exclusively based on computer
simulation (Dixon, Wallis and Moss, 1994, Dosi, Marengo, Bassanini and Valente, 1993).
Although these methodological concerns are important, there are also a
number of quite concrete limitations to mathematical representation.
Several of these can be illustrated by considering the common practice
of describing economic interactions in terms of sets of equations
linking the values of variables in discrete time periods. We will
suppose for now that the use of discrete time is a convenient (and
realistic) simplification, and, to avoid the difficulties of
aggregation discussed above, that each equation explicitly represents
the behaviour of a single agent or institution. The difficulties of
such a representation fall into two complementary classes: those
caused by an unrealistic treatment of time and those resulting from an
attempt to represent multiple agency as an ordered sequence of
individual actions. These difficulties are complementary because the
unrealistic treatment of time is both a consequence and a partial
cause of the unrealistic treatment of multiple agency.
I shall deal with the representation of time first. Prima facie it may
appear that equations linking time periods in models are representing
``real time'' and it is commonly implied that this is the case. In
fact they often reflect either ``econometric time'' (the availability
of new data) or ``theory time'' (the requirement that the output of
one equation should always be available before it is needed as input
for the next). Both of these senses of time cannot easily be
reconciled with standard ``clock'' time. Econometric time obliges us
to leave unmodelled any processes that take place between
announcements of new data.
The only way that we can improve such
models is by collecting data more frequently and this may be very
costly. (17) Because of this difficulty, it is hard to argue that mathematical models of this sort
are telling us very much about the social processes which give rise to
aggregate behaviour, except for the very broadest trends. Agents are
not, typically, making decisions on the basis of the same data as
economists, in fact, they are generating, through their individual
models of the world, the data that economists use to build aggregated
models. (18) It seems extremely unlikely that stable constants linking economic variables
should persist over periods of years unless these can be grounded in
the actual decision-making processes of individuals and the reasons
for their stability. Furthermore, these potentially
ungrounded macroeconomic constants are themselves theory constructs,
so we are again testing a joint hypothesis about both constants and
variables in a given system of equations.
Hendry (1987) has argued that we must judge ``constants'' in terms of their functional
behaviour, for example the fact that they are observed to be
stable over time and produce errors in the residuals that are randomly
distributed. Under this view, constants must be established rather
than asserted. It is clear that this process cannot just involve
econometric data since relationships between variables are also
allowed to vary. Independent support for particular decision variables
can only come from addressing the problems of individual
decision-making and its relationship to aggregate data head on.
The main difficulty with theory time is, appropriately, one of
representation. The system of equations is indeterminate with regard
to the order in which the behaviour summarised by the equations is
executed. The ``move structure'' of the system must be imposed and
executed by the modeller. Typically, this is not done with regard to
the realistic modelling of social interaction, but rather to the
requirements of mathematical tractability. (19) In particular, the move structure is
designed so that the output from one equation is always available when
it is required as input for another. In turn, this is necessary
because the equations effectively represent fixed rules of action
which involve no discretion or choice. If a piece of information is
unavailable the equation produces no result, and the system of
equations fails altogether from that time on.
As a representation of
individual behaviour, such equations are therefore plainly
unrealistic. We are often forced to act before our ideal decision
process is ready to use, sometimes before we have any
decision process available. The imposition of a move structure also
conflicts strongly with the individualistic basis of economics. If one
equation fails, they all do. Such a system lacks the everyday
robustness of human interaction. It must be protected by the
``invisible hand'' of the modeller. (The same difficulties apply if
the equations are considered to represent aggregates, though there are
additional complications arising from the lack of robustness in
variables over time.) The assumption of a common move structure can
perhaps be seen as a corollary of the assumption that all agents share
a common model. However, it has already been remarked that this
assumption requires considerably more empirical support than it
receives. If agents are using different models of the world, there
seems no reason to suppose that they will cooperate by moving in an
agreed order.
Real time, unlike econometric time or theory time can be defined more
or less independently of the actions which take place within
it. (20) By contrast theory time is designed to make the
actions of individuals appropriately sequential and econometric time
to relate available data. Actors operating in ``real time'' are not
obliged to ensure that others have sufficient information on which to
act before acting themselves. (That is not to say that we do not
cooperate to take turns, for example in conversation, but we are not
obliged to do so. Even when we do, the move structure cannot easily
be represented as a strict sequence. Turn taking can operate on very
different time scales and ``change gear'' within single interactions.
Consider the organisation of an academic conference with an audience
and speakers and, within a particular speaker session, the shifts from
a lecture punctuated with questions to a free discussion and then an
argument. The lack of realism in strictly sequential models is not
removed simply by making the time period very short.) The
representation of real time also obliges us to consider how
information is transmitted and processed. If there is a fixed move
structure, we can simplify matters by assuming that everything that
has already happened is known, but without such a structure, what has
``already happened'' is inextricably connected with the way in which
information and materials move from place to
place. (21)
In real time, agents can act simultaneously. If they do, neither can
decide ``rationally'' what to do, because that would involve knowing
what the other agent would do. Since the other agent is in the same
position, this results in infinite regress. Nevertheless agents
do act and their actions have real effects even if they are
simultaneous. Similarly, an agent or group of agents can be involved
in a positive or negative feedback process independently of the rest
of society, but that process may still affect the society at large and
be affected by it. A simple example is provided by the escalation of
an argument in the playground which can only be stopped by the
teacher. (Equation based representations must either avoid feedbacks
or model them as processes which cannot be stopped from ``outside''.
Theory time does not allow the independent action of some system that
could constitute such an outside.)
These examples lead us towards the complementary limitation arising
from the restrictive representation of time, that of representing
multiple agency as a sequence of individual actions. The modeller who
arranges an equation system to guarantee its solubility does so
because he or she must solve it sequentially, it is not feasible for
certain processes to be carried out ``in the background'' or for the
actions of several agents to be revised at once. Thus only one agent
can act at a time in such models. Everyone else must freeze while
this action is taking place. The richness of the environment is thus
restricted to suit the attention of the modeller. This is plainly
unrealistic. In practice agents are acting simultaneously and
independently all the time. This allows for the possibility of action
over different time scales, feedbacks and simultaneity.
Multiple agency also has two important corollaries which are similarly
neglected in economics. The first is the more or less independent
agency of the world, which follows its own laws to make hot coffee go
cold, ultimately regardless of our efforts. (22) The second is that we
cannot make sense of the world without our own models of agency.
Because the world will not present itself to us as a series of
snaphots, our mental models must involve an understanding of the
dynamics of action. For example, consider another case of multiple
agency, the ``retry''. (One way in which our behaviour is more robust
than that of an equation system is that if we find some data is
missing, we may wait and try again rather than simply seizing up.)
An
example of a retry occurs when a person repeatedly phones someone who
is already on the phone. Such a situation requires a representation of
independent action that cannot simply be reduced to a sequential
process. Whether the person gets through depends on whether the other
is still talking, but the decision to try again cannot simply be a
function of whether the phone is engaged or not. If it were, there
would be a danger that the person would never try again or ring
forever if the phone was broken. What protects us from this impasse is
that we decide not only on the basis of the engaged tone but also as a
result of our model of the world and other agents and objects, that
the telephone might be broken, or that it might be better to ring a
busy person again at the weekend or send a letter.
Multiple agency also arises in the individual agent, who must
reconcile different data from the senses, from inside the body, from
memory, from reason and from feelings. These different sources of
information cannot be accessed in an imposed ``order'' and it does not
seem likely that they can be represented in a single metric as utility
theory suggests. The irreducibility of multiple agency also suggests
the necessity for agents to develop dynamic models of the world based
on coherence between different sorts of information, rather than on
any static and unitary notion of ``truth''.
In this section I have argued that equation based models are
restricted to an unrealistic representation of sequential time and
single agency by the inability of the modeller to solve models with
genuine multiple agency in real time. The relaxation of the resulting
restrictions on agent behaviour discussed above suggests that we might
replace the deterministic and reactive optimising agent with one who
is cognitive, creative and adaptive. In doing so, we are also obliged
to replace the simple environment resulting from the behaviour of
deterministic agents with a profoundly and continuously uncertain one.
(23)
This shift of perspective also has an appealing symmetry. Economic
agents can only make sense of a world where everyone is very much the
same as they are. Having pursued a ``destructive'' programme in this
section, deconstructing the economic views of time and agency, the
subsequent sections offer a ``constructive'' view of the ways in which
simulation may help to rebuild them. The next section addresses the
practical concern that a research programme calling for simulations of
complex interactions by multiple agents may not be feasible. The
following section considers whether such a programme is useful in
meeting the methodological goals currently set out for mathematical
economic modelling.
The Possibilities of Simulation
After the highly critical discussion in the previous sections, it
would be quite acceptable to object. Many of these criticisms are not
particularly novel, and the practicalities of economic model building
have not apparently been taken into account. If one suggests that
every agent has a different model of the world, and can interact in a
variety of ways in real time, how can we possibly build tractable
models of human behaviour?
This question needs to be addressed on a number of levels. In the
first place, there is no point in continuing to build tractable models
that work very poorly. After a certain amount of time, it is valid to
question whether building more models of the same type is really a
worthwhile exercise, or whether it is time for something different. It
has already been remarked that progressive ``improvement'' in the
quality of economic models is by no means obvious. In some cases, like
the movement of stock prices, it has not even be demonstrated that the
best models predict better than a random walk.
Secondly, the suggestion is only that we need a representation in
which every agent might have a different model and act at any
time, not that this is in practice the case, or even that we must
build models in which it is. In fact, agents possess precisely the
same difficulty in making sense of the world as theorists, though the
latter suffer it in a more acute form because of their more ambitious
objectives. This gives the simulation approach a pleasing symmetry
with its subject matter. Both scientists and everyday actors are
extremely anxious to reduce uncertainty and to predict the world in
order to operate within it. The scientists view of the world is not
intrinsically privileged, but only to the extent that his or her model
can make more sense of the world than the folk models. (It is in this
sense that prediction may be regarded as the acid test of a model.)
The countless mechanisms by which agents ``agree'' to make their
environments more stable form a rich field for study and a source of
evidence for the extent to which agent models and behaviours do in
fact converge. (The market seems to be one such institution.) However,
such convergence must be part of our empirical data, not a theoretical
assumption. If the representation we choose for our models is only
suitable for certain empirical possibilities, it will be extremely
tempting to ignore those which don't fit.
Finally, we need to consider the use of the term ``tractability''. If
this term is intended to mean that the model produces convergence or
optimality in some formal system, then that model building criterion
requires some justification. On the other hand, if it means that the
model should not be unwieldy, then we should provide a more respectful
answer, depending on the form of unwieldiness involved.
One possibility is that a simulation of such complexity is too big or
too slow to run. It is certainly true that such models have little
predictive use in real time, but they may still be validated. (The
distinction is between data in and out of sample, rather than between
past and future after all.) If the simulation predicts well, then it
appears that reality simply is that complex, and a larger computer
will be required. (Rejecting a model because it runs too slowly is not
much different from rejecting it because it won't converge. It
confuses objectives of different sorts.)
This comment does not apply
to proofs that various economic decision processes are non computable
since that suggests that no computer, including the human mind,
could ever perform the computation fast
enough.(24) Instead it reflects the fact that a computer simulation often models the decision
processes of hundreds of agents while in reality, most agents only
deal in detail with their own decision processes and perhaps those of
a few others. (The ways in which social institutions and the
individual ability to abstract permit modelling at this level of
simplicity is an important topic of study.) The task of social
science is considerably more computationally expensive, but this is
not surprising when we reflect on its nature.
Another claim is that simulations are unwieldy because they require
extensive ``tweaking''. Most simulations have so many parameters, it
is claimed, that the designer can use them to produce almost any
desired result. (25)In part, this is an inevitable
consequence of the greater levels of complexity attainable in
simulation. It is much less clear that simulations have an
``unreasonable'' or ``inappropriate'' number of parameters. They may
simply be drawing attention to the amount of data actually required
for social understanding. In any event, this problem also arises in
mathematical models and is typically solved by endogenising as many
variables as possible. However, as Engle, Hendry and Richard point
out exogeneity is something that should be measured, not something
that can simply be assigned (1983). It seems that a useful
distinction can be made between parameters that are genuinely
exogenous, and those which are simply unmodelled. An exogenous
parameter should not be susceptible to tweaking, because it should be
one which is not being estimated within the framework of the model.
For example, a model that includes an exogenous rate of forgetting
should use psychological literature to narrow down the range of the
parameter. If the parameter is so poorly defined that it proves
impossible to assign a value to it, or even to design an experiment by
which the value might be determined, it may not be a suitable part of
any model. It is definitional of an exogenous variable that
its value is determined outside (and therefore free of) the model to
which it is exogenous.
Processes which are unmodelled are also unavailable for ``tweaking''
in the derogatory sense of the term. The relations between them can
only reflect empirical probabilities of particular transitions between
states if these are available. (It often seems to be assumed that data
made available to social scientists must be sufficient to their
purposes but there is an important distinction between a practical
inability to get more data and whether or not that data is needed.)
For example, a minimal simulation is that event B follows event A one
quarter of the time. Here event B is unmodelled, in the sense that no
causal mechanism is incorporated into the simulation to explain how it
comes about. Event A can be chosen arbitrarily, perhaps because the
transition probability between A and B is already well known. (It may
not even be supposed that A is particularly relevant to the fact that
B occurs.) Each time event A occurs, the simulation program ``rolls a
dice'' and considers whether to set an instance of event B in motion.
In fact, event B could follow event C invariably, or even be caused by
it, but that fact has not yet been established either in the
simulation or in the world.
In the process of developing a model of
``how'' event B arises, a simple probability (or model of ``what'') is
replaced by a series of causal or process links, but in no case is it
clear that the simulator has a free hand in adjusting the model to get
some desirable outcome. (In fact, accusations of ``tweaking'' reflect
complaints from both mathematical modellers and economists. In the
former case, there is a practical problem of model refinement to solve
and an incentive to demonstrate that you can solve it. In the latter
case, there is often an extra-theoretical goal like convergence to be
satisfied. Social simulation, in its attempts to avoid both
instrumental and ideological modelling should ideally only use data to
distinguish between models. It would simply reject convergence as a
criterion for parameter adjustment unless convergence was observed to
be involved in the social process.)
It is certainly true that simulators do adjust the parameters
of their models, but their motivation for doing so is obviously
important. It may be possible to show, by a sort of interactive
sensitivity analysis that certain variables can be treated as
completely exogenous, or that they are relatively unimportant in that
the model still behaves in a similar way whatever value they are set
to. (Strict exogeneity is rare, but the empirical determination of
relative unimportance with respect to a given system is probably the
most promising basis for theoretical abstraction. It also seems
compatible with the sort of approximate definition of systems used by
real actors.) This raises the issue of the systematic ``reduction'' of
models (Gilbert, 1986, Hendry, 1987, Hendry and Richard, 1982). It is very important to
distinguish between a modeller who is attempting to reduce a complex
simulation to a simpler one (or possibly even a mathematical model) at
the expense of a known loss of precision, from a mathematical modeller
who is unable to establish just how restrictive an arbitrarily
selected model is. (One of the advantages of model encompassing as a
progressive strategy is that it becomes possible to see just how much
of a special case the encompassed model was. Economics seems to be a
special case of dynamic interaction where agents' models are
fundamentally identical and move structures and interaction patterns
are fixed. Put in these terms, the plausibility of models based on
such assumptions is placed in grave doubt.)
Having addressed these concerns about the practical feasibility of
simulation, it is relatively easy to see how simulation might address
some of the difficulties outlined in the last section. Independent
agency can be implemented by genuine parallelism or the representation
of an independent environment in which time is monitored independently
of the actions of particular agents. (Note that such a system
could be simulated by a human, probably in a very error-prone
and uncomfortable way, but not solved mathematically.) Individual
activities can interact over very different timescales, through
interactions with the environment, and the models which agents use to
understand the world can be refined and transmitted. The simulation
can record and, if necessary, ``compile'' statistical data at a number
of levels. (For example, it can both record all the individual models
of the world at each point in clock time and total up the number of
sales made by a firm in any arbitrary period.) In principle, there is
no reason why the environment should not provide this compiled data to
individual agents as a basis for subsequent decision. (This draws
attention to another important consequence of multiple agency, the
possibility of wholly different types of agents such as
banks, firms, consumers and governments, each with a different
internal structure and goals.)
In the next section, a number of the advantages of simulation will be
discussed further. It will be argued that not only do these advantages
make simulation superior to mathematical representation, for practical
reasons considered already, but that they also provide additional
methodological advantages in the pursuit of ``rigour''.
But Is It Science?
So far, we have considered the representational advantages of
simulation and answered a number of practical objections to simulation
as a technique. However, there is a final objection which needs to be
addressed, namely that simulation models do not adequately fulfill
some methodological criterion of scientific ``rigour''. (It is not
always easy to separate methodological objections from practical ones
so this section may overlap somewhat with the previous one.)
The economic view of the scientific method appears to be that we
develop a theory by some means, make appropriate deductions from the
premises of the theory, test these deductions using the available data
and then modify the premises or (much more rarely) the deductive
techniques as a basis for further modelling. One difficulty with
implementing this view is that mathematical theories are not
appropriately ``modular''. It is not typically feasible to ``throw
away'' those parts of a mathematical theory that are malfunctioning.
For one thing, if the model is not adequately grounded in actual
causal processes, it may be unclear which pieces these are. In a
poorly specified system, it will be very hard to link sections of an
equation to particular behaviours, particularly when aggregation is
problematic. (There may be coefficients in the model representing a
collection of different factors. It has already been remarked that in
many cases econometric modelling involves the testing of extremely
complex joint hypotheses. In some cases, the integrity of the
variables may be as questionable as that of the constants.)
Secondly,
the mathematical representation is not itself modular. Even if the
appropriate part of an equation, or system of equations can be
identified, replacing it with a more complex or realistic functional
form may simply render the whole system insoluble or indeterminate.
(This is a common progression in economic research. A simple model
producing a definite conclusion is criticised and replaced by a more
general model producing a range of outcomes depending on the value of
some parameter. No empirical evidence is provided for the actual
value of the parameter, and more importantly, no guidance concerning
how it could be measured. If the matter is pursued
econometrically at all, the additional theory or assumptions required
to proxy such parameters make it hard to determine whether the theory
can still be falsified. (26)) Thirdly, it is seldom possible
to reconcile or aggregate theories that use different sorts of
mathematical representations. (Econometric modelling actually avoids
this difficulty by limiting itself to models in separable terms. These
can be aggregated easily, but it is unrealistic.)
For these reasons, it is very hard for the development of mathematical
models to take place progressively, and there is a strong and observed
tendency for the development of overarching and competing models that
each explain some proportion of the phenomenon but are presented as
the whole explanation. The inability of each model to deal with other
aspects of a social process is not addressed. Instead, the importance
of those recalcitrant aspects is simply minimised, often by supporting
verbal handwaving. Examples are provided by competing theories of
investment, consumption and the speed of market clearing. In each
case the competing theories provide a partial explanation but it has
proved quite difficult to reconcile them within the mathematical
framework. Perhaps the deepest division of all is that between the
microeconomic and macroeconomic representations of economic activity.
At the microeconomic level, agents and firms are modelled as making
optimising decisions in markets. At the macroeconomic level, causal
connections are deduced by reference to models that do not have any
connection with individual optimisation. Clearly there are agents
whose microeconomic behaviour gives rise to macroeconomic aggregates
and conversely there are organisations like governments, which attempt
to influence individual behaviour by controlling these aggregates.
However, there is currently no realistic and unified mathematical
representation within which the links between the two levels can be
made explicit.
The limitations of mathematical representation also affect the process
of theory development. Because only certain extensions to the theory
prevent it from becoming intractable, there is a tendency to filter
new data with this in mind. Certain sorts of behaviour, like altruism,
learning and morality have become almost unrecognisable when
translated into economic theory. Ideally, theories should be
represented in a language which actually encourages the incorporation
of new and diverse data by ensuring that this process does not make
the resulting models impossible to handle.
The final difficulty with mathematical representation concerns the
social effect it has on the accessibility of models to other
practitioners and critics. Both the representation and solution of
mathematical systems require considerable technical skill and the
``reinterpretation'' of economic phenomena for mathematical
tractability makes the resulting models even harder to compare with
everyday experience. Even among practitioners, the tendency to make
assumptions ``in passing'' while solving mathematical systems makes it
very hard to replicate the results of econometric studies. In addition
to these technical difficulties with sharing econometric models, there
are also theoretical difficulties. The simplification of time and move
structure is such that there is very little ``emergent'' behaviour in
mathematical models that can be checked by subsequent investigators.
Apart from detecting errors of calculation or using the models with a
``better'' or different data set, there are no implications in the model
other than those made explicit by its solution.
Taking the economic view of scientific progress as the correct one, we
may ask whether simulation or mathematical modelling is better adapted
to this sort of activity. Simulation is capable of representing
properly grounded theories directly. Individual agents, with their
respective models of the world, are represented exchanging information
and materials in real time.
Any processes resulting in the generation
of aggregate data involved in individual decision-making can be
represented explicitly, for example the generation of statistical data
by banks.(27) Thus macroscopic data does not ``float
free'' in such models, though it may turn out to be less important
than previously supposed. At the same time, the kind of abstractions
that individual actors make in dealing with the world also provide
valuable information about the possibility of modular simulation. If
the process of government is either predicted or taken as exogenous by
agents, without the need to refer to the internal workings of
government, then this sort of decision-making may allow the modelling
of government policy as a ``black box'' or statistical process. (Of
course, it may be that agents are being insufficiently sophisticated
in taking this view. However, we can judge this by the extent to which
they view this model as satisfactory.) Nonetheless, it seems that the
everyday understandings of agents, or at least aggregates which are
not too far removed from them, may provide a better ontology for
models than abstract theory. This sort of modelling is made possible
by the richness of computer languages, which, though by no means as
rich as everyday language, is still far less restrictive than
mathematics. (In any event, the linkage between objects or actions and
talk about them is itself something that agents may be able to
explain.)
Simulations can be developed in a modular fashion when the
descriptions of transformations and processes are not primarily
theoretical, but reflect the movements of actual goods and information
in the economy. This is again made possible by the fact that
simulation can keep track of multiple processes. Although the
observation of these variables may be more or less problematic, their
characterisation is relatively straightforward. As a result, it should
be possible to pose research questions in relatively simple language
and leave the investigation of different subsystems to different
researchers or disciplines with appropriate skills. (28)
However, once this individual research has been
done, it is still capable of being reconciled within the same
simulation. For example, it is possible to regard an agent as a black
box, in the economic fashion, with preferences as inputs and decisions
as outputs. However, within a simulation it is no longer
theoretically necessary to do so. Furthermore, the neglect
of factors influencing preference such as education and advertising
becomes apparent once the processes by which agents interact are
modelled explicitly. (Curiously, economic theories of advertising have
proposed almost every theory of its function except that it
is intended to alter preference.) These factors were previously the
province of psychology, but are clearly important to economic
behaviour too. Simulation provides a framework within which
traditional economic models can be reconciled with psychological ones,
at least in principle. Thus it enables progressive research through
the development of increasingly rich models, and modularity, through
the exercise of collecting data about the ontology which agents
actually use in decision making. (29)
Such complex models of interacting agencies also produce large amounts
of emergent data which retains its everyday interpretation. By
contrast, for example, intermediate iterations of a mathematical model
do not necessarily have any obvious real world interpretation. The
amount of emergent data produced by a system is likely to be a
function of the number of agencies involved and their ability to act
independently of each other. For example, in a model of firm
interaction, all that need be simulated is the pricing decisions of
individual firms and their survival or bankruptcy according to
profitability and the workings of the market. The age profile of
firms comprises an independent emergent piece of data
resulting from the independent actions of many firms, which is not
designed into the simulation and can be compared with the age profile
of actual firms.
A ``complex object'' like a simulation provides a
rich mixture of new effects for investigation and comparison with
empirical data, as well as suggesting the need for new theories and
data. Unmodelled features, simply simulated as probability
distributions, can be ``unpacked'' and linked to other features within
a simulation over time. The very complexity of simulated data,
provided it is based on everyday rather than theoretical
understandings, allows us to make use of our excellent cognitive
skills as pattern recognisers to develop understandings of the future
needs of the simulation. The use of everyday understandings also
allows us to present the simulation, in a suitably user friendly form,
to non technical practitioners. (30)For example, suppose that a manager is
presented with the opportunity to ``play'' an interactive simulation
of firms in a market, taking the role of one firm. She is amazed at
the difficulty of representing the pricing decision process she
actually uses within the current framework of the simulation, both in
terms of information provided and techniques available to process it.
She explains: ``If I had to make pricing decisions on that information
alone, I'd always err on the side of caution. But of course, we do it
rather differently.'' When the simulation prices are observed to be
systematically too low, having been compared to those in real markets,
such comments suggest not only what might be wrong, but what ought to
be done about it. Furthermore, such comments need not be limited to
the internal workings of the firm, but may also be used to refine the
environment if the manager reports ``I've never seen price fluctuate so
much as that''.
Finally, just as simulation makes a model more accessible to non
specialised critics, it also makes it more accessible to specialised
ones. A well designed program is relatively portable and contains a
record of assumptions far more complete than that involved in
mathematical modelling. As such, it is far harder for
non-comparability of results to go unchallenged as an invitable
consequence of the different subsidiary assumptions that result when
people attempt to solve systems of equations. At the same time, the
amount of emergent data produced by a simulation is such that it is
actually rewarding and interesting to investigate a simulation
further. By contrast, the simplicity of mathematical systems reduces
secondary analysis to the rather menial and potentially negative task
of looking for errors. In addition, the complexity and variety of
emergent data makes it far harder to manipulate parts of the model,
consciously or unconsciously, to produce ``acceptable'' results.
Adjusting one section of the model is likely to influence the nature
of a large number of other parts of the model, all of which can be
evaluated independently for plausibility. Within a simulation, it is
also possible for this plausibility to take richer forms that a simple
comparison of variable values. Not only can the simulation deal with
such features as the distribution of individuals, but, as has already
been mentioned, it can address the reconciliation of different sorts
of data and different methods of obtaining it, for example that the
simulation is consistent not only with the observed pricing decisions
of firms based on supermarket observations, but with the descriptions
of managers based on interviews. (31)The existence of independent sources of
data also means that the testing of models need not involve impossibly
complicated joint hypotheses. It may prove possible to establish that
some subsystem has been substantially understood before moving on to
deal with the next. (Such a view still requires a certain amount of
realism about the world and our ability to develop a common way of
talking about it, but it is not a simplistic realism, rather it is
predicated on our socialisation as language users in a shared
environment.)
Of course, this is an idealised picture of the possibilities of
simulation, but one that itself deals in concrete objectives. We do
not yet know how to model the human ability to abstract and develop
models, for example, but we can be reasonably confident that it will
be capable of representation in simulation. We can have no
corresponding confidence about the mathematical representation when we
already seem to be pushing at some of its limits which are described
above. Because we are discussing methodology, all arguments must be
qualified as being ``in principle'', but if we take the scientific
objectives of economics as given, it does not seem that simulation is
any less rigorous than mathematical representation and may actually be
more so. This development has a cost. Simulation will require more
data and more equipment than mathematical modelling, but these
``practical'' costs seem far more agreeable and rewarding than the
self inflicted costs of inconsistency and ambiguity which result
from the arbitrary restriction of models by their mathematical
representation. It is the difference between climbing a mountain and
digging a pit.
Conclusion
This paper addresses the three main classes of objections that have
been levelled at simulation in economics. Firstly that it is
unecessary, except as a technique for solving mathematical models,
because these models are the best representation of social processes
we have. Secondly, that even if simulation is a better potential
representation of these processes, the models it tends to produce are
either practically or methodologically unacceptable. I have challenged
the first argument by suggesting two major areas in which the
mathematical representation is restrictive, in its representation of
time and multiple agency. I have also suggested a number of concrete
examples in which these limitations are manifested such as
simultaneous action, retries and external control of feedback systems.
I have challenged the second and third arguments by unpacking them and
addressing a number of individual methodological complaints. There are
other objections, but I have tried to deal with all the commonest and
most important ones. In each case, I have not challenged the goals of
economics or its view of scientific method directly, but have
attempted to show that even given those goals, simulation is still
potentially superior to mathematical modelling. (In fact, I think it
is possible to go further and argue that simultion is compatible with
a richer and more contemporary view of the philosophy of science.
However, that is too big a task for a single paper.) Generally, the
attempt to separate different sorts of objection may prove valuable in
subsequent attempts to clarify appropriate responses. Methodological
complaints require different responses to practical ones.
The broader purpose of the paper has been to address the relationship
between methodology, theory and models which differs between the
simulation approach and the more traditional methods of economics. It
seems that economics confuses methodology and theory, which determine
the subject matter of interest and the ways of representing and
investigating it, with models, which present the results of these
investigations in a form suitable for testing. Simulation attempts to
use the widest possible representation language, allowing it to be
agnostic about what data matters. By contrast economics takes a very
particular view of what data is required. This seems to be forced on
it by the prescriptive choice of a representation language which
narrows the range of model possibilities in an arbitrary way. The
paper attempts to show that the deductive approach, favoured by
economics, and the inductive one, suggested by the capabilities of
simulation, may not prove equally satisfactory.
Footnotes
(1) Paradigm cases of this research rogramme are provided in consumer theory (Deaton and
Muelbauer, 1980) and the theory of the firm (Koutsoyiannis, 1979).
(2) This view of the role of simulation seems to predominate in the literature of
Computational Economics (Pau, 1986, Roos, 1987).
3) In a survey of evolutionary models in economics, discussed in Chattoe (1994) the
proportion of simulations describing processes that could not be solved mathematically was found
to be very small. Furthermore, it is generally acknowledged that evolutionary modelling is far
more sympathetic to simulation than other branches of economics.
(4) A simulation, which consists of a computer program, can be seen as a set of starting
conditions and rules for change in the same way that a system of equations can. Thus we may talk
about a computational representation of a social process.
(5) The relatively rare examples of descriptive simulation in economics are almost invariably
found where traditional theory has proved particularly unsuccessful (Witt, 1986), or where its
assumptions are questioned by individual economists (Alchian, 1950, Witt and Perske, 1982). In
all cases, until extremely recently, this work was seldom followed up, rarely quoted for practical
use and restricted to less prestigious publications. In many cases, this cannot easily be explained
by its lower intellectual quality.
(6) Utilitarianism does not imply individualism. Economics text books often contain
``entertaining'' examples of joint utility functions (Deaton and Muelbauer, 1980, page 126).
However, these are quite rare in economic modelling generally, I suspect because they are so
hard to solve analytically. This does not mean, however, that they do not represent important
social processes with which theory should be expected to cope.
(7) This view has been criticised by Leontief (1977).
(8) Interestingly, a residue of the era of verbal theories is still with us. Even in the most
rigorous mathematical models, the variables used, for example `capital', `unemployment' and
`profit', commonly have interpretations which neither correspond to everyday usage nor bear
close theoretical examination. (For an example of the ``deconstruction'' of the investment
variable, see the last chapter of Nickell (1978). At the very least, they turn out to encapsulate
some very controversial technical assumptions about the possibility of aggregation.
(9) A number of authors have pointed out the economic importance of changes in physical
science (Georgescu-Roegen, 1971, Mirowski, 1989).
(10) The phenomenon of ``heresy'' among Nobel Laureates also reveals something about
the social conditions prevailing within the economics profession. When, but largely only when,
academics reach an untouchable professional position, they lose faith in mathematical modelling
of rational choice as a progressive methodology and begin to criticise it. (Such methodological
criticisms should not be confused with objections to specific assumptions from within the rational
choice framework.) Sadly, these critics have often lost their direct influence on teaching and
research policy by this point. The objections by Leontief have already been referred to, but other
such ``heretics'' are Kenneth Arrow and John Hicks. There are also interesting cases like Ronald
Coase and Herbert Simon who have found their ``heretical'' objections re-absorbed into the
optimising framework. The theoretical awkwardness that has resulted from this process arises
from the requirement that optimising choice should be retained as an assumption.
(11) One may also question whether this comparison would be useful in any event. The
success of a representation is measured by its ability to represent, almost regardless of the quality
of the models it represents. This distinction is not absolute. No-one would recommend a
representation that was suitable only for palpably ridiculous models. Nonetheless, we do not yet
know enough about which models are plausible to use prediction as the main criterion of
representational quality.
(12) The fact that different representations can be used to describe the same phenomenon
makes it important that they should be associated with theories possessing adequate heuristic
fertility. This is the capability to progress by generating new models for testing. When economics
is presented with new findings in the other social sciences, it often responds by observing that the
behaviour concerned can be represented, after the event, by some utility function. However, this
is not the same as anticipating that behaviour in the first place. Pure utilitarianism implies nothing
about what people actually derive utility from. Taken alone therefore, it does provide a suitable
basis for the development of economic theories. Furthermore, if almost any behaviour can be
represented by a utility function, though not necessarily a soluble one, we need some method to
help us decide which behaviours actually occur and which utility function might be appropriate
in a given situation. The possibility that utility theory might be non-falsifiable, because it lacks
such a method, is discussed further in Chattoe (1995a)
(13) However, it may be significant that many of the most successful models involve
predicting the current value using a set of past values, a strictly econometric process that has no
starting point.
(14) The idea of encompassing originates in econometrics (Hendry, 1988), where it applies
to the comparison of model predictions rather than representations. Nonetheless, using it in this
new sense does not seem to distort the original meaning unduly.
(15) One might argue that this richness reflects our need to talk about our own mental
processes and those of others, an understanding of which is clearly vital to the modelling of social
behaviour for reasons discussed shortly.
(16) There is a third approach, proposed by Friedman (1953).
(17) Econometric time may also encourage the use of the ``lowest common denominator''
of data. If one has three monthly data on one variable and yearly data on another, one cannot
make any effective use of the additional three monthly data. One can average the three monthly
data or interpolate the yearly data, but both processes introduce uncertainties of their own.
(18) Unsurprisingly, attempts to control individual behaviour by altering these aggregates has
met with mixed results. The causal link between micro and macro data is not equally rigid in both
directions. There may be instances where individuals use macro data in their decision-making, for
example the interest rate, but the extent of such behaviour has not been demonstrated.
(19) This is sometimes referred to as the ``problem of simultaneity'' in econometrics (Hendry,
1993).
(20) This is not possible in an absolute sense, but is possible in practice through the social
institution of time-keeping.
(21) Abstracting from time in economics also seems to produce abstraction from space in
most models.
(22) The extent to which our bodies also act according to laws independent of the minds
embedded in them has also been neglected.
(23) This raises a number of other issues, for example the possibility that additional
information may be harmful rather than helpful and that it may be very hard to make rational
comparisons between past and present situations because so much is changing.
(24) However, given a proof that a decision process was not computable, nobody would
presumably build a simulation which represented agents as using that decision process!
(25) This claim may simply be false. The purpose of sensitivity analysis is to establish
whether outcomes are independent of the values of some parameters. One could certainly argue
that a model capable of producing any outcome was simply a poor model but it does not follow
that this is a necessary feature of the simulation approach.
(26) A good example of this progression is to be found in the development of the
Modigliani-Miller Theorem in the corporate finance literature.
(27) Such representations may ultimately need to model the role of simulators themselves!
This serves as an appropriate reminder that social systems can also be influenced by attempts to
measure and understand them.
(28) In fact, the extent to which these research questions can be phrased in common terms
is a useful measure of the extent to which they might reflect the decision processes and actions
of common people. If they only make sense in the terminology of one discipline, they may not
be very useful.
(29) One interesting consequence of this view of multiple processes is that different
techniques are also available to elicit different sorts of data and can be used to cross-check
simulated behaviour in a rich way. Techniques such as interviewing may allow us to establish how
agents really take decisions. Thus far, it has proved possible to transfer suitably abstracted data
between disciplines but there has been comparatively little transfer of techniques.
(30) It is true that the skills for building simulations are at least as rare as those for building
mathematical models, but because the behaviour of a simulation is more than simply the listing
of the program which produces it, it is possible for a person to use a simulation she doesn't
``understand'' in a way which has no analogy in the case of a set of equations.
(31) Such reconciliation is necessary in any event, unless we have great confidence in any one
source of data. Economists often reject interview data because agents are not ``motivated'' to tell
the truth, though the conception of motivation involved is rather attenuated. By contrast,
they are happy with official statistics, though these presume that both the reporters and the
collectors of the data are appropriately motivated.
References
Armen A. Alchian. Uncertainty, Evolution and Economic theory. Journal of Political
Economy, 58(3):211--222, June 1950.
P. W. Anderson, Kenneth J. Arrow, and D. Pines, editors. The Economy as an Evolving
Complex System, Proceedings of the Evolutionary Paths of the Global Economy Workshop,
Santa Fe, New Mexico, September 1987.
Addison Wesley, Reading, MA, 1988.
David F. Batten, John L. Casti, and Borje Johansson, editors. Economic Evolution And
Structural Adjustment. Springer-Verlag, Berlin, 1987.
Chris Chatfield. Editorial - neural networks: Forecasting breakthrough or passing fad?
International Journal of Forecasting, 9:1--3, 1993.
Edmund Chattoe. The use of evolutionary algorithms in economics: Metaphors or models
for social interaction? In Eva Hillebrand and Joachim Stender, editors, Many-Agent Simulation
and Artificial Life, volume 25 of Frontiers in Artificial Intelligence and Applications, pages
48--83. IOS Press, Amsterdam, 1994.
Edmund Chattoe. Can sociologists and economists communicate? The problem of
grounding and the theory of consumer behaviour. Paper presented at the Conference ``Sociology
and the Limits of Economics'', Liverpool, April 1995.
P.-A. Chiappori. Selection naturelle et rationalite absolue des entreprises. Revue
Economique, 35(1):87--108, January 1984.
D.Colander and R.Brenner, editors. Educating Economists. University of Michigan Press,
Ann Arbor, 1992.
Angus Deaton and John Muellbauer. Economics and Consumer Behaviour. Cambridge
University Press, Cambridge, 1980.
Huw Dixon, Steven Wallis, and Scott Moss. Axelrod meets Cournot: Oligopoly and the
evolutionary metaphor part 1. Technical Report 95/8, Department of Economics and Related
Studies, University of York, July revised November 1994.
G.Dosi, Luigi Marengo, A.Bassanini, and M.Valente. Microbehaviour and dynamical
systems: Economic routines as emergent properties of adaptive systems. Technical report, Center
for Research in Management, University of California (Berkeley), 1993.
Robert F. Engle, David F. Hendry, and Jean-Francois Richard. Exogeneity. Econometrica,
51(2):277--304, March 1983.
R. Frank, T. Gilovich, and D. Regan. Does studying economics inhibit co-operation? Journal
of Economic Perspectives, 7(2):159--171, Spring 1993.
Milton Friedman. Essays in Positive Economics, chapter The Methodology of Positive
Economics, pages 3--53. University of Chicago Press, Chicago, 1953.
Nicholas Georgescu-Roegen. The Entropy Law and the Economic Process. Harvard
University Press, Cambridge, MA, 1971.
Christopher L. Gilbert. Professor Hendry's econometric methodology. Oxford Bulletin of
Economics and Statistics, 48(3):283--307,
August 1986.
R.L. Hall and C.J. Hitch. Price theory and business behaviour. Oxford Economic Papers,
2:12--45, May 1939.
David F. Hendry. The encompassing implications of feedback versus feedforward
mechanisms in econometrics. Oxford Economic Papers, 40:132--149, 1988.
David F. Hendry. Econometric methodology: A personal perspective. In T.F. Bewley, editor,
Advances in Econometrics. Cambridge University Press, Cambridge, 1993.
David F. Hendry. Econometrics: Alchemy or Science? Essays in Econometric Methodology.
Basil Blackwell, 1993.
David F. Hendry and Jean-Francois Richard. On the formulation of empirical models in
dynamic econometrics. Journal of Econometrics, 20:3--33, 1982.
Frank H. Knight. Risk, Uncertainty, and Profit, Houghton Mifflin, Boston, 1921.
A.Koutsoyiannis. Modern microeconomics. Macmillan, London, second edition, 1979.
Imre Lakatos.Falsification and the methodology of scientific research programmes.
In Imre Lakatos and Alan Musgrave, editors, Criticism and the Growth of Knowledge, pages
95--195. Cambridge University Press, Cambridge, 1970.
Imre Lakatos. Proofs and Refutations, Cambridge University Press, Cambridge, 1976.
Wassily Leontief. Essays in Economics, Volume 2: Theories, Facts and Policies, chapter
Theoretical Assumptions and Nonobserved Facts, pages 24--34. Basil Blackwell, Oxford, 1977.
Gerald Marwell and Ruth E. Ames. Economists free ride, does anyone else? Journal of Public
Economics, 15:295--310, 1981.
P.Mirowski. More Heat than Light: Economics as Social Physics, Physics as Nature's
Economics, Cambridge University Press, Cambridge, 1989.
Richard R. Nelson and Sidney G. Winter. An Evolutionary Theory of Economic Change.
Belknap/Harvard University Press, Cambridge, MA, 1982.
S.J. Nickell. The Investment Decisions of Firms, Cambridge University Press, Cambridge,
1978.
L.-F. Pau, editor. Artificial Intelligence in Economics and Management: Proceedings of the
First International Workshop on Artificial Intelligence in Economics and Management, Zurich,
12- 14 March 1985 Elsevier, Amsterdam, 1986.
J.-L. Roos, editor. Economics and Artificial Intelligence: Proceedings of the
IFAC/IFORS/IFIP/IASC/AFCET Conference, Aix-en- Provence, France, 2-4, September 1986,
volume 12 of IFAC Proceedings Series, Pergamon Press, Oxford, 1987.
Devendra Sahal. Invention, innovation and economic evolution. Technological Forecasting
and Economic Change, 23(3):213--235, 1983.
Ulrich Witt. How can complex economic behavior be investigated? The example of the
ignorant monopolist revisited. Behavioral Science, 31:173--188, 1986.
Ulrich Witt and Joachim Perske. SMS - A Program Package for Simulating and Gaming of
Stochastic Market Processes and Learning Behaviour, volume 202 of Lecture Notes in Economics
and Mathematical Systems. Springer-Verlag, Berlin, 1982.