Abstract
The Leiden methodology (LM), also sometimes called the crown indicator, is a quantitative method for evaluating the research quality of a research group or academic department based on the citations received by the group in comparison to averages for the field. There have been a number of applications but these have mainly been in the hard sciences where the data on citations, provided by the ISI Web of Science (WoS), is more reliable. In the social sciences, including business and management, many journals and books are not included within WoS and so the LM has not been tested here. In this research study the LM has been applied on a dataset of over 3000 research publications from three UK business schools. The results show that the LM does indeed discriminate between the schools, and has a degree of concordance with other forms of evaluation, but that there are significant limitations and problems within this discipline.
Abstract
The economic crisis created major problems for a successful, hi-tech Chinese company Tonsan. They already had in place a performance management system based around the balanced scorecard which worked successfully in times of growth and high demand. However, with the world downturn they suddenly found that their current system was not able to cope with the demands placed on it. The authors were called in and decided to design a new, strategic performance management system to overhaul all the key business processes. The approach taken to develop the PM system was based around soft systems methodology (SSM), a well established systems-based approach to problem solving and organizational design. The methodology progressed from the development of key strategic objectives (using the BSC and strategy maps), through a structured decomposition of necessary organizational activities, the construction of key performance indicators, the specification of targets, to communication and future planning. It involved significant levels of participation and communication throughout the organization. The results were judged by senior management to have been very successful, and the company has grown significantly.
Abstract
This paper considers the use of the h-index as a measure of a journal's research quality and contribution. We study a sample of 455 journals in business and management all of which are included in the ISI Web of Science (WoS) and the Association of Business School's peer review journal ranking list. The h-index is compared with both the traditional impact factors, and with the peer review judgements. We also consider two sources of citation data - the WoS itself and Google Scholar. The conclusions are that the h-index is preferable to the impact factor for a variety of reasons, especially the selective coverage of the impact factor and the fact that it disadvantages journals that publish many papers. Google Scholar is also preferred to WoS as a data source. However, the paper notes that it is not sufficient to use any single metric to properly evaluate research achievements.
Abstract
The 2008 Research Assessment Exercise in the UK involved the peer review of over 12,500 research outputs in Business and Management, of which 92% were journal articles. Each output was graded on a 4-point scale from "world leading" to "national" with a fifth point being unclassified. These grades were accumulated for each department to provide an overall quality profile in terms of the proportions of its outputs in each category. The assessments of individual papers were not made public but the papers submitted by each department were. This data provides a major opportunity for addressing issues of concern about the evaluation of research and the effects of journal rankings, as well as the possibility of reconstructing the judgements made by the Panel about journal quality. Given the submission details and the resulting grade profile for each department, we have used linear programming to produce the best estimate of the grades awarded to papers from each journal that had more than three entries. This provides both a grade profile for each journal and a single quality estimate. The results are shown to have good validity in comparison with other journal rankings. Apart from providing a ranking of 700 journals based on the RAE results, the paper is also able to shed light on issues such as the accuracy and coverage of the ABS ranking: the degree of selectivity of submissions; the dispersion of grades for a journal; and differences between different subject areas.
Abstract
The article critically examines how work is shaped by performance measures. Its specific focus is upon the use of journal lists, rather than the detail of their construction, in conditioning the research activity of academics. It is argued that an effect of the one size fits all logic of journal lists is to endorse and cultivate a research monoculture in which particular criteria, favoured by a given list, assume the status of a universal benchmark of performance (research quality). The article demonstrates, with reference to the Association of Business Schools (ABS) Journal Guide, how use of a journal list can come to dominate and define the focus and trajectory of a field of research, with detrimental consequences for the development of scholarship.
Abstract
Critical realism, especially as developed by Roy Bhaskar, embodies
at its heart systemic and holistic concepts such as totality, emergence,
open systems, stratification, autopoiesis and holistic causality. These concepts
have their own long history of development in disciplines such as
systems thinking and cybernetics, but there is an absence in Bhaskars
writings, and that absence is a lack of any reference to the corresponding
systems literature. The purpose of this paper is threefold: (i) to demonstrate
the extent of this correspondence; (ii) to show that critical realism
can benefit from an exposure to these other discourses; and (iii) to show
that systems thinking too can gain philosophically from critical realism.
Abstract
Over the last forty years, new methods and methodologies have been developed to deal with wicked problems or "messes". They are structured and rigorous but non-mathematical. Prime examples are: soft systems methodology (SSM), cognitive mapping/SODA and the strategic choice approach (SCA). Collectively they are known as Soft OR, Soft Systems, or Problem Structuring Methods (PSMs). Soft OR has now come of age in terms of both dealing with complex practical situations and having a presence in the academic literature. However, Soft OR is not recognized, or even seen as a legitimate part of an OR, everywhere and this is especially so in the US, where top journals such as Operations Research and Management Science do not publish Soft OR papers. The purpose of this paper is to generate an informed discussion and debate, which may lead to a greater recognition of the contribution of Soft OR, and to it being seen to be a proper part of the OR discipline worldwide. In order to achieve this, the first section outlines the nature of Soft OR and describes briefly some of the main methods. The second section demonstrates that Soft OR has been successful both in practice and within the academic literature. The third section documents the invisibility of Soft OR within important sections of the OR literature, and the final section then suggests some explanations for this, and also proposes practical actions to try and alleviate the problem. It is not suggested that Soft OR is an alternative to traditional, mathematical OR but, rather, a complement.
Abstract
Operational researchers help managers decide what they ought to do and yet this is generally evaluated in terms of efficiency or effectiveness, not ethicality. However, the combination of the tremendous power of global corporations and the financial markets, and the problems the world faces in terms of economic and
environmental sustainability, has led to a revival of interest in ethical approaches. This paper explores a relatively recent and innovative process called discourse ethics. This is very different from traditional ethical systems in taking ethical decisions away from individuals or committees and putting them in the hands of the actual people who are involved and affected through processes of debate and deliberation. The paper demonstrates that discourse ethics has strong connections to OR, especially in the areas of soft and critical systems, and that OR can actually contribute to the practical operationalisation of discourse ethics. At the same time, discourse ethics can provide a rigorous discursive framework for ethics beyond the model.
Abstract
The number of citations is becoming an increasingly popular index for measuring the impact of a scholars research or the quality of an academic department. One obvious question is: what are the factors that influence the number of citations that a paper receives? This study investigates the number of citations received by papers published in six well-known management science journals. It considers factors that relate to the author(s), the article itself, and the journal. The results show that the strongest factor is the journal itself; but other factors are also significant including the length of the paper, the number of references, the status of the first authors institution, and the type of paper, especially if it is a review. Overall, this study provides some insights into the determinants of a papers impact that may be helpful for particular stakeholders to make important decisions.
Abstract
The systems approach, or systems thinking, has been intimately connected with the development of OR and management science initially through the work of founders such as Churchman and Ackoff and latterly through innovations such as soft systems. In this paper we have undertaken a review of the contribution that systems thinking has been making more recently, especially to the practice of OR. Systems thinking is a discipline in its own right, with many theoretical and methodological developments, but it is also applicable to almost any problem area because of its generality, and so such a review must always be selective. We have looked at the literature from both a theoretical and an applications orientation. In the first part we consider the main systems theories and methodologies in terms of their recent developments and also their applications. This covers: the systems approach, complexity theory, cybernetics, system dynamics, soft OR and PSMs, critical systems and multimethodology. In the second part we review the main domains of application: strategy, information systems, organisations, production and operations, ecology and agriculture, and medicine and health. Our overall conclusion is that while systems may not be well established institutionally, in terms of academic departments, it is incredibly healthy in terms of the quantity and variety of its applications.
Abstract
Ethics is important in the Information Systems field as illustrated, for example, by the direct effect of the Sarbanes-Oxley Act on the work of IS professionals. There is a substantial literature on ethical issues surrounding computing and information technology in the contemporary world, but much of this work is not published nor widely cited in the mainstream IS literature. The purpose of this paper is to offer one contribution to an increased emphasis on ethics in the IS field. The distinctive contribution is a focus on Habermass discourse ethics. After outlining some traditional theories of ethics and morality, the literature on IS and ethics is reviewed, and then the paper details the development of discourse ethics. Discourse ethics is different from other approaches to ethics as it is grounded in actual debates between those affected by decisions and proposals. Recognizing that the theory could be considered rather abstract, the paper discusses the need to pragmatize discourse ethics for the IS field through, for example, the use of existing techniques such as soft systems methodology. In addition, the practical potential of the theory is illustrated through a discussion of its application to specific IS topic areas including Web 2.0, open source software, the digital divide and the UK biometric identity card scheme. The final section summarizes ways in which the paper could be used in IS research, teaching, and practice
Abstract
Assessing the quality of the knowledge produced by business and management academics is increasingly being metricated. Moreover, emphasis is being placed on the impact of the research rather than simply where it is published. The main metric for impact is the number of citations a paper receives. Traditionally this data has come from the ISI Web of Science but research has shown that this has poor coverage in the social sciences. A newer and different source for citations is Google Scholar. In this paper we compare the two on a dataset of over 4,600 publications from three UK Business Schools. The results show that Web of Science is indeed poor in the area of management and that Google Scholar, whilst somewhat unreliable, has a much better coverage. The conclusion is that Web of Science should not be used for measuring research impact in management.
Abstract
This article takes a critical realist perspective to understand the research-practice gap in the field of business and management. To investigate issues surrounding the rigour versus relevance debate, we examine how the divergent perspectives of scholars and practitioners can be bridged by a critical realist approach in relation to: (1) the research paradigm: instead of confining their research within methodological purism, scholars may need to deploy any research paradigm to investigate a phenomenon in its context, (2) context and causality: critical realism provides an ontological grounding for interpretivist research reaffirming the importance of a focus on context, meaning and interpretation as causal influences, (3) methodological rigidity: multiple research methods will be more important when addressing research-practice gaps since they are more receptive to interdisciplinary functions and contexts in time and space than traditional methodologies, and (4) ethical aspects of business research highlighting the need to engage with the knowledge agenda of not only the university but also society overall. The critical nature of management studies we contend also helps to explain why at least certain research-practice gaps can be treated as natural because of divergent preferences of scholars and practitioners.
Abstract
Operational researchers help managers decide what they ought to do and yet this is generally evaluated in terms of efficiency or effectiveness, not ethicality. However, the combination of the tremendous power of global corporations and the financial markets, and the problems the world faces in terms of economic and environmental sustainability, has led to a revival of interest in ethical approaches. This paper explores a relatively recent and innovative process called discourse ethics. This is very different from traditional ethical systems in taking ethical decisions away from individuals or committees and putting them in the hands of the actual people who are involved and affected through processes of debate and deliberation. The paper demonstrates that discourse ethics has strong connections to OR, especially in the areas of soft and critical systems, and that OR can actually contribute to the practical operationalisation of discourse ethics. At the same time, discourse ethics can provide a rigorous discursive framework for ethics beyond the model".
Abstract
Assessing the quality of the knowledge produced by business and management academics is increasingly being metricated. Moreover, emphasis is being placed on the impact of the research rather than simply where it is published. The main metric for impact is the number of citations a paper receives. Traditionally this data has come from the ISI Web of Science but research has shown that this has poor coverage in the social sciences. A newer and different source for citations is Google Scholar. In this paper we compare the two on a dataset of over 4,600 publications from three UK Business Schools. The results show that Web of Science is indeed poor in the area of management and that Google Scholar, whilst somewhat unreliable, has a much better coverage. The conclusion is that Web of Science should not be used for measuring research impact in management.
Abstract
The number of citations is becoming an increasingly popular index for measuring the impact of a scholar's research or the quality of an academic department. One obvious question is: what are the factors that influence the number of citations that a paper receives? This study investigates the number of citations received by papers published in six well-known management science journals. It considers factors that relate to the author(s), the article itself, and the journal. The results show that the strongest factor is the journal itself; but other factors are also significant including the length of the paper, the number of references, the status of the first author's institution, and the type of paper, especially if it is a review. Overall, this study provides some insights into the determinants of a paper's impact that may be helpful for particular stakeholders to make important decisions.
Abstract
There is an increasing emphasis on the use of metrics for assessing the research contribution of academics, departments, journals or conferences. Contribution has two dimensions: quantity which can be measured by number/size of the outputs, and quality which is most easily measured by the number of citations. Recently, Hirsch proposed a new metric which is simple, combines both quality and quantity in one number, and is robust to measurement problems. This paper applies the h-index to three groups of management academics BAM Fellows, INFORMS Fellows, and members of COPIOR in order to evaluate the extent to which the h-index would serve as a reliable measure of the contribution of researchers in the management field.
Abstract
Until recently, businesses and corporations could argue that their only real commitments were to maximise the return to their shareholders whilst staying within the law. However, the world has changed significantly during the last ten years and now most major corporations recognise that they have significant responsibility to local and global societies beyond simply making profit. This means that there is now an increasing concern with the question of how corporations, and their employees, ought to behave, and this leads us to consider ethics as the appropriate theoretical and philosophical domain.
I will bring into the debate two relatively recent approaches to ethics: Jürgen Habermass discourse ethics (stemming from his critical theory); and the critical realist approach of Roy Bhaskar. These are interesting for several reasons: they both draw on traditional ethical theories, although different ones; they bring in innovations of practical relevance; and they both share an over-arching critical perspective. After a critical introduction to both ethical theories, their similarities and differences are explored. The article ends by considering the extent to which they may be practically useful within business.
Abstract
This paper reports on an innovative combination of hard and soft methods-soft systems methodology (SSM) with data envelopment analysis (DEA). Problems in defining and agreeing appropriate inputs and outputs for DEA led to the use of SSM as a way or producing a comprehensive and systemic database of performance indicators. The contributions of the paper are: the use of SSM to improve DEA specifications; conceptual clarifications within both SSM and DEA; and an innovative example of multimethodology. These developments are illustrated through a study evaluating the performance of the basic research institutes of the Chinese Academy of Sciences.
Abstract
This paper reports on an exploratory analysis of the behaviour of citations for management science papers over a fourteen year period. Citations often display s-curve type behaviour: beginning slowly, rising in response to previous citations, and then declining as the material becomes obsolete. Within the context of citation research such functions are known as obsolescence functions. The paper addresses three specific questions: i) can collections of papers from the same journal all be modelled using the same obsolescence function? ii) Can we identify specific patterns of behaviour such as sleeping beauties or shooting stars? iii) Can we predict the number of future citations from the pattern of behaviour in the first few years? Over 600 papers published in six leading management science journals are analysed using a variety of s-curves.
Abstract
This paper addresses the issue of truth and knowledge in management generally and knowledge management in particular. Based on ideas from critical realism and critical theory, it argues against the monovalent conceptualization of knowledge implicitly or explicitly held by many authors and aims instead to develop a characterization that recognises the rich and varied ways in which human beings may be said to know. It points out and conceptualises a fundamental dimension of knowledge that is generally ignored or cursorily treated within the literature, that is, truth. It identifies four forms of knowledge propositional, experiential, performative and epistemological and explores their characteristics, especially in terms of truth and validity. It points out some implications for knowledge management.
Abstract
The Co-Plot technique has become stereotyped in the form of a series of steps that are automatically followed with little regard for the characteristics of the data and the type of analysis it supports. While there are obvious extensions to this type of analysis, the methodology has remained unchanged over many years. Here we argue that the application of the Co-Plot to binary, nominal data, as is done in published papers, is inappropriate. We frame the Co-Plot in the general literature of multivariate analysis in order to show that it is a simplification of standard multivariate methods. We use a recently published example on mapping MBA programmes to show how a similar, although more statistically appropriate, analysis based on multidimensional scaling methods produces very different results.
Abstract
Creating rankings of academic journals is an important but contentious issue. It is of especial interest in the U.K. at this time (2007) as we are only one year away from getting the results of the next Research Assessment Exercise (RAE) the importance of which, for U.K. universities, can hardly be overstated. The purpose of this paper is to present a journal ranking for business and management based on a statistical analysis of the Harzing data set which contains 13 rankings. The primary aim of the analysis is two-fold to investigate relationships between the different rankings, including that between peer rankings and citation behaviour; and to develop a ranking based on four groups that could be useful for the RAE. Looking at the different rankings, the main conclusions are that there is in general a high degree of conformity between them as shown by a principal components analysis. Cluster analysis is used to create four groups of journals relevant to the RAE. The higher groups are found to correspond well with previous studies of top management journals and also gave, unlike them, equal coverage to all the management disciplines. The RAE Business and Management panel have a huge and unenviable task in trying to judge the quality of over 10,000 publications and they will inevitably have to resort to some standard mechanistic procedures to do so. This work will hopefully contribute by producing a ranking based on a statistical analysis of a variety of measures.
Abstract
The aim of this paper is to outline some of the key themes that I believe are important, first in applying the systems approach to produce high quality IS research in general, and second to consider more specifically some of the questions and debates that are of interest within the philosophy of IS and of the systems approach. Four themes are identified: being systemic, being critical and realist, being pluralist in approach, and having a concern for truth and knowledge.
Abstract
Management science was historically dominated by an empiricist philosophy that saw quantitative modelling and statistical analysis as the only legitimate research method. More recently interpretive or constructivist philosophies have also developed employing a range of non-quantitative methods. This has sometimes led to divisive debates. Critical realism has been proposed as a philosophy of science that can potentially provide a synthesis in recognizing both the value and limitations of these approaches. This paper explores the critical realist critique of quantitative modelling, as exemplified by multivariate statistics, and argues that its grounds must be re-conceptualised within a multimethodological framework.
Abstract
Citation rates are becoming increasingly important in judging the research quality of journals, institutions and departments, and individual faculty. This paper looks at the pattern of citations across different management science journals and over time. A stochastic model is proposed which views the generating mechanism of citations as a gamma mixture of Poisson processes generating overall a negative binomial distribution. This is tested empirically with a large sample of papers published in 1990 from six management science journals and found to fit well. The model is extended to include obsolescence, i.e., that the citation rate for a paper varies over its cited lifetime. This leads to the additional citations distribution which shows that future citations are a linear function of past citations with a time-dependent and decreasing slope. This is also verified empirically in a way that allows different obsolescence functions to be fitted to the data. Conclusions concerning the predictability of future citations, and future research in this area are discussed.
Abstract
Combinations of problem structuring methods with hard OR methodologies are seldom described in the literature. This paper will reflect on the barriers to such combinations that can be seen at the philosophical level-paradigm incommensurability-and cognitive level-type of personality and difficulty of switching paradigm. This paper examines the combination of Soft Systems Methodology and Discrete Event Simulation within an Intermediate Care case study. The paper will argue, by way of the practical application, that these problems are not insurmountable and that the result can be seen as interplay of the soft and hard paradigms. The idea of yin and yang is proposed as a metaphor for this process.
Abstract
This paper examines the application and usage of the idea of autopoiesis-a theory of living systems-within the context of viable systems theory. In recent years the term autopoiesis has extended beyond the domain of cellular biology where it originated and is now used extensively across a range of different disciplines, fields of enquiry, and professional practice. The paper seeks to provide clarification of a distinction between viable and autopoietic systems that appears to have become somewhat clouded as a result of the transfer of ideas and terminology from one domain to another.
Abstract
The paper begins by pointing out the diversity of philosophical positions within IS, and the range of reactions to this diversity. It then discusses problems within the underlying philosophies of science - particularly positivism and interpretivism. With this as a background, the paper proposes critical realism as an underpinning philosophy that has the potential to overcome both sets of difficulties. The theoretical arguments are practically illustrated by critiques of (positivist) statistical analysis and (interpretivist) soft systems methodology.
Abstract
The theory of autopoiesis, that is systems that are self-producing or self-constructing, was originally developed to explain the particular nature of living as opposed to non-living entities. It was subsequently enlarged to encompass cognition and language leading to what is known as second-order cybernetics. However, as with earlier biological theories, many authors have tried to extend the domain of the theory to encompass social systems, the most notable being Luhmann. The purpose of this paper is to consider critically the extent to which the theory of autopoiesis, as originally defined, can be applied to social systems-that is, whether social systems are autopoietic. And, if it cannot, whether some weaker version might be appropriate. It addresses this question by considering whether autopoiesis can be applied to the theoretical conceptions of Giddens and Bhaskar. It follows an earlier paper that evaluated Luhmann's autopoietic social theory.
Abstract
This paper presents a personal overview of the history of the IS discipline over the last twenty years. It highlights two particular strands of development over which there has been much controversy the so-called paradigm wars which were an epistemological battle between positivism and interpretivism; and the related debate over a critical approach to information systems. It is argued that the battle has died down and a period of stability has emerged. But further development needs to occur, especially in the area of critical management, and the philosophy of critical realism can be a significant way forward.
Abstract
This paper provides a review and evaluation of the use of problem structuring methods (PSMs) in practice. It starts by describing the origins of problem structuring methods, the type of problem situation for which they are suitable, and the characteristics of some leading methods. An overview of the practice of PSMs is provided from a number of angles, including case studies and surveys of applications. A number of issues in the application of PSMs are discussed, in particular an account of the debate about evaluation of the success of PSMs; the selection of an appropriate method; multimethodology; and a variety of aspects of the maintenance of relationships with the client organisation(s). Finally, some possible future developments are suggested, especially through productive interactions with similar or related practices.
Abstract
It has commonly been argued that the use of different research methods within the IS discipline and within individual pieces of research will produce richer and more reliable results. This paper reports on a survey of the IS literature to discover the extent of multimethod research. The findings are that such work is relatively scarce, and where it occurs involves only a small set of traditional methods. Possible reasons for this are discussed.
Abstract
Abstract: This paper presents a framework within which to examine and compare the main philosophical assumptions underpinning management science methods. It takes the position that they all have in common the basic mechanism of modelling, but that they differ in terms of what they model (ontology), how they model (epistemology), and why they model (axiology). A wide range of both hard and soft methods and methodologies ace categorised within the paper. One of the purposes of the framework is to assist in the process of multimethodology-that is, combining together several methods in an intervention. In particular, it will assist users in understanding both the implicit or explicit assumptions underlying methods, and their principle aims and purposes, in order to be able to make more informed and critically aware choices when designing particular combinations in practice.
Abstract
Abstract: OR/MS is under pressure in MBA programs in the United Kingdom as it is in the United States. To ensure its continuance, members of the operational research group at Warwick Business School redesigned the core OR/MS module. The first attempt at a redesign was a failure. As a result, the module was redesigned again. The second version was a success. Through this process, we have learned many lessons about teaching OR/MS to MBA students, among them the need to have a guiding philosophy, adopt a critical-consumer approach, stress managerial relevance, discuss the context and process of modeling as well as content, and use spreadsheets for analytical work.
Abstract
This paper goes behind the scenes, from the authors point of view, in the messy process of publishing papers in top quality journals. It describes the tortuous history of a particular paper that was eventually published in Information Systems Research to provide some insight, especially for those new to the academic world. It goes on to draw more general guidelines for shaping papers for publication.
Abstract
The theory of autopoiesis, that is systems that are self-producing or self-constructing, was originally developed to explain the particular nature of living as opposed to non-living entities. It was subsequently enlarged to encompass cognition and language leading to what is known as second-order cybernetics. However, as with earlier biological theories, many authors have tried to extend the domain of the theory to encompass social systems, the most notable being Luhmann. The purpose of this article is to consider critically the extent to which the theory of autopoiesis, as originally defined, can be applied to social systems - that is, whether social systems are autopoietic. And, if it cannot, whether some weaker version might be appropriate.
Abstract
There is now a vast range of techniques and methodologies, both hard and soft, available to the OR/MS practitioner. After a period of concern about methodology choice, ie 'which method when', we are now moving towards a pluralistic approach of combining together several methods within an intervention-multimethodology. This paper reports on a survey of OR/MS practitioners to discover the extent of multimethodology usage and which particular combinations are most commonly utilised.
Abstract
This paper puts forward arguments in favor of a pluralist approach to IS research. Rather than advocating a single paradigm, be it interpretive or positivist, or even a plurality of paradigms within the discipline as a whole, it suggests that research results will be richer and more reliable if different research methods, preferably from different (existing) paradigms, are routinely combined together. The paper is organized into three sections after the Introduction. In 2, the main arguments for the desirability of multimethod research are put forward, while 3 discusses its feasibility in theory and practice. 4 outlines two frameworks that are helpful in designing mixed-method research studies. These are illustrated with a critical evaluation of three examples of empirical research.
Abstract
Many issues are under debate as to the philosophical nature of OR/MS: is it science or technology? Is it natural or social science? Can it be realist as well as being interpretivist? There are also many debates within the philosophy of science itself. This paper proposes that a particular account of the philosophy of science, known as 'critical realism', is especially suitable as an underpinning of OR/MS. The structure of the argument of this paper is to outline the main positions within the philosophy of science and highlight their problems, especially from the point of view of OR/MS; then to introduce critical realism and to show how it addresses these problems and how it is particularly appropriate for OR/MS; and finally to illustrate this by considering examples of various practical OR methods.
Abstract
This paper, part of the Festschrift for Peter Checkland, provides an outline of the history and development of soft systems methodology. It includes a personal reflection on my experiences of SSM, as well as a more objective evaluation of its achievements and limitations.
Abstract
Some observers have expressed concern over the state of the OR/MS profession, especially as to its
failure to tackle complex, messy problems. One response has been to develop various ``soft'' methods
(also called ``problem structuring methods'') that focus on the human and political aspects of OR/MS
interventions. Recent work, both theoretical and practitioner-based, involves the combination of several
methods in a particular project (multimethod). Often the combination includes both hard (quantitative)
and soft (qualitative) approaches. This paper illustrates the utility of soft methods, and in particular
their combination, with recently published case studies. It then proposes an approach to the process of
combining methods, including several frameworks and techniques to assist in selecting and linking
di?erent methods. Finally, it discusses future research in this field
Abstract
Developing our students' abilities to be critical is important but what does it mean to be critical? It is just the cognitive skills of critical thinking or should it involve more radical re-examination of management knowledge and practice from a Foucauldian or Habermasian perspective? This article addresses the issue of what it is to be critical by reflecting on the development of an innovative core course for final year management students concerned with critical management issues. The first section outlines the specific educational context and the structure of the course as a whole. Then the article explains the underlying theoretical framework that was developed which identified four aspects of being critical-scepticism towards rhetoric, tradition, authority, and objectivity. The teaching material associated wit this part of the course is discussed next. This looks at two real situations, one the debacle of the Taurus stock exchange system, and the other an ongoing legal case concerning racial discrimination that is being documented on the web. The article concludes with a more theoretical discussion of the relation between this particular course and critical management more generally.
Abstract
This paper considers the relations between information and meaning, as generated through the interactions of individuals, and communication, at the level of society, from an autopoietic perspective. It draws on earlier work concerning first, the nature of information and its relation to meaning via embodied cognition; and, second, a classification of organizationally closed, or self-referential, systems. The contribution made in this paper is to link these analyses at the level of the individual up to the social system of communication (based on Luhmann's work) utilising structuration theory.
Abstract
This paper presents a critical evaluation of the impact of Maturana's constructivist approach to (systemic) family therapy. After an historical introduction and a brief description of the main ideas, a number of criticisms are considered. These concern the radical antirealist epistemology, and problems in dealing with the social context of the family and power relations within the family.
Abstract
In recent years the predilection for Systems/OR practice to be underpinned by a single methodology has been called into question, and reports on multimethodology projects are now filtering through into the literature, This paper takes a closer look at multimethodology, It outlines a number of different possibilities for combining methodologies, and considers why such a development might be desirable for more effective practice, in particular by focusing upon how it can deal more effectively with the richness of the real world and better assist through the various intervention stages, The paper outlines some of the philosophical, cultural and cognitive feasibility issues that multimethodology raises, It then describes a framework that can attend to the relative strengths of different methodologies and provide a basis for constructing multimethodology designs. Finally it presents a systematic way of decomposing methodologies to identify detachable elements, and the paper concludes by outlining aspects of an agenda for further research that emerges out of the discussion,
Abstract
Information is fundamental to the discipline of information systems, yet there is little agreement about even this basic concept Traditionally, information has been seen as 'processed data,' while more recently soft, interpretive approaches have taken information to be 'data plus meaning.' This paper provides a coherent and consistent analysis of data, information, meaning and their interrelations. It is particularly concerned with the semantic and pragmatic dimensions of information, and integrates the work of Maturana and Habermas into a framework provided by Dretske's theory of semantic information. The results show that meaning is generated from the information carried by signs. Information is objective, but inaccessible to humans, who exist exclusively in a world of meaning. Meaning is intersubjective - that is, based on shared agreement and understanding - rather than purely subjective. information, and information processing systems, exist within the wider context of meaning or sense-making and the IS discipline needs take account of this.
Abstract
This paper describes an algorithm for classifying elements with binary valued attributes so that the classes are similar. The problem chosen for discussing is that of allocating students to groups within an educational setting. Individual students are described by a set of binary-valued attributes. The objective of the algorithm is to create working groups which are similar to each other in terms of their mix of student attributes. The algorithm uses an information theory measure. The paper also compares the performance of the algorithm to a goal programming formulation of the problem
Abstract
Zeleny and Hufford apply the concept of autopoiesis to three different classes of systems-biological, chemical, and social. My response is concerned with the latter and in particular with Zeleny and Hufford's claims that social systems are autopoietic and that autopoietic systems are inherently social. I argue that these claims are quite ill-founded. There are a number of general weaknesses with Zeleny and Hufford's paper, but, most importantly, the authors fail to see major problems in the ascription of autopoiesis to social systems. These problems are outlined, and the responses of other writers such as Maturana, Varela, and Luhmann are explored. Finally, the importance of and problems with Maturana's and Varela's work is assessed.
Abstract
For much of its history management science had a quantitative and technical emphasis. More recently, there has been a move towards more subjective approaches such as 'soft OR' and 'soft systems'. Currently, there is interest in 'critical management science' drawing on critical theory, particularly the work of Habermas. This paper reviews developments in critical management science, in particular critiques of traditional and 'soft' management science; Jackson and Keys' system of systems methodology; critical management science methodologies and the problem of power in bringing about change; and the postmodernist critique.
Abstract
There has been, and still is, an important debate between critical systems and soft (interpretive) systems concerning epistemology and ontology. Flood and Ulrich argued for a position they termed critical idealism, but this has been contested by Fuenmayor, who proposed that critical systems was unnecessary since phenomenology provided the necessary and sufficient form of critique. This paper, in turn, argues for critical systems, providing a critique of phenomenology which shows that at least three of its own presuppositions are invalid. It is further suggested that an adequate philosophy for critical systems has not yet emerged and that the cognitive autopoietic theories of Maturana and the critical realism of Bhaskar will be important strands in its development.
Abstract
This paper reports the results of a survey intended to discover the extent to which Checkland's Soft Systems Methodology (SSM) is used in practice. Some 300 questionnaires were sent to people who had had some exposure to SSM and, surprisingly, nearly half were returned. The majority described in detail their uses of SSM and most felt that it had been successful. This paper describes the overall quantitative results from the survey as well as presenting a qualitative analysis of the experiences of using SSM
Abstract
Maturana and Varela developed the concept of autopoiesis to explain the phenomena of living organisms. They went further and postulated theories concerning the nervous system and the development of cognition. These theories have radical conclusions concerning human thought, language, and social activity. This paper aims to introduce these ideas and to explore the main implications. It also discusses the application of these cognitive theories in three separate domains-computer systems design, family therapy, and the Law.
Abstract
This paper presents the results of a survey of practising OR groups in UK organizations. The survey was conducted as part of the review procedures of Warwick University's MSc. in Operational Research. The aim was to elicit the views of OR practitioners as to the desirable content of such a course. The questionnaire was sent to 66 OR groups, of which 45 responded, and covered 75 different topics. As well as presenting the basic results, this paper explores the structure of the responses using factor analysis and attempts to classify the OR groups using cluster analysis. Comparisons are drawn with previous surveys and with the SERC OR panel recommendations
Abstract
Maturana and Varela have developed important theories about living systems (autopoiesis) and also about the brain/nervous system and cognition. These theories have strongly subjectivist implications leading to the view that our explanations and descriptions reflect the structure of the subject, rather than that of an objective world, and that we therefore construct the world which we experience. This paper analyzes Maturana's ideas in terms of the main philosophical traditions empiricism, idealism, and realism showing that they are a blend of both realist and antirealist positions. It then provides a critique of Maturana's radical subjectivism and argues that his theory is best seen as compatible with critical realism.
Abstract
One approach to induction is to develop a decision tree from a set of examples. When used with noisy rather than deterministic data, the method involve-three main stagescreating a complete tree able to classify all the examples, pruning this tree to give statistical reliability, and processing the pruned tree to improve understandability. This paper is concerned with the first stage tree creation which relies on a measure for goodness of split, that is, how well the attributes discriminate between classes. Some problems encountered at this stage are missing data and multi-valued attributes. The paper considers a number of different measures and experimentally examines their behavior in four domains. The results show that the choice of measure affects the size of a tree but not its accuracy, which remains the same even when attributes are selected randomly.
Abstract
This paper compares five methods for pruning decision trees, developed from sets of examples. When used with uncertain rather than deterministic data, decision-tree induction involves three main stagescreating a complete tree able to classify all the training examples, pruning this tree to give statistical reliability, and processing the pruned tree to improve understandability. This paper concerns the second stagepruning. It presents empirical comparisons of the five methods across several domains. The results show that three methodscritical value, error complexity and reduced errorperform well, while the other two may cause problems. They also show that there is no significant interaction between the creation and pruning methods.
Abstract
Maturana and Varela have developed a theory to explain the particular character of living systems. Such systems, they claim, have an autopoietic, or self-producing, organization. This term is now used widely, although often without a proper understanding of the detail of the theory. Moreover, the concept has been applied to other systems, such as societies and institutions, in a rather naïve manner. It is a very important theory, with far-reaching consequences both for science and for social intervention, but it must be correctly appreciated and applied. The aim of this paper is to aid that process by, first, elucidating the theoretical ideas and, second, critically evaluating its implications and applications.
Abstract
In Towards a tool kit for the systems analyst, Benyon and Skidmore discuss various approaches to systems analysis and include a comparison of De Marco's data flow diagrams and Checkland's conceptual models. This note compares the two in greater detail and concludes that the underlying methodologies are much further apart than Benyon and Skidmore
Abstract
The systems approach, or systems thinking, has been intimately connected with the development of OR and management science initially through the work of founders such as Churchman and Ackoff and latterly through innovations such as soft systems. In this paper we have undertaken a review of the contribution that systems thinking has been making more recently, especially to the practice of OR. Systems thinking is a discipline in its own right, with many theoretical and methodological developments, but it is also applicable to almost any problem area because of its generality, and so such a review must always be selective. We have looked at the literature from both a theoretical and an applications orientation. In the first part we consider the main systems theories and methodologies in terms of their recent developments and also their applications. This covers: the systems approach, complexity theory, cybernetics, system dynamics, soft OR and PSMs, critical systems and multimethodology. In the second part we review the main domains of application: strategy, information systems, organisations, production and operations, ecology and agriculture, and medicine and health. Our overall conclusion is that while systems may not be well established institutionally, in terms of academic departments, it is incredibly healthy in terms of the quantity and variety of its applications.
Abstract
This article takes a critical realist perspective to understand the research-practice gap in the field of business and management. To investigate issues surrounding the rigour versus relevance debate, we examine how the divergent perspectives of scholars and practitioners can be bridged by a critical realist approach in relation to: (1) the research paradigm: instead of confining their research within methodological purism, scholars may need to deploy any research paradigm to investigate a phenomenon in its context, (2) context and causality: critical realism provides an ontological grounding for interpretivist research reaffirming the importance of a focus on context, meaning and interpretation as causal influences, (3) methodological rigidity: multiple research methods will be more important when addressing research-practice gaps since they are more receptive to interdisciplinary functions and contexts in time and space than traditional methodologies, and (4) ethical aspects of business research highlighting the need to engage with the knowledge agenda of not only the university but also society overall. The critical nature of management studies we contend also helps to explain why at least certain research-practice gaps can be treated as natural because of divergent preferences of scholars and practitioners.
Abstract
Until recently, businesses and corporations could argue that their only real commitments were to maximise the return to their shareholders whilst staying within the law. However, the world has changed significantly during the last ten years and now most major corporations recognise that they have significant responsibility to local and global societies beyond simply making profit. This means that there is now an increasing concern with the question of how corporations, and their employees, ought to behave, and this leads us to consider ethics as the appropriate theoretical and philosophical domain. I will bring into the debate two relatively recent approaches to ethics: Jürgen Habermass discourse ethics (stemming from his critical theory); and the critical realist approach of Roy Bhaskar. These are interesting for several reasons: they both draw on traditional ethical theories, although different ones; they bring in innovations of practical relevance; and they both share an over-arching critical perspective. After a critical introduction to both ethical theories, their similarities and differences are explored. The article ends by considering the extent to which they may be practically useful within business.
Abstract
The number of citations is becoming an increasingly popular index for measuring the impact of a scholars research or the quality of an academic department. One obvious question is: what are the factors that influence the number of citations that a paper receives? This study investigates the number of citations received by papers published in six well-known management science journals. It considers factors that relate to the author(s), the article itself, and the journal. The results show that the strongest factor is the journal itself; but other factors are also significant including the length of the paper, the number of references, the status of the first authors institution, and the type of paper, especially if it is a review. Overall, this study provides some insights into the determinants of a papers impact that may be helpful for particular stakeholders to make important decisions.
Abstract
With globalization, environmental problems and significant failures in corporate governance, business ethics is perceived to be of increasing importance. This is particularly so for IS because of the huge social effects of new technologies. Yet there has been relatively little discussion of ethics in the IS literature and no clear consensus has emerged. This paper argues that Habermass discourse ethics can make a major, and practical, contribution. After outlining some major ethical theories and how they have been interpreted in business ethics and IS, the paper details the development of discourse ethics. Discourse ethics is different from other approaches to ethics as it is grounded in actual debates between those affected by decisions and proposals. Recognizing that the theory is rather abstract, the final section discusses how it can be pragmatized, with the help of existing soft and critical methodologies, to become a basis for business and IS ethics.
Abstract
There is an increasing emphasis on the use of metrics for assessing the research contribution of academics, departments, journals or conferences. Contribution has two dimensions: quantity which can be measured by number/size of the outputs, and quality which is most easily measured by the number of citations. Recently, Hirsch proposed a new metric which is simple, combines both quality and quantity in one number, and is robust to measurement problems. This paper applies the h-index to three groups of management academics BAM Fellows, INFORMS Fellows, and members of COPIOR in order to evaluate the extent to which the h-index would serve as a reliable measure of the contribution of researchers in the management field.
Abstract
This paper reports on an exploratory analysis of the behaviour of citations for management science papers over a fourteen year period. Citations often display s-curve type behaviour: beginning slowly, rising in response to previous citations, and then declining as the material becomes obsolete. Within the context of citation research such functions are known as obsolescence functions. The paper addresses three specific questions: i) can collections of papers from the same journal all be modelled using the same obsolescence function? ii) Can we identify specific patterns of behaviour such as sleeping beauties or shooting stars? iii) Can we predict the number of future citations from the pattern of behaviour in the first few years? Over 600 papers published in six leading management science journals are analysed using a variety of s-curves.
Abstract
Citation rates are becoming increasingly important in judging the research quality of journals, institutions and departments, and individual faculty. This paper looks at the pattern of citations across different management science journals and over time. A stochastic model is proposed which views the generating mechanism of citations as a gamma mixture of Poisson processes generating overall a negative binomial distribution. This is tested empirically with a large sample of papers published in 1990 from six management science journals and found to fit well. The model is extended to include obsolescence, i.e., that the citation rate for a paper varies over its cited lifetime. This leads to the additional citations distribution which shows that future citations are a linear function of past citations with a time-dependent and decreasing slope. This is also verified empirically in a way that allows different obsolescence functions to be fitted to the data. Conclusions concerning the predictability of future citations, and future research in this area are discussed.