# Stackelberg Leader Follower Models Computer Science Essay

Published:

This essay has been submitted by a student. This is not an example of the work written by our professional essay writers.

This paper reviews some Stackelberg Leader-Follower models used for strategic decision making. The simple Stackelberg duopoly is looked at first, and a generalisation of the Stackelberg duopoly problem is given. By studying the models by Murphy et al. (1983) and Smeers and Wolf (1997), the paper reviews Stackelberg model from its classical form to the recent stochastic versions. The paper looks at the mathematical formulation of both a nonlinear mathematical programming model and a nonlinear stochastic programming model. Towards the end of this paper, a simple numeric example is given and practical applications of Stackelberg Leader-Follower models are discussed.

In economics, an oligopoly is considered to be the most interesting and complex market structure (amongst other structures like monopolies and perfect competition). Most industries in the UK and world- from retailing to fast food, mobile phone networks to professional services- are oligopolistic. Given the current financial climate, it is imperative for firms to be sure that they make decisions accurately, maximising not only their profit, but also their chances of remaining competitive. Many mathematicians and economists have attempted to model the decision making process and profit maximizing strategies of oligopolistic firms. For example, A. A. Cournot was one of the first mathematicians to model the behaviours of monopolies and duopolies in 1838. In Cournot's model both firms choose their output simultaneously assuming that the other firm does not alter its output (Gibbons, 1992). Later, in 1934, H. V. Stackelberg proposed a different model where one of the duopoly firms makes its output decision first and the other firm observes this decision and sets its output level (Stackelberg, 1934).

The classical Stackelberg model has been extended to model a variety of strategic decision making. For example, Murphy et al. (1983) model the output decision making process in an oligopoly. Later works by Smeers and Wolf (1997) extend this model to include a stochastic element. More interestingly, in a model by He et al. (2009), the Stackelberg theory is used to model the interaction between a manufacturer and a retailer when making decisions about cooperative advertising policies and wholesale prices.

The objective of this paper is to review the Stackelberg models from its classic form to the more recent stochastic versions. In chapter 2, the simple Stackelberg duopoly is reviewed and a generalisation of the Stackelberg duopoly problem is given. In chapter 3, more complicated and recent models are reviewed. The mathematical formulation of Murphy et al.'s (1983) and Smeers and Wolf's (1997) model is given. At the end of chapter 3, a numerical example is applied to Smeers and Wolf's (1997) model. In chapter 4, practical applications of Stackelberg leader-follower models are discussed. Chapter 4 also looks at the drawbacks of and possible extensions to Stackelberg models. Appendix 1 explains the Oligopoly market structure and economics involved in profit maximisation.

## Chapter 2: Classical Stackelberg Leader-Follower Model

## 2.1 Duopoly Behaviour

Stackelberg (1934) discussed price formation under oligopoly by looking at the special case of a duopoly. He argued that firms in a duopoly can behave either as dependent on or independent of the rival firm's behaviour:

Referring to the two firms as firm 1 and firm 2, respectively, firm 1's behaviour can be generalised as follows:

Firm 1 views the behaviour of firm 2 as being independent of firm 1's behaviour. Firm 1 would regard firm 2's supply as a given variable and adapts itself to this supply. Thus, the behaviour of firm 1 is dependent on that of firm 2 (Stackelberg, 1934).

Firm 1 can view the behaviour of firm 2 as being dependent on firm 1's behaviour. Thus, firm 2 always adapts itself to the former's behaviour (firm 2 views firm 1's behaviour as a given situation) (Stackelberg, 1934).

However, according to Stackelberg (1934), there is a difference in the firms' actual positions; each of the firms could adapt to either of these two positions, making price formation imperfect. Stackelberg (1934) describes three cases that arise from this situation:

Bowler (1924) first described a situation when both firms in the duopoly strive for market dominance. According to Bowler (1924), for this to happen the first firm supplies the quantity it would if it dominated the market with the second firm as a follower. This supply is referred to as the "independent supply". By supplying this output level the first firm tries to convince the second firm to view its behaviour as a given variable. However, the second firm also supplies the "independent supply" since it is also striving for market dominance. This duopoly is referred to as the Bowler duopoly with total supply of the duopoly equalling the sum of two "independent supply". According to Stackelberg (1934), the price formation under the Bowler duopoly is unstable because neither of the firms tries to maximise profit "under the given circumstance".

The second case described by Stackelberg (1934) is a situation where both firms favour being dependent on the other firm's behaviour. The first firm would have to match (in a profit maximising manner) its output level to the each output in the second firm's feasible set of output. The second firm does the same and both firms are thus followers. This is a Cournot duopoly, first described by A. A Cournot in 1838. According to Stackelberg 1934, the price formation here is unstable because neither of the firms tries to achieve the largest profit "under the given circumstance".

The third case is a situation where one firm strives for independence and the other favour being dependent. In this case both firms are better off doing what the other firm would like. Both firms adapt their behaviour to maximising profit under the given circumstance. This situation is referred to as the asymmetric duopoly or more commonly as the Stackelberg duopoly. The price formation is more stable in this case because, according to Stackelberg (1934), "no one has an interest in modifying the actual price formation".

The Stackelberg model is based on the third case of a Stackelberg duopoly.

## 2.2 The Model

In the Stackelberg duopoly the leader (Stackelberg firm) moves first and the follower moves second. As opposed to other models like the Bertrand model and Cournot model where firms make decisions about price or output simultaneously, firms in the Stackelberg duopoly make decisions sequentially.

The Stackelberg equilibrium is determined using backwards induction (first determine the follower firm's best response to an arbitrary output level by the Stackelberg firm). According to Gibbons (1992), information is an important element of the model. The information in question is the Stackelberg firm's level of output (or price, Dastidar (2004) looks at Stackelberg equilibrium in price). The follower firm would know this output once the Stackelberg firm moves first and, as importantly, the Stackelberg firm knows that the follower firm will know the output level and respond to it accordingly.

Inspired by the work of Gibbons (1992), Murphy et al. (1983) and Dastidar (2004), a general solution to the Stackelberg game (duopoly) is derived in the parts that follow.

## 2.2.1 Price function, cost functions, and profit functions

Suppose that two firms in a duopoly supply a homogeneous product.

Denote the demand function of this market as, where is the total level of output supplied by the duopoly (is the Stackelberg firm's output level and is the follower firm's output level). The price function can be re-written as.

Denote the cost functions (Appendix 1) as for the Stackelberg firm, and for the follower firm.

The profit function of the Stackelberg firm is given by:

Similarly, the profit function of the follower firm is given by:

## 2.2.2 Backward induction to derive the best response functions and Stackelberg equilibrium

According to Gibbons (1992), the best response for the follower will be one that maximises its profit given the output decision of the Stackelberg firm.

The follower's profit maximisation problem can be written as:

This can be solved by differentiating the objective function and equating the differential to zero (as seen in Appendix 1).

Using chain rule to differentiate equation [2] and setting the differential to zero, the following result is obtained:

Note that this is a partial differentiation of the profit function since the function depends on the demand function which depends on two variables. Equation [4] gives the follower's best response function. For a given the best response quantity satisfies equation [4]. As a result, the Stackelberg firm's profit maximisation problem becomes:

By differentiating the objective function in equation [5] and equating the differential to zero, the following result which maximises the Stackelberg firm's profit is obtained:

By solving equation [6] with the follower firm's best response profit maximising output, is obtained by the Stackelberg firm given the follower's best response. Gibbons (1992) describes as the Stackelberg equilibrium (or the Nash equilibrium of the Stackelberg game).

## 2.2.3 Example

Gibbons (1992) considers a simple duopoly selling homogeneous products. He assumes that both firms are identical and the marginal cost of production is constant at. He also assumes that the market faces a linear downward sloping demand curve. The profit function of the firms is given by:

where, with representing the Stackelberg firm and representing the follower firm.

Using backward induction, the follower firm's best response function is calculated:

Solving equation [8]:

The Stackelberg firm anticipates that its output will be met by the follower's response. Thus the Stackelberg firm maximises profit by setting output to:

Solving equation [10]:

Substituting this in equation [9]:

Equations [11] and [12] give the Stackelberg equilibrium. The total output in this Stackelberg duopoly is.

Note: Gibbons (1992) worked out the total output in a Cournot duopoly to be (using this example) which is less than the output in the Stackelberg duopoly; the market price is higher in the Cournot duopoly and lower in the Stackelberg duopoly. Each firm in the Cournot duopoly produces; the follower is worse off in the Stackelberg model than in the Cournot model because it would supply a lower quantity at a lower market price. Clear, there exists a first mover advantage in this case.

In general, according to Dastidar (2004), first advantage is possible if firms are identical and if the demand is concave and costs are convex. Gal-or (1985) showed that first mover advantage exists if the firms are identical and have identical downward sloping best response functions.

## Chapter 3: Recent Stackelberg Leader-Follower Models

The classical Stackelberg model has been an inspiration for many economists and mathematicians. Murphy et al. (1983) extend the Stackelberg model to an oligopoly. Later, Smeers and Wolf (1997) extended Murphy et al.'s model to a stochastic version where demand is unknown when the Stackelberg firm makes its decision. In a more recent report by DeMiguel and Xu (2009) the Stackelberg problem is extended to an oligopoly with multi-leaders.

In this section the models proposed by Murphy et al. (1983) and Smeers and Wolf (1997) are reviewed.

## 3.1 A Nonlinear Mathematical Programming Version

The model proposed by Murphy et al (1983), is a nonlinear mathematical programming version of the Stackelberg model. In their model, they consider the supply side of an oligopoly that supplies homogeneous product. The model is designed to model output decisions in a non-cooperative oligopoly.

There are followers in this market who are referred to as Cournot firms (note that from now onwards the follower firms are referred to as Cournot firm as opposed to just follower firms) and leader who is referred to as the Stackelberg firm (as before). The Stackelberg firm considers the reaction of the Cournot firms in its output decision and sets its output level in a profit maximising manner. The Cournot firms, on the other hand, observe the Stackelberg firm's decision and maximise their individual profits by setting output under the Cournot assumption of zero conjectural variations (Carlton and Perloff, 2005, define conjectural variation are expectations made by firms in an oligopolistic market about reactions of the other firm). It is assumed that all the firms have complete knowledge about the other firms.

## 3.1.1 Notations and assumptions

For each Cournot firm, let represent the output level. For the Stackelberg firm, let represent the output level (note that is used here instead of, as seen earlier, to distinguish the Stackelberg firm from the Cournot firms).

is the total cost function of level of output by Cournot firms and is the total cost function of level of output by the Stackelberg firm.

Let represents the inverse market demand curve (that is, is the price at which consumers are willing and able to purchase units of output).

In addition to the Cournot assumption and assumption of complete knowledge, Murphy et al. (1983) make the following assumption:

and are both convex and twice differentiable.

is a strictly decreasing function and twice differentiable which satisfies the following inequality,

There exists a quantity (the maximum level of output any firm is willing to supply) such that,

For referencing, these set of assumption will be referred to as Assumption A.

Assumption 2 implies that the industry's marginal revenue (Appendix 1) decreases as industry supply increases. A proof of this statement can be found in the report by Murphy et al. (1983).

Assumption 3 implies that at output levels the marginal cost is greater than the price.

## 3.1.2 Stackelberg-Nash-Cournot (SCN) equilibrium

The Stackelberg-Nash-Cournot (SCN) equilibrium is derived at in a similar way to the Stackelberg equilibrium seen in chapter 2.

Using backward induction, Murphy et al. (1983) first maximise the Cournot firms' profit under the assumption of zero conjectural variation and for a given.

For each Cournot firm let the set of output levels be such that, for a given and assuming are fixed, solves the following Cournot problem:

According to Murphy et al. (1983), the objective function in equation [15] is a strictly convex profit function over the closed, convex and compact interval. This implies that a unique optimum exists.

The functions can be referred to as the joint reaction functions of the Cournot firms. Murphy et al. (1983) define the aggregate reaction curve as:

The Stackelberg problem can be written as:

If solves, then the set of output levels is the SNC equilibrium with

To get this equilibrium, the output levels need to be determined. Murphy et al. (1983) use the Equilibrating program (a family of mathematical programs designed to reconcile the supply-side and demand-side of a market to equilibrium) to determine:

Let the Lagrange multiplier associated with the maximisation problem [19] be. Murphy et al.'s (1983) approach here is to determine for which the optimal. The following result, obtained from Murphy et al. (1983), defines the optimal solution to problem [19]:

Theorem 1: For a fixed, consider Problem suppose that satisfy Assumption A. Denote by the unique optimal solution to and let be the corresponding optimal Lagrange Multiplier associated with problem [19]. (In case since alternative optimal multipliers associated with problem [19] exist, let be the minimum non-negative optimal Lagrange Multiplier.) Then,

is a continuous function of for.

is a continuous, strictly decreasing function of. Moreover, there exist output levels and such that and .

A set of output levels optimal to Problem, where, satisfy the Cournot Problem [15] if and only if, whence, for.

(This theorem is taken from Murphy et al. (1983) with a few alterations to the notation)

The proof of this result can be found in the report by Murphy et al. (1983).

This theorem provides an efficient way of finding for each fixed. For example, one can simple conduct a univariate bisection search to find the unique root of.

## 3.1.3 Properties of and

Murphy et al. (1983) describes the aggregate Cournot reaction curve as follows:

is a continuous, strictly decreasing function of.

If the right hand derivative of with respect to is denoted as (the rate of increase of with an increase in ), then for each :

The proof to these two properties can be found in the report by Murphy et al. (1983).

Murphy et al. (1983) state that if solves the Stackelberg problem [17], then the profit made by the Stackelberg firm is greater than or equal to the profit it would have made as a Cournot firm. Suppose that is a Nash-Cournot equilibrium for the firm oligopoly. is the output the "Stackelberg" firm would supply if it was a Cournot firm. solves:

But since solves the Stackelberg problem [17], the following must hold:

In fact, is the lower bound of. The proof to this can be found in Murphy et al. (1983)

From assumption 3 in Assumption A, it is clear that. Thus, it is clear that is an upper bound. However, according to Murphy et al. (1983) another upper bound exists. In a paper by Sherali et al. (1980) on the Interaction between Oligopolistic firms and Competitive Fringe (a price taking firm in an oligopoly that competes with dominant firms) a different follower-follower model is discussed. In this model, the competitive fringe is content at equilibrium to have adjusted its output to the level for which marginal cost equals price. Murphy et al. (1983) summarise this model as follows:

For fixed and suppose is a set of output levels such that for each firm solves:

and

For the "Stackelberg firm", let satisfy:

In addition to Assumption A, if is strictly convex, then a unique solution exists and satisfies conditions [23] and [24]. The Equilibrating Program with a fringe becomes:

Theorem 1 holds for with and which implies that. In fact, if is strictly convex, is the upper bound of.

Collectively, is bounded as follows:

## 3.1.4 Existence and uniqueness of the Stackelberg-Nash-Cournot equilibrium

Murphy et al. (1983) prove the existence and uniqueness of the Stackelberg-Nash-Cournot (SCN) equilibrium. Their approach to the proof is summarised below:

## Existence

For the SNC equilibrium to exist, and for should satisfy Assumption A.

Since is bounded and is continuous (as is continuous), the Stackelberg problem [17] involves the maximisation of a continuous objective function over the compact set. This implies that an optimal solution exists. From Theorem 1 it is seen that a unique set of output levels, which simultaneously solves the Cournot problem [15], exists. As a result the SNC equilibrium exists.

## Uniqueness

If is convex, then the equilibrium is unique.

Since is convex, the objective function of the Stackelberg problem [17] becomes strictly concave on. This has been proven by Murphy et al. (1983) and the proof can be found in their report. This implies the equilibrium is unique.

## 3.1.5 Algorithm to solve the Stackelberg problem

Murphy et al. (1983) provide an algorithm in their report to solve the Stackelberg problem. This algorithm is summarised as follows:

To start with the Stackelberg firm needs the following information about the market and the Cournot firms:

Cost functions of the Cournot firms, satisfying Assumption A.

The upper bound as per Assumption A.

The inverse demand function for the industry, which also satisfies Assumption A.

With this information, the Stackelberg firm need to determine the lower bound and split the interval into grid points with, where and (from [26]). A piecewise linear approximation of is made as follows:

Here,

is an approximation to and from equation [20] it follows that:

Note that at each grid point the approximation agrees with.

The Stackelberg problem [17], thus, becomes:

can be re-written as:

Where and

Thus problem [30] becomes:

The objective function is strictly concave and solvable.

Let be the objective function of the Stackelberg problem [17] and the objective function of the piecewise Stackelberg problem [32], then:

Suppose is the optimum level of output. First, suppose that is an endpoint of the interval, then. Now suppose that, that is, . Then needs to be evaluated in order to determine. Theorem 1 can be used here. Recall that is a continuous, decreasing function of. To find the point where (part iii of Theorem 1), the following method is suggested by Murphy et al. (1983):

Figure 1: Method for determining

Source: Smeers and Wolf (1997) (alterations made to the notation)

First determine using the bounds. Next, determine using the bounds. Then determine using the bounds.Next, determine using the bounds and so on. If then evaluate using the bounds.

Having evaluated for some grid points, the game can either be terminated with the best of these grid points as an optimal solution or the grid can be redefined at an appropriate region to improve accuracy.

Murphy et al. (1983) go on to determine the maximum error from the estimated optimal Stackelberg solution. This is summarised below:

Let be the derivative of with respect to , then:

Let be the marginal profit made by the Stackelberg firm for supplying units of output,

Let be the actual optimal objective function value in the interval with the estimate being . Then the error of this estimate is defined as:

satisfies the following:

This concludes the review of Murphy et al.'s (1983) nonlinear mathematical programing model of the Stackelberg problem in an oligopoly.

## 3.2 A Stochastic Version

Smeers and Wolf (1997) provide an extension to the nonlinear mathematical programming version of the Stackelberg model by Murphy et al. (1983) discussed in subsection 3.1. In the same way as Murphy et al.'s (1983) model, the Stackelberg game in this version is played in two stages. In the first stage, the Stackelberg firm makes a decision about its output level. In the second stage, the Cournot firms, having observed the Stackelberg firm's decision, react according to the Cournot assumption of zero conjectural variation. However, Smeers and Wolf (1997) add the element of uncertainty to this process. When the Stackelberg firm makes its decision the market demand is uncertain, but demand is known when the Cournot firms make their decision. This makes the Smeers and Wolf's (1997) version of the Stackelberg model stochastic. Smeers and Wolf (1997) assume that this uncertainty can be modelled my demand scenarios.

## 3.2.1 Notations and Assumption

For the costs functions, the same notations are used. is the total cost function of level of output by Cournot firms and is the total cost function of level of output by the Stackelberg firm.

The demand function is changed slightly to take into account the uncertainty. is a set of demand scenarios with corresponding probabilities of occurrence As such, is the price at which customers are willing and able to purchase units of output in demand scenario . has a probability of occurrence.

The same Assumption set A discussed in subsection 3.1.1 apply here with alterations made to conditions [13] and [14]. Assumption set A can be re-written as:

and are both convex and twice differentiable, as before.

is a strictly decreasing function and twice differentiable which satisfies the following inequality,

There exists a quantity (the maximum level of output any firm is willing to supply in each demand scenario) such that,

For referencing, these set of assumption will be referred to as Assumption B.

## 3.2.2 Stochastic Stackelberg-Nash-Cournot (SSNC) equilibrium

Smeers and Wolf (1997) use the same approach seen before to derive the SSNC equilibrium.

The Cournot problem [15]can be re-written as follows:

For each Cournot firm and each demand scenario, let the set of output levels be such that, for a given and assuming are fixed, solves the following Cournot problem:

Note that is the output level of Cournot firm when the demand scenario is .

For each, according to Murphy et al. (1983), the objective function in equation [40] is a strictly convex profit function over the closed, convex and compact interval.

The functions can be referred to as the joint reaction functions of the Cournot firms for a demand scenario. The aggregate reaction curve becomes:

The Stackelberg problem with demand uncertainty can be written as:

Note the Stackelberg problem defined problem [42] differs from that defined in [17]. This is because of the element of uncertainty. The Cournot problem [40] is similar to the Cournot problem [15] because the demand is known when the Cournot firms make their decision. In the Stackelberg problem [42] note the element. This is the estimated mean price, that is, the Stackelberg firm considers the reaction of the Cournot firm under each demand scenario and works out the market price in each scenario, and it then multiplies it by the probability of each scenario. The summation of this represents the estimated mean price.

If solves the stochastic, then the set of output levels is the SSNC equilibrium for demand scenario.

To get this equilibrium, the output levels need to be determined. Smeers and Wolf (1997) use the same approach as Murphy et al. (1983) in doing so. The Equilibrating program is the same as that in [19], with changes made to the Cournot output and demand function: For each demand scenario ,

Theorem 1 lays out a foundation on how to solve the Equilibrating program in problem [19] and can also be used to solve [44]. Smeers and Wolf (1997) Summarise Theorem 1 as follows:

Theorem 2: For each fixed,

An optimal solution for the problem satisfies the Cournot problem [40] if and only if the Lagrange multiplier,, associated with the Equilibrating program [44], is equal to zero.

This multiplier is a continuous, strictly decreasing function of . Moreover, there exists and such that:

(This theorem is taken from Smeers and Wolf (1997), with a few alteration to the notations)

The properties of are the same as those discussed in subsection 3.1.3. The existence and uniqueness of the SSNC equilibrium is shown in the same ways as the SNC equilibrium of Murphy et al.'s (1983) model discussed in subsection 3.1.4.

## 3.2.3 Algorithm to solve the Stackelberg problem

The Stackelberg problem here is solved in the same way Murphy et al. (1983) proposed (discussed in subsection 3.1.5).

In their report, Smeers and Wolf (1997) do not specify the upper and lower bound of, thus, it is assumed that is bounded by.The interval can be split into grid points with, where and . The piecewise linear approximation of in [27] can be re-written as follows:

Here,

has the same properties as [29].

The Stackelberg problem [42], thus, becomes:

Hereafter, the algorithm summarised in subsection 3.1.5 can be used to solve this problem.

## 3.3 Numerical Example

In Murphy et al.'s (1983) report a simple example of the Stackelberg model is given. They consider the case of a linear demand curve and quadratic cost functions:

It is assumed that the Stackelberg firm and Cournot firms are identical. The Cournot problem [15] becomes as follow, with as the optimal solution:

Solving this problem yields:

Note the upper bound of is found by setting. The working to get equation [51] is shown in Appendix 2.

The aggregate reaction curve can be written as:

Using this information, this example is now extended to Smeers and Wolf's (1997) model with numerical values.

Note that the functions listed in equations [49], [50], [51] and [52] satisfy Assumptions A & B and other properties discussed in previous sections.

Suppose and. And suppose demand is unknown when the Stackelberg firm makes its decision. The cost functions of the firms will be as follows:

Figure 2: Different Demand ScenariosThe tables below describe the possible demand scenarios, probability of each scenario occurring, the joint reaction curve and aggregate reaction curve for, and:

Scenario,

Demand,

Probability,

= Demand falls,

= Demand remains unchanged,

= Demand Increases,

Scenario,

Joint reaction curve,

Aggregate reaction curve,

Using this information, the Stackelberg problem [42] can be solved. First, the estimated price element can be calculated as follows:

Substituting this result back into the Stackelberg problem [42] gives:

This problem can easily be solved by differentiating the objective function and finding the value of for which the differential is equal to zero. The working to obtain the following optimal solution is shown in Appendix 2.

Using this result, the following result is obtained for each demand scenario:

Figure 3: Optimal Output, Price and Profit

1

260.870

98.02

652.96

147.04

2

260.870

134.39

798.42

201.58

3

260.870

170.75

943.87

256.13

Stackelberg firm Profit,

Cournot firm Profit,

Industry Profit,

1

21,243.87

12,010.81

69,387.12

2

35,573.12

22,574.95

125,872.92

3

49,802.37

36,444.87

195,581.87

The tables in figure 3 state the SSNC equilibriums for each scenario, and the profits made by each firm in this oligopoly and the total industry profit in each scenario. Note that since is strictly convex, the equilibrium obtained for each scenario is unique. Also note that in all three scenarios, the Stackelberg Output and profit is greater than that of the Cournot firms, illustrating the first mover advantage.

## Chapter 4: Discussion

In this section, the practical applications, drawbacks and possible extensions to Stackelberg models are discussed.

## 4.1 Practical Applications of Stackelberg models

Stackelberg models are widely used by firms to aid decision making. Some examples include:

## Manufacturer-Retailer Supply Chain

He et al. (2009) present a stochastic Stackelberg problem to model the interaction between a manufacturer and a retailer. The manufacturer would announce its cooperative advertising policy (percentage of retailer's advertising expenses it will cover-participation rate) and the wholesale price. The retailer, in response, chooses its optimal advertising and pricing policies. When the retailer's advertising and pricing is an important component of the product's marketing mix, it becomes vital for the manufacturer to take into account the reaction of the retailer when setting the participation rate and price. The stochastic element of this model is the proportion of the market aware of the product (or served by the retailer), the participation rate is a function of this proportion. Later work by Huang et al. (2009) extends this model to include more retailers.

## Strategic decision making in Marketing or Expansion

The Stackelberg model can also be used to model strategic decisions in Marketing and expansion. As seen for output decisions, a Stackelberg firm can be the first one to decide on a promotional campaign or change the existing campaign. The other oligopolistic firms will have to change their promotional strategies so as not to lose customers to competition.

Strategic decisions of expansion can be modelled by stochastic Stackelberg models. For example, Tesco plc (market leader in the UK retail industry) may decide to open more branches in UK in the future depending on the economic conditions. The competitors (Sainsbury, Morrisons, and Asda) will react to Tesco's decision and change their expansion plans. Tesco has to take into account the reaction of its competitor in different future economic scenarios when deciding on its expansion strategy.

## New entrants in a Monopolistic Market

The interactions between a new entrant to a market and an existing monopoly can be modelled using the Stackelberg model. When barriers to entry a low and a new firm enter the market, a monopoly needs to change its output to maintain its dominance in the market. The monopoly (now the incumbent firm) is likely to behave as a Stackelberg leader (Geroski and Ulph, 1988)

In a different model, it is possible for the new entrant to behave as a Stackelberg leader. Say, a foreign monopoly enters a domestic monopolistic market. Then the foreign firm can seek to gain market dominance by behaving like a Stackelberg leader.

## Product Development

Stackelberg models can also be used when developing a new product. When developing a new product, a firm will have to take into account that the competitors will follow suit and develop similar products. For example, after the release of Xbox 360 in 2005, Sony and Nintendo followed suit and released PlayStation 3 and Wii, respectively, in 2006.

## Future Production Level Decisions

The Stackelberg game can be used to model future production levels when the future is uncertain. For example, Smeers and Wolf (1997) applied their model (discussed in chapter 3, section 3.2) to the European gas market. The main oligopolistic firms (at the time when their report was written) included CEI, Norway, Netherlands, Algeria and United Kingdom. Norway, in 1990, had to decide the level of development of a new field that would be effective in 10 years. The other producers were considered to have enough spare capacities to adjust their production to meet demand in 2000 (Smeers and Wolf, 1997). The demand for natural gas in 2000 was unknown in 1990, but known in 2000. Here, Norway (the Stackelberg firm) makes a decision about its level of development for the year 2000 considering the reaction of the other countries and under uncertainty about future demand.

## 4.2 Drawbacks of Stackelberg Models and Possible Extensions

Here the drawbacks of Stackelberg models discussed in this paper and Stackelberg models in general are discussed with suggestion of possible extensions where possible.

In Smeers and Wolf (1997), future demand, at the point of making the output decision, is uncertain. Smeers and Wolf (1997) fail to take into account how other factors would change overtime. For example, in 10 years' time costs would change (uncertainly) and the cost functions known in 1990 may not be valid in 2000. The model could possibly be extended by considering how costs could change in the future (as done for demand, the model could take into account different cost scenarios).

Another drawback of Smeers and Wolf's (1997) model is the formulation of the Stackelberg problem [42]. Smeers and Wolf (1997) use estimated price in the Stackelberg problem. Suppose because of extreme scenarios, the standard deviation of market price is large. In this case, the estimated price could differ significantly from actual price. The model could be extended to include a confidence interval around the estimated price and optimal output could be worked out around this interval.

Stackelberg models, in general, assume that homogeneous products face the same demand curve. However, because of branding and brand loyalty, it is likely that some suppliers will face Steeper demand curve (if their brands are more popular) and some face a flatter demand curve (less popular brands). The Stackelberg firm would need to consider individual demand curves instead and, along with output decisions, consider how the other firms react to changes in price.

Stackelberg models assume complete information. In a competitive and non-cooperative oligopoly, this assumption may not be practical. Firms will generally not provide information about their cost functions, for example, to competitors. Geroski and Ulph (1988) look at the Stackelberg problem under symmetric and asymmetric information.

The Cournot assumption may not be valid after one period. When the Cournot firms make their output decision, it will be observed that Cournot assumption was wrong since the other Cournot firm also changed their level of output (Carlton and Perloff 2005).

## Chapter 5: Conclusion

In this paper, some Stackelberg leader-follower models have been reviewed. In chapter 2, it is seen that, in a Stackelberg duopoly (or asymmetric duopoly), one firm strives for independence and the other firm routes for dependence. In behaving like this, both firms are able to maximise their profits and the price formation is more stable. Using backward induction, the Stackelberg duopoly was generalised for any demand and cost function. In the example given in chapter 2, it is seen that the Stackelberg duopoly output is higher than that of a Cournot duopoly, and the Stackelberg firm is better off.

Chapter 3 looks at the mathematical formulation of the models by Murphy et al. (1983) and Smeers and Wolf (1997). The properties of the aggregate reaction curve (by Cournot firms) and the optimal Stackelberg output are summarised. It is found that the optimal Stackelberg output is bounded below by the optimal output it would produce if it were a Cournot firm, and bounded above by the optimal output the firm would produce if it were a competitive fringe with a strictly convex cost function. The stochastic element of Smeers and Wolf's (1997) model is also reviewed. It is seen that the Stackelberg firm considers the aggregate reaction curves of the Cournot firms in different future demand scenarios when setting its output under future demand uncertainty. The numerical example shows that in all demand scenarios, the Stackelberg firm will be better off.

Finally, in chapter 4 some practical applications of Stackelberg models are explained. It is seen that both nonlinear mathematical models and nonlinear stochastic models can be used in different decision making processes like advertising, strategizing expansion, and pricing. Some drawback of Stackelberg models are also looked at. In particular, it is noted that the Cournot assumption may not hold in a multi-period decision making process and since it is difficult to obtain complete knowledge about the competitors, Stackelberg models may not be accurate in reality.

## Appendix 1: Economic Background

To understand Stackelberg models, an understanding of the market structures involved and a firm's profit maximization theory needs to be developed. In developing the classical Stackelberg model, Stackelberg (1934) looked at a market structure with only two firms, a duopoly. The model has then been extended to include more firms and demonstrate how firms in an oligopolistic market behave.

## A1.1 Definitions and Characteristics of Oligopoly and Duopoly

A duopoly is a market structure with only two firms in the market selling homogeneous (or similar) products (Perloff, 2009).

An oligopoly is a market structure where there are a small number of firms dominating the industry. These firms are interdependent and dominate the market due to the existence of high barriers of entry (for example, brand loyalty, high start-up costs, and irrecoverable costs). The firms may produce homogeneous products (for example, metals, chemicals, sugar, and petrol) or differentiated products (for example, cars, soap powder, and electronic appliances). A duopoly is a special type of an oligopoly (Perloff, 2009).

According to Perloff (2009), other characteristics of an oligopoly include:

High concentration ratios: Supply in the industry must be concentrated in the hands of relatively few firms

Interdependence: the actions of one large firm will directly affect another large firm.

Non-price competition: Often times, price is not the most important factor in the competitive process in an oligopoly. Firms engage in competing by deciding upon their marketing mix and the branding of their product.

Price Rigidity: prices in an oligopolistic market tend to change far less than in perfectly competitive markets

Collusion: oligopolistic firms often benefit form colluding and making agreements amongst themselves to restrict competition.

## A1.2 Profit Maximisation

## A1.2.1 Definitions

Cost can be split into two parts: fixed costs and variable costs. The cost function represents the total cost of producing units of output (Chen, 2007).

Marginal cost is the cost of producing an additional unit of output and can be thought of as the slope of the cost function (Perloff, 2009). That is,

Revenue is the total amount of money received by a firm for the goods sold or services provided. The revenue function represents the total revenue received from selling units of output at price per unit. The price can often vary with the output level.

Marginal Revenue is the revenue obtained from selling an additional unit of output and can be thought of as the slope of the revenue function (Perloff, 2009). That is,

## A1.2.2 Profit and Profit Maximisation

Profit is the difference between revenue and costs. Thus, the profit function is given by:

Profit can be maximised by setting the output level to such that the profit function is maximised. This can be done by taking the first differential of with respect to and equating it to zero:

Substituting equation [59] and [61] into equation [63]:

Equating this to zero:

Therefore, profit is maximised if [65] is satisfied. Let be the profit maximising level of output, then satisfies

This can be illustrated graphically:

Figure 4: Profit maximisation

The graph above shows a firm's marginal cost and marginal revenue. The profit maximising level of output is where. At this point marginal profit is zero. At output levels less than,. Thus, marginal profit is positive; the firm can continue to produce/supply more output since it is making profit for each additional unit. At output levels greater than,. Thus, marginal profit is negative; the firm will make a loss for every additional output it produces/supplies. Thus, the maximum profit is attained only when. The shaded region represents the maximum profit.

## A1.3 Non-cooperative Oligopoly

Earlier on it was mentioned that oligopolistic firms often benefit form colluding and making agreements amongst themselves to restrict competition. They do this by acting like a monopoly collectively. However, Stackelberg models are based on the assumption that oligopolistic firms make decisions independently but are aware of the other firm's actions (Hallam, 2005). These firms are then in a non-cooperative oligopoly.

Price/Cost/Revenue

Level of Output

## Figure 5: Kinked Demand Curve

Source: Carlton and Perloff (2005)The firms in a non-cooperative oligopoly face a kinked demand curve.

According to Sweezy (1939), firms "match price reductions but ignore price increases". The curve is kinked at the current price, with demand being significantly more elastic above this price than below (Carlton and Perloff 2005). This occurs when two conditions hold:

If an oligopolistic firm cuts its price, its rivals will feel forced to follow suit and cut theirs, to prevent losing customers to the first firm

If an oligopolistic firm raised its price, its rivals will not follow suit since, by keeping their prices the same, they will gain customers from the first firm.

## Appendix 2: Workings for Numerical Example

The Cournot problem [50] is solved as follows:

Suppose,

Thus,

the solution of [67], is such that :

Note that if, then. However, in [67] is maximised subject to. Thus,

The Stackelberg problem [56] is solved as follows:

Suppose,

Thus,

, the solution to [71], is such that