Spatial Inequality Dynamics#
This chapter uses economic inequality to illustrate how the study of the evolution of social disparities can benefit from an explicitly spatial treatment. Social and economic inequality is often at the top of policymakers’ agendas. Its study has always drawn considerable attention in academic circles. Much of the focus has been on interpersonal income inequality, on differences between individuals irrespective of the geographical area where they live. Yet there is a growing recognition that the question of inter-regional income inequality requires further attention as the growing gaps between poor and rich regions have been identified as key drivers of civil unrest [Ezc19] and political polarization in developing and developed countries [RP18].
Introduction#
Much of the study of inequalities has focused at the individual level: how do outcomes differ across individuals? This approach does not group individuals geographically. In other words, it is not concerned with whether those differences follow a pattern, for example, at the regional level (e.g., is most of the more disadvantaged population located in a particular section of the map?). Indeed, while the two literatures (personal and regional inequality) are related, they have developed in a largely parallel fashion with limited cross-fertilization. In this chapter, we examine how a spatially explicit focus can provide insights on the study of inequality and its dynamics. We hope this illustration can be useful in itself but also inspire the use of these methods in the study of other phenomena for which the regional perspective can bring value. This is also the only chapter where we explicitly deal with time as an additional dimension. Our presentation of inequalities takes an inherently temporal view, considering how different indices evolve over time the extent to which a spatial pattern changes. Again, we hope the illustration we show here with inequality indices has value in itself, but also as inspiration for how to tackle time and dynamics in broader contexts.
After discussing the data we employ, we begin with an introduction to classic methods for interpersonal income inequality analysis and how they have been adopted to the question of regional inequalities. These include a number of graphical tools alongside familiar indices of inequality. As we discuss more fully, the use of these classical methods in spatially referenced data, while useful in providing insights on some of the aspects of spatial inequality, fails to fully capture the nature of geographical disparities and their dynamics. Thus, we next move to spatially explicit measures for regional inequality analysis. The chapter closes with some recent extensions of some classical measures to more fully examine the spatial dimensions of regional inequality dynamics.
import seaborn
import pandas
import geopandas
import pysal
import numpy
import mapclassify
import matplotlib.pyplot as plt
from pysal.explore import esda
from pysal.lib import weights
Data: U.S. state per capita income 1969-2017#
For this chapter, we use data on average income per capita over time. Specifically, we consider the United States counties from 1969 to 2017. The U.S. counties are small regions that fit hierarchically within states. This perspective will allow us to examine trends for individual observations (counties), or regions containing several of them in a geographically consistent way (states or census regions which are collections of states). The temporal approach will reveal whether these entities get richer or poorer, as well as how the overall distribution of income moves, skews, or spreads out.
pci_df = geopandas.read_file(
"../data/us_county_income/uscountypcincome.gpkg"
)
pci_df.columns
ERROR 1: PROJ: proj_create_from_database: Open of /opt/conda/share/proj failed
Index(['STATEFP', 'COUNTYFP', 'COUNTYNS', 'GEOID', 'NAME', 'NAMELSAD', 'LSAD',
'CLASSFP', 'MTFCC', 'CSAFP', 'CBSAFP', 'METDIVFP', 'FUNCSTAT', 'ALAND',
'AWATER', 'INTPTLAT', 'INTPTLON', 'GeoFIPS', 'GeoName', 'Region',
'TableName', 'LineCode', 'Descriptio', 'Unit', '1969', '1970', '1971',
'1972', '1973', '1974', '1975', '1976', '1977', '1978', '1979', '1980',
'1981', '1982', '1983', '1984', '1985', '1986', '1987', '1988', '1989',
'1990', '1991', '1992', '1993', '1994', '1995', '1996', '1997', '1998',
'1999', '2000', '2001', '2002', '2003', '2004', '2005', '2006', '2007',
'2008', '2009', '2010', '2011', '2012', '2013', '2014', '2015', '2016',
'2017', 'index', 'IndustryCl', 'Descript_1', 'geometry'],
dtype='object')
Inspection of the column names reveals that the table is organized around one row per county, and with the years as columns, together with information about the particular record. This format is an example of a wide longitudinal dataset. In wide-format data, each column represents a different time period, meaning that each row represents a set of measurements made about the same “entity” over time (as well as any unique identifying information about that entity.) This contrasts with a narrow, long format, where each row describes an entity at a specific point in time. Long data results in significant duplication for records and is generally worse for data storage, particularly in the geographic case. However, long form data is sometimes a more useful format when manipulating and analyzing data, as [W+14] discusses. Nonetheless, when analyzing trajectories, that is, the paths that entities take over time, wide data is more useful, and we will use that here.
In this dataset, we have 3076 counties across 49 years, as well as 28 extra columns that describe each county.
pci_df.shape
(3076, 77)
As an example, we can see the first ten years for Jackson County, Mississippi (state code 28
) below:
pci_df.query('NAME == "Jackson" & STATEFP == "28"').loc[
:, "1969":"1979"
]
1969 | 1970 | 1971 | 1972 | 1973 | 1974 | 1975 | 1976 | 1977 | 1978 | 1979 | |
---|---|---|---|---|---|---|---|---|---|---|---|
1417 | 2957 | 3121 | 3327 | 3939 | 4203 | 4547 | 5461 | 5927 | 6315 | 6619 | 6967 |
Global inequality#
We begin our examination of inequality by focusing on several global measures of income inequality. Here, “global” means that the measure is concerned with the overall nature of inequality within the income distribution. That is, these measures focus on the direct disparity between rich and poor, considering nothing about where the rich and poor live. Several classic measures of inequality are available for this purpose.
In general terms, measures of inequality focus on the dispersion present in an income distribution. In the case of regional or spatial inequality, the distributions describe the average or per capita incomes for spatial units, such as for counties, census tracts, or regions. For our U.S. county data, we can visualize (Fig. XXX1XXX) the distribution of per capita incomes for the first year in the sample as follows:
seaborn.histplot(x=pci_df["1969"], kde=True);
Looking at this distribution, notice that the right side of the distribution is much longer than the left side. This long right tail is a prominent feature, and is common in the study of incomes and many other societal phenomena, as it reflects the fact that within a single income distribution, the super-rich are generally much more wealthy than the super-poor are deprived, compared to the average.
A key point to keep in mind here is that the unit of measurement in this data is a spatial aggregate of individual incomes. Here, we are using the per capita incomes for each county. By contrast, in the wider inequality literature, the observational unit is typically a household or individual. In the latter distributions, the degree of skewness is often more pronounced. This difference arises from the smoothing that is intrinsic to aggregation: the regional distributions are based on averages obtained from the individual distributions, and so the extremely high-income individuals are averaged with the rest of their county. The regional approach implies that, to avoid falling into the so-called “ecological fallacy”, whereby individual conclusions are drawn from geographical aggregates, our conclusions will hold at the area level (county) rather than the individual one (person).
The kernel density estimate (or histogram) is a powerful visualization device that captures the overall morphology of the feature distribution for this measure of income. At the same time, the plot is silent on the underlying geographic distribution of county incomes. We can look at this second view of the distribution using a choropleth map. To construct this, we can use the standard geopandas
plotting tools.
Before we can get to mapping, we change the CRS to a suitable one for mapping, the Albers Equal Area projection for North America:
pci_df = pci_df.to_crs(
# Albers Equal Area North America
epsg=5070
)
And the quantile choropleth for 1969 (Fig. XXX2XXX) can be generated by:
ax = pci_df.plot(
column="1969",
scheme="Quantiles",
legend=True,
edgecolor="none",
legend_kwds={"loc": "lower left"},
figsize=(12, 12),
)
ax.set_axis_off()
plt.show()
The choropleth and the kernel density provide different visual depictions of the distribution of county incomes. The kernel density estimate is a feature-based representation, and the map is a geographic-based representation. Both are useful for developing a more comprehensive understanding. To gain insights on the level of inequality in the distribution, we’ll discuss a few indices common in the statistical and econometric literatures.
20:20 ratio#
One commonly used measure of inequality in a distribution is the so-called 20:20 ratio, which is defined as the ratio of the incomes at the 80th percentile over that at the 20th percentile:
top20, bottom20 = pci_df["1969"].quantile([0.8, 0.2])
The top20
(bottom20
) objects contain the boundary value that separates the series between the top (bottom) 20% of the distribution and the rest. With these, we can generate the ratio:
top20 / bottom20
1.5022494887525562
In 1969 the richest 20% of the counties had an income that was 1.5 times the poorest 20% of the counties. The 20:20 ratio has the advantage of being robust to outliers at the top and the bottom of the distribution. To look at the dynamics of this global inequality measure, one way is to create a function that calculates it for a given year, and apply it to all years in our time series, which we can then plot as a time series (Fig. XXX3XXX):
def ineq_20_20(values):
top20, bottom20 = values.quantile([0.8, 0.2])
return top20 / bottom20
# Generate range of strings from 1969 to 2018
years = numpy.arange(1969, 2018).astype(str)
# Compute 20:20 ratio for every year
ratio_2020 = pci_df[years].apply(ineq_20_20, axis=0)
# Plot evolution of 20:20 ratio
ax = plt.plot(years, ratio_2020)
# Grab figure generated in the plot
figure = plt.gcf()
# Replace tick labels with every other year
plt.xticks(years[::2])
# Set vertical label
plt.ylabel("20:20 ratio")
# Set horizontal label
plt.xlabel("Year")
# Rotate year labels
figure.autofmt_xdate(rotation=45)
plt.show()
The evolution of the ratio has a U-shaped pattern over time, bottoming out around 1994 after a long decline. Post-1994, however, the 20:20 ratio indicates there is increasing inequality up until 2013, where there is a turn toward lower income inequality between the counties.
In addition to the 20:20 ratio, we will explore two more traditional measures of inequality: the Gini index and Theil’s index. For these, we will use the inequality
package from Pysal.
from pysal.explore import inequality
Gini index#
The Gini index is a longstanding measure of inequality based on the notion of cumulative wealth distribution [MM21]. The Gini is closely linked to another popular device called the Lorenz curve. To construct a Lorenz curve, the cumulative share of wealth is plotted against the share of the population that owns that wealth. For example, in an extremely unequal society where few people own nearly all the wealth, the Lorenz curve increases very slowly at first, then skyrockets once the wealthiest people are included.
In contrast, a “perfectly equal” society would look like a straight line connecting \((0,0)\) and \((1,1)\). This is called the line of perfect equality, and represents the case where \(p\)% of the population owns exactly \(p\)% of the wealth. For example, this might mean that 50% of the population earns exactly 50% of the income, or 90% of the population owns 90% of the wealth. The main idea is that the share of wealth or income is exactly proportional to the share of population that owns that wealth or earns that income, which occurs only when everyone has the same income or owns the same amount of wealth.
With these notions in mind, we can define the Gini index as the ratio of the area between the line of perfect equality and the Lorenz curve for a given income or wealth distribution, standardized by the area under the line of perfect equality (which is always \(\frac{1}{2}\)). Thus, the Gini index is a measure of the gap between a perfectly equal society and the observed society over every level of wealth/income.
We can construct the Lorenz curve for 1969 by first computing the share of our population of counties that is below each observation. For that, we generate a cumulative series:
n = len(pci_df)
share_of_population = numpy.arange(1, n + 1) / n
Then, we consider the cumulative evolution of income. For this, we need to find out the proportion of total income owned by each share of the population. Empirically, this can be computed in the following fashion. First, we sort county incomes:
incomes = pci_df["1969"].sort_values()
Second, we find the overall percentage of income accumulated at each data point. To do this, we compute what percentage of the total income each county represents:
shares = incomes / incomes.sum()
and construct the cumulative sum of these shares, which reflects the sum of all of the shares of income up to the current one:
This starts at \(0\) and reaches \(1\) once the last share is included:
cumulative_share = shares.cumsum()
With this, we can plot both the Lorenz curve and the line of perfect equality (Fig. XXX4XXX):
# Generate figure with one axis
f, ax = plt.subplots()
# Plot Lorenz Curve
ax.plot(share_of_population, cumulative_share, label="Lorenz Curve")
# Plot line of perfect equality
ax.plot((0, 1), (0, 1), color="r", label="Perfect Equality")
# Label horizontal axis
ax.set_xlabel("Share of population")
# Label vertical axis
ax.set_ylabel("Share of income")
# Add legend
ax.legend()
plt.show()
The blue line is the Lorenz curve for county incomes in 1969. The Gini index is the area between it and the 45-degree line of equality shown in red, all standardized by the area underneath the line of equality.
A first approach to examine how inequality has evolved is to plot the Lorenz curves for each year. One way to do this in Python involves creating a function that will compute the Lorenz curve for an arbitrary set of incomes. The following function encapsulates the steps shown above into a single shot:
def lorenz(y):
y = numpy.asarray(y)
incomes = numpy.sort(y)
income_shares = (incomes / incomes.sum()).cumsum()
N = y.shape[0]
pop_shares = numpy.arange(1, N + 1) / N
return pop_shares, income_shares
For a single year, say 1969, our function would return a tuple with two arrays, one for each axis in the Lorenz curve plot:
lorenz(pci_df["1969"])
(array([3.25097529e-04, 6.50195059e-04, 9.75292588e-04, ...,
9.99349805e-01, 9.99674902e-01, 1.00000000e+00]),
array([1.22486441e-04, 2.52956561e-04, 3.83636778e-04, ...,
9.98429316e-01, 9.99176315e-01, 1.00000000e+00]))
We can now use the same strategy as above to calculate the Lorenz curves for all the years in our datasets:
lorenz_curves = pci_df[years].apply(lorenz, axis=0)
Practically, this becomes a dataframe with columns for each year. Rows contain the population shares (or income shares) as lists. We can then iterate over the columns (years) of this dataframe, generating a plot of the Lorenz curve for each year (Fig. XXX5XXX):
# Set up figure with one axis
f, ax = plt.subplots()
# Plot line of perfect equality
ax.plot((0, 1), (0, 1), color="r")
# Loop over every year in the series
for year in lorenz_curves.columns:
# Extract the two arrays or each dimension
year_pop_shares, year_inc_shares = lorenz_curves[year].values
# Plot Lorenz curve for a given year
ax.plot(year_pop_shares, year_inc_shares, color="k", alpha=0.05)
The compression of the Lorenz curves makes it difficult to ascertain the temporal pattern in inequality. Focusing explicitly on the Gini coefficients may shed more light on the evolution of inequality over time.
Remember the Gini coefficient represents the area in between the Lorenz curve and that of perfect equality. The measure can be calculated directly through the Gini
class in inequality
. For 1969, this implies:
g69 = inequality.gini.Gini(pci_df["1969"].values)
To extract the coefficient, we retrieve the g
property of g69
:
g69.g
0.13556175504269904
Here, the Gini coefficient in 1969 was 0.13. To compute this for every year, we can use a similar pattern as we have before. First, define a function to compute the quantity of interest; then, apply the function across the table with all years:
def gini_by_col(column):
return inequality.gini.Gini(column.values).g
inequality
’s Gini requires an numpy.ndarray
rather than a pandas.Series
object, which we can pull out through the values
attribute. This is passed to the Gini
class, and we only return the value of the coefficient as a DataFrame
object.
inequalities = (
pci_df[years].apply(gini_by_col, axis=0).to_frame("gini")
)
This results in a series of Gini values, one for each year:
inequalities.head()
gini | |
---|---|
1969 | 0.135562 |
1970 | 0.130076 |
1971 | 0.128540 |
1972 | 0.129126 |
1973 | 0.142166 |
Which we can turn into a graphical representation through standard pandas
plotting. The resulting pattern (Fig. XXX6XXX) is similar to that of the 20:20 ratio above:
inequalities.plot(figsize=(10, 3));
Theil’s index#
A third commonly used measure of inequality is Theil’s \(T\) [MM21] given as:
where \(y_i\) is per capita income in area \(i\) among \(m\) areas. Conceptually, this metric is related to the entropy of the income distribution, measuring how evenly distributed incomes are across the population.
The Theil index is also available in Pysal’s inequality
, so we can take a similar approach as above to calculate it for every year:
def theil(column):
return inequality.theil.Theil(column.values).T
inequalities["theil"] = pci_df[years].apply(theil, axis=0)
And generate a plot of its evolution over time (Fig. XXX7XXX):
inequalities["theil"].plot(color="orange", figsize=(10, 3));
The time paths of the Gini and the Theil coefficients appear to show striking similarities. At first glance, this might suggest that the indices are substitutes for one another. However, if we plot them against each other (Fig. XXX8XXX), we can see they are not perfectly correlated:
_ = seaborn.regplot(x="theil", y="gini", data=inequalities)
Indeed, as we shall see below, each index has properties that lend themselves to particular spatial extensions that work in complementary ways. We need both (and more) for a complete picture.
Personal vs. regional income#
There is a subtle but important distinction between the study of personal and regional income inequality. To see this, we first need to express the relationships between the two types of inequality. Consider a country composed of \(N\) individuals who are distributed over \(m\) regions. Let \(Y_l\) denote the income of individual \(l\). Total personal income in region \(i\) is given as \(Y_i = \sum_{l \in i} Y_l\), and per capita income in region \(i\) is \(y_i = \frac{Y_i}{N_i}\), where \(N_i\) is the number of individuals in region \(i\).
At the national level, the coefficient of variation in incomes could be used as an index of interpersonal income inequality. This would be:
where \(\bar{y}\) is the national average for per capita income. The key component here is the sum of squares term, and unpacking this sheds light on the personal versus regional inequality question:
An individual deviation, \(\delta_l = Y_l - \bar{y}\), is the contribution to inequality associated with individual \(l\). We can break this into two components:
The first term is the difference between the individual’s income and per capita income in the individual’s region of residence, while the second term is the difference between the region’s per capita income and average national per capita income.
In regional studies, the intra-regional personal income distribution is typically not available. As a result, the assumption is often made that intra-regional personal inequality is zero. In other words, all individuals in the same region have identical incomes. With this assumption in hand, the first term vanishes: \(Y_l -y_i = 0\), leading to:[1]
This means that each individual in a region has an equal contribution to the overall level of national interpersonal inequality, given by \((y_i - \bar{y})\), while the region in question contributes \(N_i(y_i - \bar{y})\). While it may seem that the assumption of zero intra-regional interpersonal income inequality is overly restrictive, it serves to isolate the nature of inter-regional income inequality. That is, inequality between places, rather than inequality between people within those places. In essence, this strategy shifts the question up one level in the spatial hierarchy by aggregating micro-level individual data to areal units.
Spatial inequality#
The analysis of regional income inequality differs from the analysis of national interpersonal income inequality in its focus on spatial units. Since regional incomes are explicitly embedded in geographical space, we can take advantage of their spatial configuration to learn more about the nature of the inequality. In the regional inequality literature, this has been approached in a number of ways. Three are considered in this chapter: one that links the discussion to that of spatial autocorrelation in Chapters 6 and 7, a second one based on decomposing global indices regionally, and a third one that embeds space in traditional global measures.
Spatial autocorrelation#
This approach helps us shed light on the properties of the spatial pattern of regional income data. We return to global measures of spatial autocorrelation that we encountered earlier in the book. The essence of this approach is to examine to what extent the spatial distribution of incomes is concentrated over space. For this, we use a queen spatial weights matrix and calculate Moran’s I for each year in the sample:
wq = weights.Queen.from_dataframe(pci_df)
Following the same pattern to “broadcast” a function, we create a function that returns the results we need from each statistic. Here, we will also keep the pseudo \(p\)-value for the Moran statistic which, as we saw in Chapter 6, helps us identify whether the index is statistically significant under the null hypothesis that incomes are randomly distributed geographically.
def moran_by_col(y, w=wq):
mo = esda.Moran(y, w=w)
mo_s = pandas.Series(
{"I": mo.I, "I-P value": mo.p_sim},
)
return mo_s
This time, our function returns a Series
object so that when we pass it through apply
, we get a well-formatted table:
moran_stats = pci_df[years].apply(moran_by_col, axis=0).T
moran_stats.head()
I | I-P value | |
---|---|---|
1969 | 0.649090 | 0.001 |
1970 | 0.647438 | 0.001 |
1971 | 0.626546 | 0.001 |
1972 | 0.606760 | 0.001 |
1973 | 0.640226 | 0.001 |
For further comparison, the results are attached to the inequalities
table:
inequalities = inequalities.join(moran_stats)
Which can be visualized (Fig. XXX9XXX) by:
inequalities[["I", "I-P value"]].plot(subplots=True, figsize=(10, 6))
plt.show()
Several patterns emerge from the time series of Moran’s I. Before delving into the details, it is worth noting that, while Gini and Theil indices from previous figures follow a similar path, Moran’s I displays a distinct trajectory. There is a long-term decline in the value of Moran’s I. This suggests a gradual decline in the geographic structure of inequality with two implications: (a) per capita incomes are now less similar between nearby counties and (b), this has been consistently declining, regardless of whether inequality is high or low. Second, despite this decline, there is never a year in which the spatial autocorrelation is not statistically significant. In other words, there is a strong geographic structure in the distribution of regional incomes that needs to be accounted for when focusing on inequality questions.
Regional decomposition of inequality#
One common objection to the analysis of inequality in aggregate relates to lack of detail about the scale at which inequality is most important. Inequality can be driven by differences between groups and not by discrepancies in income between similar individuals. That is, there is always the possibility that observed inequality can be “explained” by a confounding variate, such as age, sex, or education. For example, income differences between older and younger people can “explain” a large part of the societal inequality in wealth: older people have much longer to acquire experience, and thus are generally paid more for that experience. Younger people do not have as much experience, so young people (on average) have lower incomes than older people.
To tackle this issue, it is often useful to decompose inequality indices into constituent groups. This allows us to understand how much of inequality is driven by aggregate group differences and how much is driven by observation-level inequality. This also allows us to characterize how unequal each group is separately. In geographic applications, these groups are usually spatially defined, in that regions are contiguous geographic groups of observations [SW05]. This section discusses regional inequality decompositions as a way to introduce geography into the study of inequality.
Let’s illustrate these ideas with our income dataset. The table records the United States Census Bureau region a county belongs to in the Region
variable. These divide the country into eight regions, each assigned a number that relates to its name as specified below:
region_names = {
1: "New England",
2: "Mideast",
3: "Great Lakes",
4: "Plains",
5: "Southeast",
6: "Southwest",
7: "Rocky Mountain",
8: "Far West",
}
We can visualize the regions with the names on the legend (Fig. XXX10XXX) by first mapping the name to each region number, and then rendering a qualitative choropleth:
ax = pci_df.assign(Region_Name=pci_df.Region.map(region_names)).plot(
"Region_Name",
linewidth=0,
legend=True,
categorical=True,
legend_kwds=dict(bbox_to_anchor=(1.2, 0.5)),
)
ax.set_axis_off();
Let’s peak into income changes for each region. To do that, we can apply a split-apply-combine pattern that groups counties by region, calculates its mean, and combines it into a table:
rmeans = (
pci_df.assign(
# Create column with region name for each county
Region_Name=pci_df.Region.map(region_names)
)
.groupby(
# Group counties by region name
by="Region_Name"
# Calculate mean by region and save only year columns
)
.mean()[years]
)
The resulting table has a row for each region and a column for each year. We can visualize these means to get a sense of their temporal trajectory (Fig. XXX11XXX):
rmeans.T.plot.line(figsize=(10, 5));
One way to introduce geography into the analysis of inequality is to use geographical delineations to define groups for decompositions. For example, Theil’s \(T\), which we encountered previously, can be decomposed using regions into so-called between and within regional inequality components. To proceed in this direction, we first re-conceptualize our observations of per capita incomes for \(m\) regional economies as \(y = \left( y_1, y_2, \ldots, y_m \right)\). These are grouped into \(\omega\) mutually exclusive regions. Formally, this means that when \(m_g\) represents the number of areas assigned to region \(g\), the total number of areas must be equal to the count of all the areas in each region: \(\sum_{g=1}^{\omega} m_g=m\).[2] With this notation, Theil’s index from above can be rewritten to emphasize its between and within components:
where \(s_g = \frac{\sum_{i \in g} y_i}{\sum_i y_i}\), and \(s_{i,g} = y_i / \sum_{i \in g} y_i\).
The first term is the between regions inequality component, and the second is the within regions inequality component. The within regions term is a weighted average of inequality between economies belonging to the same region. Similar to what is done above for the case of interpersonal inequality, the estimate of the between-region (group) component of the decomposition is based on setting the incomes of all economies (individuals) belonging to a region (group) equal to that of the regional (group) average of these per capita incomes. Now, however, intra-regional inequality between economies within the same region is explicitly considered in the second component.[3]
Once we have covered the decomposition conceptually, the technical implementation is straightforward thanks to the inequality
package of Pysal, and the TheilD
class:
theil_dr = inequality.theil.TheilD(
pci_df[years].values, pci_df.Region
)
The theil_dr
object has the between and within group components stored in the bg
and wg
attributes, respectively. For example, the “between” component for each year is computed as:
theil_dr.bg
array([0.00914353, 0.00822696, 0.00782675, 0.00768201, 0.01022634,
0.0081274 , 0.00783943, 0.00572543, 0.00560271, 0.0054971 ,
0.00511791, 0.00566001, 0.00486877, 0.00466134, 0.00474425,
0.00424528, 0.00428434, 0.00453503, 0.00465829, 0.00456699,
0.00467363, 0.00412391, 0.00366334, 0.00342112, 0.00327131,
0.00312475, 0.00326071, 0.00359733, 0.00327591, 0.00363014,
0.00382409, 0.00436261, 0.00399156, 0.00402506, 0.00397 ,
0.00394649, 0.00353368, 0.00362698, 0.00400508, 0.00449814,
0.0043533 , 0.00470988, 0.0063954 , 0.00642426, 0.00694236,
0.00644971, 0.00591871, 0.00554072, 0.00528702])
If we store these components in our results table as we have been doing:
inequalities["theil_between"] = theil_dr.bg
inequalities["theil_within"] = theil_dr.wg
Inference on these decompositions can be done using the inequality.theil.TheilDSim
class, but we omit that here for brevity and report that, like the Moran’s \(I\), all of the Theil decompositions are statistically significant.
Since the within and between components are interpreted as shares of the overall Theil index, we can compute the share of the Theil index due to the between-region inequality.
inequalities["theil_between_share"] = (
inequalities["theil_between"] / inequalities["theil"]
)
We can visualize the three time series (Fig. XXX12XXX):
inequalities[
["theil_between", "theil_within", "theil_between_share"]
].plot(subplots=True, figsize=(10, 8));
The between-region share of inequality is at its lowest in the mid-2000s, not in the mid-1990s. This suggests that regional differences were very important in the 1970s and 1980s, but this importance has been waning, relative to the inequality within U.S. Census Regions. The ratio also generally shares the same pattern, but it does not see minima in the same places.
Spatializing classic measures#
While regional decompositions are useful, they do not tell the whole story. Indeed, a “region” is just a special kind of group; its “geography” is only made manifest through group membership (is the county “in” the region or not?). This kind of “place-based” thinking, while geographic, is not necessarily spatial. It does not incorporate the notions of distance or proximity into the study of inequality. The geographical locations of the regions could be rearranged without impact, so long as the group membership structure is maintained. While, arguably, shuffling regions around means they are no longer “regions,” the statistical methods would be no different.
The final approach we review here is an explicit integration of space within traditional, non-spatial measure. In particular, we consider a spatialized version of the Gini coefficient, introduced by [RS12]. The spatial Gini is designed to consider the role of spatial adjacency in a decomposition of the traditional Gini. The original index can be formulated focusing on the set of pairwise absolute differences in incomes:
where \(n\) is the number of observations, and \(\bar{y}\) is the mean regional income. Focusing on the set of pairwise absolute differences in income, we can de-compose this into the set of differences between “nearby” observations and the set of differences among “distant” observations. This is the main conceptual point of the “spatial Gini” coefficient. This decomposition works similarly to the regional decomposition of the Theil index:
In this decomposition, \(w_{ij}\) is a binary variable that is \(1\) when \(i\) and \(j\) are neighbors, and is zero otherwise. Recalling the spatial weights matrices from Chapter 4, this can be used directly from a spatial weights matrix.[4] Thus, with this decomposition, the spatial Gini can be stated as
with the first term being the component among neighbors and the second term being the component among non-neighbors. The “spatial Gini”, then, is the first component that describes the differences between nearby observations.
The spatial Gini allows for a consideration of spatial dependence in inequality. If spatial dependence is very strong and positive, incomes are very similar among nearby observations, so the inequality of “near” differences will be small. Most of the inequality in the society will be driven by disparities in income between distant places. In contrast, when dependence is very weak (or even negative), then the two components may equalize. Inference on the spatial Gini can be based on random spatial permutations of the income values, as we have seen elsewhere in this book. This tests whether the distribution of the components is different from that obtained when incomes are randomly distributed across the map.
The spatial Gini also provides a useful complement to the regional decomposition used in the Theil statistic. The latter does not consider pairwise relationships between observations, while the spatial Gini does. By considering the pairwise relationships between observations, the Gini coefficient is more sensitive and can also be more strongly affected by small groups of significantly wealthy observations.
We can estimate spatial Gini coefficients using the Gini_Spatial
class:
from inequality.gini import Gini_Spatial
First, since the spatial Gini requires binary spatial weights, we will ensure this is so before proceeding:
wq.transform = "B"
Then, the spatial Gini can be computed from an income vector and the spatial weights describing adjacency among the observations.
gs69 = Gini_Spatial(pci_df["1969"], wq)
The aspatial Gini is stored in the g
attribute, just like for the aspatial class:
gs69.g
0.13556175504269904
The share of the overall Gini coefficient that is due to the “far” differences is stored in the wcg
share:
gs69.wcg_share
0.13541750749645268
The \(p\)-value for this tests whether the component measuring inequality among neighbors is larger (or smaller) than that would have occurred if incomes were shuffled randomly around the map:
gs69.p_sim
0.01
The value is statistically significant for 1969, indicating that inequality between neighboring pairs of counties is different from the inequality between county pairs that are not geographically proximate.
We can apply the same statistic over each year in the sample using the function-by-column approach as before. In this case, we want to return the statistic itself, as well as the decomposition between variation in the neighbors and that for non-neighbors, and the pseudo-P-values:
def gini_spatial_by_col(incomes, weights):
gs = Gini_Spatial(incomes, weights)
denom = 2 * incomes.mean() * weights.n ** 2
near_diffs = gs.wg / denom
far_diffs = gs.wcg / denom
out = pandas.Series(
{
"gini": gs.g,
"near_diffs": near_diffs,
"far_diffs": far_diffs,
"p_sim": gs.p_sim,
}
)
return out
Inference on this estimator is computationally demanding, since the pairwise differences have to be recomputed every permutation, so the following cell takes some time to complete execution:
%%time
spatial_gini_results = (
pci_df[years].apply(gini_spatial_by_col, weights=wq).T
)
CPU times: user 56.8 s, sys: 0 ns, total: 56.8 s
Wall time: 56.8 s
spatial_gini_results.head()
gini | near_diffs | far_diffs | p_sim | |
---|---|---|---|---|
1969 | 0.135562 | 0.000144 | 0.135418 | 0.01 |
1970 | 0.130076 | 0.000141 | 0.129935 | 0.01 |
1971 | 0.128540 | 0.000142 | 0.128398 | 0.01 |
1972 | 0.129126 | 0.000140 | 0.128985 | 0.01 |
1973 | 0.142166 | 0.000145 | 0.142021 | 0.01 |
The \(p\)-values are always small, suggesting that the contribution of the local ties is always smaller than what would be expected if incomes were distributed randomly in the map.[5] We can compute the percent of times the \(p\)-value is smaller than a threshold using the mean:
(spatial_gini_results.p_sim < 0.05).mean()
1.0
While it may appear that the component due to “near differences” is quite small, this has two reasons. First, the number of “nearby” pairs is less than 0.2% of all pairs of observations:
wq.pct_nonzero
0.19385366975502275
Second, when spatial dependence is high, nearby observations will be similar. So, each “near difference” will also be small. Adding together a small number of small observations will generally be small, relative to the large differences between distant observations. Thus, small values of the “near” distances are indicative of spatial dependence. Indeed, we can see visually (Fig. XXX13XXX) that as the spatial dependence weakens, the near_diffs
get larger:
inequalities["near_diffs"] = spatial_gini_results.near_diffs
inequalities[["near_diffs", "I"]].plot.line(
subplots=True, figsize=(15, 6)
);
Conclusion#
Inequality is an important social phenomenon, and its geography is a growing concern for social scientists. Geographical disparities in well-being have been pointed to as a major driver behind the rise of right-wing populist movements in the U.S. and Europe [RP18]. Thus, understanding the nature of these disparities and their evolution is a challenge for both science and policy.
This chapter discusses methods to assess inequality, as well as to examine its spatial and regional structure. We have seen the Gini coefficient and Theil index as examples of global measures to summarize the overall level of inequality. As is often the case in many areas of spatial analysis, the straightforward adoption of methods from economics and sociology to spatial data can often be fruitful but, at the same time, can miss key elements of the spatial story. In the context of spatial income disparities, we have highlighted the differences between personal and regional inequality. From this vantage, we have reviewed three approaches to incorporate geography and space in the study of inequality. Together, this gives us a good sense of how inequality manifests geographically, and how it is (possibly) distinct from other kinds of spatial measures, such as those for spatial autocorrelation discussed in Chapters 6 and 7. Furthermore, in this chapter we have dipped our toes in spatiotemporal data, exploring how spatial patterns change and evolve over time.
Before leaving the topic of spatial inequality, we note that there is much more that can be said about inequality and related concepts. Inequality is generally concerned with the static snapshot of the regional income distribution and the shares of that distribution that each region holds. Those shares are reflected in the variance or spread of the distribution. However, this is only one moment of the distribution, and a comprehensive understanding of disparities requires analysis of the distribution’s location (mean) and shape (modes, kurtosis, skewness) as well as dispersion. Moreover, movements of individual regions within the distribution over time, or what is referred to as spatial income mobility, are critical to our understanding of the dynamics of spatial disparities. Full consideration of these concepts is beyond the scope of this chapter. Interested readers are directed to [Rey14] as an entry point to these more advanced topics.
Questions#
Why is the study of regional income inequality important? In what ways is the study of regional income inequality different from the study of personal income inequality?
Given that the Theil and Gini statistics appear to have similar time paths, why would a researcher choose to use both measures when analyzing the dynamics of regional disparities? Why not just one or the other?
What aspects of a regional income distribution are not captured by a Theil or Gini coefficient? Why are these omissions important, and what approaches might be used to address these limitations?
How might the measure of inter-regional income inequality be affected by the choice of the regionalization scheme (i.e., how the different spatial units are grouped to form regions)?
What is the relationship between spatial income inequality and the spatial dependence of regional incomes?
Next steps#
The literature on regional inequality has exploded over the last several decades. For recent reviews of the causes and policy responses, see the following:
Cörvers, Frank and Ken Mayhew. 2021. “Regional inequalities: causes and cures.” Oxford Review of Economic Policy 37(1): 1-16.[CorversM21]
Rodríguez-Pose, Andrés. 2018. “The revenge of the places that don’t matter (and what to do about it).” Cambridge Journal of Regions, Economy and Society, 11(1): 189-20.[RP18]
Methodologically, spatial analysis of regional disparities is generally covered in two strands of the literature. For work on spatial econometric modeling of convergence and divergence, see:
Arbia, Giuseppe. 2006. Spatial econometrics: statistical foundations and applications to regional convergence. Springer Science & Business Media.[Arb06]
The second branch of the methodological literature focuses on exploratory spatial data analysis of inequality and is reviewed in:
Rey, Sergio J. and Julie Le Gallo. 2009. “Spatial anlaysis of economic convergence.” In Terry C. Mills and Kerry Patterson (eds.) Palgrave Handbook of Econometrics, Palgrave, pages 1251-1290.[RLG09]