SciELO - Scientific Electronic Library Online

 
vol.7 número3Riesgo de muerte y agresiones al cruzar ilegalmente la frontera Estados Unidos-MéxicoParticipación política de los migrantes latinoamericanos en Andalucía: Oportunidades y limitaciones índice de autoresíndice de assuntospesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Journal

Artigo

Indicadores

Links relacionados

  • Não possue artigos similaresSimilares em SciELO

Compartilhar


Migraciones internacionales

versão On-line ISSN 2594-0279versão impressa ISSN 1665-8906

Migr. Inter vol.7 no.3 Tijuana Jan./Jun. 2014

 

Artículos

 

Connected Immigrants? Four Methodological Challenges for the Analysis of ICT Use through Survey Data*

 

¿Inmigrantes conectados? Cuatro desafíos metodológicos en el análisis del uso de las TIC a través de datos de encuestas

 

Mihaela Vancea y Àlex Boso

 

Universitat Pompeu Fabra. Direcciones electrónicas: mihaela.vancea@upf.edu, alex.boso@upf.edu.

 

Date of receipt: June 28, 2012.
Date of acceptance: January 14, 2013.

 

Abstract

Both the sociology of migration and the academic literature on network society tend to highlight the penetration of new information and communication technologies (ICT) in the migrant population. While there have been significant contributions to this area of knowledge from qualitative studies, very few quantitative studies examine the relationship between the migrant population and new technologies. This article outlines four methodological challenges in the analysis of migrant populations' adaptation to the network society through survey data: absence of relevant variables, possible measurement errors in the dependent variable, data collection problems and endogeneity.

Keywords: network society, surveys, information and communication technologies (ICT), migrant population, methodology.

 

Resumen

Tanto la sociología de la migración como la literatura académica especializada en el estudio de la sociedad red tienden a destacar la penetración de las nuevas tecnologías de la información y la comunicación (TIC) en la población inmigrante. Mientras que existen aportaciones relevantes en esta área de conocimiento que provienen de investigaciones de naturaleza cualitativa, escasean las aproximaciones cuantitativas al estudio de la relación entre la población inmigrada y las nuevas tecnologías. Este artículo detalla cuatro de los principales desafíos metodológicos para el análisis de esta temática mediante datos de encuestas: la ausencia de variables relevantes, los errores de medida en la variable dependiente, las dificultades en la fase de la recogida de datos y la endogeneidad.

Palabras clave: sociedad red, encuestas, tecnologías de la información y la comunicación (TIC), población inmigrante, metodología.

 

Introduction

The rapid spread of new information and communication technologies (ICT) in recent decades has provided the public with unprecedented access to large amounts of information and changed patterns of interaction and communication between people, communities and institutions. Technologies such as the Internet and mobile phones have transformed the way many people communicate, work, study and live (Vancea and Olivera, 2012).

Some authors have postulated the advent of the socalled mobility paradigm, which emphasizes the changes produced by the current movements and multiple connections between individuals in the way they communicate, relate and understand social life (Sheller and Urry, 2006). Following this line of argument, the mobility paradigm also requires a change in the "a-mobile", reductionist way of conducting research in the social sciences (Sheller and Urry, 2006:208).

The technological transformation that took place at the end of last century in conjunction with the arrival of an emerging culture of digital social networks has substantively changed the social organization of industrial societies (Castells, 2000, 2001; Castells et al., 2007). The network society, based on networks activated by information and communication technologies, has developed as a new global social structure (Castells et al., 2003:22; Castells, 2009:50-51). However, given the centrality the network society confers on ICTs, lack of access to digital information and communication networks has emerged as a new form of social exclusion in contemporary societies (Castells, 2001).

The immigrant population appears to be increasingly engaged in communication and information networks that go beyond physical or spatial boundaries. The reduction of the cost of access to communication and information that characterizes the new network societies and cheaper air fares constitute key factors in facilitating the permanent connection between immigrants and their countries or communities of origin (Castles and Miller, 2009; Vertovec, 2004). Various studies show how immigrants live across state borders, regularly traveling from one country to another (when their administrative and financial situation allows), and so acquire and develop transnational links and multiple affiliations (economic, political and social-cultural) in more than one country (Landolt, 2008; Portes, Escobar, and Walton, 2007; Østergaard-Nielsen, 2003).

This new scenario explains the surge of interest and research on the connection between ICTs and the immigrant population in recent years in the study of the sociology of migration. Several authors such as Castells (2000), Horst and Miller (2006), Diminescu (2008) and Nedelcu (2009) argue that access to ICTs turns immigrant populations into powerful connectivity nodes. Thus immigrants are usually defined in the literature as the main promoters of a digital network culture, which seamlessly adapts to their spirit of mobility (Diminescu, 2002, 2004, 2008; Urry, 2000; Larsen, Urry, and Axhausen, 2006; Nedelcu, 2009; Ros, 2010).

Current international migration processes should therefore be understood as a dynamic process that spreads throughout transnational space (Nedelcu, 2009; Levitt and Glick-Schiller, 2004; Portes, 2003; Basch, Glick-Schiller, and Szanton, 2003; Østergaard-Nielsen, 2003). Conceiving of migration as a dynamic process breaks with the traditional epistemological assumption that the contours of society coincide with those of the nation-state (Wimmer and Glick-Schiller, 2003; Llopis-Goig, 2007). Indeed, several authors have pointed out the drawbacks of "methodological nationalism"—the assumption that the triad of nation, state and society is the natural social and political form of the modern world (Wimmer and Glick-Schiller, 2003)—for studying international migration processes within the current context of globalization, where global interconnections have increased and nation-states as the unit of organization of social and political life have been challenged by global flows of communication, information, goods and people (Beck, 1999, 2004; Smith, 1979; Wallerstein, 1974).

Trying to understand and analyze human behavior simultaneously in more than one location and thereby overcome the constraints of methodological nationalism poses a substantive epistemological and methodological challenge for social sciences as a whole. From an epistemological point of view, this new perspective, which does not regard states or societies of origin and destination as nationally-bounded entities, may contribute to overcoming the dichotomy between countries of origin and countries of destination, thereby promoting a reconceptualization of migration and the incorporation or integration of immigrants (Vancea, 2009).

Analyzing the migratory phenomenon as a two-way dynamic process through a transnational social space also has certain methodological implications. One of the most conspicuous is the quality of the data social scientists rely on to draw valid descriptive and explanatory inferences. Social scientists must be provided with better data sources that encourage the acquisition of a fuller understanding of the migration processes (especially as regards adaptation and integration) of people in today's network societies and new forms of identification and transnational participation.

This article discusses some of the main methodological challenges faced by social researchers when drawing valid inferences about the immigrant population and their adaptation to the network society on the basis of survey data. An analysis of the characteristics and potential of various surveys as a tool for the systematic study of the problems described identified four possible methodological problems to be solved: 1) lack of key variables, 2) measurement errors in the dependent variable, 3) difficulties during the data collection phase and 4) endogeneity. Most of the methodological problems detected and analyzed in this study correspond to surveys such as Eurostat's (European Commission, 2012) "Community Survey on ICTs Usage in Households and by Individual", particularly the "Survey on the Equipment and Use of Information and Communication Technologies in Households" (henceforth referred to as ICT-H) (INE, 2009, 2012), although they can in fact be extended to other existing data bases. The article also uses data taken from certain studies undertaken for the case of Spain and Catalonia in order to provide an empirical basis for the methodological reflections made.

 

Immigrants and New Technologies in Surveys

The results of recent studies on ICT use by the immigrant population in Europe, both qualitative and quantitative, appear to coincide, noting that the immigrant population has become a regular ICTs user. Reports by Codagnone and Kluzer (2011) and Kluzer, Haché, and Codagnone (2008) on digital inclusion, with data on ICTs and the integration of immigrants into several European countries and other exploratory work, appear to reinforce this hypothesis (Boso and Ros, 2010; Ofcom, 2008).

Qualitative research has demonstrated the role of ICT in the integration of immigrants and the promotion of cultural diversity in the new network societies (Hepp, Welling, and Aksen, 2009; Maya et al., 2009; Diminescu, 2002, 2004; Nedelcu, 2009). In the current context of the network society, the integration of immigrants seems to imply much more than a simple process of socioeconomic insertion, civic and political participation or the mere internalization of the social norms and cultural values of the destination country. The integration of the immigrant population into the network society means "being connected", in other words, 1) being able to intelligently combine mobility, autonomy and communication, 2) knowing how to make strategic use of connectivity networks and 3) striking a balance between relations with the country of origin and the destination country (Diminescu, 2008).

Following Diminescu's (2008) definition of "connected immigrants", in this article, the adaptation or integration of the immigrant population into the network society is not only understood as this segment of the population's participation in the economic, political, social and cultural life of the host society but also as the degree of mobility and digital connectivity of these people in the various areas of their lives as residents of another country or society. While most of these qualitative studies suggest that the provision of information and social networks is a key component in the social inclusion of people of immigrant origin, relatively little is known about how newcomers to the host country locate and access information or what kind of communication networks and information they use. There is a similar lack of information about their attitudes, values and level of awareness regarding the use of various channels of information and communication offered by ICTs.

This is partly due to the heterogeneity of immigrants as a new technology user group. Immigrants tend to simultaneously belong to several socio-demographic and legal categories (skilled workers, sponsored family members, business people, refugees, foreign students or temporary workers). They often have varying cultural profiles together with different levels of familiarity with the institutions and values of the destination society. However, the lack of key quantitative data for linking the immigrant population to key institutions and agents in the so-called "network society" is one of the main causes of the dearth of quantitative studies for exploring this issue.

At present, the main tools for the quantitative analysis of the insertion of citizens into the network society are Eurostat's "Community Survey on ICTs Usage in Households and by Individual" (European Commision, 2012) at the European level, and the itch surveys by the National Statistics Institute (Instituto Nacional de Estadística or INE) for Spain. Both surveys are cross-sectional and published annually.

The survey on "Community Survey on ICTs Usage in Households and by Individual" were introduced in 2002 by the European Commission to measure the development of ICTs among individuals and in their households. Eurostat coordinates these survey, undertaken annually at the national level. The survey questionnaire, developed in collaboration with members states and the Organisation for Economic Cooperation and Development (OECD), is adapted to the changing needs of users and political agents. Surveys typically include six question modules on new technologies, ICTs access, computer use, Internet use, e-government, e-commerce and digital skills or competencies (to search, obtain, process and transmit information), together with a question module on respondents' socio-demographic characteristics.

The ITC-H, which follows the methodological recommendations of Eurostat (the data it yields are comparable to those of other European countries), collects data on the various information and communication technologies in Spanish households as well as the uses to which citizens put these products. The ICT-H survey also focuses on the use children make of new technologies. The data are available to the public and may be downloaded from the National Statistics Institute website (INE, 2009, 0212).

Compared with other surveys that address issues related to ICTs and/or the immigrant population, this data source has a significant advantage for the purposes of sociological research. The immigrant population is relatively well represented (it constitutes about 10 % of the sample, with certain variations per year), meaning that its level of ICTs ownership and use can be compared with the behavior of the native population. But, although the "National Immigrant Survey" (NIS)—"Encuesta Nacional de Inmigrantes" (ENI)—is currently the best source of information on the immigrant population in Spain, the survey does not collect detailed information on ICT issues nor does it enable effective comparisons to be carried out between the Spanish and foreign population. On the other hand, at the autonomous level, there are a number of outstanding data matrices such as the El Baròmetre de la Comunicació i la Cultura (with its excellent fieldwork) (Fundacc, 2009) and "L'Enquesta sobre l'ús de les noves technologies" by the Centro d'Estudios de Opinión (CEO, 2006, 2008, 2011) of the Generalitat de Catalunya, with its wealth of variables. However, the problem of the difficulty of extrapolating results from the study of Catalan case to a more general level, is compounded by the difficulty of access to these two data matrices, since, as can be seen from table 1, in neither case is access completely free.

 

Absence of Key Variables

When social scientists attempt to study the adaptation of the immigrant population in the network society through survey data, the first methodological problem they may encounter is how to overcome the absence of key variables in available data sources. This problem makes it difficult to draw valid inferences, and for one reason or another, affects all the data matrices analyzed to date.

The first drawback of surveys on the study of the immigrant population is the definition of the concept of immigrant. The notion of "immigrant" is sometimes used without it being clear whether a person is so defined because of his nationality, country of birth or that of his parents.1 From a sociological point of view, nationality is a normative attribute that is less important than one's country of birth. A person's nationality indicates the legal status of this person in terms of rights (and duties), which may or may not coincide with his original nationality. However, a person's country of birth is a characteristic that largely determines his culture and family structure and even influences the process of regularization of this person's administrative status or naturalization, and in the case of ICTs may be associated with certain distinct technological uses.

In order for a given survey to be a useful tool in the comparison of human behavior, its questionnaire should collect detailed data on individual characteristics such as country of birth (of both the respondent and his household), length of residence, immigration trajectory, administrative status and nationality of the person interviewed.

In the Spanish context, the only survey that currently provides substantive information on immigrants is the nis-2007 (INE, 2007). However, the problem with this survey is that in addition to only having been conducted once, it barely explores technological variables. No questions are asked about ICTs possession or use, meaning that this information can only partially be inferred from certain indicators on the means used by immigrants to contact their families in the country of origin and ICTs use for jobseeking and sending remittances.

Table 2

At the European level, there is a conspicuous lack of survey data taking into account sociologically relevant aspects that characterize the immigrant population. A notable exception is the remarkable effort by the recent "Immigrant Citizens Survey" (Huddleston, Dag, and Callier, 2012), undertaken by the King Baudouin Foundation and the Migration Policy Group. This is the first transnational study to record the views of the immigrant population on the integration policies adopted by various administrations. The survey, conducted on 7 000 immigrants legally resident in 15 cities and six E.U. countries (Germany, Belgium, Spain, France, Hungary, and Portugal) focuses on analyzing respondents' perception of the labor market, participation social and education. However, the survey barely analyzes technological variables.

Eurostat surveys on "Community Survey on ICT Usage in Households and by Individual" have also overlooked fundamental aspects in the study of the immigrant population such as the respondent's country of birth (European Commission, 2012). In the Spanish case, even though the country of birth is recorded in the fieldwork, this datum is not fully transferred to the data matrix, thereby constituting an information processing error. Not having a correctly categorized variable on the country of birth entails a significant loss of information for the study of the adaptation of the immigrant population to the network society.

For example, the Spanish "Community Survey on ICT Usage in Households and by Individual" (2009) asks, "What is your country of birth?" (the interviewer describes the country) and the datum is entered in the re-encrypted data matrix in one of the following three categories: "Spain", "another European Union country", "a country outside the European Union". This oversight makes it difficult for researchers to make valid descriptive inferences, since it assumes that the behavior of those in the three categories of country of birth is homogeneous.

Data from the Baròmetre de la Comunicació i la Cultura in Catalonia (table 3) suggest that within the group of interviewees categorized by the surveys derived from Eurostat as people from "a country outside the European Union", respondents' patterns of behavior are particularly heterogeneous, with a high variation as regards their origin (by region). The Latin American community, for example, shows high levels of ICT use, whereas the Sub-Saharan and Maghreb groups display relatively low percentages, except as regards use of the mobile telephone, the most universal technology. However, these data are unable to account for possible variations in the technological behavior of these people as a function of their country of birth.

Incorporating respondents' country of birth into survey data at both the European and national level is a necessary step in the advancement of studies concerned with analyzing how ICTs can contribute to the everyday economic, social, civic and political integration of the immigrant population.

Poor coding of the origin variable is certainly the most obvious case of the omission of sociologically relevant variables for a descriptive analysis of the behavior of the immigrant population. However, the absence of potentially relevant variables also increases the risk of introducing biases into the causal inferences that associate differences in ICT equipment, use or evaluation with the respondent's origin. Methodologically, as will be seen below, this is a more serious problem.

There are many studies and reports that have described different behavior patterns and technological attitudes between the native and immigrant population. In Germany, the "Migranten und Medien 2007" survey (ARD/ZDF Medienkommission, 2007) provides data indicating that the introduction of mobile phones and computers is higher among groups of immigrant origin. In Spain, certain studies (Boso and Ros, 2010; Kluzer, Hache, and Codagnone, 2008) point to a process of convergence on the quantitative use of ICT, yet indicate statistically significant differences in type of use, place of access and attitudes towards ICT. Despite the importance of this information, no study has succeeded in proving whether the differences in behavior and attitude found are actually due to the effect of the source variable or to other social factors intervening in the relationship. It is conceivable that the relative neglect of causal analysis in this area of knowledge is conditioned by the absence of key variables in the survey data.

Analytically, when one wishes to make a causal estimation through statistical survey analysis, the causal effect of X on Y is often expressed as β1, whose value can be calculated by a certain type of equation that provides an estimate of b1. However, as is well known, when a sociologically relevant control variable, X2 is omitted, it may create a significant methodological problem. In other words, if the surveys through which researchers attempt to link certain attributes of individuals, such as being born in another country, with uses, behavior or attitudes regarding ICT, fail to provide information on certain key variables, the causal effects they are analyzing may be biased.

The years of residence, administrative status, or family's place of residence of the immigrant respondent are other examples of potentially relevant variables that do not usually appear in technological surveys questionnaires. This problem may be illustrated by the following example. Imagine that the immigrant population has a higher level of Internet access (Y) than the native population. In other words, the aim is to test the hypothesis that the effect of the origin variable (X1) on the Internet access (Y) variable is not null, and therefore X1 could be classified as a conditioning factor of Y. This would happen provided:

P(Y/X1) > P(Ȳ/X1)

In other words, X1 (being a person of immigrant origin), will be a determining factor of Y (Internet access) when the probability that Y occurs and, given that one knows that X1 is occurring, is more likely than the fact that Y will occur, given that X1 is known not to happen.

Imagine, on the other hand, that the longer an immigrant spends in the destination country, the more his level of access to Internet will decline and approach that of the native population (for example, because that person has already managed to reunite with his family with whom he previously communicated). If a researcher does not have the "years of residence in the country" ( X2) variable, and if -as happens in most surveys- the immigrant population with more years of residence is overrepresented in the sample, when he analyzes the data, he may be including errors in his inferences. In other words, if the latter variable has an independent effect on the dependent variable Y, the researcher's inferences may show an "omitted variable bias" (King, Keohane, and Verba, 2000:179) since he is unable to control this effect. The b1 estimate of β1 would be incorrect because it would not have taken into account the effect of another explanatory variable X2.

 

Measurement Problems in the Dependent Variable

A key aspect of all sociological research is to solve the measurement problem. In other words, all empirical research must find ways of transforming empirical operations commonly used in the social sciences into abstract concepts and to do so by meeting the criteria of validity and reliability. Questions in technological survey questionnaires on citizens' evaluation and attitudes towards ICT, often contain measurement errors.2

In the current empirical research on the adaptation of the immigrant population to the network society, there is interest in determining the attitudes of the various groups of immigrants towards ICTs. The set of a person's tendencies and feelings, prejudices and preconceived ideas, notions, fears, concerns and beliefs towards ICTs is a type of attribute that is more difficult to record than other aspects such as the use or possession of the latter. This may explain why, in general, the assessment of ICTs and their emotional aspects is among the least explored elements of social research, and is not usually recorded in the questionnaires of the most important surveys.

So much so that the technological survey questionnaires modeled on Eurostat lack any questions about the attitudes or opinions of citizens surveyed about ICTs. Very few surveys contain questions of this kind in their questionnaires, whereas in surveys with attitudinal variables, they are often inaccurate or insufficiently elaborated. Surveys by the Centre d'Estudis d'Opinió in Catalonia (CEO, 2006, 2008, 2009, 2011), for example, use self-positioning interval scales in which the two extreme categories are the only significant ones. In other words, in this survey questionnaire, respondents must assess the "usefulness" of a particular ICTs, such as Internet, mobile phone, cable TV, in an interval with a range of 0 to 10. The information yielded by the survey on the population's attitudes towards ICT is not that rich and its validity questionable.

First, as one can see in graph 1, most answers tend to be concentrated in the extreme positive response values. The generic formulation of the question makes it impossible to effectively capture possible variations in the assessment of ICTs, possibly because participants may choose to give socially desirable responses to overly-generic questions. The usefulness of the Internet in the context of the network society is particularly noticeable in the media. A respondent might therefore place a high value on the usefulness of this particular ICTs, whereas in fact he only values it positively because of the possibilities it affords him of communicating with his family of origin and believes that it is not very useful in other significant areas of his life.

Scales simplified into a single element, in this case usefulness, are usually less valid when it comes to correctly registering a concept as abstract as the perception of ICTs. In order to advance the understanding of human behavior in the context of the network society, and more specifically, in the analysis of the adaptation of the immigrant population to this new technological environment, it is undoubtedly necessary to advance the construction of additive scales capable of empirically recording the multiple dimensions of people's attitudes towards ICTs.

A common methodological problem in survey-based research is the procedure for estimating and finding out about people who cannot be interviewed (because they do not have a telephone for telephone surveys, for example). Technically, this problem, defined as a coverage error, occurs when certain units of the target population are not considered within the population from which the sample is drawn. It is a well-known fact that the main drawback created by the non-coverage of a particular group of people in a survey is the loss of representation of the general population from which the researcher seeks to draw inferences, since by ignoring a segment of the population, a selection bias is introduced into the inference process (Groves, 2004:54-85).

In the case of the immigrant population, coverage errors are common in surveys. Gaining access to the immigrant population usually requires overcoming a series of obstacles, such as the lack of reliable census data on this group, the presence of immigrants with irregular immigration status, the gender role attributed to women, attitudes of suspicion or rejection regarding scientific research or simply the desire to go unnoticed (Maya, 2001).

First of all, accurate information is not usually available on the population of reference. Many immigrants with irregular migratory status are ignored in official records. The unstable work and social situation of many immigrants leads to many "entries and exits" in their current residence or work permits. Consequently, census and voting data and any other official records often contain inaccurate information on the immigrant population. In the absence of a complete list of the latter it is impossible to assign a known probability to all the units comprising it so that they can be included in the sample. In other words, without a complete list of all the immigrants living in a particular country, it is difficult to obtain a random sample that is representative of this population.

Second, quite apart from the problem of the lack of a complete list of the immigrant population, there are often problems of access to certain strata of this sector. It is a well-known fact that certain groups are difficult to interview, either because of language difficulties, certain cultural biases, or problems of social visibility. Gaining entry to the immigrant community, in other words, establishing preliminary contacts and conducting initial interviews is not usually a simple task. Sometimes the incentives or methods used to record native participants are not valid for the immigrant population and long periods of time are required to overcome psychological or cultural resistance and obtain an adequate selection of respondents.

Once the problem of access to the immigrant population has been overcome, the next challenge is to obtain a high response rate and a sufficiently heterogeneous sample in demographic variables. The problems of size and representativeness of the sample are often the result of excessive concentration in groups that are more readily accessible to interviewers. These two problems jeopardize both the validity of the construct and the external validity of the results. In numerous surveys, the low "N" of participants of immigrant origin means that in the multivariate statistical analysis, it is impossible to make correct causal inferences.

Finally, the third source of coverage error arises from the telephone data collection method used by most of the surveys that serve as the basis for empirical research on immigration and ICT. Despite the wide use of the telephone in most households in the host country, not all members of the immigrant population have one in their homes. In Spain, as one can see from table 4, about 4 in 10 immigrants have no landline in their homes.

Note that the key to the methodological problem caused by coverage errors in telephone surveys linking new technologies to respondents of immigrant origin is not so much the omission of this stratum of the population itself as the fact that the subjects included in the sample possess a series of attributes that make them different from those who are outside it, which have implications as regards their attitudes, behavior and ownership of ICTs.

Numerous studies, including the classic one by Trewin and Lee (1988), show how households with telephones differ from households without telephones in key variables for sociological analysis such as household size, income level or regime of housing ownership or rental. Peleteiro and Gabardo (2006:22) note that in Spain, people who do not have landlines at home tend to be younger than the average population, are more likely to be single or divorced and to form part of the workforce than the rest of the population while one in four is foreign. Also, within the immigrant population, the segment with landlines at home usually enjoys a higher social status than the rest of the immigrant population that does not have a landline.

For the above reasons, the risk of introducing a bias into inferences about the relationship between certain properties that characterize the immigrant population and certain uses and appraisals of ICTs is extremely high. In general, when a selection bias is made, it means that data have been collected incorrectly, since the researcher's observations are limited to a smaller range of changes than those that would occur in a sociologically relevant variable in the real world.

If one of the selection criteria for the sample (in this case, having a landline) correlates with some of the dependent variables most commonly addressed in studies on immigration and new technologies, the mean of the estimates of the studies based on data from telephone surveys is likely to be artificially low. In other words, the numerical estimates of the causal effects studied can be assumed to be closer to zero than they are in actual fact.

 

Endogeneity Due to Reverse Causality

The study of the adaptation of the immigrant population to the network society is usually approached from the analysis of the relationship between ICT and the incorporation of this group into the workforce. Chiswick and Miller (2007), for example, note that the fact that the bulk of the immigrant population is in a worse socioeconomic situation than the native population, may partly explain some of the differences observed in ICT ownership or use. Following their analysis model, an individual i's possession of a computer in the home (Dt¡) depends on D = f (price, individual characteristics, characteristics of the other components of the home, family structure, level of paternalism).

Note that computer ownership at home is therefore, at least partially, a result of variables such as family income, the head of household's status in the work force or the educational attainment of household members. At the same time, however, in the academic literature on the network society, it has been argued that the greater capacity of access to ICTs, which can partly be materialized in the fact of having a computer and Internet at home, or the computer skills of certain individuals, is precisely the fact that determines wealth or social status in the network society (Castells, 2001; Castells and Cardoso, 2005; Diminescu et al., 2009; Garrido et al., 2010).

Communication appears to have a key value in immigrants' training in today's society (Sen, 1999) and even in achieving "competitive advantages" (Van Dijk, 2005) in the medium and long term. Those who have the means and skills to manage communication and information flows in the network society will obtain competitive advantages that will presumably enable them to gain access to higher earnings.

The factors that appear to cause variations in computer ownership may also be a consequence of the latter. Most studies serve as sources of cross-sectional data that prevent an accurate estimation of the timing between these components. Thus one of the main methodological challenges in the study of the economic integration of the immigrant population in the network society is to ensure the absence of endogeneity in the explanations that researchers bring to this area of knowledge.

In the processes of drawing causal inferences, social researchers must ensure compliance with the assumption of "conditional independence". In other words, the values attributed to explanatory variables must be independent of dependent variables. Observance of this principle is often defined as the absence of endogeneity. As illustrated in the previous example, causal models experience problems of endogeneity when the factors assumed to affect a particular estimate, depend in turn on that result. Endogeneity problems due to reverse causation affect several research papers analyzing the social processes and dynamics governing the network society.3 Despite growing interest in the detection and correction of such problems in the social sciences (Hamilton and Nickerson, 2003), studies that have attempted to show the links between the fact of being an immigrant and differential ICT use equipment are not immune to this problem.

Since 1974, econometric techniques to control for endogeneity have greatly increased and developed (Heckman, 1974; Lee, 1978). Although these processes may help clarify the causal sequence of a problem as described above, the data provided by surveys of a cross-cutting nature remain poorly suited to overcoming this obstacle. In order to assess the possible effects of empowerment ICTs can provide for certain strata of society, longitudinal data are required that will allow us to find the causal links between the temporality of events.

 

Conclusions

Determining the processes of adaptation of the immigrant population in the network society poses a significant challenge to the sociology of migration. How does the immigrant population use ICTs in the various spheres of its life? Does it use them to access public services or training opportunities? What effects does ICTs use have on the composition of migratory social networks; the linking and orientation of the extrapolation of the uses and patterns of communication and access to information on the developmental needs created at the different stages of the migration cycle? To what extent do the integration models in each E.U. country help or hinder the ability of the immigrant population to access or use ICTs? What are the consequences of the digital gap on certain segments of the immigrant population? The purpose of understanding the links between digital inclusion and the full insertion of the immigrant population into host societies tests existing sources of quantitative data.

Although the results of a number of recent studies on ICT use by the immigrant population in Europe, both qualitative and quantitative, appear to converge, noting that the immigrant population has become a regular ICT user, some sociologically relevant issues remain unanswered, partly as a result of the difficulty of overcoming any of the four methodological challenges outlined in this article.

There are data matrices with considerable potential to address these challenges, such as the Eurostat annual surveys on "Community Survey on ICTs Usage in Households and by Individual". However, some of the reasons why there is an urgent need to improve their performance have already been pointed out. Coverage errors may be corrected by acting in both directions. Likewise, the problem of the difficulty of access to the immigrant population can be solved by investing more resources during the phase of locating subjects. It is worth making as many visits to the home of the sample subjects as necessary. Channels of location can be expanded and there are increasing possibilities of using the mobile phone or the Internet as tools for collecting complementary data. Quite apart from the above, data collection may be enhanced by devoting more time and resources to translating questionnaires into different languages.

The problems of measuring indicators that attempt to empirically capture citizens' appraisal and attitudes towards ICTs can also be addressed. In order to provide the attitudinal variables of technological surveys with a certain degree of content validity, the conceptualization of this appraisal should be enhanced in order to determine the main dimensions. This theoretical work should facilitate the reconfiguration of survey questionnaires by improving data collection on this aspect of ICTs.

Lastly, the development of longitudinal data matrices on the adaptation of the population in network societies would provide a solid foundation for social researchers to make explanatory inferences efficiently and avoid problems stemming from the uncertainty of the timing of the causes and effects studied. Access to longitudinal data would make it easier for social researchers to avoid problems of endogeneity due to reverse causality between variables such as socio-economic status and ICT use in the study of the immigrant population.

 

References

ARD/ZDF-MEDIENKOMMISSION, 2007, "Migranten und Medien 2007", in Heinrich-Böll-Stiftung, pp. 1-112. Available at <http://www.migration-boell.de/downloads/diversity/ZDF_ARD_Migranten_und_Medien_2007_Handout_neu.pdf> (last accessed on February 15, 2013.         [ Links ]

BASCH, Linda; Nina GLICK-SCHILLER, and Cristina SZAN-TON BLANC, 2003, Nations Unbound: Transnational Projects, Postcolonial Predicaments and Deterritorialized Nation-States, London, Routledge.         [ Links ]

BECK, Ulrik, 1999, ¿Qué es la globalización?, Barcelona, Paidós.         [ Links ]

BECK, Ulrik, 2004, Poder y contrapoder en la era global, Barcelona, Paidós.         [ Links ]

BOSO, Àlex and Adela ROS [lecture], 2010, "Immigrants' Accommodation to the Network Society: High Access for Staying in the Same Place?", Gothenburg, XVII ISA World Congress of Sociology, July 11-17.         [ Links ]

CASTELLS, Manuel, 2000, The Rise of the Network Society, Oxford, Blackwell.         [ Links ]

CASTELLS, Manuel, 2001, The Internet Galaxy: Reflections on the Internet, Business and Society, Oxford, Oxford University Press.         [ Links ]

CASTELLS, Manuel, 2009, Comunicació i poder, Barcelona, Editorial UOC.         [ Links ]

CASTELLS, Manuel and Gustavo CARDOSO, 2005, eds., The Network Society. From Knowledge to Policy, Washington, DC, Johns Hopkins Center for Transatlantic Relations.         [ Links ]

CASTELLS, Manuel et al., 2003, La societat xarxa a Catalunya, Barcelona, Random House-Mondadori/Rosa dels Vents/Editorial UOC.         [ Links ]

CASTELLS, Manuel et al., 2007, Mobile Communication and Society. A Global Perspective, Cambridge, United States, The MIT Press.         [ Links ]

CASTLES, Stephen and Mark J. MILLER, 2009, The Age of Migration, London, Palgrave.         [ Links ]

CENTRE D'ESTUDIS D'OPINIÓ (CEO), 2006, "Enquesta sobre l'ús de les noves tecnologies 2006", in Els estudis d'opinió de la Generalitat de Catalunya al vostre abast, Generalitat de Catalunya, October 27 (Registre d'Estudis d'Opinió, no. 364). Available at <http://www.ceo.gencat.cat/ceop/AppJava/pages/estudis/registrats/> (last accessed on February 15, 2013).         [ Links ]

CENTRE D'ESTUDIS D'OPINIÓ, 2008, "Estudi quantitatiu sobre el context en què es mouen els serveis d'informació i atenció de la Generalitat de Catalunya i el grau de coneixement de les noves tecnologies per part de la ciutadania 2008", in Els estudis d'opinió de la Generalitat de Catalunya al vostre abast, Generalitat de Catalunya, July 31 (Registre d'Estudis d'Opinió, no. 451). Available at <http://www.ceo.gencat.cat/ceop/AppJava/pages/estudis/registrats/> (last accessed on February 15, 2013).         [ Links ]

CENTRE D'ESTUDIS D'OPINIÓ, 2009, "Estudi quantitatiu per conèixer l'evolució del coneixement i ús de les noves tecnologies i dels serveis d'atenció als ciutadans. Onada 2008", in Els estudis d'opinió de la Generalitat de Catalunya al vostre abast, Generalitat de Catalunya/Registre d'Estudis d'Opinió, June 2 (Registre d'Estudis d'Opinió, no. 510). Available at <http://www.ceo.gencat.cat/ceop/AppJava/pages/estudis/registrats/> (last accessed on February 15, 2013).         [ Links ]

CENTRE D'ESTUDIS D'OPINIÓ, 2010, "Estudi quantitatiu per conèixer l'evolució del coneixement i ús de les noves tecnologies i dels serveis d'atenció als ciutadans. Onada 2009", in Els estudis d'opinió de la Generalitat de Catalunya al vostre abast, Generalitat de Catalunya, June 2 (Registre d'Estudis d'Opinió, no. 583). Available at <http://www.ceo.gencat.cat/ceop/AppJava/pages/estudis/registrats/> (last accessed on February 15, 2013).         [ Links ]

CENTRE D'ESTUDIS D'OPINIÓ, 2011, "Estudi quantitatiu per conèixer l'evolució del coneixement i ús de les tecnologies de la informació i la comunicació i dels serveis d'atenció de la Generalitat de Catalunya entre la ciutadania en l'any 2010", in Els estudis d'opinió de la Generalitat de Catalunya al vostre abast, Generalitat de Catalunya, June 2 (Registre d'Estudis d'Opinió, no. 627). Available at <http://www.ceo.gencat.cat/ceop/AppJava/pages/estudis/registrats/> (last accessed on February 15, 2013).         [ Links ]

CHISWICK, Barry and Paul MILLER, 2007, "Computer Usage, Destination Language Proficiency and the Earnings of Natives and Immigrants", Review of Economics of the Household, vol. 5, no. 2, pp. 129-157.         [ Links ]

CODAGNONE, Cristiano and Stefano KLUZER, 2011, "ICT for the Social and Economic Integration of Migrants into Europe, EUR 24719 EN - 2011", JRC Scientific and Technical Reports, Luxembourg. Available at <http://ftp.jrc.es/EURdoc/jRC63183.pdf> (last accessed on June 18, 2012).         [ Links ]

DIMINESCU, Dana, 2002, "L'usage du téléphone portable par les migrants en situation précaire", Hommes et Migrations, no. 1240, pp. 66-81.         [ Links ]

DIMINESCU, Dana, 2004, "Le migrant connecté", Migrations/ Société, vol. 17, no. 102, pp. 275-292.         [ Links ]

DIMINESCU, Dana, 2008, "The Connected Migrant: An Epistemological Manifesto", Social Science Information, vol. 47, no. 4, pp. 565-579.         [ Links ]

DIMINESCU, Dana et al., 2009, "ICT for Integration, Social Inclusion and Economic Participation of Immigrants and Ethnic Minorities: Case Studies from France", JRC Technical Notes, Sevilla, European Commission. Available at <http://ftp.jrc.es/EURdoc/JRC51834_TN.pdf> (last accessed on June 18, 2012).         [ Links ]

EUROPEAN COMMISSION, 2012, "Community Survey on ICT Usage in Households and by Individual", Eurostat. Available at <http://epp.eurostat.ec.europa.eu/statistics_explained/index.php/Glossary:Community_survey_on_ICT_usage_in_households_and_by_individuals> (last accessed on February 15, 2013).         [ Links ]

FUNDACIÓ AUDIÈNCIES DE LA COMUNICACIÓ I LA CULTURA (FUNDACC) [digital publication], 2009, "Resum 1a onada 2009. Baròmetre de la Comunicació i la Cultura. Catalunya", El Baròmetre de la Comunicació i la Cultura, Barcelona, Fundacc (REO, no. 484). Available at <http://www.fundacc.org/docroot/fundacc/pdf/resum_any_natural_08_barometre_cat.pdf> (last accessed on February 15, 2013).         [ Links ]

GARRIDO, María et al., 2010, "Immigrant Women, E-skills & Employability in Europe: The Case of Hungary, Italy, the Netherlands, Romania, and Spain", Seattle, Technology & Social Change Group-University of Washington.         [ Links ]

GROVES, Robert, 2004, Survey Errors and Survey Costs, New Jersey, John Wiley & Sons.         [ Links ]

HAMILTON, Barton H. and Jackson A. NICKERSON, 2003, "Correcting for Endogeneity in Strategic Management Research", Strategic Organization, vol. 1, no. 1, pp. 51-78.         [ Links ]

HORST, Heather and Daniel MILLER, 2006, The Cell Phone: An Anthropology of Communication, Oxford/New York, Berg.         [ Links ]

HECKMAN, James, 1974, "Shadow Prices, Market Wages, and Labor Supply", Econometrica, vol. 42, no. 4, pp. 679-694.         [ Links ]

HEPP, Andreas; Stefan WELLING, and Bora AKSEN, 2009, "ICT for Integration, Social Inclusion and Economic Participation of Immigrants and Ethnic Minorities: Case Studies from Germany", JRC Technical Notes, Seville, European Commission. Available at <http://ftp.jrc.es/EURdoc/JRC53397_TN.pdf> (last accessed on June 18, 2012).         [ Links ]

HUDDLESTON, Thomas; Jasper DAG TJADEN, and Louise CALLIER, 2012, Immigrant Citizens Survey. How Immigrants Experience Integration in 15 European Cities, Brussels, King Baudouin Foundation/Migration Policy Group, pp. 1-92. Available at <http://www.immigrantsurvey.org/downloads/ICS_ENG_Full.pdf> (last accessed on February 15, 2013).         [ Links ]

INSTITUTO NACIONAL DE ESTADÍSTICA (INE), 2007, "National Immigrant Survey 2007 (NIS-2007)", INE/Ministerio de Trabajo e Inmigración/Universidad Complutense de Madrid. Available at <http://www.ine.es/jaxi/menu.do;jsessionid=4BE0D4091BB0A2D8E6152333F52BE6FC.jaxi03?type=pcaxis&path=%2Ft20%2Fp319&file=inebase&L=1> (last accessed on February 15, 2013).         [ Links ]

INSTITUTO NACIONAL DE ESTADÍSTICA, 2009, "Survey on Equipment and Use of Information and Communication Technologies in Households (ICT-H)", INE. Available at <http://www.ine.es/ss/Satellite?L=en_GB&c=INEPublicacion_C&cid=1259925186941&p=1254735110606&pagename=ProductosYServicios%2FPYSLayout&tittema=Society> (last accessed on February 15, 2013).         [ Links ]

INSTITUTO NACIONAL DE ESTADÍSTICA, 2012, "Survey on Equipment and Use of Information and Communication Technologies in Households (ICT-H)", INE. Available at <http://www.ine.es/ss/Satellite?L=en_GB&c=INEPublicacion_C&cid=1259925186941&p=1254735110606&pagename=ProductosYServicios%2FPYSLayout&tittema=Society> (last accesed on December 10, 2013).         [ Links ]

INTERNATIONAL ORGANIZATION FOR MIGRATION (IOM), 2010, World Migration Report 2010. The Future of Migration: Building Capacities for Change, Geneva, IOM. Available at <http://publications.iom.int/bookstore/free/WMR_2010_ENGLISH.pdf> (last accessed on 23, 2012).         [ Links ]

KING, Gary; Robert O. KEOHANE, and Sidney VERBA, 2000, El diseño de la investigación social. La inferencia científica en los estudios cualitativos, Madrid, Alianza.         [ Links ]

KLUZER, Stefano; Alexandra HACHÉ, and Cristiano CODAGNONE, 2008, "Overview of Digital Support Initiatives for/by Immigrants and Ethnic Minorities in the EU27", Seville, Institute for Prospective Technological Studies/JRC- European Comission. Available at <http://ftp.jrc.es/EURdoc/JRC48588.pdf> (last accessed on May 21, 2012).         [ Links ]

LANDOLT, Patricia, 2008, "The Transnational Geographies of Immigrant Politics: Insights from a Comparative Study of Migrant Grassroots Organizing", The Sociological Quarterly, vol. 49, no. 1, pp. 53-77.         [ Links ]

LARSEN, Jonas; John URRY, and Kay AXHAUSEN, 2006, Mobilities, Networks, Geographies, Hampshire, Ashgate.         [ Links ]

LEE, Lung-Fei, 1978, "Unionism and Wage Rates: A Simultaneous Equation Model with Qualitative and Limited (Censored) Dependent Variables", International Economic Review, vol. 19, no. 2, pp. 415-433.         [ Links ]

LEVITT, Peggy and Nina GLICK-SCHILLER, 2004, "Conceptualizing Simultaneity: A Transnational Social Field Perspective on Society", International Migration Review, vol. 38, no. 3, pp. 1002-1039.         [ Links ]

LLOPIS-GOIG, Ramón, 2007, "El 'nacionalismo metodológico' como obstáculo en la investigación sociológica sobre migraciones internacionales", Empiria. Revista de Metodología de Ciencias Sociales, no. 13, January-June, pp. 101-117.         [ Links ]

MARTON, Adam, 1988, Sampling and Non-sampling Errors in Surveys, Vitoria, Basque Country, Euskal Estatistika Erakun-dea-Basque Government.         [ Links ]

MAYA JARIEGO, Isidro, 2001, "Sesgos de medida y problemas de muestreo en las encuestas de poblaciones inmigrantes", Metodología de Encuestas, vol. 3, no. 2, pp. 197-213.         [ Links ]

MAYA JARIEGO, Isidro et al., 2009, "ICT for Integration, Social Inclusion and Economic Participation of Immigrants and Ethnic Minorities: Case Studies from Spain", JRC Technical Notes, Sevilla, European Commission. Available at <http://ftp.jrc.es/EURdoc/JRC51774_TN.pdf> (last accessed on February 25, 2012).         [ Links ]

NEDELCU, Mihaela, 2009, Le migrant online. Nouveaux modèles migratoires à l'ère du numérique, Paris, L'Harmattan.         [ Links ]

OFFICE OF COMMUNICATION (OFCOM) [research document], 2007, "Communications Market Special Report. Ethnic Minority Groups and Communications Services", June 21. Available at <http://stakeholders.ofcom.org.uk/binaries/research/cmr/ethnic_grps.pdf>, last accessed on October 16, 2013.         [ Links ]

OFFICE OF COMMUNICATION, 2008, "Media Literacy Audit: Report on UK Adults from Ethnic Minority Groups". Available at <http://stakeholders.ofcom.org.uk/binaries/research/media-literacy/ml_emg.pdf> (last accessed on October 16, 2013).         [ Links ]

ØSTERGAARD-NIELSEN, Eva, 2003, "The Politics of Migrants' Transnational Political Practices", International Migration Review, vol. 37, no. 3, pp. 760-786.         [ Links ]

PELETEIRO, Isabel and José Andrés GABARDO, 2006, "Los hogares 'exclusivamente móviles' en la investigación telefónica de audiencia", Metodología de Encuestas, vol. 7, no. 3, pp. 17-40.         [ Links ]

PORTES, Alejandro, 2003, "Conclusion: Theoretical Convergencies and Empirical Evidence in the Study of Immigrant Transnationalism", International Migration Review, vol. 37, no. 3, September, pp. 874-892.         [ Links ]

PORTES, Alejandro; Cristina ESCOBAR, and Alexandria WALTON RADFORD, 2007, "Immigrant Transnational Organizations and Development: A Comparative Study", International Migration Review, vol. 41, no. 1, March, pp. 242-281.         [ Links ]

ROS, Adela, 2010, "Interconnected Immigrant in the Information Society", in Andoni Alonso and Pedro J. Oiarzabal, eds., Diasporas in the New Media Age: Identity, Politics and Community, Reno, United States, University of Nevada Press, pp. 19-38.         [ Links ]

SEN, Amartya, 1999, Development as Freedom, New York, Knopf Press.         [ Links ]

SHELLER, Mimi and John URRY, 2006, "The New Mobilities Paradigm", Environment and Planning A, vol. 38, no. 2, pp. 207-226.         [ Links ]

SMITH, Anthony D., 1979, Nationalism in the Twentieth Century, Oxford, Oxford University Press.         [ Links ]

TREWIN, Dennis and Geoff LEE, 1988, "International Comparisons of Telephone Coverage", in Robert M. Groves et al., eds., Telephone Survey Methodology, New York, John Wiley & Sons, pp. 9-24.         [ Links ]

URRY, John, 2000, Sociology beyond Societies. Mobilities for the Twenty-First Century, London, Routledge.         [ Links ]

VAN DIJK, Jean, 2005, The Deepening Divide. Inequality in the Information Society, Thousand Oaks, United States, Sage Publications.         [ Links ]

VANCEA, Mihaela [doctoral dissertation], 2009, "The Political Transnationalism of Immigrant Associations in Barcelona", Barcelona, Departamento de Ciencias Políticas y Sociales-Universitat Pompeu Fabra.         [ Links ]

VANCEA, Mihaela and Nihil OLIVERA, 2012, "Emigrant Women in Catalonia: Mobile Phone Use and Maintenance of Family", Gender, Development and Technology, vol. 17, no. 2, July, pp. 179-203.         [ Links ]

VERTOVEC, Steven, 2004, "Cheap Calls: The Social Glue of Migrant Transnationalism", Global Networks, vol. 4, no. 2, pp. 219-224.         [ Links ]

WALLERSTEIN, Immanuel, 1974, The Modern World System, New York, Academic Press.         [ Links ]

WIMMER, Andreas and Nina GLICK-SCHILLER, 2003, "Methodological Nationalism, the Social Sciences, and the Study of Migration: An Essay in Historical Epistemology", International Migration Review, vol. 37, no. 3, September, pp. 576-610.         [ Links ]

ZHAN, Yujie et al., 2009, "Bridge Employment and Retirees' Health: A Longitudinal Investigation", Journal of Occupational Health Psychology, vol. 14, no. 4, pp. 374-389.         [ Links ]

 

Notas

* Text originally written in Spanish.

1 The International Organization for Migration (iom, 2010) defines an immigrant as an individual who resides in a country different from that of his birth (whether or not on a regular basis), for a period of up to or over a year. The choice of a period of one year is not arbitrary; it is the period that the scientific community deems necessary to distinguish an immigrant from a person in another type of situation involving mobility such as tourism or transit migration.

2 Following Marton (1988:17), the measurement error can be defined as, "The difference between the observed value and the actual value of a given unit", and originates in the lack of fit between the data collected and the concept used.

3 The following examples may serve to illustrate this fact. A recent study conducted by researchers at the University of Maryland states that retirees who continue to work are healthier (Zhan et al., 2009). However, extreme caution must be used in evaluating these results, since it is plausible that the health of retirees who are working part-time is not actually better but rather that retirees who are healthier are those who choose to continue working. If so, this would be a problem of endogeneity due to reverse causality.

 

INFORMACIÓN SOBRE LOS AUTORES

MIHAELA VANCEA: es doctora en ciencias políticas por la Universitat Pompeu Fabra de Barcelona y licenciada en sociología y matemáticas por la Universitatea Babes-Bolyai (Rumania). Es profesora-investigadora posdoctoral en el Departamento de Ciencias Políticas y Sociales de la Universitat Pompeu Fabra de Barcelona. Realizó estancias de posgrado en el Departamento de Sociología de la Lund University (Suecia) y en el Instituto Internacional de Sociología Jurídica de Oñati (País Vasco). También fue investigadora posdoctoral del Internet Interdisciplinary Institute de la Universitat Oberta de Catalunya. Sus principales líneas de investigación son el estudio de los procesos migratorios en la sociedad red, la sociología de las migraciones, y los derechos humanos. Ha publicado diversos artículos en revistas internacionales entre los que destacan: "Emigrant Women in Catalonia: Mobile Phone Use and Maintenance-of Family Relationships", Gender, Technology and Development (vol. 17, núm. 2, 2013), y (en coautoría con Àlex Boso) "Basic Income for Immigrants? Reflections on the Pull Effect of Social Benefits", en Basic Income Studies (vol. 7, núm. 1, 2012).

ÀLEX BOSO: es doctor por el Departamento de Teoría Sociológica, Filosofía del Derecho y Metodología de las Ciencias Sociales de la Universitat de Barcelona y licenciado en sociología por la misma universidad. Actualmente, es profesor en el Department of Political and Social Sciences de la Universitat Pompeu Fabra de Barcelona y en la Facultad de Ciencias de la Salud y Bienestar de la Universitat de Vic. Sus principales líneas de investigación son la sociología de las migraciones y el análisis de políticas medioambientales y de la salud. Ha sido investigador visitante del Centro de Investigaciones Filosóficas de Buenos Aires y del Internet Interdisciplinary Institute de la Universitat Oberta de Catalunya. Es autor o coautor de diversas publicaciones, entre las que destacan: "A Qualitative Study of Users' Engagement with Real-time Feedback from In-house Energy Consumption Displays", en Energy Policy (2013), y "Basic Income for Immigrants? Reflections on the Pull Effect of Social Benefits" (en coautoría con Mihaela Vancea), en Basic Income Studies (vol. 7, núm. 1, 2012).

Creative Commons License Todo o conteúdo deste periódico, exceto onde está identificado, está licenciado sob uma Licença Creative Commons