Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

The Effects of Contextual Factors on PSS Usefulness: an International Questionnaire Survey

The Effects of Contextual Factors on PSS Usefulness: an International Questionnaire Survey Contextual factors have been consistently argued as influencing the usefulness of planning support systems (PSS). Whereas previous studies were mostly conducted within a single planning project or based on experimental workshops, the present study looked at the application of PSS in smart city projects worldwide, and investigated the extent to which subjectively measured contextual factors contribute to PSS usefulness in smart cities. Based on a recent international questionnaire (268 respondents) de- signed to gather the perceptions of scholars and practitioners in the smart city realm, an ordinal regression model was fitted to assess the associations between the argued contextual factors and PSS usefulness. The results show that, in general, four contextual factors—namely the characteristics of the technology itself, user characteristics, char- acteristics of the planning process, and political context—have a significant influence on the usefulness of PSS, and that their impacts vary significantly. This paper empha- sizes that only when PSS users can identify the critical contextual factors that are favorable and unfavorable, will the potential benefits of PSS for spatial planning be fully achieved. . . . . . Keywords Smart cities Context Added value Functionality Usability Ordinal regression analysis Electronic supplementary material The online version of this article (https://doi.org/10.1007/s12061-020- 09352-5) contains supplementary material, which is available to authorized users. * Huaxiong Jiang h.jiang@uu.nl Stan Geertman S.C.M.Geertman@uu.nl Patrick Witte P.A.Witte@uu.nl Faculty of Geosciences, Department of Human Geography and Spatial Planning, Utrecht University, Utrecht 3584 CB, The Netherlands 222 H. Jiang et al. Introduction Recent years have seen a plethora of discussions and studies on how big data infra- structure, accrued through sensors, and associated information and communication technologies (ICTs) can help achieve sustainable development goals and improve the management of cities (Geertman and Stillwell 2020; Pan et al. 2019; Thakuriah et al. 2017;Khan et al. 2015;Caragliu et al. 2011). In planning, planning support systems (PSS) have been imagined and conceptualized to make use of big data and interactive interfaces to achieve smart goals (Babar and Arif 2017;Deal etal. 2017a; Allwinkle and Cruickshank 2011). Defined as geo-information technology-based instruments, PSS are dedicated to supporting those involved in planning in the performance of their specific planning tasks (Geertman 2006, 2017). More recently, studies have shown that with the advent of urban sensing and ubiquitous computing, and the gradual standardization of embedded location information within administrative datasets on urban activities, the promise of a smart city has led to an exponential increase in data by several orders of magnitude (Geertman and Stillwell 2020). Consequently, such enormous volumes of data, or big data, act as valuable input for PSS. By capturing, analyzing, and integrating this real-time and up-to-date data into various types of PSS, spatial analyses related to the realm of urban planning in the city (e.g., energy consumption, land use, traffic congestion, energy usage, and air quality) are improved substantially (Rathore et al. 2016;Khan etal. 2015). Besides, ICTs and big data can also be used to enhance PSS’s capabilities for extending and transforming somewhat conventional citizens’ participa- tion practices, and for facilitating technology-facilitated communication and interplay between the formal political sphere (government) and the civil society sphere (citizens) (Jiang et al. 2019, 2020a;Khanet al. 2014). For instance, Pan et al. (2020)showthat urban informatics augmented by new smart data enhance the sharing of information to the general public and make planning processes more participatory and democratic, especially for disadvantaged groups. Geertman and Stillwell (2020) indicate that web- based PSS enable more non-state actors (i.e., individuals and organizations that are not affiliated to the government, such as private sector entities, academic institutions, and non-governmental organizations) to build solutions that enable the delivery of content, services, and even applications over the HTTP protocol. Briefly, PSS enabled by smart ICTs help enhance reach and range by enabling information to be shared across different stakeholders and contribute to aspects of the planning process, including data collection and storage, data analysis and presentation, plan- and policy-making, interpersonal dialogue and debate, and policy implementation and administration (Jiang et al. 2020b; Pettit et al. 2018; Zhang et al. 2019; Thakuriah et al. 2017). It should be noted, however, that in practice PSS have not fully achieved their potential, since their usefulness depends not only on the characteristics and capabilities of the tools themselves (Pan and Deal 2020; Geertman 2017; Russo et al. 2018; Pelzer 2015). It has been widely accepted that PSS need to be enhanced to better align the instruments with user requirements and the planning tasks and problems at hand, since the specific situations or contexts in which PSS are embedded have a significant influence on how PSS work in actual planning practice (Champlin et al. 2019; Geertman 2017; Geertman 2006). Here, context indicates the real circumstance or situation in which a PSS tool is embedded in planning practices. Empirical studies have demonstrated the influence of contextual factors on PSS usefulness. For instance, The Effects of Contextual Factors on PSS Usefulness: an... 223 Pelzer (2017) found that existing organizational hierarchies, the timing of the policy process, and the users’ characteristics (disciplinary background, existing habits, etc.) affect how the role of a PSS is perceived, implemented, and evaluated. Zhang et al. (2019) point out that digital literacy has prevented many ordinary people from engag- ing in web-based participatory planning. As Jiang et al. (2020c), Geertman (2017, 2006), and te Brömmelstroet (2010) argue, what can be achieved with a PSS, and the meaning of those achievements, largely depend on how the planning context is treated. However, despite the importance of contextual factors in influencing PSS usefulness in practice, research on PSS has concentrated more on aspects of the tools than on understanding the interactions between the tools and the contexts in which they are used (McEvoy et al. 2019;Champlin etal. 2019). This shortcoming is well recognized in the field of PSS, which calls for tools to be studied in the “real world, context-rich environment” (te Brömmelstroet 2013:306). Rather than taking a normative view, it embraces a more pragmatic attitude toward the role of ICT: To what extent can the implementation of ICT in planning become more effective and useful? (Deal et al. 2017b;Geertman 2017). Consequently, research into the supportive role of PSS in the realm of smart cities has recently been advanced to embrace such a question: What kinds of ICT are, or should be, implemented by what kinds of stakeholders in which types of planning situations, contexts, or circumstances? (Russo et al. 2018; Pelzer et al. 2015; Biermann 2011;Vonk 2006). It has to be noted, however, that the significance of the proposed guidelines for improving PSS usefulness in practice is still limited by a lack of studies on theorizing the different contextual factors and their effects in practice. Thus, the aim of this paper is to draw attention to the critical influence of contextual factors on the usefulness of PSS in smart cities. An ordinal regression model was applied to data gathered through an international questionnaire, to quantify the impact of the identified contextual factors on PSS usefulness. It should be noted that this study was anextension to theworkbyGeertman(2006), te Brömmelstroet (2013), and Pelzer (2017), who argue that further study could systematically analyze the effects of the contextual factors on PSS usefulness in practice. Based on this, Section 2 operationalizes the key terms describing earlier research and the various indicators related to the role of context in PSS usefulness. Section 3 introduces the methodology. Section 4 describes the main findings from the questionnaire. This is followed by a discussion in Section 5. The paper ends with a conclusion. Context and PSS Usefulness The study by Pelzer et al. (2014) found that the added value of PSS is often conceived as the focal point, since the questions permeating these studies not only reveal the value of PSS, but also contribute to supporting planning in a better way. From a general technological viewpoint, Nielsen (1994:24) conceptualizes the added value of a system as “usefulness,” which indicates “the issue of whether the system can be used to achieve some desired goal.” As te Brömmelstroet (2013) argues, the usefulness of PSS can be measured at both the process level and the outcome level. And Pelzer et al. (2014) highlight that an evaluation of the usefulness of a PSS tool should focus on at least three dimensions, namely individual, group, and outcome. Based on this, they identify seven major types of usefulness that a PSS tool can provide. 224 H. Jiang et al. In practice, scholars and professionals have developed a wide variety of applications to support all kinds of planning actions, ranging from highly strategic to operational actions (te Brömmelstroet 2013). However, what is remarkable about PSS is its long- standing implementation gap, that is, a discrepancy between supply and demand: Despite the availability of a growing number and variety of potentially valuable PSS instruments, planning practitioners are rather hesitant to buy, implement, or apply them (Geertman 2006, 2017). To find the main bottlenecks to increasing the usefulness of PSS in planning practice, numerous authors have identified that the support role of PSS is closely related to the context in which a PSS is applied (Luque-Martín and Pfeffer 2020;McEvoyetal. 2019; Zhang et al. 2019; Vonk and Geertman 2008; Vonk et al. 2005; Geertman 2006). According to Pelzer (2017), context influences both the extent to which a PSS is useful and the kind of usefulness that is achieved. For instance, at an early stage of a policy process, learning about the object might be the prime usefulness (cf. te Brömmelstroet 2010; Goodspeed 2013), whereas at a later stage efficiency might be more important. In addition, different planning styles affect how the technological intelligence is organized and operates; for example, the ICT-enabled centralized planning process in which the entire set of intelligent devices is arranged hierarchically and steered into one center, versus ICT-facilitated participatory planning processes in which new technologies enable various stakeholders to participate in urban issues. As Luque-Martín and Pfeffer (2020) summarize, local context specifics are one of the main factors that define the PSS-based potential solutions. Geertman (2006) provides a comprehensive conceptual discussion on the different contextual factors. In his framework, six major contextual factors are argued to influence the potential roles of PSS in planning practice, namely characteristics of the technology, content of the planning issue, user characteristics, characteristics of the planning process, planning style, and political context (see Fig. 1). The present study applied and operationalized these six contextual factors to further examine the effects of contextual factors on PSS usefulness in practice. Contextual Factors Characteristics of the Technology Regarding the characteristics of the technology itself, Geertman (2006) argues that planning support tools are contextual in that the support role of PSS proves to be more evident in operational decision-making than at the level of strategic decision-making. From a technological innovation perspective, the technology itself as a contextual factor can be understood from two variables: functionality and usability. Functionality “is the question of whether [the information-handling capabilities] of the system in principle can do what is needed” (Nielsen 1994:24). Since the planning tasks vary in different planning practices, a PSS tool in one specific project is unlikely to act in the same way in another project. Thus, an effective way to achieve planning support is to apply the information- handling capabilities of a PSS to support specific professional spatial-planning tasks (Luque-Martín and Pfeffer 2020;McEvoyetal. 2019; Zhang et al. 2019). Several authors (e.g., Jiang et al. 2020a;Vonk 2006) categorized these information-handling capabilities into three groups: informing, communicating, and analyzing & designing. & Informing indicates the functional support for transferring information in one direction only. The Effects of Contextual Factors on PSS Usefulness: an... 225 Characteristics of the technology Functionality: Informing; Communicating; Analyzing & Designing Usability: Transparency; User friendliness; Interactivity; Flexibility Content of the planning issue Types of urban issues: Economic issues; Social issues; Environmental issues The User characteristics usefulness Profession; Expertise level; User attitude of PSS Characteristics of the planning process Time pressure; Active uptaker; Funding P lanning style Closed planning; Interactive planning Political context Political pressure Fig. 1 Contextual factors influencing PSS usefulness (framework based on Geertman (2006: 867); the indicators describing each variable are explained in section 2.1) & Communicating describes the functional support for facilitating communication and discussion between those involved in the governance process through supporting flows of information between them. & Analyzing & designing indicates the functional support for examining spatial patterns of human behavior and facilitating the perception, production, and presen- tation of design ideas. Usability refers to “how well users can use that [functionality]” (Nielsen 1994:24). It indicates the goodness of fit between the capabilities of the user and the functionalities offered by the technology (Jiang et al. 2020a). In general, a high level of usability will lead to the more usefulness of a PSS. In literature, although a range of usability indicators have been identified (Pelzer 2015), four key indicators are widely used to describe the usability of a PSS: transparency, user friendliness, interactivity, and flexibility (Pan and Deal 2020;Champlinetal. 2019;teBrömmelstroet 2017; te Brömmelstroet 2012; te Brömmelstroet 2010; Vonk et al. 2005). & Transparency describes the extent to which the underlying models and variables of the PSS are visible to users. & User friendliness is the extent to which participants are able to use the tool themselves. & Interactivity refers to the extent to which the tool can directly respond to the users’ questions and suggestions. & Flexibility indicates the extent to which the tool can be applied to different planning tasks. 226 H. Jiang et al. Together, these functionality and usability indicators delineate the specific characteris- tics of the technology (PSS) itself. Content of the Urban Issue According to Rittel and Webber (1984), a range of strategic, nonroutine planning issues can be said to be ill-structured or at best semi-structured. New PSS are primarily developed to provide new capabilities to gain insights into genuinely unique spatial issues. However, it should be noted that many of the urban issues that PSS tools attempt to solve are typically ill-structured or ill-defined by nature (Klosterman 1997;Cats- Baril and Huber 1987). The consequence is that there is no clear procedural or predetermined way to solve a specific urban issue; instead, it requires diverse and innovative solutions. Because of this, the PSS—which usual promotes a false idea of value-free and objective knowledge of urban issues—exacerbates technocratic reduc- tionism (Söderström et al. 2014) and masks those urban conflicts and issues that are not visible in the digital representations (e.g., congestion, unemployment, pollution, and diseases peculiar to the urban way of life) (Verrest and Pfeffer 2019). Hence, to improve the appropriateness of dedicated PSS tools, it is vital to distinguish the different attributes of the urban issue. In this study, we applied the variable “types of urban issues” to operationalize the content of the urban issue. According to Campbell (1996), economic issues, social issues, and environmental issues are the three main types of urban issues. User Characteristics User characteristics are contextual factors in that they are a useful source of information that helps designers to foster an understanding of target users and the product under development (Chesbrough 2006; Geertman 2006). For each category of user, the demands and requirements regarding the content of the functionalities needed differ considerably. For instance, in the profession of planning practitioner, there is a signif- icant difference between more design-oriented practitioners and research-oriented practitioners: The former need more functional support that can stimulate their imag- ination and lead to original and innovative ideas, whereas research-oriented practi- tioners are more concerned about how a PSS functionality can gather, store, analyze, model, and visualize data in a digital representation (Brail and Klosterman 2001). As Geertman (2006: 868) argues, “professional protectionism plays a role of importance.” In addition, attributes of users such as competency, skill, knowledge, qualification, and proficiency level also affect the performance of PSS in practice (Zhang et al. 2019; Pelzer 2017; Holsapple et al. 2005). Without a doubt, an inexperienced newcomer (newbie) differs from a person who has comprehensive and authoritative knowledge or skill in terms of using PSS (expert) (Vonk et al. 2005). Finally, Vonk and Geertman (2008) argue that user attitude is also responsible for promoting the supportive role of PSS in their field. Users with a rational mindset and a positive attitude toward PSS will usually be early adopters and be more enthusiastic about PSS innovations and their added value. Therefore, a user-oriented approach in developing and implementing PSS requires a deeper understanding of user characteristics related to the expected and unexpected problems that users face when interacting with particular PSS tools. In this The Effects of Contextual Factors on PSS Usefulness: an... 227 study, the three previously mentioned variables—profession, expertise level, and user attitude—were applied to operationalize the user characteristics. Characteristics of the Planning Process The characteristics of a planning process are the qualities or features that are regarded as inherent parts of a plan. For instance, plans are made for a period of, say, five, ten, or more years. Therefore, in composing a plan and getting it politically approved, PSS users may face time pressure or strict deadlines (Geertman 2006;Vonk 2006). Then, active uptakers are responsible for signaling promising supportive roles of PSS in their field and bringing these to the attention of other potential users (Vonk and Geertman 2008). For instance, geo-information specialists have the important role of scanning the organization’s external environment, signaling PSS developments, and evaluating their usefulness to the planning organization (Vonk 2006). Besides, funding is also crucial for providing continuous support and maintenance of the PSS being used in practice (Ismail 2008; Hutchison et al. 2006). Thus, three variables are used to describe the characteristics of the planning process: time pressure, active uptaker, and funding. Planning Style A planning style is understood as the leading form of planning during a certain period of time (Pelzer 2015). It represents time-bound normative opinions as to the way in which the planning job should be performed (Healey 1997). However, it should be noted that the influence of planning style on PSS usefulness changes along with changes in time and place. For instance, the dominant rational comprehensive model in the 1960s led to the design and implementation of a range of large-scale computer- based systems (e.g., large-scale metropolitan land use, integrated municipal information systems, and urban transportation models) to solve some of the large and urgent urban issues (Chadwick 1977). Thus, the usefulness of PSS at that time was mainly related to gaining insights into urban issues. Then, in the 1990s, PSS were used to facilitate interpersonal communication and community-based debates because of the rise of participatory and collaborative planning (Pelzer 2015; Pettit 2005). In the present study, planning styles were categorized as either “closed planning” or “interactive planning” (Jiang et al. 2020b;Healey 1997). & In closed planning, the government and its agent planner act as the prime stake- holders in the planning process. & In interactive planning, also non-state actors—like citizens and the private sector— are important and involved in the planning process. Political Context As a decision-making process, each planning process should be aware of the broader political context in which it is embedded (Jiang et al. 2019;Lin 2018;Biermann 2011). This context has specific mechanisms that influence how technology is organized in planning practice. For instance, in democratic Western countries, there is a general 228 H. Jiang et al. consensus that the increasing number of crowdsourcing platforms, social media, smartphones, portals, and planning support systems should be applied to facilitate e- participation, e-democracy, and wider collaboration for collective problem-solving (Geertman and Stillwell 2020;Lin 2018). In contrast, in some societies that are tightly controlled by the government, the use of innovative technologies in planning is more oriented toward improving the efficiency and effectiveness of the planning process, for example, to gain a better understanding of the urban issue and inform the public of the plan (Long et al. 2011). According to some authors, the influence of the political context can be described as “political pressure” (Stanilov 2007), which reflects com- prehensive persuasion by, the influence of, or even intimidation from members of the political planning systems. PSS Usefulness As explained by Pelzer et al. (2014)and te Brömmelstroet (2013), the usefulness of PSS can be measured by different aspects or dimensions. However, it is worth mentioning that PSS usefulness is often demonstrated and asserted in PSS experimental case studies (Champlin et al. 2019; Pelzer et al. 2016;Pelzer 2015). Results show that the benefits obtained in an experimental environment, to a large extent do not meet the actual needs of users and planning practices (Geertman 2017; te Brömmelstroet 2013; Vonk 2006). Studies also tend to emphasize the importance of improving PSS func- tionalities and usability in optimizing PSS usefulness (Pan and Deal 2020; Silva et al. 2017; Pelzer 2017). Thus, there has been much argument that PSS validity and potential would benefit from being employed in a context-rich, real-world research scenario, as well as much lobbying for such employment (Jiang et al. 2020a, 2020c; Luque-Martín and Pfeffer 2020;McEvoy et al. 2019; Zhang et al. 2019;Vonkand Geertman 2008), since it would provide PSS with “a structure [to] constructively develop a coherent and comprehensive body of knowledge” (te Brömmelstroet 2013: 306). In the present study, we conducted a survey to determine the multidimensional impact of contextual factors on the usefulness of PSS in smart city practices. Although PSS usefulness consists of different levels and dimensions, we applied the subjective perception of the overall satisfaction of the supportive role of PSS in practice—“overall usefulness”—to measure PSS usefulness (Jiang et al. 2020a). Research Design Data Collection In order to study the effects of contextual factors on the usefulness of PSS in smart cities, we used an international questionnaire to gather and consolidate in-depth data and information concerning the application of PSS in smart city practices and to track performance across 55 quantitative indicators. The questionnaire was distributed to approximately 1300 members of the Computers in Urban Planning and Urban Man- agement (CUPUM) research community across a wide geographical area. The CUPUM community was selected for two reasons. First, CUPUM is a major international academic platform that offers a state-of-the-art overview of the availability and The Effects of Contextual Factors on PSS Usefulness: an... 229 applications of PSS-based methods, tools, and techniques, and it provides valuable and meticulous insights into a diverse range of social and environmental issues in the context of smart cities, big data, and smart urban futures (Geertman et al. 2019). Second, the perspectives of scholars and practitioners reflect the empirical case of applying PSS in practice, which provides a highly professional overview of the influence of contextual factors on PSS usefulness in the context of smart cities. The questionnaire, which was delivered by regular and electronic mailing systems, was administered over a 3-month period (May–July 2019). The questionnaire consisted of three main parts. The first part gathered the (anonymous) participants’ basic information (e.g., gender, age, profession, origin, expertise with planning support ICTs), whereas the second part gathered in-depth information about their knowledge regarding the application of PSS in practical smart city projects. The respondents were specifically asked whether in recent years they had been academically and/or professionally involved in smart city projects. The follow-up questions chiefly assessed the performance level of five indicators—namely urban problems, functionalities, usability, added value, and context—perceived by re- searchers and PSS experts. The questions in the third part were related to specifics of the 2019 CUPUM conference and were not of relevance to this research. Information about the influence of contextual factors on the usefulness of PSS in smart cities was obtained from the second part of the questionnaire. The development of the statements was based on previously recognized PSS literature. In order to effectively measure the strength of an individual’s perception of the importance and attainment of contextual factors’ roles, a 7-point rating system was used (1 = low, 7 = high). Respondents were not expected to respond to every statement. Data Processing This study used only the 18 statements related to the indicators presented in Section 2 to analyze the effects of context on PSS usefulness. It should be noted that “overall usefulness” (measured on a scale from 0 to 100 in the questionnaire) was recategorized into ordinal scale (from 1 to 5) to fit the relationship between the effects of contextual factors and PSS usefulness. “Types of urban issues” was regrouped as “economic issues,”“social–environmental issues,” and “mixed urban issues.”“Profession” was categorized as “academic researcher” and “practitioner.” The “academic research” group included academic researchers/scholars and doctoral students, while the “prac- titioner” group consisted of designers, politicians, and planners. As mentioned, “plan- ning style” was categorized as “closed planning” and “interactive planning.” All other indicators were measured on a 7-point scale. The value assignment types for each indicator are shown in the second column of Table 1. Statistical Analysis Of the approximately 1300 questionnaires that were distributed, 268 were completed (response rate of just over 20%). Of these, 175 were completed by respondents who had been involved in smart city projects in which the role of ICTs was significant, and we used their questionnaires in our analysis. In terms of geographical origin, more than half of the respondents were from China (53%); the other respondents were from 230 H. Jiang et al. Table 1 Variable measurement and descriptive statistics Variables (indicators) Measures Descriptive Statistics N Minimum Maximum Mean Std. Deviation Overall usefulness 1 = Low to 5 = High 175 1 5 2.90 0.842 Characteristics of the technology itself Informing 1 = Low to 7 = High 152 1 7 4.78 1.452 Communicating 1 = Low to 7 = High 151 1 7 4.34 1.544 Analyzing 1 = Low to 7 = High 163 1 7 5.60 1.480 Designing 1 = Low to 7 = High 149 1 7 4.91 1.495 Transparency 1 = Low to 7 = High 172 1 7 5.05 1.352 User-friendliness 1 = Low to 7 = High 172 1 7 4.84 1.424 Interactivity 1 = Low to 7 = High 170 1 7 4.51 1.461 Flexibility 1 = Low to 7 = High 171 1 7 4.74 1.356 Characteristics of the 1 = Economic 174 urban issue 2= Non-economic 3 = Mixed User characteristics Profession 1 = Academic researcher 175 2 = Practitioner User attitude 1 = Low to 7 = High 174 1 7 3.04 1.209 Expertise level 1 = Low to 7 = High 175 1 7 4.87 1.381 Characteristics of planning process Time pressure 1 = Low to 7 = High 166 1 7 3.20 1.526 Active uptaker 1 = Low to 7 = High 170 1 7 2.92 1.395 Funding 1 = Low to 7 = High 167 1 7 3.09 1.563 Planning style 1 = State-led 175 2 = Interactive Political context Political pressure 1 = Low to 7 = High 159 1 7 3.79 1.646 Europe (15.4%), Asia (excluding China) (14.2%), North America (5.1%), South America (5.1%), Oceania (5.1%), and Africa (2.3%). Approximately 61.7% of the respondents were academic researchers/scholars (including doctoral students); the others (practitioners) were planners (32.6%), politicians (2.3%), or designers (3.4%). Descriptive statistics were used to summarize the data (Table 1 and Appendix 1). Among all participants, the average score on “overall usefulness” was 2.90. Regarding “characteristics of the technology,” the average scores on “analyzing,”“designing,” and “transparency” are the top three indicators, whereas “communicating” had relatively lower scores (4.34). This indicates the different influences of the indicators of this variable. In terms of “characteristics of the urban issue,” the majority of the participants were involved in projects dealing with “mixed urban issues.” For the variable “user characteristics,” 61.7% of the participants were academic researchers, whereas 38.3% were practitioners, as mentioned. The average score on “expertise level” was much higher than the scores on “user attitude,” indicating the importance of “expertise level” The Effects of Contextual Factors on PSS Usefulness: an... 231 in influencing PSS usefulness. Concerning “characteristics of the planning process,” the indicator “time pressure” received higher scores than “active uptaker” and “funding.” Further, 44.6% of the participants were engaged in “closed planning” and 55.4% in “interactive planning.” Finally, the average score on “political pressure” was 3.79, showing its relatively large influence. Results Model Fitting Information To determine whether the effects of the argued contextual factors are statistically significant, ordinal logistical regression was employed to determine their associations. Table 2 shows the strength of associations, the predicted ability of the model, and goodness-of-fit statistics. Regarding the overall model test of the null hypothesis, the results yield a significance level of 0.000. Thus, it can be concluded that this is an important test, because the change in the likelihood function has a chi-square distribu- tion (Harrell Jr 2015). The pseudo-R statistics measures the success of the model in explaining the variations in the data, which is an indication of the strength of the association between the dependent (overall usefulness) and the independent variables (contextual factors). Since the results of Cox and Snell (0.878), Nagelkerke (0.955), and McFadden (0.834) are smaller than those for a linear model, the pseudo-R can be regarded as very satisfactory (Harrell Jr 2015). However, because the number of empty cells in the model is relatively large (there are 456 cells (80.0% of the total number) with zero frequencies), the goodness-of-fit measures of Pearson and Deviance are not reliable. Ordinal Regression Model to Explain PSS Usefulness The detailed results of the calculations are summarized in Appendix 2. All variables were simultaneously added to the model along with a statistically significant two-way interaction term. The test of the proportional odds assumption was non-significant for the two models, suggesting that effects were proportional across the categories of the Table 2 Overall model-fitting information, strength of association, goodness-of-fit-statistics Model −2 Log Likelihood Chi-square Df Sig. Intercept Only 287.267 Final 47.660 239.608 86 0.000 Pseudo R-square Goodness-of-fit Statistics Value Statistics Chi-square df Sig. Cox & Snell 0.878 Nagelkerke 0.955 Pearson 5614.123 366 0.000 McFadden 0.834 Deviance 97.872 366 1.000 Link function: Logit 232 H. Jiang et al. outcome variables. The estimates indicate that several variables representing “charac- teristics of the technology,”“user characteristics,”“characteristics of the planning process,” and “political context” have a strong influence on PSS usefulness. The variables that were determined as statistically significant are presented in Table 3. In particular, the regression coefficient for overall usefulness has a positive value and the observed significance of the “overall usefulness” is satisfactory (all p val- ue≤0.05). The positive sign indicates that the influence of the contextual factors in general is positively related to the level of PSS usefulness. In other words, improve- ments in the positive effects and/or limitations on the negative impact of some contextual factors can increase the usefulness of PSS. In terms of “characteristics of the technology,” some indicators show a positive sign whereas others are negatively related to PSS usefulness. First, the estimates of “informing,”“communicating,” and “transparency” are positive, which means the better performance of these indicators in practice leads to a higher evaluation of PSS usefulness. However, the positive relationship between these indicators and PSS usefulness varies. For instance, the influence of “informing” is only significant at level 2, whereas the significance of “communicating” is determined at levels 5 and 6. This reflects that the higher score on “communicating” could contribute significantly to the increase in PSS usefulness. Finally, the influence of “transparency” is significant at all 6 levels, indicating that the extent to which the underlying models and variables of the PSS are visible to users is important for PSS usefulness. Second, “analyzing,”“designing,” and “flexibility” show negative signs, which means that a high score on these functionalities leads to lower usefulness perception. In terms of “analyzing” and “designing,” the result might seem odd and contradict findings presented in literature. A plausible explanation is that the frequency of the use of “analyzing” and “designing” in practice is high; thus, even low scores on these functionalities could lead to a high evaluation of the overall usefulness of PSS. Regarding “flexibility,” it is understandable that tools that can handle different planning tasks often indicates low specialization. In other words, users prefer more specialized tools. As regards the variable “user characteristics,” the estimates of the indicator “user attitude” have a positive sign, indicating that users with a high positive attitude toward using PSS are more likely to give PSS a higher score on usefulness in practice. The estimate of “expertise level” is negatively associated with PSS usefulness at levels 2 and 3, indicating that a high level of expertise could lead to low PSS usefulness. This seemingly odd result perhaps arose because the majority of the participants were academic researchers and practitioners with high levels of expertise; therefore, they could have been more critical about the supportive role of PSS tools and thus gave a low evaluation of PSS usefulness. In terms of “characteristics of the planning process,” the positive estimate of “active uptaker” implies that active users have a positive influence on PSS usefulness. As Vonk and Geertman (2008) argue, active users act as a catalyst because of their demonstration effect; that is, they encourage other stakeholders to emulate their behaviors via obser- vation of the actions. The estimate of the variable “planner style” shows a negative sign and the relevant p value is 0.002. This means that users in “closed planning” are more likely to give high scores to PSS usefulness. This can be understood from a reverse perspective, namely The Effects of Contextual Factors on PSS Usefulness: an... 233 Table 3 Parameter estimates determined as significant Estimate Std. Error Wald df Sig. Overall usefulness [Overall usefulness = 1] 30.358 12.029 6.369 1 0.012 [Overall usefulness = 2] 37.128 12.362 9.02 1 0.003 [Overall usefulness = 3] 48.775 14.839 10.804 1 0.001 [Overall usefulness = 4] 55.825 15.66 12.708 1 0.000 Characteristics of the technology [Informing = 2] 40.269 12.256 10.796 1 0.001 [Communicating = 4] 6.389 2.828 5.102 1 0.024 [Communicating = 5] 12.077 3.704 10.628 1 0.001 [Analyzing = 3] −15.067 6.2 5.905 1 0.015 [Analyzing = 5] −13.194 4.212 9.812 1 0.002 [Designing = 2] −22.704 7.975 8.106 1 0.004 [Designing = 6] −8.845 2.878 9.447 1 0.002 [Transparency = 1] 53.717 17.164 9.795 1 0.002 [Transparency = 3] 27.313 7.692 12.609 1 0.000 [Transparency = 4] 13.914 4.724 8.674 1 0.003 [Transparency = 5] 6.383 2.887 4.887 1 0.027 [Transparency = 6] 9.666 3.176 9.265 1 0.002 [Flexibility = 2] −40.295 12.131 11.034 1 0.001 [Flexibility = 5] −7.891 3.117 6.41 1 0.011 User characteristics [User attitude = 1] 58.024 17.441 11.068 1 0.001 [User attitude = 2] 53.214 15.818 11.317 1 0.001 [User attitude = 3] 54.049 16.458 10.786 1 0.001 [User attitude = 4] 50.919 15.411 10.917 1 0.001 [User attitude = 5] 40.465 14.045 8.301 1 0.004 [User attitude = 6] 30.699 14.903 4.243 1 0.039 [Expertise level = 2] −20.539 9.525 4.65 1 0.031 [Expertise level = 3] −7.152 3.58 3.991 1 0.046 Characteristics of the planning process [Active uptaker = 4] 14.842 7.52 3.896 1 0.048 Planning style [Planning style = 1] −5.675 1.842 9.495 1 0.002 Political context [Political pressure = 2] −19.442 5.786 11.292 1 0.001 [Political pressure = 3] −23.22 6.617 12.315 1 0.000 [Political pressure = 4] −24.007 6.379 14.163 1 0.000 [Political pressure = 5] −22.787 6.957 10.729 1 0.001 [Political pressure = 6] −22.288 9.133 5.955 1 0.015 Sig. codes: p ≤ 0.05 234 H. Jiang et al. that closed planning processes are less influenced by those factors that appear in interactive planning, such as information overload, conflict of interest occurring when different actors oppose each other, and the difficulty of facilitating interpersonal communication and reaching consensus through PSS (Luque-Martín and Pfeffer 2020; Pelzer 2015; Vonk 2006). Theestimateof “political pressure” shows a negative sign, indicating that political pressure has a strong negative influence on PSS usefulness. According to Cairney (2016), political pressure and intervention highly affect the cognition, perception, and actions of the stakeholders involved in the policy-making process. As for PSS users in planning practice, politically motivated external pressure has a significant influence on the emo- tional and physical condition of users and how PSS is implemented and performed. Finally, it should be noted that a range of other contextual factors (e.g., “types of urban problems” in Appendix 2) are not statistically significant, which means these indicators do not appear to be related to the level of PSS usefulness, at least for the current model and the study period. Discussion The results of the present study suggest an association between contextual factors and PSS usefulness, namely that, in general, “characteristics of the technology,”“user characteristics,”“characteristics of the planning process,” and “political context” have a significant influence on the usefulness of PSS, although their impacts vary signifi- cantly in practice. In particular, the indicators of “characteristics of the planning process” showed a positive sign, whereas the indicators of “political context” were found to be negatively associated with PSS usefulness. The indicators of “characteris- tics of the technology” and “user characteristics” showed both positive and negative associations with PSS usefulness. In addition, PSS usefulness can be better achieved in “closed planning.” Some of the results presented in this paper are in line with previous studies, while others are in contradiction with them. First, the findings concerning the effects of usability indicators on PSS usefulness correspond with Pelzer’s argument that while “usability can be a necessary condition to achieve usefulness, it is never a sufficient condition” (Pelzer 2017:94). For instance, some studies found that simple and transparent PSS applications were positively associated with PSS usefulness (Pan and Deal 2020; Russo et al. 2018;Vonk and Ligtenberg 2010). The results obtained in terms of the “transparency” indicator confirm their findings. Silva et al. (2017) surveyed a number of instrument developers and found that user-friendliness improvement may make a limited contribution to the successful implementation of accessibility concepts in planning practice. In the present study, the influence of “user friendliness” on PSS usefulness was not significant. However, it should be noted that in an experimental environment, user-friendliness is significant in terms of its influence on PSS usefulness (Pelzer 2017). A possible explanation for this discrepancy is that the broader contextual factors considered in this study downplayed the significance of user-friendliness. In terms of the functionality indicators, previous studies found that PSS that are able to facilitate social interaction, interpersonal communication, and community debate can empower professionals and citizens alike to have a better PSS experience and make The Effects of Contextual Factors on PSS Usefulness: an... 235 better informed decisions (Zhang et al. 2019; Saad-Sulonen 2012;Pelzer 2015). Our findings indicate that the influence of “informing” and “communicating” functionalities is statistically positively associated with the overall evaluation of PSS usefulness, revealing its positive effects. Nevertheless, the findings concerning “analyzing” and “designing” functionalities contradict previous findings. For instance, Moghadam and Lombardi (2019), Vonk and Ligtenberg (2010), and Pettit (2005) found that analyzing and designing tools allows decision makers to systematically generate and evaluate alternative solutions, gaining insights that were introduced as inputs to help guide further analyses (e.g., GIS, Maptable, What-If and CommunityViz). However, the large-scale survey carried out for the present study showed that the significance of “analyzing” and “designing” functionalities is negative rather than positive. As men- tioned, the high implementation frequency of these tools is a plausible reason for this. Second, the findings in terms of the variable “user characteristics” correspond with those of earlier studies on how users define technological functions and their use. As Geertman and Stillwell (2004) argue, the user interface of a PSS should be sensitive to the character- istics of the user and to the kind of information that it communicates to that user. The findings of the present study confirm their argument that a high level of positive attitude toward using PSS would improve the awareness of the benefits of using PSS. This finding supports Vonk (2006), who found that a low level of intention to use PSS among possible users reduces the potential expectation of PSS usefulness. Nevertheless, the results obtained concerning “user characteristics” also seem to contradict earlier results. For instance, Holsapple et al. (2005)and Hocetal. (2013) show that higher educated users have greater user satisfaction due to their ability to learn and to develop a high level of expertise. However, the findings presented in this paper show that this relationship could be negatively associated, since experts with a high level of expertise tend to have a fault-finding attitude. As mentioned, they are often more critical of the performance of PSS tools in practice. Third, the negative influence of “active uptaker” shows that in order to improve awareness of the existence and potential of PSS, more effort should be made to demonstrate to users the benefits of applying the diversity of PSS (Vonk and Geertman 2008). Only such an effort will increase the awareness of PSS, making the PSS message more likely to be picked up and appreciated by employees of planning organizations (Vonk et al. 2005). Fourth, it is interesting that “closed planning” seems to be more beneficial for optimizing the supportive role of PSS. Although few previous studies have compared the performance of PSS in these two distinctive planning styles (Vonk and Ligtenberg 2010; Pelzer et al. 2015), an inverse perspective can be used to explain this finding. For example, in ICT-facilitated interactive planning, PSS are more vulnerable to external- ities and a range of side effects or consequences. Fifth, the significant negative influence of “political context” on PSS usefulness confirms the claims by some authors that a broad field of politics impacts the likelihood that actors in the process will absorb new PSS knowledge, and that they will be able to use this knowledge to assess problems and find solutions. For instance, Zhang et al. (2019) identified that in the earlier divergence period, the top-down government-led approach in China often limited the usefulness of web-based PSS in eliciting ideas from independent citizens and supporting participation and engagement. And te Brömmelstroet (2015) shows that in the later convergence period, power relations and hierarchical structures affected the group dynamics and how PSS perform. 236 H. Jiang et al. Finally, we hypothesized that “characteristics of the urban issue” have a significant influence on PSS usefulness. Some studies highlight that the attributes of the urban issue help judge the appropriateness of the supportive role (Jiang et al. 2020c; Pelzer et al. 2015;Vonk and Ligtenberg 2010), and thus their importance should be given more attention. However, the estimate of the indicator “types of urban problems” was not found to be as significant due to the broader multiple and multidimensional aspects of context impact. The present study had some limitations. Because of our selection procedure, the opinions and attitudes of civil society were not considered. According to some authors, however, ideas and knowledge from civil society can effectively promote the advance- ment of PSS (Geertman and Stillwell 2020; Zhang et al. 2019;Pelzer 2015). It should be noted that although the usefulness of PSS is comprised of different dimensions, in this study we considered only the overall evaluation of PSS usefulness. The importance of these different kinds of usefulness of PSS was acknowledged in another article by Jiang et al. (2020a). Thirdly, it should be noted that not all the functionality and usability indicators were discussed in this paper due to the semantic overlap between some concepts (e.g., communicative support capabilities as part of functionality, and communicative value as a usability indicator) (Pelzer 2017). Conclusion Studies on PSS usefulness pay much attention to developing a conceptual and empirical understanding of the relation between planning tasks and PSS (i.e., task–technology fit) and the interaction between the user and a PSS (i.e., human–computer interaction) (Pan and Deal 2020; Jiang et al. 2020a; Russo et al. 2018; Silva et al. 2017; Pelzer 2017; Pelzer et al. 2014; te Brömmelstroet 2012). As a consequence, there is a lack of empirical evidence concerning the importance of the multidimensional aspects of contextual factors in analyzing the development, implementation, and effects of PSS in planning practice. In the present study, we comprehensively examined the extent to which contextual factors influence PSS usefulness via an international questionnaire survey. This paper contributes empirically to insights that “the way in which [PSS] are handled within a specific planning situation will enhance their potential for performing a more effective planning-supportive role (Geertman 2006:878).” While this study did not provide evidence that all contextual factors are associated with PSS usefulness, our results suggest that some contextual factors (i.e., “characteristics of the technology,” “user characteristics,”“characteristics of the planning process,” and “political context”) indeed have differentiated effects on the usefulness of PSS. The results of our study expand the knowledge of the complex relations between contextual factors and PSS usefulness in the realm of smart cities. Base on this, we emphasize that only when PSS users can identify the critical contextual factors that are favorable and unfavorable, will the potential benefits of PSS for spatial planning be fully achieved. Acknowledgements The author would like to thank the anonymous reviewers for many helpful suggestions that simulated improvements to the earlier version of this paper. Financial supports from the China Scholarship Committee (Grant No. 20160601386) are gratefully acknowledged. The Effects of Contextual Factors on PSS Usefulness: an... 237 Compliance with Ethical Standards Statement Conflict of Interest The authors declare that they have no conflicts of interest. Informed Consent This article does not contain any studies involving human participants performed by any of the authors. Appendix 1 Table 4 Frequency statistics of each variable Measures Frequency Marginal Percentage (%) Overall usefulness 1 9 5.1 2 41 23.4 3 86 49.1 4 36 20.6 5 3 1.7 Characteristics of the technology Informing 1 4 2.3 2 4 2.3 316 9.1 4 48 27.4 5 26 14.9 6 34 19.4 7 20 11.4 17 4 Communicating 2 9 5.1 3 24 13.7 4 51 29.1 521 12 6 24 13.7 715 8.6 Analyzing 1 3 1.7 27 4 3 5 2.9 4 18 10.3 5 24 13.7 6 53 30.3 7 53 30.3 Designing 1 2 1.1 27 4 315 8.6 4 40 22.9 5 26 14.9 6 33 18.9 238 H. Jiang et al. Table 4 (continued) Measures Frequency Marginal Percentage (%) 7 26 14.9 Transparency 1 4 2.3 2 1 0.6 314 8 4 38 21.7 5 47 26.9 642 24 7 26 14.9 User-friendliness 1 4 2.3 2 8 4.6 312 6.9 442 24 5 50 28.6 6 33 18.9 7 23 13.1 Interactivity 1 3 1.7 215 8.6 321 12 4 45 25.7 5 41 23.4 6 30 17.1 715 8.6 Flexibility 1 3 1.7 2 5 2.9 3 20 11.4 4 44 25.1 5 52 29.7 6 27 15.4 7 20 11.4 Characteristics of the urban issue Types of urban issues 1 42 24 228 16 3104 59.4 User characteristics Profession 1 108 61.7 2 67 38.3 User attitude 1 15 8.6 2 46 26.3 3 53 30.3 4 44 25.1 511 6.3 6 3 1.7 7 2 1.1 Expertise level 1 5 2.9 The Effects of Contextual Factors on PSS Usefulness: an... 239 Table 4 (continued) Measures Frequency Marginal Percentage (%) 2 3 1.7 316 9.1 4 45 25.7 5 41 23.4 6 47 26.9 7 18 10.3 Characteristics of planning process Time pressure 1 23 13.1 2 39 22.3 3 31 17.7 4 48 27.4 511 6.3 6 8 4.6 7 6 3.4 Active uptaker 1 28 16 2 47 26.9 3 34 19.4 4 43 24.6 511 6.3 6 4 2.3 7 3 1.7 Funding 1 33 18.9 2 31 17.7 3 32 18.3 4 48 27.4 512 6.9 6 4 2.3 77 4 Planning style Planning style 1 78 44.6 2 97 55.4 Political context Political pressure 1 12 6.9 2 23 13.1 3 34 19.4 4 58 33.1 517 9.7 6 6 3.4 7 18 10.3 Valid 114 100% Missing 61 Total 175 240 H. Jiang et al. Appendix 2 Table 5 Parameter estimates Estimate Std. Error Wald df Sig. [Overall usefulness = 1] 30.358 12.029 6.369 1 0.012 [Overall usefulness = 2] 37.128 12.362 9.02 1 0.003 [Overall usefulness = 3] 48.775 14.839 10.804 1 0.001 [Overall usefulness = 4] 55.825 15.66 12.708 1 0.000 Characteristics of the technology [Informing = 1] −3.287 11.122 0.087 1 0.768 [Informing = 2] 40.269 12.256 10.796 1 0.001 [Informing = 3] 0.638 2.984 0.046 1 0.831 [Informing = 4] 0.16 2.057 0.006 1 0.938 [Informing = 5] 0.602 2.348 0.066 1 0.798 [Informing = 6] 2.776 1.964 1.998 1 0.158 [Informing = 7] 0 .. 0 . [Communicating = 1] 13.103 7.152 3.356 1 0.067 [Communicating = 2] 6.606 5.31 1.548 1 0.213 [Communicating = 3] 3.574 3.142 1.294 1 0.255 [Communicating = 4] 6.389 2.828 5.102 1 0.024 [Communicating = 5] 12.077 3.704 10.628 1 0.001 [Communicating = 6] 4.178 2.745 2.317 1 0.128 [Communicating = 7] 0 .. 0 . [Analyzing = 1] −18.705 20.842 0.805 1 0.369 [Analyzing = 2] −0.694 3.978 0.03 1 0.861 [Analyzing = 3] −15.067 6.2 5.905 1 0.015 [Analyzing = 4] 0.498 2.813 0.031 1 0.86 [Analyzing = 5] −13.194 4.212 9.812 1 0.002 [Analyzing = 6] 1.133 1.67 0.461 1 0.497 [Analyzing = 7] 0 .. 0 . [Designing = 1] −25.854 9583.456 0 1 0.998 [Designing = 2] −22.704 7.975 8.106 1 0.004 [Designing = 3] 0.07 3.835 0 1 0.986 [Designing = 4] −2.096 2.29 0.838 1 0.360 [Designing = 5] 2.189 2.735 0.641 1 0.424 [Designing = 6] −8.845 2.878 9.447 1 0.002 [Designing = 7] 0 .. 0 . [Transparency = 1] 53.717 17.164 9.795 1 0.002 [Transparency = 2] 0 .. 0 . [Transparency = 3] 27.313 7.692 12.609 1 0.000 [Transparency = 4] 13.914 4.724 8.674 1 0.003 [Transparency = 5] 6.383 2.887 4.887 1 0.027 The Effects of Contextual Factors on PSS Usefulness: an... 241 Table 5 (continued) Estimate Std. Error Wald df Sig. [Transparency = 6] 9.666 3.176 9.265 1 0.002 [Transparency = 7] 0 .. 0 . [User friendliness = 1] −21.25 9583.401 0 1 0.998 [User friendliness = 2] −11.125 7.714 2.08 1 0.149 [User friendliness = 3] −12.795 7.027 3.316 1 0.069 [User friendliness = 4] 2.003 3.702 0.293 1 0.589 [User friendliness = 5] −2.003 3.854 0.27 1 0.603 [User friendliness = 6] −0.69 2.927 0.056 1 0.814 [User friendliness = 7] 0 .. 0 . [Interactivity = 1] 0 .. 0 . [Interactivity = 2] −1.296 4.77 0.074 1 0.786 [Interactivity = 3] −6.775 4.244 2.549 1 0.110 [Interactivity = 4] −7.34 4.757 2.381 1 0.123 [Interactivity = 5] −1.311 3.487 0.141 1 0.707 [Interactivity = 6] −1.635 3.205 0.26 1 0.610 [Interactivity = 7] 0 .. 0 . [Flexibility = 1] 6.785 15.425 0.193 1 0.660 [Flexibility = 2] −40.295 12.131 11.034 1 0.001 [Flexibility = 3] −5.517 3.578 2.378 1 0.123 [Flexibility = 4] −5.497 3.005 3.346 1 0.067 [Flexibility = 5] −7.891 3.117 6.41 1 0.011 [Flexibility = 6] 2.414 2.224 1.179 1 0.278 [Flexibility = 7] 0 .. 0 . Types of the urban issue [Types of urban issues = 1] −1.27 1.495 0.721 1 0.396 [Types of urban issues = 2] −2.61 2.16 1.46 1 0.227 [Types of urban issues = 3] 0 .. 0 . User characteristics [Profession = 1] 3.543 1.9 3.477 1 0.062 [Profession = 2] 0 .. 0 . [User attitude = 1] 58.024 17.441 11.068 1 0.001 [User attitude = 2] 53.214 15.818 11.317 1 0.001 [User attitude = 3] 54.049 16.458 10.786 1 0.001 [User attitude = 4] 50.919 15.411 10.917 1 0.001 [User attitude = 5] 40.465 14.045 8.301 1 0.004 [User attitude = 6] 30.699 14.903 4.243 1 0.039 [User attitude = 7] 0 .. 0 . [Expertise level = 1] −0.563 3.638 0.024 1 0.877 [Expertise level = 2] −20.539 9.525 4.65 1 0.031 [Expertise level = 3] −7.152 3.58 3.991 1 0.046 [Expertise level = 4] 4.837 2.596 3.471 1 0.062 [Expertise level = 5] −0.843 2.551 0.109 1 0.741 242 H. Jiang et al. Table 5 (continued) Estimate Std. Error Wald df Sig. [Expertise level = 6] 2.154 2.149 1.005 1 0.316 [Expertise level = 7] 0 .. 0 . Characteristics of planning process [Time pressure = 1] −5.368 5.222 1.057 1 0.304 [Time pressure = 2] −1.732 5.292 0.107 1 0.743 [Time pressure = 3] −3.894 5.153 0.571 1 0.450 [Time pressure = 4] −4.529 5.69 0.634 1 0.426 [Time pressure = 5] −3.222 6.084 0.28 1 0.596 [Time pressure = 6] 3.349 12.604 0.071 1 0.790 [Time pressure = 7] 0 .. 0 . [Active uptaker = 1] 12.424 7.83 2.517 1 0.113 [Active uptaker = 2] 13.796 7.167 3.706 1 0.054 [Active uptaker = 3] 11.042 7.182 2.364 1 0.124 [Active uptaker = 4] 14.842 7.52 3.896 1 0.048 [Active uptaker = 5] 5.853 8.639 0.459 1 0.498 [Active uptaker = 6] −13.784 12.007 1.318 1 0.251 [Active uptaker = 7] 0 .. 0 . [Funding = 1] −3.126 6.712 0.217 1 0.641 [Funding = 2] −5.155 6.446 0.639 1 0.424 [Funding = 3] −2.001 6.958 0.083 1 0.774 [Funding = 4] 1.991 6.416 0.096 1 0.756 [Funding = 5] 1.338 7.003 0.036 1 0.849 [Funding = 6] 1.668 7.141 0.055 1 0.815 [Funding = 7] 0 .. 0 . Planning style [Planning style = 1] −5.675 1.842 9.495 1 0.002 [Planning style = 2] 0 .. 0 . Political context [Political pressure = 1] −6.557 4.633 2.003 1 0.157 [Political pressure = 2] −19.442 5.786 11.292 1 0.001 [Political pressure = 3] −23.22 6.617 12.315 1 0.000 [Political pressure = 4] −24.007 6.379 14.163 1 0.000 [Political pressure = 5] −22.787 6.957 10.729 1 0.001 [Political pressure = 6] −22.288 9.133 5.955 1 0.015 [Political pressure = 7] 0 .. 0 . Link function: Logit a. This parameter is set to zero because it is redundant b. Sig. codes: p ≤ 0.05 The Effects of Contextual Factors on PSS Usefulness: an... 243 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. References Allwinkle, S., & Cruickshank, P. (2011). Creating smart-er cities: An overview. Journal of Urban Technology, 18(2), 1–16. Babar, M., & Arif, F. (2017). Smart urban planning using big data analytics to contend with the interoper- ability in internet of things. Future Generation Computer Systems, 77,65–76. Biermann, S. (2011). Planning support systems in a multi-dualistic spatial planning context. Journal of Urban Technology, 18(4), 5–37. Brail, R. K., & Klosterman, R. E. (2001). Planning support systems: Integrating geographic information systems, models, and visualization tools. Redlands: ESRI Press. Cairney, P. (2016). The politics of evidence-based policy making. London: Palgrave Macmillan UK. Campbell, S. (1996). Green cities, growing cities, just cities?: Urban planning and the contradictions of sustainable development. Journal of the American Planning Association, 62(3), 296–312. Caragliu, A., Del Bo, C., & Nijkamp, P. (2011). Smart cities in Europe. Journal of Urban Technology, 18(2), 65–82. Cats-Baril, W. L., & Huber, G. P. (1987). Decision support systems for ill-structured problems: An empirical study. Decision Sciences, 18(3), 350–372. Chadwick, G. F. (1977). The limits of the plannable: Stability and complexity in planning and planned systems. Environment and Planning A, 9(10), 1189–1192. Champlin, C., te Brömmelstroet, M., & Pelzer, P. (2019). Tables, tablets and flexibility: Evaluating planning support system performance under different conditions of use. Applied Spatial Analysis and Policy, 12(3), 467–491. Chesbrough, H. (2006). Open business models: How to thrive in the new innovation landscape. Cambridge: Harvard Business Press. Deal, B., Pan, H., Pallathucheril, V., & Fulton, G. (2017a). Urban resilience and planning support systems: The need for sentience. Journal of Urban Technology, 24(1), 29–45. Deal, B., Pan, H., Timm, S., & Pallathucheril, V. (2017b). The role of multidirectional temporal analysis in scenario planning exercises and planning support systems. Computers, Environment and Urban Systems, 64,91–102. Geertman, S. (2006). Potentials for planning support: A planning-conceptual approach. Environment and planning B: Planning and Design, 33(6), 863–880. Geertman, S. (2017). PSS: Beyond the implementation gap. Transportation Research Part A: Policy and Practice, 104(C), 70–76. Geertman, S., & Stillwell, J. (2004). Planning support systems: An inventory of current practice. Computers, Environment and Urban Systems, 28(4), 291–310. Geertman, S., Zhan, Q., Allan, A., & Pettit, C. (Eds.). (2019). Computational Urban Planning and Management for Smart Cities. New York: Springer International Publishing. Geertman,S. C.M., &Stillwell,J.(2020). Handbook of planning support science. Cheltenham: Edward Elgar Publishing. Goodspeed, R. (2013). Planning support systems for spatial planning through social learning. PhD thesis, Massachusetts Institute of Technology. Harrell Jr., F. E. (2015). Regression modeling strategies: With applications to linear models, logistic and ordinal regression, and survival analysis. Cham: Springer. Healey, P. (1997). Collaborative planning: Shaping places in fragmented societies. London: Macmillan International Higher Education. Hoc, J. M., Cacciabue, P. C., Hollnagel, E., & Cacciabue, P. C. (Eds.). (2013). Expertise and technology: Cognition & human-computer cooperation. Hillsdale: Psychology Press. 244 H. Jiang et al. Holsapple, C. W., Wang, Y. M., & Wu, J. H. (2005). Empirically testing user characteristics and fitness factors in enterprise resource planning success. International Journal of Human-Computer Interaction, 19(3), 325–342. Hutchison, P., Lord, J., & Salisbury, B. (2006). North American approaches to individualised planning and direct funding. In J. Leece & J. Bornat (Eds.), Developments in direct payments. Bristol: Policy Press. Ismail, N. A. (2008). Information technology governance, funding and structure: A case analysis of a public university in Malaysia. Campus Wide Information Systems, 25(3), 145–160. Jiang, H., Geertman, S., & Witte, P. (2019). Smart urban governance: An urgent symbiosis? Information Polity, 24(3), 245–269. Jiang, H., Geertman, S., & Witte, P. (2020a). Ignorance is bliss? An empirical analysis of the determinants of PSS usefulness in practice. Computers, Environment and Urban Systems, 83,1–11. Jiang, H., Geertman, S., & Witte, P. (2020b). Smartening urban governance: An evidence-based perspective. Regional Science Policy and Practice. https://doi.org/10.1111/rsp3.12304. Jiang, H., Geertman, S., & Witte, P. (2020c). Avoiding the planning support system pitfalls? What smart governance can learn from the planning support system implementation gap. Environment and Planning B: Urban Analytics and City Science, 2399808320934824, 239980832093482. https://doi.org/10.1177 /2399808320934824. Khan, Z., Anjum, A., Soomro, K., & Tahir, M. A. (2015). Towards cloud based big data analytics for smart future cities. Journal of Cloud Computing, 4(1), 1–11. Khan, Z., Ludlow, D., Loibl, W., & Soomro, K. (2014). ICT enabled participatory urban planning and policy development: The UrbanAPI project. Transforming Government: People, Process and Policy, 8(2), 205– Klosterman, R. E. (1997). Planning support systems: A new perspective on computer-aided planning. Journal of Planning Education and Research, 17(1), 45–54. Lin, Y. (2018). A comparison of selected Western and Chinese smart governance: The application of ICT in governmental management, participation and collaboration. Telecommunications Policy, 42(10), 800– Long, Y., Shen, Z., & Mao, Q. (2011). An urban containment planning support system for Beijing. Computers, Environment and Urban Systems, 35(4), 297–307. Luque-Martín, I., & Pfeffer, K. (2020). Limitations and potential of planning support systems application in planning in southern Spain: Bridging academia and practice. In S. C. M. Geertman & J. Stillwell (Eds.), Handbook of planning support science. Cheltenham, UK: Edward Elgar Publishing. McEvoy, S., van de Ven, F. H., Santander, A. G., & Slinger, J. H. (2019). The influence of context on the use and added value of planning support systems in workshops: An exploratory case study of climate adaptation planning in Guayaquil, Ecuador. Computers, Environment and Urban Systems, 77,101353. Moghadam, S. T., & Lombardi, P. (2019). An interactive multi-criteria spatial decision support system for energy retrofitting of building stocks using CommuntiyVIZ to support urban energy planning. Building and Environment, 163,106233. Nielsen, J. (1994). Usability engineering. San Diego: Academic Press. Pan, H., Chen, S., Gao, Y., Deal, B., & Liu, J. (2020). An urban informatics approach to understanding residential mobility in metro Chicago. Environment and Planning B: Urban Analytics and City Science, 2399808320924437. https://doi.org/10.1177/2399808320924437. Pan, H., & Deal, B. (2020). Reporting on the performance and usability of planning support systems— Towards a common understanding. Applied Spatial Analysis and Policy, 13(1), 137–159. Pan, H., Page, J., Zhang, L., Cong, C., Ferreira, C., Jonsson, E., Näsström, H., Destouni, G., Deal, B., & alantari, Z. (2019). Understanding interactions between urban development policies and GHG emis- sions: A case study in Stockholm region. Ambio, 49, 1313–1327. https://doi.org/10.1007/s13280-019- 01290-y. Pelzer, P. (2015). Usefulness of Planning Support Systems: Conceptual perspectives and practitioners' experiences (doctoral dissertation). Groningen: InPlanning. Pelzer, P. (2017). Usefulness of planning support systems: A conceptual framework and an empirical illustration. Transportation Research Part A: Policy and Practice, 104,84–95. Pelzer, P., Geertman, S., van der Heijden, R., & Rouwette, E. (2014). The added value of planning support systems: A practitioner’s perspective. Computers, Environment and Urban Systems, 48,16–27. Pelzer, P., Arciniegas, G., Geertman, S., & Lenferink, S. (2015). Planning support systems and task- technology fit: A comparative case study. Applied Spatial Analysis and Policy, 8(2), 155–175. Pelzer, P., Geertman, S., & van der Heijden, R. (2016). A comparison of the perceived added value of PSS applications in group settings. Computers, Environment and Urban Systems, 56,25–35. The Effects of Contextual Factors on PSS Usefulness: an... 245 Pettit, C. J. (2005). Use of a collaborative GIS-based planning-support system to assist in formulating a sustainable-development scenario for Hervey Bay, Australia. Environment and Planning B: planning and design, 32(4), 523–545. Pettit, C., Bakelmun, A., Lieske, S. N., Glackin, S., Thomson, G., Shearer, H., et al. (2018). Planning support systems for smart cities. City, Culture and Society, 12,13–24. Rathore, M. M., Ahmad, A., Paul, A., & Rho, S. (2016). Urban planning and building smart cities based on the internet of things using big data analytics. Computer Networks, 101,63–80. Rittel, H. W., & Webber, M. M. (1984). Planning problems are wicked problems. In N. Cross (Ed.), Developments in design methodology (pp. 135–144). Chichester: John Wiley & Sons. Russo, P., Lanzilotti, R., Costabile, M. F., & Pettit, C. J. (2018). Towards satisfying practitioners in using planning support systems. Computers, Environment and Urban Systems, 67,9–20. Saad-Sulonen, J. (2012). The role of the creation and sharing of digital media content in participatory e- planning. International Journal of E-Planning Research (IJEPR), 1(2), 1–22. Silva, C., Bertolini, L., te Brömmelstroet, M., Milakis, D., & Papa, E. (2017). Accessibility instruments in planning practice: Bridging the implementation gap. Transport Policy, 53,135–145. Söderström, O., Paasche, T., & Klauser, F. (2014). Smart cities as corporate storytelling. City, 18(3), 307–320. Stanilov, K. (2007). Urban planning and the challenges of the post-socialist transformation. In K. Stanilov (Ed.), The post-Socialist City. Dordrecht: Springer. te Brömmelstroet, M. (2010). Equip the warrior instead of manning the equipment: Land use and transport planning support in the Netherlands. Journal of Transport and Land Use, 3(1), 25–41. te Brömmelstroet, M. (2012). Transparency, flexibility, simplicity: From buzzwords to strategies for real PSS improvement. Computers, Environment and Urban Systems, 36(1), 96–104. te Brömmelstroet, M. (2013). Performance of planning support systems: What is it, and how do we report on it? Computers, Environment and Urban Systems, 41,299–308. te Brömmelstroet, M. (2015). A critical reflection on the experimental method for planning research: Testing the added value of PSS in a controlled environment. Planning Practice and Research, 30(2), 179–201. te Brömmelstroet, M. (2017). PSS are more user-friendly, but are they also increasingly useful? Transportation Research Part A: Policy and Practice, 104,96–107. Thakuriah, P. V., Tilahun, N. Y., & Zellner, M. (2017). Big data and urban informatics: Innovations and challenges to urban planning and knowledge discovery. In P. Thakuriah, N. Tilahun, & M. Zellner (Eds.), Seeing cities through big data. Cham: Springer. Verrest, H., & Pfeffer, K. (2019). Elaborating the urbanism in smart urbanism: Distilling relevant dimensions for a comprehensive analysis of smart city approaches. Information, Communication & Society, 22(9), 1328–1342. Vonk,G. A.(2006). Improving planning support: The use of planning support systems for spatial planning (PhD dissertation). Utrecht: KNAG/Netherlands Geographical Studies. Vonk, G., & Geertman, S. (2008). Improving the adoption and use of planning support systems in practice. Applied Spatial Analysis and Policy, 1(3), 153–173. Vonk, G., & Ligtenberg, A. (2010). Socio-technical PSS development to improve functionality and usability—Sketch planning using a Maptable. Landscape and Urban Planning, 94(3–4), 166–174. Vonk, G., Geertman, S., & Schot, P. (2005). Bottlenecks blocking widespread usage of planning support systems. Environment and Planning A, 37(5), 909–924. Zhang, L., Geertman, S., Hooimeijer, P., & Lin, Y. (2019). The usefulness of a web-based participatory planning support system in Wuhan, China. Computers, Environment and Urban Systems, 74,208–217. Publisher’sNote Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Applied Spatial Analysis and Policy Springer Journals

The Effects of Contextual Factors on PSS Usefulness: an International Questionnaire Survey

Download PDF
25 pages

Loading next page...
 
/lp/springer-journals/the-effects-of-contextual-factors-on-pss-usefulness-an-international-qrSqeDUej6

References (72)

Publisher
Springer Journals
Copyright
Copyright © The Author(s) 2020
ISSN
1874-463X
eISSN
1874-4621
DOI
10.1007/s12061-020-09352-5
Publisher site
See Article on Publisher Site

Abstract

Contextual factors have been consistently argued as influencing the usefulness of planning support systems (PSS). Whereas previous studies were mostly conducted within a single planning project or based on experimental workshops, the present study looked at the application of PSS in smart city projects worldwide, and investigated the extent to which subjectively measured contextual factors contribute to PSS usefulness in smart cities. Based on a recent international questionnaire (268 respondents) de- signed to gather the perceptions of scholars and practitioners in the smart city realm, an ordinal regression model was fitted to assess the associations between the argued contextual factors and PSS usefulness. The results show that, in general, four contextual factors—namely the characteristics of the technology itself, user characteristics, char- acteristics of the planning process, and political context—have a significant influence on the usefulness of PSS, and that their impacts vary significantly. This paper empha- sizes that only when PSS users can identify the critical contextual factors that are favorable and unfavorable, will the potential benefits of PSS for spatial planning be fully achieved. . . . . . Keywords Smart cities Context Added value Functionality Usability Ordinal regression analysis Electronic supplementary material The online version of this article (https://doi.org/10.1007/s12061-020- 09352-5) contains supplementary material, which is available to authorized users. * Huaxiong Jiang h.jiang@uu.nl Stan Geertman S.C.M.Geertman@uu.nl Patrick Witte P.A.Witte@uu.nl Faculty of Geosciences, Department of Human Geography and Spatial Planning, Utrecht University, Utrecht 3584 CB, The Netherlands 222 H. Jiang et al. Introduction Recent years have seen a plethora of discussions and studies on how big data infra- structure, accrued through sensors, and associated information and communication technologies (ICTs) can help achieve sustainable development goals and improve the management of cities (Geertman and Stillwell 2020; Pan et al. 2019; Thakuriah et al. 2017;Khan et al. 2015;Caragliu et al. 2011). In planning, planning support systems (PSS) have been imagined and conceptualized to make use of big data and interactive interfaces to achieve smart goals (Babar and Arif 2017;Deal etal. 2017a; Allwinkle and Cruickshank 2011). Defined as geo-information technology-based instruments, PSS are dedicated to supporting those involved in planning in the performance of their specific planning tasks (Geertman 2006, 2017). More recently, studies have shown that with the advent of urban sensing and ubiquitous computing, and the gradual standardization of embedded location information within administrative datasets on urban activities, the promise of a smart city has led to an exponential increase in data by several orders of magnitude (Geertman and Stillwell 2020). Consequently, such enormous volumes of data, or big data, act as valuable input for PSS. By capturing, analyzing, and integrating this real-time and up-to-date data into various types of PSS, spatial analyses related to the realm of urban planning in the city (e.g., energy consumption, land use, traffic congestion, energy usage, and air quality) are improved substantially (Rathore et al. 2016;Khan etal. 2015). Besides, ICTs and big data can also be used to enhance PSS’s capabilities for extending and transforming somewhat conventional citizens’ participa- tion practices, and for facilitating technology-facilitated communication and interplay between the formal political sphere (government) and the civil society sphere (citizens) (Jiang et al. 2019, 2020a;Khanet al. 2014). For instance, Pan et al. (2020)showthat urban informatics augmented by new smart data enhance the sharing of information to the general public and make planning processes more participatory and democratic, especially for disadvantaged groups. Geertman and Stillwell (2020) indicate that web- based PSS enable more non-state actors (i.e., individuals and organizations that are not affiliated to the government, such as private sector entities, academic institutions, and non-governmental organizations) to build solutions that enable the delivery of content, services, and even applications over the HTTP protocol. Briefly, PSS enabled by smart ICTs help enhance reach and range by enabling information to be shared across different stakeholders and contribute to aspects of the planning process, including data collection and storage, data analysis and presentation, plan- and policy-making, interpersonal dialogue and debate, and policy implementation and administration (Jiang et al. 2020b; Pettit et al. 2018; Zhang et al. 2019; Thakuriah et al. 2017). It should be noted, however, that in practice PSS have not fully achieved their potential, since their usefulness depends not only on the characteristics and capabilities of the tools themselves (Pan and Deal 2020; Geertman 2017; Russo et al. 2018; Pelzer 2015). It has been widely accepted that PSS need to be enhanced to better align the instruments with user requirements and the planning tasks and problems at hand, since the specific situations or contexts in which PSS are embedded have a significant influence on how PSS work in actual planning practice (Champlin et al. 2019; Geertman 2017; Geertman 2006). Here, context indicates the real circumstance or situation in which a PSS tool is embedded in planning practices. Empirical studies have demonstrated the influence of contextual factors on PSS usefulness. For instance, The Effects of Contextual Factors on PSS Usefulness: an... 223 Pelzer (2017) found that existing organizational hierarchies, the timing of the policy process, and the users’ characteristics (disciplinary background, existing habits, etc.) affect how the role of a PSS is perceived, implemented, and evaluated. Zhang et al. (2019) point out that digital literacy has prevented many ordinary people from engag- ing in web-based participatory planning. As Jiang et al. (2020c), Geertman (2017, 2006), and te Brömmelstroet (2010) argue, what can be achieved with a PSS, and the meaning of those achievements, largely depend on how the planning context is treated. However, despite the importance of contextual factors in influencing PSS usefulness in practice, research on PSS has concentrated more on aspects of the tools than on understanding the interactions between the tools and the contexts in which they are used (McEvoy et al. 2019;Champlin etal. 2019). This shortcoming is well recognized in the field of PSS, which calls for tools to be studied in the “real world, context-rich environment” (te Brömmelstroet 2013:306). Rather than taking a normative view, it embraces a more pragmatic attitude toward the role of ICT: To what extent can the implementation of ICT in planning become more effective and useful? (Deal et al. 2017b;Geertman 2017). Consequently, research into the supportive role of PSS in the realm of smart cities has recently been advanced to embrace such a question: What kinds of ICT are, or should be, implemented by what kinds of stakeholders in which types of planning situations, contexts, or circumstances? (Russo et al. 2018; Pelzer et al. 2015; Biermann 2011;Vonk 2006). It has to be noted, however, that the significance of the proposed guidelines for improving PSS usefulness in practice is still limited by a lack of studies on theorizing the different contextual factors and their effects in practice. Thus, the aim of this paper is to draw attention to the critical influence of contextual factors on the usefulness of PSS in smart cities. An ordinal regression model was applied to data gathered through an international questionnaire, to quantify the impact of the identified contextual factors on PSS usefulness. It should be noted that this study was anextension to theworkbyGeertman(2006), te Brömmelstroet (2013), and Pelzer (2017), who argue that further study could systematically analyze the effects of the contextual factors on PSS usefulness in practice. Based on this, Section 2 operationalizes the key terms describing earlier research and the various indicators related to the role of context in PSS usefulness. Section 3 introduces the methodology. Section 4 describes the main findings from the questionnaire. This is followed by a discussion in Section 5. The paper ends with a conclusion. Context and PSS Usefulness The study by Pelzer et al. (2014) found that the added value of PSS is often conceived as the focal point, since the questions permeating these studies not only reveal the value of PSS, but also contribute to supporting planning in a better way. From a general technological viewpoint, Nielsen (1994:24) conceptualizes the added value of a system as “usefulness,” which indicates “the issue of whether the system can be used to achieve some desired goal.” As te Brömmelstroet (2013) argues, the usefulness of PSS can be measured at both the process level and the outcome level. And Pelzer et al. (2014) highlight that an evaluation of the usefulness of a PSS tool should focus on at least three dimensions, namely individual, group, and outcome. Based on this, they identify seven major types of usefulness that a PSS tool can provide. 224 H. Jiang et al. In practice, scholars and professionals have developed a wide variety of applications to support all kinds of planning actions, ranging from highly strategic to operational actions (te Brömmelstroet 2013). However, what is remarkable about PSS is its long- standing implementation gap, that is, a discrepancy between supply and demand: Despite the availability of a growing number and variety of potentially valuable PSS instruments, planning practitioners are rather hesitant to buy, implement, or apply them (Geertman 2006, 2017). To find the main bottlenecks to increasing the usefulness of PSS in planning practice, numerous authors have identified that the support role of PSS is closely related to the context in which a PSS is applied (Luque-Martín and Pfeffer 2020;McEvoyetal. 2019; Zhang et al. 2019; Vonk and Geertman 2008; Vonk et al. 2005; Geertman 2006). According to Pelzer (2017), context influences both the extent to which a PSS is useful and the kind of usefulness that is achieved. For instance, at an early stage of a policy process, learning about the object might be the prime usefulness (cf. te Brömmelstroet 2010; Goodspeed 2013), whereas at a later stage efficiency might be more important. In addition, different planning styles affect how the technological intelligence is organized and operates; for example, the ICT-enabled centralized planning process in which the entire set of intelligent devices is arranged hierarchically and steered into one center, versus ICT-facilitated participatory planning processes in which new technologies enable various stakeholders to participate in urban issues. As Luque-Martín and Pfeffer (2020) summarize, local context specifics are one of the main factors that define the PSS-based potential solutions. Geertman (2006) provides a comprehensive conceptual discussion on the different contextual factors. In his framework, six major contextual factors are argued to influence the potential roles of PSS in planning practice, namely characteristics of the technology, content of the planning issue, user characteristics, characteristics of the planning process, planning style, and political context (see Fig. 1). The present study applied and operationalized these six contextual factors to further examine the effects of contextual factors on PSS usefulness in practice. Contextual Factors Characteristics of the Technology Regarding the characteristics of the technology itself, Geertman (2006) argues that planning support tools are contextual in that the support role of PSS proves to be more evident in operational decision-making than at the level of strategic decision-making. From a technological innovation perspective, the technology itself as a contextual factor can be understood from two variables: functionality and usability. Functionality “is the question of whether [the information-handling capabilities] of the system in principle can do what is needed” (Nielsen 1994:24). Since the planning tasks vary in different planning practices, a PSS tool in one specific project is unlikely to act in the same way in another project. Thus, an effective way to achieve planning support is to apply the information- handling capabilities of a PSS to support specific professional spatial-planning tasks (Luque-Martín and Pfeffer 2020;McEvoyetal. 2019; Zhang et al. 2019). Several authors (e.g., Jiang et al. 2020a;Vonk 2006) categorized these information-handling capabilities into three groups: informing, communicating, and analyzing & designing. & Informing indicates the functional support for transferring information in one direction only. The Effects of Contextual Factors on PSS Usefulness: an... 225 Characteristics of the technology Functionality: Informing; Communicating; Analyzing & Designing Usability: Transparency; User friendliness; Interactivity; Flexibility Content of the planning issue Types of urban issues: Economic issues; Social issues; Environmental issues The User characteristics usefulness Profession; Expertise level; User attitude of PSS Characteristics of the planning process Time pressure; Active uptaker; Funding P lanning style Closed planning; Interactive planning Political context Political pressure Fig. 1 Contextual factors influencing PSS usefulness (framework based on Geertman (2006: 867); the indicators describing each variable are explained in section 2.1) & Communicating describes the functional support for facilitating communication and discussion between those involved in the governance process through supporting flows of information between them. & Analyzing & designing indicates the functional support for examining spatial patterns of human behavior and facilitating the perception, production, and presen- tation of design ideas. Usability refers to “how well users can use that [functionality]” (Nielsen 1994:24). It indicates the goodness of fit between the capabilities of the user and the functionalities offered by the technology (Jiang et al. 2020a). In general, a high level of usability will lead to the more usefulness of a PSS. In literature, although a range of usability indicators have been identified (Pelzer 2015), four key indicators are widely used to describe the usability of a PSS: transparency, user friendliness, interactivity, and flexibility (Pan and Deal 2020;Champlinetal. 2019;teBrömmelstroet 2017; te Brömmelstroet 2012; te Brömmelstroet 2010; Vonk et al. 2005). & Transparency describes the extent to which the underlying models and variables of the PSS are visible to users. & User friendliness is the extent to which participants are able to use the tool themselves. & Interactivity refers to the extent to which the tool can directly respond to the users’ questions and suggestions. & Flexibility indicates the extent to which the tool can be applied to different planning tasks. 226 H. Jiang et al. Together, these functionality and usability indicators delineate the specific characteris- tics of the technology (PSS) itself. Content of the Urban Issue According to Rittel and Webber (1984), a range of strategic, nonroutine planning issues can be said to be ill-structured or at best semi-structured. New PSS are primarily developed to provide new capabilities to gain insights into genuinely unique spatial issues. However, it should be noted that many of the urban issues that PSS tools attempt to solve are typically ill-structured or ill-defined by nature (Klosterman 1997;Cats- Baril and Huber 1987). The consequence is that there is no clear procedural or predetermined way to solve a specific urban issue; instead, it requires diverse and innovative solutions. Because of this, the PSS—which usual promotes a false idea of value-free and objective knowledge of urban issues—exacerbates technocratic reduc- tionism (Söderström et al. 2014) and masks those urban conflicts and issues that are not visible in the digital representations (e.g., congestion, unemployment, pollution, and diseases peculiar to the urban way of life) (Verrest and Pfeffer 2019). Hence, to improve the appropriateness of dedicated PSS tools, it is vital to distinguish the different attributes of the urban issue. In this study, we applied the variable “types of urban issues” to operationalize the content of the urban issue. According to Campbell (1996), economic issues, social issues, and environmental issues are the three main types of urban issues. User Characteristics User characteristics are contextual factors in that they are a useful source of information that helps designers to foster an understanding of target users and the product under development (Chesbrough 2006; Geertman 2006). For each category of user, the demands and requirements regarding the content of the functionalities needed differ considerably. For instance, in the profession of planning practitioner, there is a signif- icant difference between more design-oriented practitioners and research-oriented practitioners: The former need more functional support that can stimulate their imag- ination and lead to original and innovative ideas, whereas research-oriented practi- tioners are more concerned about how a PSS functionality can gather, store, analyze, model, and visualize data in a digital representation (Brail and Klosterman 2001). As Geertman (2006: 868) argues, “professional protectionism plays a role of importance.” In addition, attributes of users such as competency, skill, knowledge, qualification, and proficiency level also affect the performance of PSS in practice (Zhang et al. 2019; Pelzer 2017; Holsapple et al. 2005). Without a doubt, an inexperienced newcomer (newbie) differs from a person who has comprehensive and authoritative knowledge or skill in terms of using PSS (expert) (Vonk et al. 2005). Finally, Vonk and Geertman (2008) argue that user attitude is also responsible for promoting the supportive role of PSS in their field. Users with a rational mindset and a positive attitude toward PSS will usually be early adopters and be more enthusiastic about PSS innovations and their added value. Therefore, a user-oriented approach in developing and implementing PSS requires a deeper understanding of user characteristics related to the expected and unexpected problems that users face when interacting with particular PSS tools. In this The Effects of Contextual Factors on PSS Usefulness: an... 227 study, the three previously mentioned variables—profession, expertise level, and user attitude—were applied to operationalize the user characteristics. Characteristics of the Planning Process The characteristics of a planning process are the qualities or features that are regarded as inherent parts of a plan. For instance, plans are made for a period of, say, five, ten, or more years. Therefore, in composing a plan and getting it politically approved, PSS users may face time pressure or strict deadlines (Geertman 2006;Vonk 2006). Then, active uptakers are responsible for signaling promising supportive roles of PSS in their field and bringing these to the attention of other potential users (Vonk and Geertman 2008). For instance, geo-information specialists have the important role of scanning the organization’s external environment, signaling PSS developments, and evaluating their usefulness to the planning organization (Vonk 2006). Besides, funding is also crucial for providing continuous support and maintenance of the PSS being used in practice (Ismail 2008; Hutchison et al. 2006). Thus, three variables are used to describe the characteristics of the planning process: time pressure, active uptaker, and funding. Planning Style A planning style is understood as the leading form of planning during a certain period of time (Pelzer 2015). It represents time-bound normative opinions as to the way in which the planning job should be performed (Healey 1997). However, it should be noted that the influence of planning style on PSS usefulness changes along with changes in time and place. For instance, the dominant rational comprehensive model in the 1960s led to the design and implementation of a range of large-scale computer- based systems (e.g., large-scale metropolitan land use, integrated municipal information systems, and urban transportation models) to solve some of the large and urgent urban issues (Chadwick 1977). Thus, the usefulness of PSS at that time was mainly related to gaining insights into urban issues. Then, in the 1990s, PSS were used to facilitate interpersonal communication and community-based debates because of the rise of participatory and collaborative planning (Pelzer 2015; Pettit 2005). In the present study, planning styles were categorized as either “closed planning” or “interactive planning” (Jiang et al. 2020b;Healey 1997). & In closed planning, the government and its agent planner act as the prime stake- holders in the planning process. & In interactive planning, also non-state actors—like citizens and the private sector— are important and involved in the planning process. Political Context As a decision-making process, each planning process should be aware of the broader political context in which it is embedded (Jiang et al. 2019;Lin 2018;Biermann 2011). This context has specific mechanisms that influence how technology is organized in planning practice. For instance, in democratic Western countries, there is a general 228 H. Jiang et al. consensus that the increasing number of crowdsourcing platforms, social media, smartphones, portals, and planning support systems should be applied to facilitate e- participation, e-democracy, and wider collaboration for collective problem-solving (Geertman and Stillwell 2020;Lin 2018). In contrast, in some societies that are tightly controlled by the government, the use of innovative technologies in planning is more oriented toward improving the efficiency and effectiveness of the planning process, for example, to gain a better understanding of the urban issue and inform the public of the plan (Long et al. 2011). According to some authors, the influence of the political context can be described as “political pressure” (Stanilov 2007), which reflects com- prehensive persuasion by, the influence of, or even intimidation from members of the political planning systems. PSS Usefulness As explained by Pelzer et al. (2014)and te Brömmelstroet (2013), the usefulness of PSS can be measured by different aspects or dimensions. However, it is worth mentioning that PSS usefulness is often demonstrated and asserted in PSS experimental case studies (Champlin et al. 2019; Pelzer et al. 2016;Pelzer 2015). Results show that the benefits obtained in an experimental environment, to a large extent do not meet the actual needs of users and planning practices (Geertman 2017; te Brömmelstroet 2013; Vonk 2006). Studies also tend to emphasize the importance of improving PSS func- tionalities and usability in optimizing PSS usefulness (Pan and Deal 2020; Silva et al. 2017; Pelzer 2017). Thus, there has been much argument that PSS validity and potential would benefit from being employed in a context-rich, real-world research scenario, as well as much lobbying for such employment (Jiang et al. 2020a, 2020c; Luque-Martín and Pfeffer 2020;McEvoy et al. 2019; Zhang et al. 2019;Vonkand Geertman 2008), since it would provide PSS with “a structure [to] constructively develop a coherent and comprehensive body of knowledge” (te Brömmelstroet 2013: 306). In the present study, we conducted a survey to determine the multidimensional impact of contextual factors on the usefulness of PSS in smart city practices. Although PSS usefulness consists of different levels and dimensions, we applied the subjective perception of the overall satisfaction of the supportive role of PSS in practice—“overall usefulness”—to measure PSS usefulness (Jiang et al. 2020a). Research Design Data Collection In order to study the effects of contextual factors on the usefulness of PSS in smart cities, we used an international questionnaire to gather and consolidate in-depth data and information concerning the application of PSS in smart city practices and to track performance across 55 quantitative indicators. The questionnaire was distributed to approximately 1300 members of the Computers in Urban Planning and Urban Man- agement (CUPUM) research community across a wide geographical area. The CUPUM community was selected for two reasons. First, CUPUM is a major international academic platform that offers a state-of-the-art overview of the availability and The Effects of Contextual Factors on PSS Usefulness: an... 229 applications of PSS-based methods, tools, and techniques, and it provides valuable and meticulous insights into a diverse range of social and environmental issues in the context of smart cities, big data, and smart urban futures (Geertman et al. 2019). Second, the perspectives of scholars and practitioners reflect the empirical case of applying PSS in practice, which provides a highly professional overview of the influence of contextual factors on PSS usefulness in the context of smart cities. The questionnaire, which was delivered by regular and electronic mailing systems, was administered over a 3-month period (May–July 2019). The questionnaire consisted of three main parts. The first part gathered the (anonymous) participants’ basic information (e.g., gender, age, profession, origin, expertise with planning support ICTs), whereas the second part gathered in-depth information about their knowledge regarding the application of PSS in practical smart city projects. The respondents were specifically asked whether in recent years they had been academically and/or professionally involved in smart city projects. The follow-up questions chiefly assessed the performance level of five indicators—namely urban problems, functionalities, usability, added value, and context—perceived by re- searchers and PSS experts. The questions in the third part were related to specifics of the 2019 CUPUM conference and were not of relevance to this research. Information about the influence of contextual factors on the usefulness of PSS in smart cities was obtained from the second part of the questionnaire. The development of the statements was based on previously recognized PSS literature. In order to effectively measure the strength of an individual’s perception of the importance and attainment of contextual factors’ roles, a 7-point rating system was used (1 = low, 7 = high). Respondents were not expected to respond to every statement. Data Processing This study used only the 18 statements related to the indicators presented in Section 2 to analyze the effects of context on PSS usefulness. It should be noted that “overall usefulness” (measured on a scale from 0 to 100 in the questionnaire) was recategorized into ordinal scale (from 1 to 5) to fit the relationship between the effects of contextual factors and PSS usefulness. “Types of urban issues” was regrouped as “economic issues,”“social–environmental issues,” and “mixed urban issues.”“Profession” was categorized as “academic researcher” and “practitioner.” The “academic research” group included academic researchers/scholars and doctoral students, while the “prac- titioner” group consisted of designers, politicians, and planners. As mentioned, “plan- ning style” was categorized as “closed planning” and “interactive planning.” All other indicators were measured on a 7-point scale. The value assignment types for each indicator are shown in the second column of Table 1. Statistical Analysis Of the approximately 1300 questionnaires that were distributed, 268 were completed (response rate of just over 20%). Of these, 175 were completed by respondents who had been involved in smart city projects in which the role of ICTs was significant, and we used their questionnaires in our analysis. In terms of geographical origin, more than half of the respondents were from China (53%); the other respondents were from 230 H. Jiang et al. Table 1 Variable measurement and descriptive statistics Variables (indicators) Measures Descriptive Statistics N Minimum Maximum Mean Std. Deviation Overall usefulness 1 = Low to 5 = High 175 1 5 2.90 0.842 Characteristics of the technology itself Informing 1 = Low to 7 = High 152 1 7 4.78 1.452 Communicating 1 = Low to 7 = High 151 1 7 4.34 1.544 Analyzing 1 = Low to 7 = High 163 1 7 5.60 1.480 Designing 1 = Low to 7 = High 149 1 7 4.91 1.495 Transparency 1 = Low to 7 = High 172 1 7 5.05 1.352 User-friendliness 1 = Low to 7 = High 172 1 7 4.84 1.424 Interactivity 1 = Low to 7 = High 170 1 7 4.51 1.461 Flexibility 1 = Low to 7 = High 171 1 7 4.74 1.356 Characteristics of the 1 = Economic 174 urban issue 2= Non-economic 3 = Mixed User characteristics Profession 1 = Academic researcher 175 2 = Practitioner User attitude 1 = Low to 7 = High 174 1 7 3.04 1.209 Expertise level 1 = Low to 7 = High 175 1 7 4.87 1.381 Characteristics of planning process Time pressure 1 = Low to 7 = High 166 1 7 3.20 1.526 Active uptaker 1 = Low to 7 = High 170 1 7 2.92 1.395 Funding 1 = Low to 7 = High 167 1 7 3.09 1.563 Planning style 1 = State-led 175 2 = Interactive Political context Political pressure 1 = Low to 7 = High 159 1 7 3.79 1.646 Europe (15.4%), Asia (excluding China) (14.2%), North America (5.1%), South America (5.1%), Oceania (5.1%), and Africa (2.3%). Approximately 61.7% of the respondents were academic researchers/scholars (including doctoral students); the others (practitioners) were planners (32.6%), politicians (2.3%), or designers (3.4%). Descriptive statistics were used to summarize the data (Table 1 and Appendix 1). Among all participants, the average score on “overall usefulness” was 2.90. Regarding “characteristics of the technology,” the average scores on “analyzing,”“designing,” and “transparency” are the top three indicators, whereas “communicating” had relatively lower scores (4.34). This indicates the different influences of the indicators of this variable. In terms of “characteristics of the urban issue,” the majority of the participants were involved in projects dealing with “mixed urban issues.” For the variable “user characteristics,” 61.7% of the participants were academic researchers, whereas 38.3% were practitioners, as mentioned. The average score on “expertise level” was much higher than the scores on “user attitude,” indicating the importance of “expertise level” The Effects of Contextual Factors on PSS Usefulness: an... 231 in influencing PSS usefulness. Concerning “characteristics of the planning process,” the indicator “time pressure” received higher scores than “active uptaker” and “funding.” Further, 44.6% of the participants were engaged in “closed planning” and 55.4% in “interactive planning.” Finally, the average score on “political pressure” was 3.79, showing its relatively large influence. Results Model Fitting Information To determine whether the effects of the argued contextual factors are statistically significant, ordinal logistical regression was employed to determine their associations. Table 2 shows the strength of associations, the predicted ability of the model, and goodness-of-fit statistics. Regarding the overall model test of the null hypothesis, the results yield a significance level of 0.000. Thus, it can be concluded that this is an important test, because the change in the likelihood function has a chi-square distribu- tion (Harrell Jr 2015). The pseudo-R statistics measures the success of the model in explaining the variations in the data, which is an indication of the strength of the association between the dependent (overall usefulness) and the independent variables (contextual factors). Since the results of Cox and Snell (0.878), Nagelkerke (0.955), and McFadden (0.834) are smaller than those for a linear model, the pseudo-R can be regarded as very satisfactory (Harrell Jr 2015). However, because the number of empty cells in the model is relatively large (there are 456 cells (80.0% of the total number) with zero frequencies), the goodness-of-fit measures of Pearson and Deviance are not reliable. Ordinal Regression Model to Explain PSS Usefulness The detailed results of the calculations are summarized in Appendix 2. All variables were simultaneously added to the model along with a statistically significant two-way interaction term. The test of the proportional odds assumption was non-significant for the two models, suggesting that effects were proportional across the categories of the Table 2 Overall model-fitting information, strength of association, goodness-of-fit-statistics Model −2 Log Likelihood Chi-square Df Sig. Intercept Only 287.267 Final 47.660 239.608 86 0.000 Pseudo R-square Goodness-of-fit Statistics Value Statistics Chi-square df Sig. Cox & Snell 0.878 Nagelkerke 0.955 Pearson 5614.123 366 0.000 McFadden 0.834 Deviance 97.872 366 1.000 Link function: Logit 232 H. Jiang et al. outcome variables. The estimates indicate that several variables representing “charac- teristics of the technology,”“user characteristics,”“characteristics of the planning process,” and “political context” have a strong influence on PSS usefulness. The variables that were determined as statistically significant are presented in Table 3. In particular, the regression coefficient for overall usefulness has a positive value and the observed significance of the “overall usefulness” is satisfactory (all p val- ue≤0.05). The positive sign indicates that the influence of the contextual factors in general is positively related to the level of PSS usefulness. In other words, improve- ments in the positive effects and/or limitations on the negative impact of some contextual factors can increase the usefulness of PSS. In terms of “characteristics of the technology,” some indicators show a positive sign whereas others are negatively related to PSS usefulness. First, the estimates of “informing,”“communicating,” and “transparency” are positive, which means the better performance of these indicators in practice leads to a higher evaluation of PSS usefulness. However, the positive relationship between these indicators and PSS usefulness varies. For instance, the influence of “informing” is only significant at level 2, whereas the significance of “communicating” is determined at levels 5 and 6. This reflects that the higher score on “communicating” could contribute significantly to the increase in PSS usefulness. Finally, the influence of “transparency” is significant at all 6 levels, indicating that the extent to which the underlying models and variables of the PSS are visible to users is important for PSS usefulness. Second, “analyzing,”“designing,” and “flexibility” show negative signs, which means that a high score on these functionalities leads to lower usefulness perception. In terms of “analyzing” and “designing,” the result might seem odd and contradict findings presented in literature. A plausible explanation is that the frequency of the use of “analyzing” and “designing” in practice is high; thus, even low scores on these functionalities could lead to a high evaluation of the overall usefulness of PSS. Regarding “flexibility,” it is understandable that tools that can handle different planning tasks often indicates low specialization. In other words, users prefer more specialized tools. As regards the variable “user characteristics,” the estimates of the indicator “user attitude” have a positive sign, indicating that users with a high positive attitude toward using PSS are more likely to give PSS a higher score on usefulness in practice. The estimate of “expertise level” is negatively associated with PSS usefulness at levels 2 and 3, indicating that a high level of expertise could lead to low PSS usefulness. This seemingly odd result perhaps arose because the majority of the participants were academic researchers and practitioners with high levels of expertise; therefore, they could have been more critical about the supportive role of PSS tools and thus gave a low evaluation of PSS usefulness. In terms of “characteristics of the planning process,” the positive estimate of “active uptaker” implies that active users have a positive influence on PSS usefulness. As Vonk and Geertman (2008) argue, active users act as a catalyst because of their demonstration effect; that is, they encourage other stakeholders to emulate their behaviors via obser- vation of the actions. The estimate of the variable “planner style” shows a negative sign and the relevant p value is 0.002. This means that users in “closed planning” are more likely to give high scores to PSS usefulness. This can be understood from a reverse perspective, namely The Effects of Contextual Factors on PSS Usefulness: an... 233 Table 3 Parameter estimates determined as significant Estimate Std. Error Wald df Sig. Overall usefulness [Overall usefulness = 1] 30.358 12.029 6.369 1 0.012 [Overall usefulness = 2] 37.128 12.362 9.02 1 0.003 [Overall usefulness = 3] 48.775 14.839 10.804 1 0.001 [Overall usefulness = 4] 55.825 15.66 12.708 1 0.000 Characteristics of the technology [Informing = 2] 40.269 12.256 10.796 1 0.001 [Communicating = 4] 6.389 2.828 5.102 1 0.024 [Communicating = 5] 12.077 3.704 10.628 1 0.001 [Analyzing = 3] −15.067 6.2 5.905 1 0.015 [Analyzing = 5] −13.194 4.212 9.812 1 0.002 [Designing = 2] −22.704 7.975 8.106 1 0.004 [Designing = 6] −8.845 2.878 9.447 1 0.002 [Transparency = 1] 53.717 17.164 9.795 1 0.002 [Transparency = 3] 27.313 7.692 12.609 1 0.000 [Transparency = 4] 13.914 4.724 8.674 1 0.003 [Transparency = 5] 6.383 2.887 4.887 1 0.027 [Transparency = 6] 9.666 3.176 9.265 1 0.002 [Flexibility = 2] −40.295 12.131 11.034 1 0.001 [Flexibility = 5] −7.891 3.117 6.41 1 0.011 User characteristics [User attitude = 1] 58.024 17.441 11.068 1 0.001 [User attitude = 2] 53.214 15.818 11.317 1 0.001 [User attitude = 3] 54.049 16.458 10.786 1 0.001 [User attitude = 4] 50.919 15.411 10.917 1 0.001 [User attitude = 5] 40.465 14.045 8.301 1 0.004 [User attitude = 6] 30.699 14.903 4.243 1 0.039 [Expertise level = 2] −20.539 9.525 4.65 1 0.031 [Expertise level = 3] −7.152 3.58 3.991 1 0.046 Characteristics of the planning process [Active uptaker = 4] 14.842 7.52 3.896 1 0.048 Planning style [Planning style = 1] −5.675 1.842 9.495 1 0.002 Political context [Political pressure = 2] −19.442 5.786 11.292 1 0.001 [Political pressure = 3] −23.22 6.617 12.315 1 0.000 [Political pressure = 4] −24.007 6.379 14.163 1 0.000 [Political pressure = 5] −22.787 6.957 10.729 1 0.001 [Political pressure = 6] −22.288 9.133 5.955 1 0.015 Sig. codes: p ≤ 0.05 234 H. Jiang et al. that closed planning processes are less influenced by those factors that appear in interactive planning, such as information overload, conflict of interest occurring when different actors oppose each other, and the difficulty of facilitating interpersonal communication and reaching consensus through PSS (Luque-Martín and Pfeffer 2020; Pelzer 2015; Vonk 2006). Theestimateof “political pressure” shows a negative sign, indicating that political pressure has a strong negative influence on PSS usefulness. According to Cairney (2016), political pressure and intervention highly affect the cognition, perception, and actions of the stakeholders involved in the policy-making process. As for PSS users in planning practice, politically motivated external pressure has a significant influence on the emo- tional and physical condition of users and how PSS is implemented and performed. Finally, it should be noted that a range of other contextual factors (e.g., “types of urban problems” in Appendix 2) are not statistically significant, which means these indicators do not appear to be related to the level of PSS usefulness, at least for the current model and the study period. Discussion The results of the present study suggest an association between contextual factors and PSS usefulness, namely that, in general, “characteristics of the technology,”“user characteristics,”“characteristics of the planning process,” and “political context” have a significant influence on the usefulness of PSS, although their impacts vary signifi- cantly in practice. In particular, the indicators of “characteristics of the planning process” showed a positive sign, whereas the indicators of “political context” were found to be negatively associated with PSS usefulness. The indicators of “characteris- tics of the technology” and “user characteristics” showed both positive and negative associations with PSS usefulness. In addition, PSS usefulness can be better achieved in “closed planning.” Some of the results presented in this paper are in line with previous studies, while others are in contradiction with them. First, the findings concerning the effects of usability indicators on PSS usefulness correspond with Pelzer’s argument that while “usability can be a necessary condition to achieve usefulness, it is never a sufficient condition” (Pelzer 2017:94). For instance, some studies found that simple and transparent PSS applications were positively associated with PSS usefulness (Pan and Deal 2020; Russo et al. 2018;Vonk and Ligtenberg 2010). The results obtained in terms of the “transparency” indicator confirm their findings. Silva et al. (2017) surveyed a number of instrument developers and found that user-friendliness improvement may make a limited contribution to the successful implementation of accessibility concepts in planning practice. In the present study, the influence of “user friendliness” on PSS usefulness was not significant. However, it should be noted that in an experimental environment, user-friendliness is significant in terms of its influence on PSS usefulness (Pelzer 2017). A possible explanation for this discrepancy is that the broader contextual factors considered in this study downplayed the significance of user-friendliness. In terms of the functionality indicators, previous studies found that PSS that are able to facilitate social interaction, interpersonal communication, and community debate can empower professionals and citizens alike to have a better PSS experience and make The Effects of Contextual Factors on PSS Usefulness: an... 235 better informed decisions (Zhang et al. 2019; Saad-Sulonen 2012;Pelzer 2015). Our findings indicate that the influence of “informing” and “communicating” functionalities is statistically positively associated with the overall evaluation of PSS usefulness, revealing its positive effects. Nevertheless, the findings concerning “analyzing” and “designing” functionalities contradict previous findings. For instance, Moghadam and Lombardi (2019), Vonk and Ligtenberg (2010), and Pettit (2005) found that analyzing and designing tools allows decision makers to systematically generate and evaluate alternative solutions, gaining insights that were introduced as inputs to help guide further analyses (e.g., GIS, Maptable, What-If and CommunityViz). However, the large-scale survey carried out for the present study showed that the significance of “analyzing” and “designing” functionalities is negative rather than positive. As men- tioned, the high implementation frequency of these tools is a plausible reason for this. Second, the findings in terms of the variable “user characteristics” correspond with those of earlier studies on how users define technological functions and their use. As Geertman and Stillwell (2004) argue, the user interface of a PSS should be sensitive to the character- istics of the user and to the kind of information that it communicates to that user. The findings of the present study confirm their argument that a high level of positive attitude toward using PSS would improve the awareness of the benefits of using PSS. This finding supports Vonk (2006), who found that a low level of intention to use PSS among possible users reduces the potential expectation of PSS usefulness. Nevertheless, the results obtained concerning “user characteristics” also seem to contradict earlier results. For instance, Holsapple et al. (2005)and Hocetal. (2013) show that higher educated users have greater user satisfaction due to their ability to learn and to develop a high level of expertise. However, the findings presented in this paper show that this relationship could be negatively associated, since experts with a high level of expertise tend to have a fault-finding attitude. As mentioned, they are often more critical of the performance of PSS tools in practice. Third, the negative influence of “active uptaker” shows that in order to improve awareness of the existence and potential of PSS, more effort should be made to demonstrate to users the benefits of applying the diversity of PSS (Vonk and Geertman 2008). Only such an effort will increase the awareness of PSS, making the PSS message more likely to be picked up and appreciated by employees of planning organizations (Vonk et al. 2005). Fourth, it is interesting that “closed planning” seems to be more beneficial for optimizing the supportive role of PSS. Although few previous studies have compared the performance of PSS in these two distinctive planning styles (Vonk and Ligtenberg 2010; Pelzer et al. 2015), an inverse perspective can be used to explain this finding. For example, in ICT-facilitated interactive planning, PSS are more vulnerable to external- ities and a range of side effects or consequences. Fifth, the significant negative influence of “political context” on PSS usefulness confirms the claims by some authors that a broad field of politics impacts the likelihood that actors in the process will absorb new PSS knowledge, and that they will be able to use this knowledge to assess problems and find solutions. For instance, Zhang et al. (2019) identified that in the earlier divergence period, the top-down government-led approach in China often limited the usefulness of web-based PSS in eliciting ideas from independent citizens and supporting participation and engagement. And te Brömmelstroet (2015) shows that in the later convergence period, power relations and hierarchical structures affected the group dynamics and how PSS perform. 236 H. Jiang et al. Finally, we hypothesized that “characteristics of the urban issue” have a significant influence on PSS usefulness. Some studies highlight that the attributes of the urban issue help judge the appropriateness of the supportive role (Jiang et al. 2020c; Pelzer et al. 2015;Vonk and Ligtenberg 2010), and thus their importance should be given more attention. However, the estimate of the indicator “types of urban problems” was not found to be as significant due to the broader multiple and multidimensional aspects of context impact. The present study had some limitations. Because of our selection procedure, the opinions and attitudes of civil society were not considered. According to some authors, however, ideas and knowledge from civil society can effectively promote the advance- ment of PSS (Geertman and Stillwell 2020; Zhang et al. 2019;Pelzer 2015). It should be noted that although the usefulness of PSS is comprised of different dimensions, in this study we considered only the overall evaluation of PSS usefulness. The importance of these different kinds of usefulness of PSS was acknowledged in another article by Jiang et al. (2020a). Thirdly, it should be noted that not all the functionality and usability indicators were discussed in this paper due to the semantic overlap between some concepts (e.g., communicative support capabilities as part of functionality, and communicative value as a usability indicator) (Pelzer 2017). Conclusion Studies on PSS usefulness pay much attention to developing a conceptual and empirical understanding of the relation between planning tasks and PSS (i.e., task–technology fit) and the interaction between the user and a PSS (i.e., human–computer interaction) (Pan and Deal 2020; Jiang et al. 2020a; Russo et al. 2018; Silva et al. 2017; Pelzer 2017; Pelzer et al. 2014; te Brömmelstroet 2012). As a consequence, there is a lack of empirical evidence concerning the importance of the multidimensional aspects of contextual factors in analyzing the development, implementation, and effects of PSS in planning practice. In the present study, we comprehensively examined the extent to which contextual factors influence PSS usefulness via an international questionnaire survey. This paper contributes empirically to insights that “the way in which [PSS] are handled within a specific planning situation will enhance their potential for performing a more effective planning-supportive role (Geertman 2006:878).” While this study did not provide evidence that all contextual factors are associated with PSS usefulness, our results suggest that some contextual factors (i.e., “characteristics of the technology,” “user characteristics,”“characteristics of the planning process,” and “political context”) indeed have differentiated effects on the usefulness of PSS. The results of our study expand the knowledge of the complex relations between contextual factors and PSS usefulness in the realm of smart cities. Base on this, we emphasize that only when PSS users can identify the critical contextual factors that are favorable and unfavorable, will the potential benefits of PSS for spatial planning be fully achieved. Acknowledgements The author would like to thank the anonymous reviewers for many helpful suggestions that simulated improvements to the earlier version of this paper. Financial supports from the China Scholarship Committee (Grant No. 20160601386) are gratefully acknowledged. The Effects of Contextual Factors on PSS Usefulness: an... 237 Compliance with Ethical Standards Statement Conflict of Interest The authors declare that they have no conflicts of interest. Informed Consent This article does not contain any studies involving human participants performed by any of the authors. Appendix 1 Table 4 Frequency statistics of each variable Measures Frequency Marginal Percentage (%) Overall usefulness 1 9 5.1 2 41 23.4 3 86 49.1 4 36 20.6 5 3 1.7 Characteristics of the technology Informing 1 4 2.3 2 4 2.3 316 9.1 4 48 27.4 5 26 14.9 6 34 19.4 7 20 11.4 17 4 Communicating 2 9 5.1 3 24 13.7 4 51 29.1 521 12 6 24 13.7 715 8.6 Analyzing 1 3 1.7 27 4 3 5 2.9 4 18 10.3 5 24 13.7 6 53 30.3 7 53 30.3 Designing 1 2 1.1 27 4 315 8.6 4 40 22.9 5 26 14.9 6 33 18.9 238 H. Jiang et al. Table 4 (continued) Measures Frequency Marginal Percentage (%) 7 26 14.9 Transparency 1 4 2.3 2 1 0.6 314 8 4 38 21.7 5 47 26.9 642 24 7 26 14.9 User-friendliness 1 4 2.3 2 8 4.6 312 6.9 442 24 5 50 28.6 6 33 18.9 7 23 13.1 Interactivity 1 3 1.7 215 8.6 321 12 4 45 25.7 5 41 23.4 6 30 17.1 715 8.6 Flexibility 1 3 1.7 2 5 2.9 3 20 11.4 4 44 25.1 5 52 29.7 6 27 15.4 7 20 11.4 Characteristics of the urban issue Types of urban issues 1 42 24 228 16 3104 59.4 User characteristics Profession 1 108 61.7 2 67 38.3 User attitude 1 15 8.6 2 46 26.3 3 53 30.3 4 44 25.1 511 6.3 6 3 1.7 7 2 1.1 Expertise level 1 5 2.9 The Effects of Contextual Factors on PSS Usefulness: an... 239 Table 4 (continued) Measures Frequency Marginal Percentage (%) 2 3 1.7 316 9.1 4 45 25.7 5 41 23.4 6 47 26.9 7 18 10.3 Characteristics of planning process Time pressure 1 23 13.1 2 39 22.3 3 31 17.7 4 48 27.4 511 6.3 6 8 4.6 7 6 3.4 Active uptaker 1 28 16 2 47 26.9 3 34 19.4 4 43 24.6 511 6.3 6 4 2.3 7 3 1.7 Funding 1 33 18.9 2 31 17.7 3 32 18.3 4 48 27.4 512 6.9 6 4 2.3 77 4 Planning style Planning style 1 78 44.6 2 97 55.4 Political context Political pressure 1 12 6.9 2 23 13.1 3 34 19.4 4 58 33.1 517 9.7 6 6 3.4 7 18 10.3 Valid 114 100% Missing 61 Total 175 240 H. Jiang et al. Appendix 2 Table 5 Parameter estimates Estimate Std. Error Wald df Sig. [Overall usefulness = 1] 30.358 12.029 6.369 1 0.012 [Overall usefulness = 2] 37.128 12.362 9.02 1 0.003 [Overall usefulness = 3] 48.775 14.839 10.804 1 0.001 [Overall usefulness = 4] 55.825 15.66 12.708 1 0.000 Characteristics of the technology [Informing = 1] −3.287 11.122 0.087 1 0.768 [Informing = 2] 40.269 12.256 10.796 1 0.001 [Informing = 3] 0.638 2.984 0.046 1 0.831 [Informing = 4] 0.16 2.057 0.006 1 0.938 [Informing = 5] 0.602 2.348 0.066 1 0.798 [Informing = 6] 2.776 1.964 1.998 1 0.158 [Informing = 7] 0 .. 0 . [Communicating = 1] 13.103 7.152 3.356 1 0.067 [Communicating = 2] 6.606 5.31 1.548 1 0.213 [Communicating = 3] 3.574 3.142 1.294 1 0.255 [Communicating = 4] 6.389 2.828 5.102 1 0.024 [Communicating = 5] 12.077 3.704 10.628 1 0.001 [Communicating = 6] 4.178 2.745 2.317 1 0.128 [Communicating = 7] 0 .. 0 . [Analyzing = 1] −18.705 20.842 0.805 1 0.369 [Analyzing = 2] −0.694 3.978 0.03 1 0.861 [Analyzing = 3] −15.067 6.2 5.905 1 0.015 [Analyzing = 4] 0.498 2.813 0.031 1 0.86 [Analyzing = 5] −13.194 4.212 9.812 1 0.002 [Analyzing = 6] 1.133 1.67 0.461 1 0.497 [Analyzing = 7] 0 .. 0 . [Designing = 1] −25.854 9583.456 0 1 0.998 [Designing = 2] −22.704 7.975 8.106 1 0.004 [Designing = 3] 0.07 3.835 0 1 0.986 [Designing = 4] −2.096 2.29 0.838 1 0.360 [Designing = 5] 2.189 2.735 0.641 1 0.424 [Designing = 6] −8.845 2.878 9.447 1 0.002 [Designing = 7] 0 .. 0 . [Transparency = 1] 53.717 17.164 9.795 1 0.002 [Transparency = 2] 0 .. 0 . [Transparency = 3] 27.313 7.692 12.609 1 0.000 [Transparency = 4] 13.914 4.724 8.674 1 0.003 [Transparency = 5] 6.383 2.887 4.887 1 0.027 The Effects of Contextual Factors on PSS Usefulness: an... 241 Table 5 (continued) Estimate Std. Error Wald df Sig. [Transparency = 6] 9.666 3.176 9.265 1 0.002 [Transparency = 7] 0 .. 0 . [User friendliness = 1] −21.25 9583.401 0 1 0.998 [User friendliness = 2] −11.125 7.714 2.08 1 0.149 [User friendliness = 3] −12.795 7.027 3.316 1 0.069 [User friendliness = 4] 2.003 3.702 0.293 1 0.589 [User friendliness = 5] −2.003 3.854 0.27 1 0.603 [User friendliness = 6] −0.69 2.927 0.056 1 0.814 [User friendliness = 7] 0 .. 0 . [Interactivity = 1] 0 .. 0 . [Interactivity = 2] −1.296 4.77 0.074 1 0.786 [Interactivity = 3] −6.775 4.244 2.549 1 0.110 [Interactivity = 4] −7.34 4.757 2.381 1 0.123 [Interactivity = 5] −1.311 3.487 0.141 1 0.707 [Interactivity = 6] −1.635 3.205 0.26 1 0.610 [Interactivity = 7] 0 .. 0 . [Flexibility = 1] 6.785 15.425 0.193 1 0.660 [Flexibility = 2] −40.295 12.131 11.034 1 0.001 [Flexibility = 3] −5.517 3.578 2.378 1 0.123 [Flexibility = 4] −5.497 3.005 3.346 1 0.067 [Flexibility = 5] −7.891 3.117 6.41 1 0.011 [Flexibility = 6] 2.414 2.224 1.179 1 0.278 [Flexibility = 7] 0 .. 0 . Types of the urban issue [Types of urban issues = 1] −1.27 1.495 0.721 1 0.396 [Types of urban issues = 2] −2.61 2.16 1.46 1 0.227 [Types of urban issues = 3] 0 .. 0 . User characteristics [Profession = 1] 3.543 1.9 3.477 1 0.062 [Profession = 2] 0 .. 0 . [User attitude = 1] 58.024 17.441 11.068 1 0.001 [User attitude = 2] 53.214 15.818 11.317 1 0.001 [User attitude = 3] 54.049 16.458 10.786 1 0.001 [User attitude = 4] 50.919 15.411 10.917 1 0.001 [User attitude = 5] 40.465 14.045 8.301 1 0.004 [User attitude = 6] 30.699 14.903 4.243 1 0.039 [User attitude = 7] 0 .. 0 . [Expertise level = 1] −0.563 3.638 0.024 1 0.877 [Expertise level = 2] −20.539 9.525 4.65 1 0.031 [Expertise level = 3] −7.152 3.58 3.991 1 0.046 [Expertise level = 4] 4.837 2.596 3.471 1 0.062 [Expertise level = 5] −0.843 2.551 0.109 1 0.741 242 H. Jiang et al. Table 5 (continued) Estimate Std. Error Wald df Sig. [Expertise level = 6] 2.154 2.149 1.005 1 0.316 [Expertise level = 7] 0 .. 0 . Characteristics of planning process [Time pressure = 1] −5.368 5.222 1.057 1 0.304 [Time pressure = 2] −1.732 5.292 0.107 1 0.743 [Time pressure = 3] −3.894 5.153 0.571 1 0.450 [Time pressure = 4] −4.529 5.69 0.634 1 0.426 [Time pressure = 5] −3.222 6.084 0.28 1 0.596 [Time pressure = 6] 3.349 12.604 0.071 1 0.790 [Time pressure = 7] 0 .. 0 . [Active uptaker = 1] 12.424 7.83 2.517 1 0.113 [Active uptaker = 2] 13.796 7.167 3.706 1 0.054 [Active uptaker = 3] 11.042 7.182 2.364 1 0.124 [Active uptaker = 4] 14.842 7.52 3.896 1 0.048 [Active uptaker = 5] 5.853 8.639 0.459 1 0.498 [Active uptaker = 6] −13.784 12.007 1.318 1 0.251 [Active uptaker = 7] 0 .. 0 . [Funding = 1] −3.126 6.712 0.217 1 0.641 [Funding = 2] −5.155 6.446 0.639 1 0.424 [Funding = 3] −2.001 6.958 0.083 1 0.774 [Funding = 4] 1.991 6.416 0.096 1 0.756 [Funding = 5] 1.338 7.003 0.036 1 0.849 [Funding = 6] 1.668 7.141 0.055 1 0.815 [Funding = 7] 0 .. 0 . Planning style [Planning style = 1] −5.675 1.842 9.495 1 0.002 [Planning style = 2] 0 .. 0 . Political context [Political pressure = 1] −6.557 4.633 2.003 1 0.157 [Political pressure = 2] −19.442 5.786 11.292 1 0.001 [Political pressure = 3] −23.22 6.617 12.315 1 0.000 [Political pressure = 4] −24.007 6.379 14.163 1 0.000 [Political pressure = 5] −22.787 6.957 10.729 1 0.001 [Political pressure = 6] −22.288 9.133 5.955 1 0.015 [Political pressure = 7] 0 .. 0 . Link function: Logit a. This parameter is set to zero because it is redundant b. Sig. codes: p ≤ 0.05 The Effects of Contextual Factors on PSS Usefulness: an... 243 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. References Allwinkle, S., & Cruickshank, P. (2011). Creating smart-er cities: An overview. Journal of Urban Technology, 18(2), 1–16. Babar, M., & Arif, F. (2017). Smart urban planning using big data analytics to contend with the interoper- ability in internet of things. Future Generation Computer Systems, 77,65–76. Biermann, S. (2011). Planning support systems in a multi-dualistic spatial planning context. Journal of Urban Technology, 18(4), 5–37. Brail, R. K., & Klosterman, R. E. (2001). Planning support systems: Integrating geographic information systems, models, and visualization tools. Redlands: ESRI Press. Cairney, P. (2016). The politics of evidence-based policy making. London: Palgrave Macmillan UK. Campbell, S. (1996). Green cities, growing cities, just cities?: Urban planning and the contradictions of sustainable development. Journal of the American Planning Association, 62(3), 296–312. Caragliu, A., Del Bo, C., & Nijkamp, P. (2011). Smart cities in Europe. Journal of Urban Technology, 18(2), 65–82. Cats-Baril, W. L., & Huber, G. P. (1987). Decision support systems for ill-structured problems: An empirical study. Decision Sciences, 18(3), 350–372. Chadwick, G. F. (1977). The limits of the plannable: Stability and complexity in planning and planned systems. Environment and Planning A, 9(10), 1189–1192. Champlin, C., te Brömmelstroet, M., & Pelzer, P. (2019). Tables, tablets and flexibility: Evaluating planning support system performance under different conditions of use. Applied Spatial Analysis and Policy, 12(3), 467–491. Chesbrough, H. (2006). Open business models: How to thrive in the new innovation landscape. Cambridge: Harvard Business Press. Deal, B., Pan, H., Pallathucheril, V., & Fulton, G. (2017a). Urban resilience and planning support systems: The need for sentience. Journal of Urban Technology, 24(1), 29–45. Deal, B., Pan, H., Timm, S., & Pallathucheril, V. (2017b). The role of multidirectional temporal analysis in scenario planning exercises and planning support systems. Computers, Environment and Urban Systems, 64,91–102. Geertman, S. (2006). Potentials for planning support: A planning-conceptual approach. Environment and planning B: Planning and Design, 33(6), 863–880. Geertman, S. (2017). PSS: Beyond the implementation gap. Transportation Research Part A: Policy and Practice, 104(C), 70–76. Geertman, S., & Stillwell, J. (2004). Planning support systems: An inventory of current practice. Computers, Environment and Urban Systems, 28(4), 291–310. Geertman, S., Zhan, Q., Allan, A., & Pettit, C. (Eds.). (2019). Computational Urban Planning and Management for Smart Cities. New York: Springer International Publishing. Geertman,S. C.M., &Stillwell,J.(2020). Handbook of planning support science. Cheltenham: Edward Elgar Publishing. Goodspeed, R. (2013). Planning support systems for spatial planning through social learning. PhD thesis, Massachusetts Institute of Technology. Harrell Jr., F. E. (2015). Regression modeling strategies: With applications to linear models, logistic and ordinal regression, and survival analysis. Cham: Springer. Healey, P. (1997). Collaborative planning: Shaping places in fragmented societies. London: Macmillan International Higher Education. Hoc, J. M., Cacciabue, P. C., Hollnagel, E., & Cacciabue, P. C. (Eds.). (2013). Expertise and technology: Cognition & human-computer cooperation. Hillsdale: Psychology Press. 244 H. Jiang et al. Holsapple, C. W., Wang, Y. M., & Wu, J. H. (2005). Empirically testing user characteristics and fitness factors in enterprise resource planning success. International Journal of Human-Computer Interaction, 19(3), 325–342. Hutchison, P., Lord, J., & Salisbury, B. (2006). North American approaches to individualised planning and direct funding. In J. Leece & J. Bornat (Eds.), Developments in direct payments. Bristol: Policy Press. Ismail, N. A. (2008). Information technology governance, funding and structure: A case analysis of a public university in Malaysia. Campus Wide Information Systems, 25(3), 145–160. Jiang, H., Geertman, S., & Witte, P. (2019). Smart urban governance: An urgent symbiosis? Information Polity, 24(3), 245–269. Jiang, H., Geertman, S., & Witte, P. (2020a). Ignorance is bliss? An empirical analysis of the determinants of PSS usefulness in practice. Computers, Environment and Urban Systems, 83,1–11. Jiang, H., Geertman, S., & Witte, P. (2020b). Smartening urban governance: An evidence-based perspective. Regional Science Policy and Practice. https://doi.org/10.1111/rsp3.12304. Jiang, H., Geertman, S., & Witte, P. (2020c). Avoiding the planning support system pitfalls? What smart governance can learn from the planning support system implementation gap. Environment and Planning B: Urban Analytics and City Science, 2399808320934824, 239980832093482. https://doi.org/10.1177 /2399808320934824. Khan, Z., Anjum, A., Soomro, K., & Tahir, M. A. (2015). Towards cloud based big data analytics for smart future cities. Journal of Cloud Computing, 4(1), 1–11. Khan, Z., Ludlow, D., Loibl, W., & Soomro, K. (2014). ICT enabled participatory urban planning and policy development: The UrbanAPI project. Transforming Government: People, Process and Policy, 8(2), 205– Klosterman, R. E. (1997). Planning support systems: A new perspective on computer-aided planning. Journal of Planning Education and Research, 17(1), 45–54. Lin, Y. (2018). A comparison of selected Western and Chinese smart governance: The application of ICT in governmental management, participation and collaboration. Telecommunications Policy, 42(10), 800– Long, Y., Shen, Z., & Mao, Q. (2011). An urban containment planning support system for Beijing. Computers, Environment and Urban Systems, 35(4), 297–307. Luque-Martín, I., & Pfeffer, K. (2020). Limitations and potential of planning support systems application in planning in southern Spain: Bridging academia and practice. In S. C. M. Geertman & J. Stillwell (Eds.), Handbook of planning support science. Cheltenham, UK: Edward Elgar Publishing. McEvoy, S., van de Ven, F. H., Santander, A. G., & Slinger, J. H. (2019). The influence of context on the use and added value of planning support systems in workshops: An exploratory case study of climate adaptation planning in Guayaquil, Ecuador. Computers, Environment and Urban Systems, 77,101353. Moghadam, S. T., & Lombardi, P. (2019). An interactive multi-criteria spatial decision support system for energy retrofitting of building stocks using CommuntiyVIZ to support urban energy planning. Building and Environment, 163,106233. Nielsen, J. (1994). Usability engineering. San Diego: Academic Press. Pan, H., Chen, S., Gao, Y., Deal, B., & Liu, J. (2020). An urban informatics approach to understanding residential mobility in metro Chicago. Environment and Planning B: Urban Analytics and City Science, 2399808320924437. https://doi.org/10.1177/2399808320924437. Pan, H., & Deal, B. (2020). Reporting on the performance and usability of planning support systems— Towards a common understanding. Applied Spatial Analysis and Policy, 13(1), 137–159. Pan, H., Page, J., Zhang, L., Cong, C., Ferreira, C., Jonsson, E., Näsström, H., Destouni, G., Deal, B., & alantari, Z. (2019). Understanding interactions between urban development policies and GHG emis- sions: A case study in Stockholm region. Ambio, 49, 1313–1327. https://doi.org/10.1007/s13280-019- 01290-y. Pelzer, P. (2015). Usefulness of Planning Support Systems: Conceptual perspectives and practitioners' experiences (doctoral dissertation). Groningen: InPlanning. Pelzer, P. (2017). Usefulness of planning support systems: A conceptual framework and an empirical illustration. Transportation Research Part A: Policy and Practice, 104,84–95. Pelzer, P., Geertman, S., van der Heijden, R., & Rouwette, E. (2014). The added value of planning support systems: A practitioner’s perspective. Computers, Environment and Urban Systems, 48,16–27. Pelzer, P., Arciniegas, G., Geertman, S., & Lenferink, S. (2015). Planning support systems and task- technology fit: A comparative case study. Applied Spatial Analysis and Policy, 8(2), 155–175. Pelzer, P., Geertman, S., & van der Heijden, R. (2016). A comparison of the perceived added value of PSS applications in group settings. Computers, Environment and Urban Systems, 56,25–35. The Effects of Contextual Factors on PSS Usefulness: an... 245 Pettit, C. J. (2005). Use of a collaborative GIS-based planning-support system to assist in formulating a sustainable-development scenario for Hervey Bay, Australia. Environment and Planning B: planning and design, 32(4), 523–545. Pettit, C., Bakelmun, A., Lieske, S. N., Glackin, S., Thomson, G., Shearer, H., et al. (2018). Planning support systems for smart cities. City, Culture and Society, 12,13–24. Rathore, M. M., Ahmad, A., Paul, A., & Rho, S. (2016). Urban planning and building smart cities based on the internet of things using big data analytics. Computer Networks, 101,63–80. Rittel, H. W., & Webber, M. M. (1984). Planning problems are wicked problems. In N. Cross (Ed.), Developments in design methodology (pp. 135–144). Chichester: John Wiley & Sons. Russo, P., Lanzilotti, R., Costabile, M. F., & Pettit, C. J. (2018). Towards satisfying practitioners in using planning support systems. Computers, Environment and Urban Systems, 67,9–20. Saad-Sulonen, J. (2012). The role of the creation and sharing of digital media content in participatory e- planning. International Journal of E-Planning Research (IJEPR), 1(2), 1–22. Silva, C., Bertolini, L., te Brömmelstroet, M., Milakis, D., & Papa, E. (2017). Accessibility instruments in planning practice: Bridging the implementation gap. Transport Policy, 53,135–145. Söderström, O., Paasche, T., & Klauser, F. (2014). Smart cities as corporate storytelling. City, 18(3), 307–320. Stanilov, K. (2007). Urban planning and the challenges of the post-socialist transformation. In K. Stanilov (Ed.), The post-Socialist City. Dordrecht: Springer. te Brömmelstroet, M. (2010). Equip the warrior instead of manning the equipment: Land use and transport planning support in the Netherlands. Journal of Transport and Land Use, 3(1), 25–41. te Brömmelstroet, M. (2012). Transparency, flexibility, simplicity: From buzzwords to strategies for real PSS improvement. Computers, Environment and Urban Systems, 36(1), 96–104. te Brömmelstroet, M. (2013). Performance of planning support systems: What is it, and how do we report on it? Computers, Environment and Urban Systems, 41,299–308. te Brömmelstroet, M. (2015). A critical reflection on the experimental method for planning research: Testing the added value of PSS in a controlled environment. Planning Practice and Research, 30(2), 179–201. te Brömmelstroet, M. (2017). PSS are more user-friendly, but are they also increasingly useful? Transportation Research Part A: Policy and Practice, 104,96–107. Thakuriah, P. V., Tilahun, N. Y., & Zellner, M. (2017). Big data and urban informatics: Innovations and challenges to urban planning and knowledge discovery. In P. Thakuriah, N. Tilahun, & M. Zellner (Eds.), Seeing cities through big data. Cham: Springer. Verrest, H., & Pfeffer, K. (2019). Elaborating the urbanism in smart urbanism: Distilling relevant dimensions for a comprehensive analysis of smart city approaches. Information, Communication & Society, 22(9), 1328–1342. Vonk,G. A.(2006). Improving planning support: The use of planning support systems for spatial planning (PhD dissertation). Utrecht: KNAG/Netherlands Geographical Studies. Vonk, G., & Geertman, S. (2008). Improving the adoption and use of planning support systems in practice. Applied Spatial Analysis and Policy, 1(3), 153–173. Vonk, G., & Ligtenberg, A. (2010). Socio-technical PSS development to improve functionality and usability—Sketch planning using a Maptable. Landscape and Urban Planning, 94(3–4), 166–174. Vonk, G., Geertman, S., & Schot, P. (2005). Bottlenecks blocking widespread usage of planning support systems. Environment and Planning A, 37(5), 909–924. Zhang, L., Geertman, S., Hooimeijer, P., & Lin, Y. (2019). The usefulness of a web-based participatory planning support system in Wuhan, China. Computers, Environment and Urban Systems, 74,208–217. Publisher’sNote Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Journal

Applied Spatial Analysis and Policy – Springer Journals

Published: Jul 21, 2020

There are no references for this article.