Metamodel-Based Optimization Method for Traffic Network Signal Design under Stochastic Demand
Metamodel-Based Optimization Method for Traffic Network Signal Design under Stochastic Demand
Huang, Wei;Zhang, Xuanyu;Cheng, Haofan;Xie, Jiemin
2023-05-27 00:00:00
Hindawi Journal of Advanced Transportation Volume 2023, Article ID 3917657, 15 pages https://doi.org/10.1155/2023/3917657 Research Article Metamodel-Based Optimization Method for Traffic Network Signal Design under Stochastic Demand 1 1 1 2 Wei Huang , Xuanyu Zhang, Haofan Cheng, and Jiemin Xie School of Intelligent Systems Engineering, Sun Yat-Sen University, Guangzhou 510006, China School of Intelligent Systems Engineering, Shenzhen Campus of Sun Yat-Sen University, Guangdong 518107, China Correspondence should be addressed to Jiemin Xie; xiejm28@mail.sysu.edu.cn Received 13 March 2023; Revised 20 April 2023; Accepted 24 April 2023; Published 27 May 2023 Academic Editor: Seungjae Lee Copyright © 2023 Wei Huang et al. Tis is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Trafcnetworkdesignproblems(NDPs)playanimportantroleinurbanplanning.Sincethereexistuncertaintiesintherealurban trafc network, neglecting the uncertainty factors may lead to unreasonable decisions. Tis paper considers the transportation network signal design problem under stochastic origin-destination (OD) demand. In general, solving this stochastic problem requires a large amount of computational budget to calculate the equilibrium fow corresponding to a certain demand dis- tribution,whichlimitsitsrealapplications.Toreducethecomputationaltimeincalculatingtheequilibriumfowunderstochastic demand, this paper proposes a metamodel-based optimization method. First, a combined metamodel that integrates a physical modeling part and a model bias generic part is developed. Te metamodel is used to approximate the time-consuming average equilibrium fow solution process, hence to improve the computational efciency. To further improve the convergence and the solutionoptimalityperformanceofthemetamodel-basedoptimization,thegradientinformationoftrafcfowwithrespecttothe signal planisincorporated intheoptimization model.Agradient-basedmetamodelalgorithmis thenproposed. Inthenumerical example, a six-node test network is used to examine the proposed metamodel-based optimization method. Te proposed combined metamodel is compared with the benchmark method to investigate the importance of incorporating a model bias generic part and the trafc fow gradient information in the combined metamodel. Although there is a reduction in solution optimality since the metamodel is an approximation of the original model, the metamodel methods greatly improve the computational efciency (the computational time is reduced by 4.84 to 13.47 times in the cases of diferent initial points). By incorporating the model bias, the combined metamodel can better approximate the original optimal solution. Moreover, in- corporating the gradient information of the trafc fow in the optimization search algorithm can further improve the solution performance. Numerical results show that the gradient-based metamodel method can efectively improve the computation efciency while slightly reducing the solution optimality (with an increase of 0.09% in the expected total travel cost). optimization design, and road tolling design. For network 1. Introduction trafc signal control, it focuses on determining optimal Trafc network design is a basic means to improve trafc signal timing plans that can trigger better equilibrium fow fow distribution and alleviate trafc congestion in urban patterns with optimal network performance. It is also called trafc networks. Te network design problem (NDP) is the combined trafc assignment and signal control problem usuallytodetermineoptimalnetworksupplydecisions,such [7–12] or anticipatory network trafc control [13–16] be- as adding new links or improving the capacity of existing cause the signal control anticipates the efect of route choice ones, with certain objectives (e.g., maximizes social benefts response. or minimizes total travel cost), while considering users’ Te trafc network signal design problem has been route choice behavior [1–6]. Tere exist diferent network extensively explored in the literature. Allsop [17] frst supply decisions for the trafc network design problems, proposed the concept of combined signal control and trafc including road network expansion design, signal control assignment and developed an iterative optimization method 2 Journal of Advanced Transportation complex queue network in the simulation. To improve the to achieve the equilibrium solution by alternately modifying the signal timings and the equilibrium fows. However, it is accuracy of the physical metamodel, it is necessary to conduct a model parameter ftting. A conventional two-step reported that the solution of the iterative optimization method highly depends on the initial point (initial assign- approach was usually applied to reduce the errors between ment), and the equilibrium solution is generally not nec- the physical model and the real system [33]. However, for essarily the optimal solution [18–20]. In view of the complex transportation system, it is difcult to calibrate drawbacks of the iterative approach, Yang and Yagar [21] model parameters and establish an accurate physical model. established the network signal control model from the Another is the functional metamodel, which is com- perspective of global optimization and proposed a global posed of generic functions with general purposes. Te functional metamodel is usually developed based on ana- optimization approach, which is usually formulated as a bilevel programming optimization model. Te upper level lytical tractability, following a data-driven regression anal- ysis approach. Hence, it does not include physical problem is the signal control optimization problem, which optimizes the network performance with fow constraints. information regarding the underlying problem. A common way is to apply low-order polynomials for constructing the Te lower level problem solves the user equilibrium (UE) problem [22–25] under the given signal timing plan. Te functional metamodel. In recent years, the functional global optimization approach needs to simultaneously metamodel has been gradually applied to the domain of consider the trafc fow equilibrium and signal control trafc network design. Chen et al. [34] introduced Kriging optimization, which makes it time-consuming and difcult surrogates to solve the network design problem under dy- to solve. Te computational budget increases especially for namic trafc assignment. Li et al. [35] proved the conver- large-scale road network problems. gence of solving the continuous network design problem with the surrogate model and showed the advantages of the Traditional trafc network design problems usually as- sume fxed or deterministic trafc conditions, such as fxed surrogate model in computation efciency. However, the functional metamodel relies highly on data, and the ap- trafc demand. However, the transportation system is generallyafectedbymanyuncertainfactorsondemandand proximationperformanceoutsidetherangeofsampledatais often unsatisfactory. It is typically that the data-driven supply, for instance, OD demand fuctuations, link capacity variations, special events, and random route choice be- method has a rigid requirement on the sample data and havior. Ignoring the uncertainty efects in the decision- parameter ftting in order to achieve a good approximation making process may result in inaccurate evaluations and performance. suboptimal control plans [26–28]. Li et al. [29] dealt with To overcome the shortcomings of the physical and NDP under stochastic demand and reported that demand functional metamodels, Osorio and Bierlaire [32] proposed stochasticityafectsthereliabilityoftheoptimalsolutionand a metamodel that combines a functional component with a physical component to approximate the trafc queueing its real application. Lv and Liu [30] also showed that the stochastic features of trafc demand will signifcantly afect process. Te purpose of the functional component is to provide a more accurate local approximation, and the the optimal signal control settings as well as the associated equilibrium fow pattern of the transportation network, physical component is to provide a good global approxi- leading to suboptimal network performance. Tis paper mation. It has been shown that the combined metamodel focuses on network trafc control under stochastic demand. method has a faster convergence speed and better ftting To account for the impact of demand stochasticity and performance[36,37].Teabove-mentionedstudiesfocuson ensure the reliability of the solution, it is required to cal- localintersectionsignalcontrol,whichdoesnotconsiderthe culate the equilibrium fows under a large number of ran- travelers’ route choice behavior. Moreover, the demand dom demand scenarios, which substantially adds to the uncertainty is not explicitly addressed. computation complexity of the control optimization prob- Following the combined metamodeling approach, this paperproposesametamodel-basedoptimizationmethodfor lem. Te high computational budget of the control method that addresses the demand uncertainty limits its real-time trafc network signal design under stochastic demand. Taking account of the stochastic features of trafc demand, and large-scale network applications. Metamodel(orsurrogatemodel)isacommonmethodto a global optimization model is established with the goal of solvenonlinearproblemswithhighcomputationalbudget.It minimizing the expected total travel cost of the road net- typically makes use of simple analytical models, which are work. Terefore, it needs to calculate the equilibrium fows called metamodels to approximate the original time- under random demand scenarios and derive the expected expensive analysis or models, so as to improve the overall performance. In order to improve the computational ef- computation efciency [31]. In general, metamodels can be ciency of solving the average equilibrium trafc state, a metamodel that consists of a trafc assignment model classifed in two types: physical metamodels and functional metamodels. Te physical metamodel usually develops (physical modeling) and a model bias (generic function) is constructed to approximate the expected equilibrium trafc problem-specifcmodeltoapproximatetheoriginalproblem from frst principle. Teir functional form and parameters fow.Tispaperfurtherproposestoincorporatethegradient information of trafc fow with respect to the decision have a physical or structural interpretation. Osorio and Bierlaire [32] considered simulation-based optimization variable(thesignal timingplaninourcase) inthecombined approachfortrafcsignalcontrolanddevelopedasimplifed metamodel. By incorporating the gradient information, it is analytical queueing network model to approximate the able to improve the parameter ftting performance and Journal of Advanced Transportation 3 hence the solution optimality. A gradient-based metamodel k � 1,2, ..., K, represents the sample size of stochastic de- algorithm is then developed to solve the network signal mand. Te equilibrium fow is derived by the trafc as- Eq control optimization problem. Te main contributions of signment model x (g, d ). Equation (3) is the signal timing this paper are summarized as follows: constraint. Equation (4) sets the upper and lower limits of the signal control variables. According to the discussion (1) A metamodel-based optimization method is de- above,inthepresenceofdemanduncertainty,itis necessary veloped for trafc network signal design under to calculate the equilibrium link fow under a certain de- stochastic demand. To explicitly address the sto- mand distribution. In other words, calculations of the trafc chasticity in trafc demand and improve the com- assignment model and the total travel cost function are putation efciency, a combined metamodel that repeated a large number of times, leading to a computa- consistsofaphysicalmodelingpartandamodelbias tional-intensive optimization problem. Terefore, the generic part is proposed to approximate the time- computational budget restricts the application of the sto- consuming average equilibrium fow solution chastic network design in real-time or large-scale problems. process. (2) A gradient metamodel scheme is further developed 2.2. Metamodel-Based Optimization Method for Network to make use of the gradient information of trafc fow to improve solution performance. Signal Control. In order to improve the efciency of cal- culation, this paper proposes a metamodeling approach. As (3) A gradient-based metamodel algorithm is proposed shown in equation (1), the objective is to minimize the to solve the network signal control optimization expected total travel cost, which requires calculating the problem. equilibrium fow under diferent demand scenarios. It Te rest of the paper is organized as follows. Section 2 usually involves a large number of scenarios (sample size) in elaborates the problem formulation and methodology of the order to achieve a comparable accuracy level, leading to metamodel-based optimization for trafc network signal a time-expensive calculation process. Terefore, the meta- design. Section 3 presents the numerical example on a test model is developed as a surrogate of the expensive calcu- network. Insights into the properties of the proposed lationprocesstoimprovecomputationalefciency.First,we metamodel method and the solution performance of the assume that the expected total travel cost is associated with ave Eq method are demonstrated. Concluding remarks are dis- the expected equilibrium link fow x � E[x (g, d )] cussed in Section 4. under stochastic demand. In general, calculating the ex- pectedequilibriumfowtakesmostofthecomputationtime. To reduce the computation time, we introduce a meta- 2. Metamodel-Based Optimization Method for meta ave model x (g, d; β, θ) as a surrogate of x , to approximate Traffic Network Signal Design the expensive calculation of the expected equilibrium fow with diferent demand scenarios. d is the average trafc 2.1. Trafc Network Design Problems under Stochastic demand. β and θ are parameters of the metamodel, whose Demand. In view of the inherent variations in trafc de- feasible regions are Β and Θ, respectively. mand, in the trafc network design problem, the stochastic features of trafc demand need to be explicitly addressed in Based on the metamodel, trafc network signal design problem under stochastic demand can be written as follows: the optimization model to ensure reliable decisions. For the trafc network signal design problem under stochastic de- min Z (g, x), mand, it can be expressed as the problem of minimizing the (5) i∈L expected total travel cost of the road network as follows: meta s.t. x � x (g, d; β, θ), (6) ⎡ ⎣ ⎤ ⎦ min E Z (g, x) , (1) i∈L f(g) � 0, (7) Eq (2) s.t. x � x g, d k � 1,2, . . . , K, g ≤ g ≤ g , (8) min max f(g) � 0, (3) where in equation (6) we calculate the expected equilibrium fow with the metamodel. Other constraints are the same of g ≤ g ≤ g , (4) min max theoriginalproblem.Inordertoimprovetheapproximation accuracyandmaketheapproximateresultofthemetamodel where Z represents the travel cost of link i, which is closer to the actual average equilibrium fow, a suitable a function of signal settings g (such as green splits) and link parameter set should be determined. Te parameter ftting fow x. L represents the total number of links in the road can be formulated as a general least square error problem: network. Equation (1) is the objective function, i.e., mini- mizing the average of the total travel cost of all links. Eq meta min f(α, β, θ) � min E x g , d − x g , d; β, θ , t k t Constraint condition (2) represents the equilibrium fow β,θ β,θ constraint. Te equilibrium link fow pattern x is related to (9) the signal settings g and the stochastic trafc demand d , k 4 Journal of Advanced Transportation where t is the iteration indicator and g is signal settings at routefow,whichcantransformtheroutefowfunctioninto iteration t. the link fow function F(c). Finding the solution of equa- tions (10) represents a fxed-point problem, for which there As discussed, the metamodel is an analytical approxi- mation of the expensive calculation process of the original exist diferent solution algorithms [38]. Assuming that the optimization,i.e.,thecalculationofaverageequilibriumfow link cost function C(x, g) is continuous and strictly in- under stochastic demand. Te metamodel-based optimiza- creasingwith xandthelinkfowfunction F(c)iscontinuous tion method then iterates over two main steps, including and monotonically decreasing with c, the existence and a metamodel ftting step and a signal control optimization uniqueness of the fxed-point solution is guaranteed [39]. step (i.e., the trafc network signal design). Figure 1 shows Te solution of the fxed-point problem is the equilibrium theinteractionbetweendiferentmodulesinthemetamodel- fow. Te signal settings will afect the equilibrium state based optimization framework. Te metamodel is con- because the travel cost highly depends on the signal settings. structed based on a sample of calculation results of the Given a set of signal settings g , the equilibrium fow can be average equilibrium fow. Given the signal settings and expressed as follows: stochastic demand, we can calculate the average equilibrium x � F C x, g � g . (11) fow which involves solving the equilibrium fow for each demand and taking the average value. In the metamodel Te solution of this fxed-point problem depends on the ftting step, based on the current sample of average equi- link travel cost function and link fow function. Equation librium fow, the metamodel is ftted by solving the opti- (11) shows that the equilibrium fow is related to the signal mization problem (9). Ten, the signal control optimization settings. step uses the ftted metamodel as constraint (6) to solve the In this paper, the metamodel is used to approximate the signal control design problem and derive the optimal signal average value of equilibrium fow under stochastic demand. settings g . Further, the updated signal settings are imple- As mentioned above, the metamodel that combines mented in the expensive calculation process, which leads to a functional component with a physical component is ave a new calculation result of the average equilibrium fow x . considered. Te purpose of the functional component is to As the new sample becomes available, the metamodel is provide a detailed local approximation and that of the ftted again, leading to a more accurate metamodel. Te two physical component is to provide a good global approxi- steps iterate until convergence. At convergence, an accurate mation. Tis study develops a combined metamodel to metamodel that approximates the original model can be approximatetheaverageequilibriumfow.Weformulatethe obtained,andultimatelytheoptimalcontrolschemederived trafc assignment model F(g; θ) as the physical modeling based on the metamodel should be close to the solution of part. g is the set of signal settings, and θ is the set of model the original trafc network design problem under stochastic parameters to be calibrated. Te generic function is demand. expressed as Φ(g; β). Ten the metamodel can be written as follows: 2.3. Equilibrium Flow and Metamodel Fitting. Te trafc meta x (12) (g; β, θ) � F(g; θ) + Φ(g; β), network signal design considers the equilibrium fow con- straint. From a network planning perspective, the signal where β is the parameter of the generic function. In this control involves the interaction between the controller and paper, we consider the low-order polynomials function and travelers. Te controller anticipates travelers’ route choice defne Φ as follows: response when determining the signal settings, while trav- elers make route choice based on trafc conditions (13) Φ(g; β) � β + β g , 0 i i i�1 depending on the signal settings [13–15]. Hence, the route whereNisthenumberofsignalcontrolvariables.Terefore, choice response and the resulting equilibrium fow pattern, the objective function of the metamodel ftting problem (9) whichisderivedbysolvingatrafcassignmentproblem,are can be written as follows: taken as constraints in the network signal design process. In general, fnding the solution of trafc assignment problem 2 N ave meta 2 min x − x g ; β, θ + β . t (14) t i can be represented as a fxed-point problem. Te link fow i�1 β,θ determines the link travel cost, and the route travel cost calculated from the link travel cost will afect the route Tefrsttermistheerrorbetweentheapproximateresult selection and hence the trafc fow assignment. Tis can be of the metamodel and the actual average equilibrium fow ave formulated as the following equations: x , and the second term is the ridge penalty term. Next, we elaborate on the development of the meta- c � C(x, g), model. First, thephysical metamodel that onlyconsiders the x � F(c) (10) simplifed problem-specifc model (the trafc assignment modelinourcase)isestablished.Ten,theconceptofmodel � Bh(c), bias is introduced, and a combined metamodel with the where c is the link cost vector, which is calculated as model bias as the generic part is proposed. To improve the solutionperformance,thispaperfurtherintegratesthetrafc a function of link fows x and signal settings g, h(c) rep- resents the route fow, and B is incidence matrix of link- fow gradient information into the combined metamodel. Journal of Advanced Transportation 5 Metamodel-based optimization Metamdoel fitting Traffic network signal design Metamdoel parameter Historical data meta Metamodel ave ave x (g,d;β,θ) {x ,..., x } β ,θ 1 t t t Optimization formulation ave Signal settings g Average equilibrium flow x t The expensive calculation process: t calculate the average equilibrium flow Figure 1: Metamodel-based optimization framework. 2.3.1. Physical Metamodel. Te physical metamodel only to the generic function part, which is updated by using the considers the simplifed physical model, that is, the trafc data during the iteration process. Te signal optimization assignment model F(g; θ), as shown in equation (11). design problem is formulated as follows: Generally, a two-step scheme is used to iteratively update meta x g ; θ � F g ; θ + b , (20) t t t model parameters θ and determine the optimal signal set- tings as follows: meta � � g � argmin zg, x g ; θ . t+1 t (21) � � ave � � g θ � argmin x − F g ; θ , � � (15) t t t Te model bias b is updated with the data obtained � argmin z g, F g; θ during the iteration process. g , t+1 t (16) where t is the iteration indicator, and constraints of the 2.3.3. Gradient-Based Metamodel. Inthispaper,acombined optimization problem are not included for simplicity. metamodel considering gradient information of trafc fow Equation (15) represents the problem of model parameter isproposed.Ingeneral,gradientisanimportantinformation estimation, which minimizes the distance between the ap- for fnding the descending direction of the optimization proximate metamodel and the average equilibrium fow by problem. In the trafc assignment model, the gradient re- updatingthemodelparameters.Equation(16)representsthe fects the variations of the trafc fow when the signal set- signaloptimizationproblem.Basedonthefttedmetamodel, tings change. Incorporating gradient information generally the optimal signal setting is calculated by minimizing the improvessolutionperformanceintermsofconvergenceand total travel cost, and these two steps iterate until solution optimality, i.e., faster convergence and better so- convergence. lution point [14]. Patwary et al. [40] proposed a metamodel method with trafc fow gradient for an efcient calibration of large-scale trafc simulation models. For calculating the 2.3.2. Combined Metamodel with Model Bias. In view of the gradient of the equilibrium fow, this paper makes use of physical modeling error, this paper introduces a concept of a fnite diference (FD) approach, which requires perturbing model bias, which is defned as the error between the trafc eachsignalcontrolvariableandcalculatesthecorresponding assignment model and the average equilibrium link fow of derivative component. the system as follows: zF(g) F g , g , . . . , g + h, . . . , g − F g , g , . . . , g , . . . , g ave 1 2 i N 1 2 i N b � x − F(g; θ). (17) � , zg h At iteration step t, the model bias is calculated by the (22) average equilibrium fow and the trafc assignment model where F(g) is the equilibrium fow function (i.e., the trafc with the corresponding signal settings g as follows: assignment model) and h is a small perturbation on signal ave b � x g − F g ; θ . (18) control variable g . Calculating the gradient of the trafc t t t t assignment model, i.e., ∇F(g; θ), is trivial. However, it is With the help of model bias, a combined metamodel is computationally intensive to estimate the gradient of the developed as follows: actual average equilibrium fow, i.e., ave Eq meta ∇x � ∇E[x (g , d )]. Tis is because for each changed x (g; θ) � F(g; θ) + b. (19) t t k signal control variable, derivatives of equilibrium fows Tecombinedmetamodelconsistsoftwoterms.Tefrst under diferent demand scenarios are required, which in- term is the trafc assignment model, which is the physical volve repeatedly solving the trafc assignment model. Re- modelingpart.Tesecondtermofmodelbias bcorresponds garding the computational budget on calculating the 6 Journal of Advanced Transportation gradient information, this paper applies a fnite diference and the gradient of trafc assignment model ∇F(g ; θ). approximation method[41],which usestheresults recorded Compared with the metamodel with model bias in equation in previous iterations to estimate the Jacobian matrix of the (19), the gradient-based metamodel (24) not only considers average equilibrium fow. In each iteration, the Jacobian thevalueofmodelbiasbutalsotakesaccountofthegradient matrix is updated by the average equilibrium fow obtained information, i.e., the frst-order derivative information. Tis in the historical iterations. Assuming that the number of gradient-based metamodel method, which incorporates the control variables is n , then n +1 control parameters and gradient information of the metamodel at each local point g g corresponding values of the average equilibrium fow are g , can ensure the frst-order optimality at convergence. Applying the gradient-based metamodel, the optimal ave ave required, i.e., g , . . . , g and x , . . . , x . Te Ja- t t−n t t−n ∗ g g signal setting g at (t + 1) th iteration is determined by t+1 cobian matrix of iteration t can be calculated by the fol- solving the following optimization problem: lowing formula: ∗ meta T g � argmin z g, x (g; θ) , ave ave t+1 (25) x − x g t t−1 ⎡ ⎢ ⎤ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ave ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ zx ⎢ ⎥ −1⎢ ⎥ ⎢ ⎥ meta ave ⎢ ⎥ . . . ⎥ ⎢ ⎥, (23) � ∆g ⎢ ⎥ s.t. x (g; θ) � F(g; θ) + x − F g ; θ ⎢ ⎥ t ⎢ ⎥ t ⎢ ⎥ t ⎢ ⎥ ⎢ ⎥ zg ⎢ ⎥ ⎢ ⎥ (26) ⎢ ⎥ g ⎢ ⎥ t ⎢ ⎥ ave ⎢ ⎥ ⎢ ⎥ ⎢ T ⎥ ⎣ ⎦ + ∇x − ∇F g ; θ