Connecting the Dots: Identifying Network Structure via Graph Signal Processing

Gonzalo Mateos; Santiago Segarra; Antonio G. Marques; Alejandro Ribeiro

doi:10.1109/MSP.2018.2890143

Mateos, Gonzalo;Segarra, Santiago;Marques, Antonio G.;Ribeiro, Alejandro

2018-10-31 00:00:00

Network topology inference is a prominent problem in Network Science. Most graph signal pro- cessing (GSP) efforts to date assume that the underlying network is known, and then analyze how the graph’s algebraic and spectral characteristics impact the properties of the graph signals of interest. Such an assumption is often untenable beyond applications dealing with e.g., directly observable social and infrastructure networks; and typically adopted graph construction schemes are largely informal, distinctly lacking an element of validation. This tutorial offers an overview of graph learning methods developed to bridge the aforementioned gap, by using information available from graph signals to infer the underlying graph topology. Fairly mature statistical approaches are surveyed ﬁrst, where correlation analysis takes center stage along with its connections to covariance selection and high-dimensional regression for learning Gaussian graphical models. Recent GSP-based network inference frameworks are also described, which postulate that the network exists as a latent underlying structure, and that observations are generated as a result of a network process deﬁned in such a graph. A number of arguably more nascent topics are also brieﬂy outlined, including inference of dynamic networks, nonlinear models of pairwise interaction, as well as extensions to directed graphs and their relation to causal inference. All in all, this paper introduces readers to challenges and opportunities for signal processing research in emerging topic areas at the crossroads of modeling, prediction, and control of complex behavior arising in networked systems that evolve over time. I. I NTRODUCTION Coping with the challenges found at the intersection of Network Science and Big Data necessitates fundamental breakthroughs in modeling, identiﬁcation, and controllability of distributed network processes – often conceptualized as signals deﬁned on graphs [38]. For instance, graph-supported signals can model vehicle congestion levels over road networks, economic activity observed over a network of production ﬂows between industrial sectors, infectious states of individuals susceptible to an epidemic disease spreading on a social network, gene expression levels deﬁned on top of gene regulatory networks, y Work in this paper was supported by the USA NSF award CCF-1750428, the Spanish MINECO grants OMICRON (TEC2013- 41604-R) and KLINILYCS (TEC2016-75361-R), and an MIT IDSS seed grant. G. Mateos is with the Dept. of Electrical and Computer Engineering, University of Rochester. S. Segarra is with the Dept. of Electrical and Computer Engineering, Rice University. A. G. Marques is with the Dept. of Signal Theory and Communications, King Juan Carlos University. A. Ribeiro is with the Dept. of Electrical and Systems Engineering, University of Pennsyl- vania. Emails: gmateosb@ece.rochester.edu, segarra@rice.edu, antonio.garcia.marques@urjc.es, and aribeiro@seas.upenn.edu. arXiv:1810.13066v1 [eess.SP] 31 Oct 2018 2 brain activity signals supported on brain connectivity networks, and fake news that diffuse in online social networks, just to name a few. There is an evident mismatch between our scientiﬁc understanding of signals deﬁned over regular domains (time or space) and graph-supported signals. Knowledge about time series was developed over the course of decades and boosted by technology-driven needs in areas such as communications, speech processing, and control. On the contrary, the prevalence of network-related signal processing (SP) problems and the access to quality network data are recent events. Making sense of large-scale datasets from a network-centric perspective will constitute a crucial step to obtain new insights in various areas in science and engineering; and SP can play a key role to that end. Under the assumption that the signals are related to the topology of the graph where they are supported, the goal of graph signal processing (GSP) is to develop algorithms that fruitfully leverage this relational structure, and can make inferences about these relationships even when they are only partially observed. Most GSP efforts to date assume that the underlying network topology is known, and then analyze how the graph’s algebraic and spectral characteristics impact the properties of the graph signals of interest. This is feasible in applications involving physical networks, or, when the relevant links are tangible and can be directly observed (e.g., when studying ﬂows in transportation networks, monitoring cascading failures in power grids, maximizing inﬂuence on social networks, and tracking the dynamic structure of the World Wide Web). However, in many other settings the network may represent a conceptual model of pairwise relationships among entities. In exploratory studies of e.g., functional brain connectivity or regulation among genes, inference of nontrivial pairwise interactions between signal elements (i.e., blood-oxygen- level dependent time series per voxel or gene expression levels, respectively) is often a goal per se. In these settings and beyond, arguably most graph construction schemes are largely informal, distinctly lacking an element of validation. Even for infrastructure networks, their sheer size, (un)intentional reconﬁguration, in addition to privacy or security constraints enforced by administrators may render the acquisition of updated topology information a challenging endeavor. Accordingly, a fundamental question is how to use observations of graph signals to learn the underlying network structure, or, a judicious network model of said data facilitating efﬁcient signal representation, visualization, prediction, (nonlinear) dimensionality reduction, and (spectral) clustering. In this tutorial we offer an overview of graph learning methods developed to bridge the aforementioned gap, by using information available from graph signals to infer the underlying graph topology (see Section II for a general, yet formal problem statement). For the topology inference problem to be well posed, it is clear that one must assume a data model linking the observations to the unknown graph. One can thus formulate the graph learning task as an inverse problem, with a criterion adapted to the properties of the observations (e.g., via a probabilistic model, smoothness, or graph stationarity) and regularized to encourage desirable characteristics of the sought network. Fairly mature statistical approaches are surveyed ﬁrst in Section III, where linear correlation analysis takes center stage along with its connections to covariance selection and high-dimensional regression for learning Gaussian graphical models. In Section IV we shift gears and review recent GSP advances including the graph Fourier transform (GFT) and related 3 Fig. 1. Advancing our scientiﬁc understanding of fundamental issues arising with networked systems can have sizable impact in neuroscience, social networks, smart cities, Internet-of-Things technologies, networking and sensing integration for cyber-physical systems, as well as green grid analytics for seamless integration of renewable sources of energy. To that end, the signal processing body of knowledge is one of the core required components at the intersection of data and network sciences. notions of signal variation on graphs, as well as graph ﬁlter models of network diffusion and an innovative characterization of stationarity for random network processes. These concepts are at the heart of recent GSP-based topology inference frameworks that postulate that the network exists as a latent underlying structure, and that observations are generated as a result of a network process deﬁned on such a graph. Within this class, focus is laid ﬁrst on methods that infer graph structure from observed signals assumed to be smooth over the graph (Section V). Historically, the success of signal and information processing algorithms has hinged upon exploiting signal structure. It is thus only natural that one would opt for graphs under which data admit certain regularity. Next, Section VI deals with a family of approaches that postulate a graph ﬁlter-based generative model for the observations that diffused on the sought network. Such linear models of network diffusion arise with, e.g., distributed control, multi-agent coordination, opinion formation, brain disease progression, and molecular communications. The central part of this tutorial is summarized in Section VII, where we take a step back and compare the methods surveyed so far. In doing so we emphasize the new GSP perspective to the topology identiﬁcation problem, and offer insights on the choice of the ‘right’ graph learning algorithm for a given network-analytic application. A number of arguably more nascent topics are also brieﬂy outlined in Section VIII, including infer- ence of dynamic and multi-networks, nonlinear models of pairwise interaction, as well as extensions to directed (di)graphs and their relation to causal inference. Through rigorous problem formulations, intuitive reasoning, and illustration of applications (Section IX), this tutorial introduces readers to challenges and opportunities for SP research in emerging topic areas at the crossroads of modeling, prediction, and control of complex behavior arising in networked systems; see Figure 1 and the research outlook in Section X. Notation. The entries of a matrix X and a (column) vector x are denoted by X and x , respectively. Sets ij i are represented by calligraphic capital letters, and jj stands for the cardinality of a set or the magnitude T H y of a scalar. The notation () , () and () stands for transpose, conjugate transpose and matrix pseudo- inverse, respectively; 0 and 1 refer to the all-zero and all-one vectors; while I denotes the identity matrix. For a vector x, diag(x) is a diagonal matrix whose i-th diagonal entry is x ; when applied to a matrix, i 4 diag(X) is a vector collecting the diagonal elements of X. The operators , , , vec(), trace() and E [] stand for Kronecker product, Khatri-Rao (columnwise Kronecker) product, Hadamard (entry-wise) product, matrix vectorization, matrix trace, and expectation, respectively. The indicator function Ifg takes the value 1 if the logical condition in the argument holds true, and 0 otherwise. For matrix X,kXk denotes the ` -norm of vec(X) (kXk = kXk stands for the Frobenius norm), whereas kXk is the matrix p F 2 M (p) norm induced by the vector ` -norm. Lastly, range(X) refers to the column space of X. II. GRAPH-THEORETIC PRELIMINARIES AND PROBLEM STATEMENT As the Data Science revolution keeps gaining momentum, it is only natural that complex signals with irregular structure become increasingly of interest. While there are many possible sources and models of added complexity, a general proximity relationship between signal elements is not only a plausible but a ubiquitous model across science and engineering. To develop such a model, consider signals whose values are associated with nodes of a weighted, T N undirected, and connected graph. Formally, we consider the signal x = [x ; : : : ; x ] 2 R and the 1 N generally unknown weighted graph G(V;E; W), where V = f1; : : : ; Ng is a set of N vertices or nodes and E VV is the set of edges. Scalar x denotes the signal value at node i 2 V . The map W : VV ! R i + from the set of unordered pairs of vertices to the nonnegative reals associates a weight W 0 with ij the edge (i; j) 2 E , while W 0 for (i; j) 6= E . The symmetric coefﬁcients W = W represent the ij ij ji strength of the connection (i.e., the similarity or inﬂuence) between nodes i and j. In terms of the signal x, this means that when the weight W is large, the signal values x and x tend to be similar. Conversely, ij i j when the weight W is small or, in the extremum, when we have W = 0, the signal values x and x ij ij i j are not directly related except for what is implied by their separate connections to other nodes. Such an interpretation of the edge weights establishes a link between the signal values and the graph topology, which at a high level supports the feasibility of inferring G from signal observations. As a more general algebraic descriptor of network structure (i.e., topology), associated with the graph NN G one can introduce the so-called graph-shift operator S [48]. The shift S 2 R is a matrix whose entry S can be nonzero only if i = j or if (i; j) 2 E . Thus, the sparsity pattern of the matrix S captures ij the local structure of G, but we make no speciﬁc assumptions on the values of its nonzero entries. Widely-adopted choices for S are the adjacency matrix W [48], [49], the combinatorial graph Laplacian L := diag(W1) W [60], or, their various degree-normalized counterparts. For probabilistic graphical models of random x, one could adopt covariance or precision matrices as graph shifts encoding conditional (in)dependence relationships among nodal random variables; see e.g., [29, Ch. 7.3.3] and Section III. Other application-speciﬁc alternatives have been proposed as well; see [38] and references therein. In any case, parameterizing graph topology via a graph-shift operator of choice can offer additional ﬂexibility when it comes to formulating constrained optimization problems to estimate graph structure. As it will become clear in the sequel, such a generality can have a major impact on the performance and computational complexity of the ensuing algorithms. 5 Why graph shift? To justify the adopted graph shift terminology, consider the directed cycle graph whose circulant adjacency matrix W is zero, except for entries W = 1 whenever i = mod (j)+1, dc ij N where mod (x) denotes the modulus (remainder) obtained after dividing x by N . Such a graph can be used to represent the domain of discrete-time periodic signals with period N . If S = W , then dc y = Sx implements a circular shift of the entries in x, which corresponds to a one-unit time delay under the aforementioned interpretation [38]. Notice though that in general S need not be neither invertible nor isometric, an important departure from the shift in discrete-time signal processing. The intuition behind S for general graphs beyond the directed cycle, is to capture a linear transformation that can be computed locally at the nodes of the graph. Formally, if signal y is given by y = Sx, then node i can compute y as a linear combination of the signal values x at node i’s neighbors i j N := fj : (i; j) 2 Eg. For example, one can think of an individual’s opinion formation process as one of weighing in the views of close friends regarding the subject matter. As elaborated in Section IV-B, S also serves as the main building block to deﬁne more general linear shift-invariant operators for graph signals, namely graph ﬁlters [48]. The shift operator is also at the heart of graph stationarity notions for random network processes (Section IV-C). All elements are now in place to state a general network topology identiﬁcation problem. Problem. Given a set X := fx g of graph signal observations supported on the unknown graph p=1 G(V;E; W) with jVj = N , the goal is to identify the topology encoded in the entries of a graph-shift operator S that is optimal in some sense. The optimality criterion is usually dictated by the adopted network-dependent model for the signals in X , possibly augmented by priors motivated by physical characteristics of S, to effect statistical regularization, or else to favor more interpretable graphs. This is admittedly a very general and somewhat loose formulation, that will be narrowed down in subsequent sections as we elaborate on various criteria stemming from different models binding the (statistical) signal properties to the graph topology. Indeed, it is clear that one must assume some relation between the signals and the unknown underlying graph, since otherwise the topology inference exercise would be hopeless. This relation will be henceforth given by statistical generative priors (Section III), and by properties of the signals with respect to the underlying graph such as smoothness (Section V) or stationarity (Section VI). The observations in X can be noisy and incomplete, and accordingly the relationship between N , P and the mechanisms of data errors and missingness will all play a role in the graph recovery performance. Mostly the focus will be on inference of undirected and static graphs, an active ﬁeld for which the algorithms and accompanying theory are nowadays better developed. Section VIII will broaden the scope to more challenging directed, dynamic, and multi-graphs. III. S TATISTICAL M ETHODS FOR NETWORK TOPOLOGY INFERENCE As presented in the previous section, networks typically encode similarities between signal elements. Thus, a natural starting point towards constructing a graph representation of the data is to associate edge 6 weights with nontrivial correlations or coherence measures between signal proﬁles at incident nodes. In this vein, informal (but popular) scoring methods rely on ad hoc thresholding of user-deﬁned edgewise score functions. Examples include the Pearson product-moment correlation used to quantify gene-regulatory interactions, the Jaccard coefﬁcient for scientiﬁc citation networks, the Gaussian radial basis function to link measurements from a sensor network, or mutual information to capture nonlinear interactions. Often thresholds are manually tuned so that the resulting graph is deemed to accurately capture the relational structure in the data; a choice possibly informed by domain experts. In other cases, a prescribed number k of the top relations out of each node are retained, leading to the so-called k-nearest neighbor graphs that are central to graph smoothing techniques in machine learning. Such informal approaches fall short when it comes to assessing whether the obtained graph is accurate in some appropriate (often application-dependent) sense. In other words, they lack a framework that facilitates validation. Recognizing this shortcoming, a different paradigm is to cast the graph learning problem as one of selecting the best representative from a family of candidate networks by bringing to bear elements of statistical modeling and inference. The advantage of adopting such a methodology is that one can leverage existing statistical concepts and tools to formally study issues of identiﬁability, consistency, robustness to measurement error and sampling, as well as those relating to sample and computational complexities. Early statistical approaches to the network topology inference problem are the subject of this section. A. Correlation networks Arguably the most widely adopted linear measure of similarity between nodal random variables x and x is the Pearson correlation coefﬁcient deﬁned as cov(x ; x ) i j := p : (1) ij var(x )var(x ) i j It can be obtained from entries := cov(x ; x ) in the covariance matrix := E (x )(x ) ij i j of the random graph signal x = [x ; : : : ; x ] , with mean vector := E [x]. Given this choice, it 1 N is natural to deﬁne the correlation network G(V;E; W) with vertices V := f1; : : : ; Ng and edge set E := f(i; j) 2 V V : 6= 0g. There is some latitude on the deﬁnition of the weights. To directly ij capture the correlation strength between x and x one can set W = j j or its un-normalized variant i j ij ij W = jcov(x ; x )j; alternatively the choice W = If 6= 0g gives an unweighted graph consistent with ij i j ij ij E . In GSP applications it is often common to refer to correlation network as one with graph-shift operator S := . Regardless of these choices, what is important here is that the deﬁnition of E dictates that the problem of identifying the topology of G becomes one of inferring the subset of nonzero correlations. To that end, given independent realizations X := fx g of x one forms empirical correlations ^ by p ij p=1 replacing the ensemble covariances in (1), with the entries ^ of the unbiased sample covariance matrix ij estimate . As discussed earlier in this section, one could then manually ﬁx a threshold and assign edges to the corresponding largest values j ^ j. Instead, a more principled approach is to test the hypotheses ij H : = 0 versus H : 6= 0; (2) 0 ij 1 ij 7 for each of the = N (N 1)=2 candidate edges in G, i.e., the number of unordered pairs in V V . While j ^ j would appear to be the go-to test statistic, a more convenient choice is the Fischer score ij 1 1 z := tanh ( ^ ). The reason is that under H one (approximately) has z Normal(0; ); see [29, ij ij 0 ij P3 p. 210] for further details and the justiﬁcation based on asymptotic-theory arguments. This simple form of the null distribution facilitates computation of p-values, or, the selection of a threshold that guarantees a prescribed signiﬁcance level (i.e., false alarm probability P in the SP parlance) per test. FA However, such individual test control procedures might not be effective for medium to large-sized graphs, since the total number of simultaneous tests to be conducted scales as O(N ). Leaving aside potential computational challenges, the problem of large-scale hypothesis testing must be addressed [10, Ch. 15]. Otherwise, say for an empty graph with E = ; a constant false alarm rate P per edge will yield FA on average O(N P ) spurious edges, which can be considerable if N is large. A common workaround FA is to instead focus on controlling the false discovery rate (FDR) deﬁned as FDR := E R > 0 Pr [R > 0] ; (3) where R denotes the number of rejections among all O(N ) edgewise tests conducted, and R stands for the number of false rejections (here representing false edge discoveries). Let p p : : : p (1) (2) (jVVj) be the ordered p-values for all tests. Then a prescribed level FDR q can be guaranteed by following the Benjamini-Hochberg FDR control procedure, which declares edges for all tests i such that p (i) (2i=N (N 1))q; see e.g., [10, Ch. 15.2]. It is worth noting that the FDR guarantee is only valid for independent tests, an assumption that rarely holds in a graph learning setting. Hence results and control levels should be interpreted with care; see also [29, p. 212] for a discussion on FDR extensions when some level of dependency is present between tests. With regards to the scope of correlation networks, apparently they can only capture linear and sym- metric pairwise dependencies among vertex-indexed random variables. Most importantly, the measured correlations can be due to latent network effects rather than from strong direct inﬂuence among a pair of vertices. For instance, a suspected regulatory interaction among genes (i; j) inferred from their highly correlated micro-array expression-level proﬁles, could be an artifact due to a third latent gene k that is actually regulating the expression of both i and j. If seeking a graph reﬂective of direct inﬂuence among pairwise signal elements, clearly correlation networks may be undesirable. Interestingly, one can in principle resolve such a confounding by instead considering partial correlations cov(x ; x V n ij) i j := q ; (4) ijjVnij var(x V n ij)var(x V n ij) i j where Vnij symbolically denotes the collection of all N 2 random variables fx g after excluding those indexed by nodes i and j. A partial correlation network can be deﬁned in analogy to its (unconditional) correlation network counterpart, but with edge set E := f(i; j) 2 V V : 6= 0g. Again, the ijjVnij problem of inferring nonzero partial correlations from data X := fx g can be equivalently cast as one p=1 of hypothesis testing. With minor twists, issues of selecting a test statistic and a tractable approximate 8 null distribution, as well as successfully dealing with the multiple-testing problem, can all be addressed by following similar guidelines to those in the Pearson correlation case [29, Ch. 7.3.2]. B. Gaussian graphical models, covariance selection, and graphical lasso Suppose now that the graph signal x = [x ; : : : ; x ] is a Gaussian random vector, meaning that the 1 N vertex-indexed random variables are jointly Gaussian. Under such a distributional assumption, = 0 ijjVnij is equivalent to x and x being conditionally independent given all of the other variables in V n ij. i j Consequently, the partial correlation network with edges E := f(i; j) 2 V V : 6= 0g speciﬁes ijjVnij conditional independence relations among the entries of x, and is known as an undirected Gaussian graphical model or Gaussian Markov random ﬁeld (GMRF). A host of opportunities for inference of Gaussian graphical models emerge by recognizing that the partial correlation coefﬁcients can be expressed as ij = p ; (5) ijjVnij ii jj where is the (i; j)-th entry of the precision or concentration matrix := , namely the inverse of ij the covariance matrix of x. The upshot of (5) is that it reveals a bijection between the set of nonzero partial correlations (the edges of G) and the sparsity pattern of the precision matrix . The graphical model selection problem of identifying the conditional independence relations in G given i.i.d. realizations X := fx g from a multivariate Gaussian distribution, is known as the covariance selection problem. p=1 The term covariance selection was ﬁrst coined by Dempster back in the early 70s, who explored the role of sparsity in estimating the entries of via a recursive, likelihood-based thresholding procedure on the ^ ^ entries of := [8]. Computationally, this classical algorithm does not scale well to contemporary large-scale networks. Moreover, in high-dimensional regimes where N P the method breaks down since the sample covariance matrix is rank deﬁcient. Such a predicament calls for regularization, and next we describe graphical model selection approaches based on ` -norm regularized global likelihoods for the Gaussian setting. Neighborhood-based regression methods are the subject of Section III-C. We will henceforth assume zero-mean x Normal(0; ), since the focus is on estimating graph structure encoded in the entries of the precision matrix = . Under this model, the maximum- likelihood estimate (ML) of the precision matrix is given by a strictly concave log-determinant program n o ^ ^ = arg max log det trace() ; (6) ML 1 T where 0 requires the matrix to be positive semideﬁnite (PSD) and := x x is the P p=1 empirical covariance matrix obtained from the data in X . It can be shown that if is singular, the expression in (6) does not yield the ML estimator, which, in fact, does not exist. This happens e.g., when N is larger than P . To overcome this challenge or otherwise to encourage parsimonious (hence more interpretable) graphs, the graphical lasso regularizes the ML estimator (6) with the sparsity-promoting ` -norm of [64], yielding n o ^ ^ 2 arg max log det trace() kk : (7) 0 9 Variants of the model penalize only the off-diagonal entries of , or incorporate edge-speciﬁc penalty parameters > 0 to account for structural priors on the graph topology. Estimators of graphs with non- ij negative edge weights are of particular interest; see Learning Gaussian graphical models with Laplacian constraints. Learning Gaussian graphical models with Laplacian constraints. There are important differences when estimating precision matrices subject to combinatorial graph Laplacian constraints. The off- diagonal elements L := W 0 of a Laplacian must be non-positive, so when = L the ij ij resulting GMRF is termed attractive ; see also [61] for estimation of precision matrices under the constraint that all partial correlations are non-negative. Moreover, the Laplacian matrix is always singular because L1 = 0, which yields an improper GMRF. A proper GMRF can be obtained via diagonal loading of the sought Laplacian, which motivates the following sparse precision matrix estimation problem [30] n o max log det trace() kk (8) 0; 0 s. to = L + I L1 = 0; L 0; i 6= j: ij ^ ^ ^ Given a solution f; ^g of (8), a combinatorial Laplacian can be recovered as L := ^I. There are various probabilistic interpretations of such a diagonal loading, e.g., one where corresponds to the variance of white Gaussian noise modeling isotropic signal ﬂuctuations; see also the related factor analysis model in Section V-A. A general optimization framework for estimating (possibly diagonally-dominant, generalized) Lapla- cian matrices was presented in [11], along with specialized block-coordinate descent algorithms to tackle the resulting graphical model selection problems. A customized algorithm based on sequential quadratic approximation was developed in [21] to identify the topology of sparse consensus networks, where the steady-state precision matrix is shown to have Laplacian structure. Recently, an efﬁcient soft- thresholding based estimator for a sparse graph Laplacian encoded in the precision matrix of a GMRF was put forth in [43]. The procedure offers quantiﬁable performance, in the form of probabilistic recovery error bounds similar to those available for the graphical lasso [45]. Although (7) is convex, the objective is non-smooth and has an unbounded constraint set. As shown in [2] the resulting complexity for off-the-shelf interior point methods adopted in [64] is O(N ). In addition, interior point methods require computing and storing a Hessian matrix of size O(N ) every iteration. The memory requirements and complexity are thus prohibitive for even modest-sized graphs, calling for custom-made scalable algorithms that are capable of handling larger problems. Such efﬁcient ﬁrst-order cyclic block-coordinate descent algorithms were developed in [2] and subsequently reﬁned in [14], which can comfortably tackle sparse problems with thousands of nodes in under a few minutes. 10 In terms of performance guarantees for the recovery of a ground-truth precision matrix , the graphical q q d log N log N max lasso estimator (7) with = 2 satisﬁes the operator norm bound k k with 0 2 P P high probability, where d denotes the maximum nodal degree in [45]. Support consistency has max 0 been also established provided the number of samples scales as P = (d log N ); see [45] for details. max C. Graph selection via neighborhood-based sparse linear regression Another way to estimate the graphical model is to ﬁnd the set of neighborsN := fj : (i; j) 2 Eg of each node i 2 V in the graph, by regressing x against all other variables x := [x ; : : : ; x ; x ; : : : ; x ] 2 i 1 i1 i+1 N ni N1 1 R . To illustrate this idea, note that in the Gaussian setting where x Normal(0; ), we have that the conditional distribution of x given x is also Gaussian. The minimum mean-square error (MMSE) ni T (i) predictor of x based on x is E x x = x , which is linear in x and yields the decomposition i i ni ni ni ni T (i) x = x + " ; (9) ni ni where " is the zero-mean Gaussian prediction error, independent of x by the orthogonality principle. ni ni The dependency between x and x (what speciﬁes the incident edges to i 2 V in G) is thus entirely ni (i) N1 captured in the regression coefﬁcients 2 R , which are expressible in terms of the entries of as (i) ij = : (10) ii Importantly, (10) together with (5) reveal that a candidate edge (i; j) belongs to E := f(i; j) 2 V V : (i) (j) (i) (i) 6= 0g if and only if 6= 0 (and also 6= 0). Compactly, we have supp( ) := fj : 6= ijjVnij j i j 0g N , which suggests casting the problem of Gaussian graphical model selection as one of sparse linear regression using observations X := fx g . p=1 The neighborhood-based lasso method in [36] cycles over vertices i = 1; : : : ; N and estimates [cf. (9)] 8 9 < = (i) (i) T 2 ^ ^ ^ N = supp( ); where 2 arg min (x x ) + k k : (11) i pi 1 p;ni N1 2R : ; p=1 (i) (j) ^ ^ For ﬁnite data there is no guarantee that 6= 0 implies 6= 0 and vice versa, so the information j i ^ ^ in N and N should be combined to enforce symmetry. To declare an edge (i; j) 2 E the algorithm i j (i) (j) ^ ^ in [36] requires that either or are nonzero (the OR rule), or alternatively consider the AND rule j i requiring that both coefﬁcients be nonzero. Interestingly, for a judicious choice of in (11) and under suitable conditions on (possibly) P N as well as the sparsity of the ground-truth precision matrix , the graph can be consistently identiﬁed using either edge selection rule; see [36] for the technical details. D. Comparative summary The estimator (11) is computationally appealing, since all N lasso problems can be solved in parallel. Such a decomposability can be traced to the fact that the neighborhood-based approach relies on conditional likelihoods per vertex and does not enforce the PSD constraint 0, whereas the graphical lasso maximizes a penalized version of the global likelihood L(;X ) = log det trace(). For these 11 Testing partial correlations For each , test the hypothesis ! ⇢ 6=0 , ✓ 6=0 ij|V\ij ij <latexit sha1_base64="AGCua9z7shBnSXbsJIW6J/MCvKo=">AAACQHicbVA9axtBFNyz8+EoX7JTplkiAqnEnQk4pDKkcZHChkgyaIV4t3qnW3tv97L7LkGc76e5yU9w59pNihiTNlX2JEESOwMLw8wb3r5JS608xfFltLF57/6Dh1uPOo+fPH32vLu9M/S2chIH0mrrjlPwqJXBASnSeFw6hCLVOEpPP7T+6As6r6z5RIsSJwXMjcqUBArStDsSTs1zAufsV/FeuNxOa3VyJgqgXIKuh43wSIUylefqpOHC4Gcec/ERM/qT5IJyJGijzWpi2u3F/XgJfpcka9JjaxxOuxdiZmVVoCGpwftxEpc0qcGRkhqbjqg8liBPYY7jQA0U6Cf1soCGvw7KjGfWhWeIL9W/EzUU3i+KNEy2h/nbXiv+zxtXlL2b1MqUFaGRq0VZpTlZ3rbJZ8qhJL0IBKRT4a9c5uBAUui8E0pIbp98lwx3+0ncT47e9vZ313VssZfsFXvDErbH9tkBO2QDJtk5u2I/2HX0Lfoe3UQ/V6Mb0Trzgv2D6NdvUrKx3g==</latexit><latexit sha1_base64="AGCua9z7shBnSXbsJIW6J/MCvKo=">AAACQHicbVA9axtBFNyz8+EoX7JTplkiAqnEnQk4pDKkcZHChkgyaIV4t3qnW3tv97L7LkGc76e5yU9w59pNihiTNlX2JEESOwMLw8wb3r5JS608xfFltLF57/6Dh1uPOo+fPH32vLu9M/S2chIH0mrrjlPwqJXBASnSeFw6hCLVOEpPP7T+6As6r6z5RIsSJwXMjcqUBArStDsSTs1zAufsV/FeuNxOa3VyJgqgXIKuh43wSIUylefqpOHC4Gcec/ERM/qT5IJyJGijzWpi2u3F/XgJfpcka9JjaxxOuxdiZmVVoCGpwftxEpc0qcGRkhqbjqg8liBPYY7jQA0U6Cf1soCGvw7KjGfWhWeIL9W/EzUU3i+KNEy2h/nbXiv+zxtXlL2b1MqUFaGRq0VZpTlZ3rbJZ8qhJL0IBKRT4a9c5uBAUui8E0pIbp98lwx3+0ncT47e9vZ313VssZfsFXvDErbH9tkBO2QDJtk5u2I/2HX0Lfoe3UQ/V6Mb0Trzgv2D6NdvUrKx3g==</latexit><latexit sha1_base64="AGCua9z7shBnSXbsJIW6J/MCvKo=">AAACQHicbVA9axtBFNyz8+EoX7JTplkiAqnEnQk4pDKkcZHChkgyaIV4t3qnW3tv97L7LkGc76e5yU9w59pNihiTNlX2JEESOwMLw8wb3r5JS608xfFltLF57/6Dh1uPOo+fPH32vLu9M/S2chIH0mrrjlPwqJXBASnSeFw6hCLVOEpPP7T+6As6r6z5RIsSJwXMjcqUBArStDsSTs1zAufsV/FeuNxOa3VyJgqgXIKuh43wSIUylefqpOHC4Gcec/ERM/qT5IJyJGijzWpi2u3F/XgJfpcka9JjaxxOuxdiZmVVoCGpwftxEpc0qcGRkhqbjqg8liBPYY7jQA0U6Cf1soCGvw7KjGfWhWeIL9W/EzUU3i+KNEy2h/nbXiv+zxtXlL2b1MqUFaGRq0VZpTlZ3rbJZ8qhJL0IBKRT4a9c5uBAUui8E0pIbp98lwx3+0ncT47e9vZ313VssZfsFXvDErbH9tkBO2QDJtk5u2I/2HX0Lfoe3UQ/V6Mb0Trzgv2D6NdvUrKx3g==</latexit><latexit sha1_base64="hP+6LrUf2d3tZaldqaQQvEKMXyw=">AAAB2XicbZDNSgMxFIXv1L86Vq1rN8EiuCozbnQpuHFZwbZCO5RM5k4bmskMyR2hDH0BF25EfC93vo3pz0JbDwQ+zknIvSculLQUBN9ebWd3b/+gfugfNfzjk9Nmo2fz0gjsilzl5jnmFpXU2CVJCp8LgzyLFfbj6f0i77+gsTLXTzQrMMr4WMtUCk7O6oyaraAdLMW2IVxDC9YaNb+GSS7KDDUJxa0dhEFBUcUNSaFw7g9LiwUXUz7GgUPNM7RRtRxzzi6dk7A0N+5oYkv394uKZ9bOstjdzDhN7Ga2MP/LBiWlt1EldVESarH6KC0Vo5wtdmaJNChIzRxwYaSblYkJN1yQa8Z3HYSbG29D77odBu3wMYA6nMMFXEEIN3AHD9CBLghI4BXevYn35n2suqp569LO4I+8zx84xIo4</latexit><latexit sha1_base64="bF8lA38/w1OfIZaqbAOOB2uWNN8=">AAACNXicbVA9bxNBEJ0LX8EEMLQ0KyIkKuuOBkSFlIaCIkjYjuS1rLn1nG+Tvd3L7hyRddxPo+En0FHTUIAQ/4A92xKQ8KSVnt6bp9l5eW104DT9kuxdu37j5q3924M7B3fv3R8+OJgE13hFY+WM8yc5BjLa0pg1GzqpPWGVG5rmZ0e9P31PPmhn3/G6pnmFK6sLrZCjtBhOpderktF7dyFfSl+6RatPP8gKuVRo2kknA3GlbROEPu2EtHQuUiHfUMF/kkJySYx9tNtOLIaH6SjdQFwl2Y4cwg7Hi+FnuXSqqciyMhjCLEtrnrfoWStD3UA2gWpUZ7iiWaQWKwrzdlNAJ55EZSkK5+OzLDbq34kWqxDWVR4n+8PCZa8X/+fNGi5ezFtt64bJqu2iojGCnejbFEvtSbFZR4LK6/hXoUr0qDh2PoglZJdPvkomz0ZZOsreprAPj+AxPIUMnsMreA3HMAYFH+ErfIcfyafkW/JzW9desuvtIfyD5NdvvCiwQw==</latexit><latexit sha1_base64="bF8lA38/w1OfIZaqbAOOB2uWNN8=">AAACNXicbVA9bxNBEJ0LX8EEMLQ0KyIkKuuOBkSFlIaCIkjYjuS1rLn1nG+Tvd3L7hyRddxPo+En0FHTUIAQ/4A92xKQ8KSVnt6bp9l5eW104DT9kuxdu37j5q3924M7B3fv3R8+OJgE13hFY+WM8yc5BjLa0pg1GzqpPWGVG5rmZ0e9P31PPmhn3/G6pnmFK6sLrZCjtBhOpderktF7dyFfSl+6RatPP8gKuVRo2kknA3GlbROEPu2EtHQuUiHfUMF/kkJySYx9tNtOLIaH6SjdQFwl2Y4cwg7Hi+FnuXSqqciyMhjCLEtrnrfoWStD3UA2gWpUZ7iiWaQWKwrzdlNAJ55EZSkK5+OzLDbq34kWqxDWVR4n+8PCZa8X/+fNGi5ezFtt64bJqu2iojGCnejbFEvtSbFZR4LK6/hXoUr0qDh2PoglZJdPvkomz0ZZOsreprAPj+AxPIUMnsMreA3HMAYFH+ErfIcfyafkW/JzW9desuvtIfyD5NdvvCiwQw==</latexit><latexit sha1_base64="ooqjUCmbXeMLGDWRh5tHKJXN2xI=">AAACQHicbVA9bxNBFNwLAYL5iAklzSpWJCrrLg0oVSQaCopEiu1IXst6t37n22Rv99h9B7KO+2lp8hPoqGlSgFDaVOzZloAkI600mnmjt2/SUitPcfw92niw+fDR460nnafPnr/Y7r7cGXpbOYkDabV1pyl41MrggBRpPC0dQpFqHKXn71t/9BmdV9ac0KLESQFzozIlgYI07Y6EU/OcwDn7RRwIl9tprc6+igIol6DrYSM8UqFM5bk6a7gw+InHXHzEjP4muaAcCdpos5qYdntxP16C3yXJmvTYGkfT7jcxs7Iq0JDU4P04iUua1OBISY1NR1QeS5DnMMdxoAYK9JN6WUDD94Iy45l14RniS/XfRA2F94siDZPtYf6214r3eeOKsneTWpmyIjRytSirNCfL2zb5TDmUpBeBgHQq/JXLHBxICp13QgnJ7ZPvkuF+P4n7yXHcO9xf17HFXrNd9oYl7C07ZB/YERswyS7YD/aT/Youo6vod3S9Gt2I1plX7D9EN38AUXKx2g==</latexit><latexit sha1_base64="AGCua9z7shBnSXbsJIW6J/MCvKo=">AAACQHicbVA9axtBFNyz8+EoX7JTplkiAqnEnQk4pDKkcZHChkgyaIV4t3qnW3tv97L7LkGc76e5yU9w59pNihiTNlX2JEESOwMLw8wb3r5JS608xfFltLF57/6Dh1uPOo+fPH32vLu9M/S2chIH0mrrjlPwqJXBASnSeFw6hCLVOEpPP7T+6As6r6z5RIsSJwXMjcqUBArStDsSTs1zAufsV/FeuNxOa3VyJgqgXIKuh43wSIUylefqpOHC4Gcec/ERM/qT5IJyJGijzWpi2u3F/XgJfpcka9JjaxxOuxdiZmVVoCGpwftxEpc0qcGRkhqbjqg8liBPYY7jQA0U6Cf1soCGvw7KjGfWhWeIL9W/EzUU3i+KNEy2h/nbXiv+zxtXlL2b1MqUFaGRq0VZpTlZ3rbJZ8qhJL0IBKRT4a9c5uBAUui8E0pIbp98lwx3+0ncT47e9vZ313VssZfsFXvDErbH9tkBO2QDJtk5u2I/2HX0Lfoe3UQ/V6Mb0Trzgv2D6NdvUrKx3g==</latexit><latexit sha1_base64="AGCua9z7shBnSXbsJIW6J/MCvKo=">AAACQHicbVA9axtBFNyz8+EoX7JTplkiAqnEnQk4pDKkcZHChkgyaIV4t3qnW3tv97L7LkGc76e5yU9w59pNihiTNlX2JEESOwMLw8wb3r5JS608xfFltLF57/6Dh1uPOo+fPH32vLu9M/S2chIH0mrrjlPwqJXBASnSeFw6hCLVOEpPP7T+6As6r6z5RIsSJwXMjcqUBArStDsSTs1zAufsV/FeuNxOa3VyJgqgXIKuh43wSIUylefqpOHC4Gcec/ERM/qT5IJyJGijzWpi2u3F/XgJfpcka9JjaxxOuxdiZmVVoCGpwftxEpc0qcGRkhqbjqg8liBPYY7jQA0U6Cf1soCGvw7KjGfWhWeIL9W/EzUU3i+KNEy2h/nbXiv+zxtXlL2b1MqUFaGRq0VZpTlZ3rbJZ8qhJL0IBKRT4a9c5uBAUui8E0pIbp98lwx3+0ncT47e9vZ313VssZfsFXvDErbH9tkBO2QDJtk5u2I/2HX0Lfoe3UQ/V6Mb0Trzgv2D6NdvUrKx3g==</latexit><latexit sha1_base64="AGCua9z7shBnSXbsJIW6J/MCvKo=">AAACQHicbVA9axtBFNyz8+EoX7JTplkiAqnEnQk4pDKkcZHChkgyaIV4t3qnW3tv97L7LkGc76e5yU9w59pNihiTNlX2JEESOwMLw8wb3r5JS608xfFltLF57/6Dh1uPOo+fPH32vLu9M/S2chIH0mrrjlPwqJXBASnSeFw6hCLVOEpPP7T+6As6r6z5RIsSJwXMjcqUBArStDsSTs1zAufsV/FeuNxOa3VyJgqgXIKuh43wSIUylefqpOHC4Gcec/ERM/qT5IJyJGijzWpi2u3F/XgJfpcka9JjaxxOuxdiZmVVoCGpwftxEpc0qcGRkhqbjqg8liBPYY7jQA0U6Cf1soCGvw7KjGfWhWeIL9W/EzUU3i+KNEy2h/nbXiv+zxtXlL2b1MqUFaGRq0VZpTlZ3rbJZ8qhJL0IBKRT4a9c5uBAUui8E0pIbp98lwx3+0ncT47e9vZ313VssZfsFXvDErbH9tkBO2QDJtk5u2I/2HX0Lfoe3UQ/V6Mb0Trzgv2D6NdvUrKx3g==</latexit><latexit sha1_base64="AGCua9z7shBnSXbsJIW6J/MCvKo=">AAACQHicbVA9axtBFNyz8+EoX7JTplkiAqnEnQk4pDKkcZHChkgyaIV4t3qnW3tv97L7LkGc76e5yU9w59pNihiTNlX2JEESOwMLw8wb3r5JS608xfFltLF57/6Dh1uPOo+fPH32vLu9M/S2chIH0mrrjlPwqJXBASnSeFw6hCLVOEpPP7T+6As6r6z5RIsSJwXMjcqUBArStDsSTs1zAufsV/FeuNxOa3VyJgqgXIKuh43wSIUylefqpOHC4Gcec/ERM/qT5IJyJGijzWpi2u3F/XgJfpcka9JjaxxOuxdiZmVVoCGpwftxEpc0qcGRkhqbjqg8liBPYY7jQA0U6Cf1soCGvw7KjGfWhWeIL9W/EzUU3i+KNEy2h/nbXiv+zxtXlL2b1MqUFaGRq0VZpTlZ3rbJZ8qhJL0IBKRT4a9c5uBAUui8E0pIbp98lwx3+0ncT47e9vZ313VssZfsFXvDErbH9tkBO2QDJtk5u2I/2HX0Lfoe3UQ/V6Mb0Trzgv2D6NdvUrKx3g==</latexit><latexit sha1_base64="AGCua9z7shBnSXbsJIW6J/MCvKo=">AAACQHicbVA9axtBFNyz8+EoX7JTplkiAqnEnQk4pDKkcZHChkgyaIV4t3qnW3tv97L7LkGc76e5yU9w59pNihiTNlX2JEESOwMLw8wb3r5JS608xfFltLF57/6Dh1uPOo+fPH32vLu9M/S2chIH0mrrjlPwqJXBASnSeFw6hCLVOEpPP7T+6As6r6z5RIsSJwXMjcqUBArStDsSTs1zAufsV/FeuNxOa3VyJgqgXIKuh43wSIUylefqpOHC4Gcec/ERM/qT5IJyJGijzWpi2u3F/XgJfpcka9JjaxxOuxdiZmVVoCGpwftxEpc0qcGRkhqbjqg8liBPYY7jQA0U6Cf1soCGvw7KjGfWhWeIL9W/EzUU3i+KNEy2h/nbXiv+zxtXlL2b1MqUFaGRq0VZpTlZ3rbJZ8qhJL0IBKRT4a9c5uBAUui8E0pIbp98lwx3+0ncT47e9vZ313VssZfsFXvDErbH9tkBO2QDJtk5u2I/2HX0Lfoe3UQ/V6Mb0Trzgv2D6NdvUrKx3g==</latexit><latexit sha1_base64="AGCua9z7shBnSXbsJIW6J/MCvKo=">AAACQHicbVA9axtBFNyz8+EoX7JTplkiAqnEnQk4pDKkcZHChkgyaIV4t3qnW3tv97L7LkGc76e5yU9w59pNihiTNlX2JEESOwMLw8wb3r5JS608xfFltLF57/6Dh1uPOo+fPH32vLu9M/S2chIH0mrrjlPwqJXBASnSeFw6hCLVOEpPP7T+6As6r6z5RIsSJwXMjcqUBArStDsSTs1zAufsV/FeuNxOa3VyJgqgXIKuh43wSIUylefqpOHC4Gcec/ERM/qT5IJyJGijzWpi2u3F/XgJfpcka9JjaxxOuxdiZmVVoCGpwftxEpc0qcGRkhqbjqg8liBPYY7jQA0U6Cf1soCGvw7KjGfWhWeIL9W/EzUU3i+KNEy2h/nbXiv+zxtXlL2b1MqUFaGRq0VZpTlZ3rbJZ8qhJL0IBKRT4a9c5uBAUui8E0pIbp98lwx3+0ncT47e9vZ313VssZfsFXvDErbH9tkBO2QDJtk5u2I/2HX0Lfoe3UQ/V6Mb0Trzgv2D6NdvUrKx3g==</latexit> Covariance selection Infer non-zero entries of the precision matrix (i) ! 6=0 , ✓ 6=0 ij <latexit sha1_base64="clPjN9VcCWByN2U7+65H4kp1uKA=">AAACLnicbVDLSgMxFM3Ud31VXboJFkE3ZaYIiquCCC5cKFgVOrVk0jttNJMZkztKGeaL3PgruhBUxK2fYfoAnwcCh3PO5eaeIJHCoOs+O4Wx8YnJqemZ4uzc/MJiaWn51MSp5lDnsYz1ecAMSKGgjgIlnCcaWBRIOAuu9vr+2Q1oI2J1gr0EmhHrKBEKztBKrdK+r0Wni0zr+Nbf9QNA1sou84tsQ2zm1FdwTV3qH0KIXznqY3eQE5f5MNEqld2KOwD9S7wRKZMRjlqlR78d8zQChVwyYxqem2AzYxoFl5AX/dRAwvgV60DDUsUiMM1scG5O163SpmGs7VNIB+r3iYxFxvSiwCYjhl3z2+uL/3mNFMOdZiZUkiIoPlwUppJiTPvd0bbQwFH2LGFcC/tXyrtMM4624aItwft98l9yWq14bsU73irXqqM6pskqWSMbxCPbpEYOyBGpE07uyAN5Ia/OvfPkvDnvw2jBGc2skB9wPj4BixupXQ==</latexit><latexit sha1_base64="clPjN9VcCWByN2U7+65H4kp1uKA=">AAACLnicbVDLSgMxFM3Ud31VXboJFkE3ZaYIiquCCC5cKFgVOrVk0jttNJMZkztKGeaL3PgruhBUxK2fYfoAnwcCh3PO5eaeIJHCoOs+O4Wx8YnJqemZ4uzc/MJiaWn51MSp5lDnsYz1ecAMSKGgjgIlnCcaWBRIOAuu9vr+2Q1oI2J1gr0EmhHrKBEKztBKrdK+r0Wni0zr+Nbf9QNA1sou84tsQ2zm1FdwTV3qH0KIXznqY3eQE5f5MNEqld2KOwD9S7wRKZMRjlqlR78d8zQChVwyYxqem2AzYxoFl5AX/dRAwvgV60DDUsUiMM1scG5O163SpmGs7VNIB+r3iYxFxvSiwCYjhl3z2+uL/3mNFMOdZiZUkiIoPlwUppJiTPvd0bbQwFH2LGFcC/tXyrtMM4624aItwft98l9yWq14bsU73irXqqM6pskqWSMbxCPbpEYOyBGpE07uyAN5Ia/OvfPkvDnvw2jBGc2skB9wPj4BixupXQ==</latexit><latexit sha1_base64="clPjN9VcCWByN2U7+65H4kp1uKA=">AAACLnicbVDLSgMxFM3Ud31VXboJFkE3ZaYIiquCCC5cKFgVOrVk0jttNJMZkztKGeaL3PgruhBUxK2fYfoAnwcCh3PO5eaeIJHCoOs+O4Wx8YnJqemZ4uzc/MJiaWn51MSp5lDnsYz1ecAMSKGgjgIlnCcaWBRIOAuu9vr+2Q1oI2J1gr0EmhHrKBEKztBKrdK+r0Wni0zr+Nbf9QNA1sou84tsQ2zm1FdwTV3qH0KIXznqY3eQE5f5MNEqld2KOwD9S7wRKZMRjlqlR78d8zQChVwyYxqem2AzYxoFl5AX/dRAwvgV60DDUsUiMM1scG5O163SpmGs7VNIB+r3iYxFxvSiwCYjhl3z2+uL/3mNFMOdZiZUkiIoPlwUppJiTPvd0bbQwFH2LGFcC/tXyrtMM4624aItwft98l9yWq14bsU73irXqqM6pskqWSMbxCPbpEYOyBGpE07uyAN5Ia/OvfPkvDnvw2jBGc2skB9wPj4BixupXQ==</latexit><latexit sha1_base64="clPjN9VcCWByN2U7+65H4kp1uKA=">AAACLnicbVDLSgMxFM3Ud31VXboJFkE3ZaYIiquCCC5cKFgVOrVk0jttNJMZkztKGeaL3PgruhBUxK2fYfoAnwcCh3PO5eaeIJHCoOs+O4Wx8YnJqemZ4uzc/MJiaWn51MSp5lDnsYz1ecAMSKGgjgIlnCcaWBRIOAuu9vr+2Q1oI2J1gr0EmhHrKBEKztBKrdK+r0Wni0zr+Nbf9QNA1sou84tsQ2zm1FdwTV3qH0KIXznqY3eQE5f5MNEqld2KOwD9S7wRKZMRjlqlR78d8zQChVwyYxqem2AzYxoFl5AX/dRAwvgV60DDUsUiMM1scG5O163SpmGs7VNIB+r3iYxFxvSiwCYjhl3z2+uL/3mNFMOdZiZUkiIoPlwUppJiTPvd0bbQwFH2LGFcC/tXyrtMM4624aItwft98l9yWq14bsU73irXqqM6pskqWSMbxCPbpEYOyBGpE07uyAN5Ia/OvfPkvDnvw2jBGc2skB9wPj4BixupXQ==</latexit> Neighborhood-based regression For each , infer non-zero regression coefficients in Fig. 2. Conceptual roadmap for Gaussian graphical model selection with edge set E := f(i; j) 2 V V : 6= 0g. The ijjVnij problem of inferring nonzero partial correlations can be cast as one of covariance selection, since there is a bijection between the set of nonzero partial correlations (the edges of G) and the sparsity pattern of the precision matrix . Another equivalent approach to estimate the graphical model is to ﬁnd the set of neighbors N of each node i 2 V in the graph, by regressing x i i (i) against all the other variables in x . The regression coefﬁcients are expressible in terms of the entries of the precision ni (i) matrix , and it follows that supp( ) = N . reasons, the neighborhood-based lasso method in [36] is computationally faster while the graphical lasso tends to be more (statistically) efﬁcient [64]. Another advantage of relying on neighborhood- based conditional likelihoods is that they yield tractable graph-learning approaches even for discrete or mixed graphical models, where computation of global likelihoods is generally infeasible. For binary x 2 f1; +1g , an ` -norm penalized logistic regression counterpart of (11) was proposed for Ising model selection in [44]. To summarize and relate the approaches for Gaussian graphical model selection covered, Figure 2 shows a schematic conceptual roadmap of this section. So far we have shown how to cast the graph topology identiﬁcation problem as one of statistical inference, where modern topics such as multiple-testing, learning with sparsity, and high-dimensional model selection are prevalent. While fairly mature, the methods of this section may not be as familiar to the broad SP community and provide the needed historical context on the graph learning problem. Next, we shift gears to recent GSP-based topology inference frameworks that postulate the observed signals as either smoothly-varying or stationary with respect to the unknown graph (Sections V and VI, respectively). To formalize these signal models, in the next section we introduce the required GSP background. In Section VII we come full circle and offer a big picture summary of the new perspectives, beneﬁts, and limitations of the GSP-based approaches relative to the statistical methods of this section. IV. G RAPH SIGNAL PROCESSING FOUNDATIONS FOR GRAPH LEARNING ADVANCES Here we review foundational GSP tools and concepts that have enabled recent topology inference advances, the subject of Sections V and VI. The graph Fourier transform (GFT), graph ﬁlter design, implementation and performance analysis, as well as structured signal models induced by graph smoothness 12 or stationarity are all active areas of research on their own right, where substantial progress can be made. A. Graph Fourier transform and signal smoothness An instrumental GSP tool is the GFT, which decomposes a graph signal into orthonormal components describing different modes of variation with respect to the graph topology encoded in L (or an application- dictated graph-shift operator S). The GFT allows to equivalently represent a graph signal in two different domains – the vertex domain consisting of the nodes in V , and the graph frequency domain spanned by the spectral basis of G. Therefore, signals can be manipulated in the frequency domain to induce different levels of interactions between neighbors in the network; see Section IV-B for more on graph ﬁlters. To elaborate on this concept, consider the eigenvector decomposition of the combinatorial graph Lapla- cian L to deﬁne the GFT and the associated notion of graph frequencies. With := diag( ; : : : ; ) 1 N denoting the diagonal matrix of non-negative Laplacian eigenvalues and V := [v ; : : : ; v ] the orthonor- 1 N mal matrix of eigenvectors, one can always decompose the symmetric graph Laplacian as L = VV . Deﬁnition 1 (Graph Fourier transform): The GFT of x with respect to the combinatorial graph Lapla- T T cian L is the signal x ~ = [x ~ ; : : : ; x ~ ] deﬁned as x ~ = V x. The inverse iGFT of x ~ is given by x = Vx ~, which is a proper inverse by the orthogonality of V. The iGFT formula x = Vx ~ = x ~ v allows one to synthesize x as a sum of orthogonal frequency k k k=1 components v . The contribution of v to the signal x is the GFT coefﬁcient x ~ . The GFT encodes a k k k notion of signal variability over the graph akin to the notion of frequency in Fourier analysis of temporal signals. To understand this analogy, deﬁne the total variation of the graph signal x with respect to the Laplacian L (also known as Dirichlet energy) as the following quadratic form T 2 TV(x) := x Lx = W (x x ) : (12) ij i j i6=j The total variation TV(x) is a smoothness measure, quantifying how much the signal x changes with respect to the presumption on variability that is encoded by the weights W [38], [60]. Topology inference algorithms that search for graphs under which the observations are smooth is the subject of Section V. Back to the GFT, consider the total variation of the eigenvectors v , which is given by TV(v ) = k k v Lv = . It follows that the eigenvalues 0 = < : : : can be viewed as graph frequencies, k k 1 2 N indicating how the eigenvectors (i.e., frequency components) vary over the graph G. Accordingly, the GFT and iGFT offer a decomposition of the graph signal x into spectral components that characterize different levels of variability. To the extent thatG is a good representation of the relationship between the components of x, the GFT can be used to process x by e.g., exploiting sparse or low-dimensional representations x ~ in the graph frequency domain. For instance, Section IX-A illustrates how the disaggregated gross domestic product signal supported on a graph of United States (US) economic sectors can be accurately represented with a handful of GFT coefﬁcients. So far the discussion has focused on the GFT for symmetric graph Laplacians L associated with undirected graphs. However, the GFT can be deﬁned in more general contexts where the interpretation 13 of components as different modes of variability is not as clean and Parseval’s identity may not hold, but its value towards yielding parsimonious spectral representations of network processes remains [38]. Consider instead a (possibly asymmetric) graph-shift operator S which is assumed to be diagonalizable as 1 1 S = VV , and redeﬁne the GFT as x ~ = V x; otherwise one can consider Jordan decompositions [49]. Allowing for generic graph-shift operators reveals the encompassing nature of the GFT relative to the time- domain discrete Fourier transform (DFT), the multidimensional DFT, and the Karhunen-Loev ` e transform (KLT) [also known as the principal component analysis (PCA) transform in statistics and data analysis]; see Encompassing nature of the graph Fourier Transform. The GFT offers a unifying framework that subsumes all the aforementioned transforms for speciﬁc graphs, while it also offers a natural representation to work with signals of increasingly complex structure. Encompassing nature of the graph Fourier transform. Discrete-time, space, and correlated signals can be reinterpreted as graph signals supported on particular graphs. 00 11 x x x 00 01 02 x x 0 1 00 01 02 x x 5 1 0 1 5 1 x x x 10 11 12 10 11 12 30 03 21 12 x x 4 2 x x 4 2 3 2 x x x 20 21 22 3 2 20 21 22 33 22 A (periodic) discrete-time signal can be viewed as a graph signal supported on the directed cycle, whose circulant adjacency matrix is diagonalized by the DFT basis (left). A spatial signal such as an image can be thought of as a graph signal supported on a regular lattice (middle). A zero- mean correlated signal can be interpreted as a graph signal supported on the covariance graph, where S = = E xx is diagonalized by the orthogonal basis of principal components (right). Respective GFTs reduce to the time-domain DFT, the multidimensional DFT, and the KLT or PCA transform. B. Graph ﬁlters as models of network diffusion Here we introduce a fairly general class of linear network diffusion processes on the graph G with shift operator S. Speciﬁcally, let y be a graph signal supported on G, which is generated from an input graph signal x via linear network dynamics of the form 1 1 Y X y = (I S)x = S x: (13) 0 l l l=1 l=0 While S encodes only one-hop interactions, each successive application of the shift in (13) diffuses x over G. The product and sum representations in (13) are common (and equivalent) models for the generation of linear network processes. Indeed, any process that can be understood as the linear propagation of a seed 14 signal through a static graph can be written in the form in (13), and subsumes heat diffusion, consensus, and the classic DeGroot model of opinion dynamics as special cases. The diffusion expressions in (13) are polynomials in S of possibly inﬁnite degree, yet the Cayley- Hamilton theorem asserts that they are equivalent to polynomials of degree smaller than N . This is intimately related to the concept of (linear shift-invariant) graph ﬁlter. Speciﬁcally, upon deﬁning the vector of coefﬁcients h := [h ; : : : ; h ] , a graph ﬁlter is deﬁned as 0 L1 L1 2 L1 l H := h I + h S + h S + : : : + h S = h S : (14) 0 1 2 L1 l l=0 L1 Hence, one has that the signal model in (13) can be rewritten as y = h S x := Hx, for some l=0 particular h and L N . Due to the local structure of S, graph ﬁlters represent linear transformations that can be implemented in a distributed fashion, e.g., with L 1 successive exchanges of information among neighbors. Since H is a polynomial in S, graph ﬁlters have the same eigenvectors as the shift. This implies that H and S commute and hence graph ﬁlters represent shift-invariant transformations [48]. Leveraging the spectral decomposition of S, graph ﬁlters can be represented in the frequency domain. Speciﬁcally, let us use the eigenvectors of S to deﬁne the GFT matrix U := V , and the eigenvalues j1 of S to deﬁne the N L Vandermonde matrix , where := ( ) . The frequency representation ij i of a ﬁlter h is deﬁned as h := h, since the output y = Hx of a graph ﬁlter in the frequency domain is ~ ~ y ~ = diag h Ux = diag h x ~ = h x ~: (15) This identity can be seen as a counterpart of the convolution theorem for temporal signals, where y ~ is the elementwise product of x ~ and the ﬁlter’s frequency response h. To establish further connections with the time domain, recall the directed cycle graph with adjacency matrix W . If S = W , one ﬁnds that: dc dc i) y = Hx can be found as the circular convolution of h and x; and ii) both U and correspond to the DFT matrix. While in the time domain U = , this is not true for general (non-circulant) graphs. C. Stationary graph processes Having introduced the notions of graph-shift operator, GFT and graph ﬁlter, we review here how to use those to characterize a particular class of random graph signals (often referred to as graph processes, meaning collections of vertex-indexed random variables). In classical SP, stationarity is a fundamental property that facilitates the (spectral) analysis and processing of random signals, by requiring that the data-generation mechanisms (i.e., the joint probability distributions) are invariant to time shifts. Due to the intrinsic irregularity of the graph domain and the associated challenges of deﬁning translation operators, extending the notion of stationarity to random graph signals is no easy task [17], [34], [42]. Stationary graph processes were ﬁrst deﬁned and analyzed in [17]. The fundamental problem identiﬁed therein is that graph-shift operators do not preserve energy in general and therefore they cannot be isometric. This hurdle is overcome with the deﬁnition of an isometric graph shift that preserves the eigenvector space of the Laplacian, but modiﬁes its eigenvalues [16]. A stationary graph process is 15 then deﬁned as one whose probability distributions are invariant with respect to multiplications with the isometric shift. It is further shown that this deﬁnition requires the covariance matrix of the signal to be diagonalized by the eigenvectors of the graph shift, which by construction are also the eigenvectors of the isometric shift. This implies the existence of a graph power spectral density with components given by the covariance eigenvalues. The requirement of having a covariance matrix diagonalizable by the eigenvectors of the Laplacian is itself adopted as a deﬁnition in [42], where the requirement is shown to be equivalent to statistical invariance with respect to the non-isometric translation operator introduced in [59]. These ideas are further reﬁned in [34] and extended to general normal (not necessarily Laplacian) graph-shift operators. Following the approach in [34], here we present two (equivalent) deﬁnitions of weak stationarity for zero-mean graph signals. We then discuss brieﬂy some of their implications in the context of network topology identiﬁcation, paving the way for the approaches surveyed in Section VI. To that end, we deﬁne a standard zero-mean white random graph signal w as one with mean E [w] = 0 and covariance := E ww = I. Deﬁnition 2 (Weak stationarity - Filtering characterization): Given a normal shift operator S, a ran- dom graph signal x is weakly stationary with respect to S if it can be written as the response of a linear N1 shift-invariant graph ﬁlter H = h S to a white input w, that is l=0 N1 x = h S w = Hw: (16) l=0 The deﬁnition states that stationary graph processes can be written as the output of graph ﬁlters when excited with a white input. This generalizes the well-known fact that stationary processes in time can be expressed as the output of linear time-invariant systems driven by white noise. Starting from (16), the covariance matrix = E xx of the random vector x is given by H H H = E Hw(Hw) = H H = HH ; (17) x w which shows that the correlation structure of x is determined by the ﬁlter H. We can think of Deﬁnition 2 as a constructive deﬁnition of stationarity since it describes how a stationary process can be generated. Alternatively, one can deﬁne stationarity from a descriptive perspective, by imposing requirements on the second-order moment of the random graph signal in the frequency domain. Deﬁnition 3 (Weak stationarity - Spectral characterization): Given a normal shift operator S, a ran- dom graph signal x is weakly stationary with respect to S if and S are simultaneously diagonalizable. The second deﬁnition characterizes stationarity from a graph frequency perspective by requiring the covariance to be diagonalized by the GFT basis V. When particularized to time by letting S = W , x dc Deﬁnition 3 requires to be diagonalized by the DFT matrix and, therefore, must be circulant. x x Deﬁnitions 2 and 3 are equivalent in time. For the equivalence to hold also in the graph domain, it is possible to show one only needs S to be normal and with eigenvalues all distinct [34]. Moreover, it follows from Deﬁnition 3 that stationary graph processes are also characterized by a power spectral density. In 16 particular, given a random vector x that is stationary with respect to S = VV , the power spectral density of such a vertex-indexed process is the vector p 2 R deﬁned as p := diag V V : (18) Note that since is diagonalized by V (see Deﬁnition 3) the matrix V V is diagonal, and x x it follows that the power spectral density in (18) corresponds to the (non-negative) eigenvalues of the covariance matrix < 0. Thus, (18) is equivalent to = Vdiag(p)V . The latter identity shows that x x stationarity reduces the degrees of freedom of a random graph process –the symmetric matrix has N (N + 1)=2 degrees of freedom, while p has only N –, thus facilitating its description and estimation. In closing, several remarks are in order. First, note that stating that a graph process is stationary is an inherently incomplete assertion, since we need to specify which graph we are referring to. Hence, the proposed deﬁnitions depend on the graph-shift operator, so that a random vector x can be stationary in S but not in S 6= S. White noise is, on the other hand, an example of a random graph signal that is stationary with respect to any graph shift S. A second, albeit related, observation is that, by deﬁnition, any random vector x is stationary with respect to the shift given by the covariance matrix S = . The same is true for the precision matrix S = . These facts will be leveraged in Section VI, to draw connections between stationary graph signal-based topology inference approaches and some of the classical statistical methods reviewed in Section III. Third, notice that the stationarity requirement is tantamount to the covariance of the process being a polynomial in the graph-shift operator. Accordingly, under stationarity we ask the mapping from S to the covariance to be smooth (an analytic function), which is a natural and intuitively pleasing requirement [54]. Section VI will delve into this last issue when presenting models for topology inference based on graph stationary observations. But before that, in the next section we consider graph learning as an inverse problem subject to a signal smoothness prior. V. L EARNING GRAPHS FROM OBSERVATIONS OF SM OOTH SIGNALS In various GSP applications it is desirable to construct a graph on which network data admit certain regularity. Accordingly, in this section we survey a family of topology identiﬁcation approaches that deal with the following general problem. Given a set X := fx g of possibly noisy graph signal observations, p=1 the goal is to learn a graph G(V;E; W) with jVj = N nodes such that the observations in X are smooth on G. Recall that a graph signal is said to be smooth if the values associated with vertices incident to edges with large weights in the graph tend to be similar. As discussed in Section IV-A, the so-deﬁned smoothness of a signal can be quantiﬁed by means of a total variation measure given by the Laplacian quadratic form in (12). Such a measure offers a natural criterion to search for the best topology (encoded in the entries of the Laplacian), which endows the signals in X with the desired smoothness property. There are several reasons that motivate this graph learning paradigm. First, smooth signals admit low- pass band-limited (i.e., sparse) representations using the GFT basis [cf. the discussion following (12)]. From this vantage point, the graph learning problem can be equivalently viewed as one of ﬁnding efﬁcient 17 information processing transforms for graph signals. Second, smoothness is a cornerstone property at the heart of several graph-based statistical learning tasks including nearest-neighbor prediction (also known as graph smoothing), denoising, semi-supervised learning, and spectral clustering. The success of these methods hinges on the fact that many real-world graph signals are smooth. This should not come as a surprise when graphs are constructed based on similarities between nodal attributes (i.e., signals), or when the network formation process is driven by mechanisms such as homophily or proximity in some latent space. Examples of smooth graph signals include natural images [25], average annual temperatures recorded by meteorological stations [5], type of practice in a network of lawyer collaborations [29, Ch. 8], and product ratings supported over similarity graphs of items or consumers [24], just to name a few. A. Laplacian-based factor analysis model and graph kernel regression A factor analysis-based approach was advocated in [9] to estimate graph Laplacians, seeking that input graph signals are smooth over the learned topologies. Speciﬁcally, let L = VV be the eigendecom- position of the combinatorial Laplacian associated with an unknown, undirected graph G(V;E; W) with N = jVj vertices. The observed graph signal x 2 R is assumed to have zero mean for simplicity, and adheres to the following graph-dependent factor analysis model x = V + ; (19) where the factors are given by the Laplacian eigenvectors V, 2 R represents latent variables or factor loadings, and Normal(0; I) is an isotropic error term. Adopting V as the representation matrix is well motivated, since Laplacian eigenvectors comprise the GFT basis – a natural choice for synthesizing graph signals as explained in Section IV-A. Through this lens the latent variables in (19) can be interpreted as GFT coefﬁcients. Moreover, the Laplacian eigenvectors offer a spectral embedding of the graph vertices, that is often useful for higher-level network analytic tasks such as data visualization, clustering, and community detection. The representation matrix establishes a ﬁrst link between the signal model and the graph topology. The second one comes from the adopted latent variables’ prior distribution y y Normal(0; ), where denotes pseudo-inverse and thus the precision matrix is deﬁned as the eigenvalue matrix of the Laplacian. From the GFT interpretation of (19), it follows that the prior on encourages low-pass bandlimited x. Indeed, the mapping ! translates the large eigenvalues of the Laplacian (those associated with high frequencies) to low-power factor loadings in . On the other hand, small eigenvalues associated with low frequencies are translated to high-power factor loadings – a manifestation of the model imposing a smoothness prior on x. Given the observed signal x, the maximum a posteriori (MAP) estimator of the latent variables is given by ( is henceforth assumed known and absorbed into the parameter > 0) 2 T h = arg min kx Vk + ; (20) MAP which is of course parameterized by the unknown eigenvectors and eigenvalues of the Laplacian. With y := V denoting the predicted graph signal (or error-free representation of x), it follows that [cf. (12)] T T T T = y VV y = y Ly = TV(y): (21) 18 Consequently, one can interpret the MAP estimator (20) as a Laplacian-based total variation denoiser of x, which effectively imposes a smoothness prior on the recovered signal y = V. One can also view (20) as a kernel ridge-regression estimator with (unknown) Laplacian kernel K := L [29, Ch. 8.4.1]. Building on (20) and making the graph topology an explicit variable in the optimization, the idea is to jointly search for the graph Laplacian L and a denoised representation y = V of x, thus solving 2 T min kx yk + y Ly : (22) L;y The objective function of (22) encourages both: i) data ﬁdelity through a quadratic loss penalizing discrepancies between y and the observation x; and ii) smoothness on the learned graph via total-variation regularization. Given data in the form of multiple independent observations X := fx g that we collect p=1 NP in the matrix X = [x ; : : : ; x ] 2 R , the approach of [9] is to solve 1 P 2 T 2 min kX Yk + trace Y LY + kLk (23) F F L;Y 2 s. to trace(L) = N; L1 = 0; L = L 0; i 6= j; ij ji which imposes constraints on L so that it qualiﬁes as a valid combinatorial Laplacian. Notably, trace(L) = N avoids the trivial all-zero solution and essentially ﬁxes the ` -norm of L. To control the sparsity of the resulting graph, a Frobenius-norm penalty is added to the objective of (23) to shrink its edge weights. The trade-off between data ﬁdelity, smoothness and sparsity is controlled via the positive regularization parameters and . While not jointly convex in L and Y, (23) is bi-convex meaning that for ﬁxed L the resulting problem with respect to Y is convex, and vice versa. Accordingly, the algorithmic approach of [9] relies on alternating minimization, a procedure that converges to a stationary point of (23). For ﬁxed Y, (23) reduces to a quadratic program (QP) subject to linear constraints, which can be solved via interior point methods. For large graphs, scalable alternatives include the alternating-direction method of multipliers (ADMM), or, primal-dual solvers of the reformulation described in the following section; see (26). For ﬁxed L, the resulting problem is a matrix-valued counterpart of (22). The solution is given in closed form as Y = (I + L) X, which represents a low-pass, graph ﬁlter-based smoother of the signals in X. B. Signal smoothness meets edge sparsity An alternative approach to the problem of learning graphs under a smoothness prior was proposed NP T 1P in [25]. Recall the data matrix X = [x ; : : : ; x ] 2 R , and let x 2 R denote its i-th row 1 P collecting those P measurements at vertex i. The key idea in [25] is to establish a link between smoothness and sparsity, revealed through the identity TV(x ) = tr(X LX) = kW Zk ; (24) p 1 p=1 NN where the Euclidean-distance matrix Z 2 R has entries Z := kx x k , i; j 2 V . The intuition ij i j is that when the given distances in Z come from a smooth manifold, the corresponding graph has a 19 sparse edge set, with preference given to those edges (i; j) associated with smaller distances Z . Identity ij (24) offers an advantageous way of parameterizing graph learning formulations under smoothness priors, because the space of adjacency matrices can be described via simpler (meaning entry-wise decoupled) constraints relative to its Laplacian counterpart. It also reveals that once a smoothness penalty is included in the criterion to search for G, adding an extra sparsity-inducing regularization is essentially redundant. Given these considerations, a general purpose model for learning graphs is advocated in [25], namely T 2 min kW Zk 1 log(W1) + kWk (25) W 2 s. to diag(W) = 0; W = W 0; i 6= j; ij ji where ; are tunable regularization parameters. Unlike [9], the logarithmic barrier on the vector W1 of nodal degrees enforces each vertex to have at least one incident edge. The Frobenius-norm regularization on the adjacency matrix W controls the graph’s edge sparsity pattern by penalizing larger edge weights. Overall, this combination enforces degrees to be positive but does not prevent most individual edge weights from becoming zero. The sparsest graph is obtained when = 0, and edges form preferentially between nodes with smaller Z , similar to a 1-nearest neighbor graph. ij The convex optimization problem (25) can be solved efﬁciently with complexity O(N ) per itera- tion, by leveraging provably-convergent primal-dual solvers amenable to parallelization. The optimization framework is quite general and it can be used to scale other related state-of-the-art graph learning problems. For instance, going back to the alternating minimization algorithm in Section V-A, recall that the computationally-intensive step was to minimize (23) with respect to L, for ﬁxed Y. Leveraging (24) 2 2 2 and noting that kLk = kW1k +kWk , said problem can be equivalently reformulated as F F 2 2 min kW Zk log(IfkWk = Ng) + kW1k +kWk (26) 1 1 s. to diag(W) = 0; W = W 0; i 6= j: ij ji As shown in [25, Sec. 5], problem (26) has a favorable structure that can be exploited to develop fast and scalable primal-dual algorithms to bridge the computational gap in [9]. C. Graph learning as an edge subset selection problem Consider identifying the edge set E of an undirected, unweighted graph G(V;E ) with jVj = N vertices. NP The observations X = [x ; : : : ; x ] 2 R are assumed to vary smoothly on the sparse graph G and 1 P the actual number of edges jEj is assumed to be considerably smaller than the maximum possible number of edges M := = N (N 1)=2. We describe the approach in [5], whose idea is to cast the graph learning problem as one of edge subset selection. As we show in the sequel, it is possible to parametrize the unknown graph topology via a sparse edge selection vector. This way, the model provides an elegant handle to directly control the number of edges in G. NM Let B := [b ; : : : ; b ] 2 R be the incidence matrix of the complete graph on N vertices. The 1 M rows of the incidence matrix index the vertices of the graph, and the columns its M = N (N 1)=2 20 T N edges. If edge m connects nodes i and j, say, the m-th column b := [b ; : : : ; b ] 2 f1; 0; 1g is m m1 mN a vector of all zeros except for b = 1 and b = 1 (the sign choice is inconsequential for undirected mi mj T M graphs). Next, consider the binary edge selection vector ! := [! ; : : : ; ! ] 2 f0; 1g , where ! = 1 1 M m if edge m 2 E , and ! = 0 otherwise. In other words, we have E supp(!) := fm : ! 6= 0g. Using m m the columns of B, one can express the Laplacian of candidate graphs as a function of !, namely L(!) = ! b b : (27) m m m=1 For example, an empty graph with E = ; corresponds to ! = 0, while the complete graph is recovered by setting ! = 1. Here we are interested in sparse graphs having a prescribed number of edges K M , which means k!k := jsupp(w)j = K . We can now formally state the problem studied in [5]. Given graph signals X := fx g , determine p=1 an undirected and unweighted graph G with K edges such that the signals in X exhibit smooth variations on G. A natural formulation given the model presented so far, is to solve the optimization problem min trace(X L(!)X); s. to k!k = K: (28) !2f0;1g Problem (28) is a cardinality-constrained Boolean optimization, hence non-convex. Interestingly, the exact solution can be efﬁciently computed by means of a simple rank ordering procedure. In a nutshell, the solver T T entails computing edge scores c = trace(X (b b )X) for all candidate edges, and setting ! = 1 for m m m those K edges having the smallest scores. Computationally, the sorting algorithm costs O(K log K ). One can also consider a more pragmatic setting where the observations x = y + are corrupted p p p by Gaussian noise , and it is the unobservable noise-free signal y that varies smoothly on G, for p p p = 1; : : : ; P . In this case, selection of the best K -sparse graph can be accomplished by solving 2 T min kX Yk + trace(Y L(!)Y) ; s. to k!k = K; (29) Y;!2f0;1g which can be tackled using alternating minimization, or as a semideﬁnite program obtained via convex relaxation [5]. D. Comparative summary Relative to the methods in Sections V-A and V-B, edge sparsity can be explicitly controlled in (28) and the graph learning algorithm is simple (at least in the noise-free case). There is also no need to impose Laplacian feasibility constraints as in (23), because the topology is encoded via an edge selection vector. However, (28) does not encourage connectivity of G, and there is no room for optimizing edge weights. The framework in [25] is not only attractive due to is computational efﬁciency but also due to its generality. In fact, through the choice of g(W) in the advocated inverse problem [cf. (25) and (26)] minfkW Zk + g(W)g (30) s. to diag(W) = 0; W = W 0; i 6= j; ij ji 21 one can span a host of approaches to graph inference from smooth signals. Examples include the Laplacian- based factor analysis model [9] in (26), and common graph constructions using the Gaussian kernel to 2 P kx x k i j deﬁne edge weights W := exp are recovered for g(W) = W (log(W ) 1). ij 2 ij ij i;j Next, we search for graphs under which the observed signals are stationary. This more ﬂexible model imposes structural invariants that call for innovative approaches that operate in the graph spectral domain. VI. I DENTIFYING THE STRUCTURE OF NETWORK DIFFUSION PROCESSES Here we present a novel variant of the problem of inferring a graph from vertex-indexed signals. In previous sections the relation between the signals in X and the unknown graph G was given by statistical generative priors (Section III), or, by properties of the signals with respect to the underlying graph such as smoothness (Section V). Here instead we consider observations of linear diffusion processes in G, such as those introduced in Section IV-B. As we will see, this is a more general model where we require the covariance structure of the observed signals to be explained by the unknown network structure. This loose notion of explanatory capabilities of the underlying graph – when formalized – has strong ties with the theory of stationary processes on graphs outlined in Section IV-C. Stationarity and graph-ﬁltering models can be accurate for real-world signals generated through a physical process akin to network diffusion. Examples include information cascades spreading over social networking platforms [1], vehicular mobility patterns [56], [63], consensus dynamics [21], and progression of brain atrophy [22]. A. Learning graphs from observations of stationary graph processes As in previous sections, we are given a set X := fx g of graph signal observations and wish to p=1 infer the symmetric shift S = VV associated with the unknown underlying graph G. We assume that x comes from a network diffusion process in S. Formally, consider a random network process L1 x = h S w = Hw driven by a zero-mean input w. We assume for now that w is white, i.e., l=0 = E ww = I. This assumption will be lifted in Section VI-C. As explained in Section IV-B, the graph ﬁlter H represents a global network transformation that can be locally explained by the operator S. The goal is to recover the direct relations described by S from the set X of P independent samples of the random signal x. We consider the challenging setup where we have no knowledge of the ﬁlter degree L 1 or the coefﬁcients h, nor we get to observe the speciﬁc realizations of the inputs fw g . p=1 The stated problem is severely underdetermined and non-convex. It is underdetermined because for every observation x we have the same number of unknowns in the input w on top of the unknown ﬁlter p p coefﬁcients h and the shift S, the latter being the quantity of interest. The problem is non-convex because the observations depend on the product of our unknowns and, notably, on the ﬁrst L 1 powers of S. To overcome the underdeterminacy we will rely on statistical properties of the input process w as well as on some imposed regularity on the graph to be recovered, such as edge sparsity or least-energy weights. To surmount the non-convexity, we split the overall inference task by ﬁrst estimating the eigenvectors of S – that remain unchanged for any power of S – and then its eigenvalues. This naturally leads to a two-step process whereby we: (i) leverage the observation model to estimate V from the signals X ; and 22 (ii) combine V with a priori information about G and feasibility constraints on S to obtain the optimal eigenvalues . We specify these two steps next; see Figure 3 (a) for a schematic view of the strategy in [53]. A similar two-step approach was proposed in [40], but it relies on a different optimization problem in (ii). 1) Step 1 – Inferring the eigenvectors: From the described model it follows that the covariance matrix of the signal x is given by h i T 2 L1 2 l T 2 2 = E Hw Hw = H = V h V = h I + 2h h S + (2h h + h )S + : : : ; x l 0 0 1 0 2 l=0 (31) where we have used = I and the fact that H = H since S is assumed to be symmetric. It is apparent from (31) that the eigenvectors (i.e., the GFT basis) of the shift S and the covariance are the same. Hence the difference between , which includes indirect relationships between signal elements, and S, which contains exclusively direct relationships, is only on their eigenvalues. While the underlying diffusion in H obscures the eigenvalues of S as per the frequency response of the ﬁlter, the eigenvectors V remain unaffected in as templates of the original spectrum. So if we have access to then V x x can be obtained by performing an eigendecomposition of the covariance. The attentive reader will realize that obtaining perfectly from a ﬁnite set of signals X is, in general, infeasible. Hence, in practice we estimate the covariance, e.g. via the sample covariance , leading to a noisy version of the eigenvectors ^ ^ V. The robustness of this two-step process to the level of noise in V is analyzed in Section VI-B. The fact that S and are simultaneously diagonalizable implies that x is a stationary process on the unknown graph-shift operator S (cf. Deﬁnition 3). Consequently, one can restate the graph inference problem as one of ﬁnding a shift on which the observed signals are stationary. Moreover, (31) reveals that the assumption on the observations being explained by a diffusion process is in fact more general than the statistical counterparts outlined in Section III; see Diffusion processes as an overarching model. Smooth signal models are subsumed as special cases found with diffusion ﬁlters having a low-pass response. Diffusion processes as an overarching model. In some settings, such as opinion formation in social networks, it is reasonable to assume the existence of a bona ﬁde diffusion process that shapes the observed signals. For instance, individuals observe the opinions of their neighbors and, as inﬂuences or beliefs propagate across the network, they form their own opinion. However, the fact that we are modeling the observations as being represented by the output of a diffusion process does not require such a diffusion process to be the true generative mechanism. Indeed, this assumption is valid in the absence of any generative model since (31) reveals that it translates into concrete statistical requirements on the observed process. More precisely, assuming a diffusion-based representation is equivalent to assuming that the covariance of the observed process is an analytic matrix function of the unknown shift S. In this sense, correlation networks ( = S), covariance selection ( = x x 1 2 S ), and symmetric structural equation models driven by white noise ( = (I S) ) are special cases of this framework. 23 2) Step 2 – Inferring the eigenvalues: From the previous discussion it follows that any S that shares the eigenvectors with can explain the observations, in the sense that there exist ﬁlter coefﬁcients h that generate x through a diffusion process on S. In fact, the covariance matrix itself is a graph that can generate x through a diffusion process and so is the precision matrix (of partial correlations under Gaussian assumptions). To sort out this ambiguity, which amounts to selecting the eigenvalues of S, we assume that the shift of interest is optimal in some sense [53]. Our idea is then to seek for the shift operator S that: (a) is optimal with respect to (often convex) criteria f (S); (b) belongs to a convex set S that speciﬁes the desired type of shift operator (e.g., the adjacency W or Laplacian L); and (c) has the prescribed V as eigenvectors. Formally, one can solve min f (S); s. to S = VV (32) S2S; which is a convex optimization problem provided f (S) is convex. Within the scope of the signal model (13), the formulation (32) entails a general class of network topology inference problems parametrized by the choices of f (S) and S . The selection of f (S) allows to incorporate physical characteristics of the desired graph into the formulation, while being consistent with the spectral basis V. For instance, the matrix (pseudo-)norm f (S) = kSk which counts the number of nonzero entries in S can be used to minimize the number of edges; while f (S) = kSk is a convex proxy for the aforementioned edge cardinality function. Alternatively, the Frobenius norm f (S) = kSk can be adopted to minimize the energy of the edges in the graph, or f (S) = kSk which yields shifts S associated with graphs of uniformly low edge weights. This can be meaningful when identifying graphs subject to capacity constraints. Finally, one can minimize f (S) = , where is the second smallest 2 2 eigenvalue of S. If S is further constrained to be a combinatorial Laplacian via S = fSj S 0; S ij 0 for i 6= j; S1 = 0g, then IS is a shift with fast mixing times. Alternatively, to impose that S represents the adjacency matrix of an undirected graph with non-negative weights and no self-loops, one can set S := fSj S = S 0; S = 0; S = 1g. The ﬁrst condition in S encodes the non-negativity ij ji ii j1 of the weights and incorporates that G is undirected, hence, S must be symmetric. The second condition encodes the absence of self-loops, thus, each diagonal entry of S must be null. Finally, the last condition ﬁxes the scale of the admissible graphs by setting the weighted degree of the ﬁrst node to 1, and rules out the trivial solution S = 0. 24 (p) P {x } p=1 {x } ⌃ w,m m p=1 Es#mate(eigenvectors( Es#mate(eigenvectors( STEP(1( 0(Compute(sample(covariance( STEP(1( 0(Solve(system(ID(problem( 0(Perform(eigendecomposi#on( 0(Perform(eigendecomposi#on( A(priori(info( A(priori(info( (f, S) V (f, S) Es#mate(eigenvalues( Es#mate(eigenvalues( STEP(2( STEP(2( 0(Convex(and(robust(op#miza#on( 0(Convex(and(robust(op#miza#on( ⇤ ⇤ S S (a) (b) Fig. 3. Schematic view of the two-step network inference method for (a) stationary and (b) non-stationary diffusion processes. The main differences between both approaches lie in Step 1. For stationary processes, we are given only one set of realizations of a random process, whose covariance is guaranteed to share the eigenvectors with S. For non-stationary processes, covariance matrices are no longer simultaneously diagonalizable with S, thus requiring a more challenging system identiﬁcation step in order to estimate H. In both cases the output of Step 1 is an estimate of the eigenvectors V of the sought shift. During Step 2, this estimate is combined with a priori information about the shift in an optimization problem to obtain the estimate S . B. Robust network topology inference The optimization problem formulated in Step 2 assumes perfect knowledge of the eigenvectors V, which is only feasible if we have access to the ensemble covariance matrix . In practice, we form ^ ^ the empirical covariance that results in a noisy eigenbasis V. It is thus prudent to account for the (ﬁnite sample) discrepancies between V and the actual eigenvectors of S. To that end, we modify (32) by relaxing the equality constraint to obtain ^ ^ S := argmin f (S); s. to d(S; VV ) ; (33) S2S; where d(;) is a convex matrix distance and is a tuning parameter chosen based on a priori information on the noise level. The form of the distance d(;) depends on the particular application. For instance, ^ ^ if kS VV k is chosen, the focus is more on the similarities across the entries of the compared ^ ^ matrices, while kS VV k focuses on their spectrum. M (2) One may ponder how does the noise level in V affect the recovery performance of S. To provide an answer we focus on the particular case of sparse shifts, where we adopt f (S) = kSk as criterion in (33) T T ^ ^ ^ ^ and d(S; VV ) = kS VV k to obtain ^ ^ S := argmin kSk ; s. to kS VV k : (34) 1 F ;S2S We denote by S the sparsest S with the true eigenbasis V, and we assume that is chosen large enough to ensure that S belongs to the feasibility set of (34). It was shown in [53] that under two conditions on matrices derived from V it can be guaranteed that kS S k < C, where C is a well-deﬁned constant 1 0 25 that depends, among other things, on the size of the support of the sparse graph S . This means that when given noisy versions V of the eigenvectors, the recovered shift is guaranteed to be at a distance from the desired shift bounded by the tolerance times a constant. This also implies that, for ﬁxed N , as the number of observed signals P increases we recover the true shift. In particular, the empirical covariance ! x x as P ! 1 and, for the cases where has no repeated eigenvalues, the noisy eigenvectors V converge to the eigenvectors V of the desired shift S ; see, e.g., [39, Th. 3.3.7]. Moreover, with better estimates V the tolerance in (34) needed to guarantee feasibility can be made smaller, entailing a smaller discrepancy between the recovered S and the sparsest shift S . In the limit when V = V and under no additional 1 0 uncertainties, the tolerance can be made zero and solving (34) guarantees perfect recovery under the two aforementioned conditions. For a comprehensive performance evaluation that includes comparisons with the statistical methods of Section III as well as with graph learning algorithms that rely on smoothness priors (Section V), the interested reader is referred to [53]. An alternative scenario for robustness analysis arises when we have partial access to the eigenbasis V and, as a result, we can only access K out of the N eigenvectors of the unknown shift S. This would be the case when, e.g., the given signal ensemble is bandlimited and V is found as the eigenbasis of the low-rank ; when the noise level is high and the eigenvectors associated with low-power components cannot be effectively estimated; or, when contains repeated eigenvalues, giving rise to a rotation ambiguity in the deﬁnition of the associated eigenvectors. In this latter case, we keep the eigenvectors that can be unambiguously characterized and, for the remaining ones, we include the rotation ambiguity as an additional constraint in the optimization problem. To state the problem in this setting, assume that the K ﬁrst eigenvectors V = [v ; :::; v ] are those K 1 K which are known. For simplicity of exposition, suppose as well that V is estimated error free. Then, the network topology inference problem with incomplete eigenbasis can be formulated as [cf. (32)] S := argmin kSk ; s. to S = S + v v ; S V = 0 (35) 1 k k K 1 K k=1 k K S2S;S ; where we already particularized the objective to the ` -norm convex relaxation. The formulation in (35) constrains S to be diagonalized by the subset of known eigenvectors V , with its remaining component S being forced to belong to the orthogonal complement of range(V ). This implies that the rank of S can be at most N K . An advantage of using only partial information of the eigenbasis as opposed to the whole V is that the set of feasible solutions in (35) is larger than that in (32). This is particularly important when the desired eigenvectors do not come from a prescribed shift but, rather, one has the freedom to choose S provided it satisﬁes certain spectral properties (see [52] for examples in the context of distributed estimation). Performance guarantees can also be derived for (35); see [53] for the technical details and formulations to accommodate scenarios where the knowledge of the K templates is imperfect. Regarding the computational complexity incurred by the two-step network topology inference strategy depicted in Figure 3 (a), there are two major tasks to consider: (i) computing the eigenvectors of the sample covariance which incurs O(N ) complexity; and (ii) solving iteratively the sparsity minimization problems in (34) or (35) to recover the graph-shift operator, which cost O(N ) per iteration [53]. The 26 cost incurred by the linear-programming based algorithms in [40] is of the same order. Admittedly, cubic complexity could hinder applicability of these approaches to problems involving high-dimensional signals. To bridge this complexity gap, progress should be made in developing custom-made scalable algorithms that exploit the particular structure of the problems; see the research outlook in Section X. C. Diffused non-stationary graph signals We now deal with more general non-stationary signals x that adhere to linear diffusion dynamics L1 l T x = h S w = Hw, but where the input covariance = E ww can be arbitrary. In other l w l=0 words, we relax the assumption of w being white, which led to the stationary signal model dealt with so far [cf. Deﬁnition 2 and (31)]. Such a model is for instance relevant to (geographically) correlated sensor network data, or to models of opinion dynamics, where (even before engaging in discussion) the network agents can be partitioned into communities according to their standing on the subject matter. For generic (non-identity) , we face the challenge that the signal covariance [cf. (17)] = H H (36) x w is no longer simultaneously diagonalizable with S. This rules out using the eigenvectors of the sample covariance as eigenbasis of S, as proposed in Step 1 for the stationary case. Still, observe that the eigenvectors of the shift coincide with those of the graph ﬁlter H that governs the underlying diffusion dynamics. This motivates adapting Step 1 in Section VI-A when given observations of non-stationary graph processes. In a nutshell, the approach in [56] is to use snapshot observations X together with additional (statistical) information on the excitation input w to identify the ﬁlter H, with the ultimate goal of estimating its eigenvectors V. These estimated eigenvectors V are then used as inputs to the shift identiﬁcation problem (33), exactly as in the robust version of Step 2 in Section VI-B. Accordingly, focus is henceforth placed on the graph ﬁlter (i.e., system) identiﬁcation task; see Figure 3 (b). Identiﬁcation of the graph ﬁlter H from non-stationary signal observations is studied in detail in [56], for various scenarios that differ on what is known about the input process w. Of particular interest is the setting where realizations of the excitation input are challenging to acquire, but information about the statistical description of w is still available. Concretely, consider M different excitation processes that are zero mean and their covariance = E w w is known for all m = 1; : : : ; M . Further suppose w;m m (p) that for each input process w we have access to a set of independent realizations X = fx g m m m p=1 from the diffused signal x = Hw , which are then used to estimate the output covariance as = m m x;m (p) (p) 1 m T T T x (x ) . Since the ensemble covariance is = E x x = H H [cf. (36)], the m m x;m m w;m p=1 m aim is to identify a ﬁlter H such that matrices and H H are close in some appropriate sense. x;m w;m Assuming for now perfect knowledge of the signal covariances, the above rationale suggests studying the solutions of the following system of matrix quadratic equations = H H ; m = 1; : : : ; M: (37) x;m w;m Given the eigendecomposition of the PSD covariance matrix = V V , its principal w;m w;m w;m w;m 1=2 1=2 square root is given by = V V . With this notation in place, let us introduce the matrix w;m w;m w;m w;m 27 1=2 1=2 := . We now study the set of solutions of (37) for two different settings where wxw;m w;m x;m w;m we: i) assume that H is PSD, and ii) do not make any assumption on H other than symmetry. 1) Positive semideﬁnite graph ﬁlters: PSD graph ﬁlters arise, for example, with heat diffusion processes l l of the form x = ( L )w, > 0, where the graph Laplacian L is PSD and the ﬁlter coefﬁcients l=0 h = are all positive. In this setting, if is nonsingular then the ﬁlter H can be recovered via [56] l w;m 1=2 1=2 1=2 H = : (38) w;m wxw;m w;m The solution in (38) reveals that the assumption H 0 gives rise to a strong identiﬁability result. Indeed, if f g are known perfectly, the graph ﬁlter is identiﬁable even for M = 1. x;m m=1 However, in pragmatic settings where only empirical covariances are available, the observation of multiple (M > 1) diffusion processes improves the performance of the system identiﬁcation task. Given empirical covariances f g respectively estimated with enough samples P to ensure that they are x;m m m=1 1=2 1=2 ^ ^ full rank, deﬁne := for each m. Motivated by (38), one can estimate the graph wxw;m w;m x;m w;m ﬁlter by solving the constrained linear least-squares (LS) problem [56] 1=2 1=2 1=2 ^ ^ H = argmin H : (39) wxw;m w;m w;m H0 m=1 Whenever the number of samples P – and accordingly the accuracy of the empirical covariances – m x;m differs signiﬁcantly across diffusion processes m = 1; : : : ; M , it may be prudent to introduce non-uniform coefﬁcients to downweigh those residuals in (39) associated with inaccurate covariance estimates. 2) General symmetric graph ﬁlters: Consider now a more general setting whereby H is only assumed to be symmetric, and denote by V the unitary matrix containing the eigenvectors of . While wxw;m wxw;m for PSD graph ﬁlters the solution to (37) is unique and given by (38), when H is symmetric any matrix 1=2 obtained by changing the sign of one (or more) of the eigenvalues of is also a feasible solution. wxw;m Leveraging this and provided that the input covariance matrix is nonsingular, it follows that all w;m symmetric solutions of = H H are described by the set x;m w;m n o 1=2 1=2 1=2 sym T N H = H j H = V diag(b )V and b 2f1; 1g : (40) w;m wxw;m wxw;m m w;m m m wxw;m sym Inspection of H conﬁrms that in the absence of the PSD assumption, the problem for M = 1 is non- identiﬁable. Indeed, for each m there are 2 possible solutions to the quadratic equation (36), which are parameterized by the binary vector b . If H 0 the solution is unique and corresponds to b = 1, m m consistent with (38). For M > 1, the set of feasible solutions to the system of equations (37) is naturally sym M sym given by H = H . m=1 1:M If only empirical covariances f g are available, (40) can be leveraged to deﬁne the matrices x;m m=1 1=2 1=2 1=2 ^ ^ ^ ^ A := ( V ) ( V ) and solve the binary-constrained LS problem m w;m wxw;m w;m wxw;m wxw;m ^ ^ min A b A 0 b 0 s. to b 2 f1; 1g ; m = 1; : : : ; M: (41) m m m m m fb g m=1 m;m Both terms within the ` -norm in (41) should equal vec(H) in a noiseless setting. Thus, we are minimizing the residuals across the M processes considered. While the objective in (41) is convex in the fb g , m=1 28 the binary constraints render the optimization non-convex and particularly hard. Interestingly, this problem can be tackled using a convexiﬁcation technique known as semideﬁnite relaxation [31]. More precisely, (41) can be recast as a Boolean quadratic program and then equivalently expressed as a semideﬁnite program subject to a rank constraint. Dropping this latter constraint, one arrives at a convex relaxation with provable approximation bounds; see [56] for full algorithmic, complexity, and performance details. D. Learning heat diffusion graphs A different graph topology identiﬁcation method was put forth in [63], which postulates that the observed signals consist of superimposed heat diffusion processes on the unknown graph. Mathematically, the observed graph signals are modeled as a linear combination of a few (sparse) components from a dictionary consisting of heat diffusion ﬁlters with different heat rates. The graph learning task is then formulated as a regularized inverse problem where both the graph – hence, the ﬁlters – and the sparse combination coefﬁcients are unknown. Similar to Section V, let us deﬁne the matrix X = [x ; : : : ; x ] collecting the P observed graph 1 P signals, as well as the vector = [ ; : : : ; ] of heat rates corresponding to each of the S diffusion 1 S P l 1 ( L) L s ﬁlters H = e = . With those notations in place, the inference problem is formulated as l=0 l! 8 9 < = 2 X L L L 2 1 2 S min X e ; e ; : : : ; e R + kr k + kLk (42) p 1 L;R; : ; p=1 s. to trace(L) = N; L1 = 0; L = L 0; i 6= j; 0; ij ji i NS where r 2 R , which corresponds to the p-th column of R, collects the (sparse) coefﬁcients that combine the columns of the dictionary to approximate the graph signal x . The objective function in (42) has three components. The ﬁrst term seeks to explain the observations with a dictionary model, where the atoms of the dictionary are the potential outputs of heat diffusion processes centered at every possible node and for several candidate heat diffusion rates . The model postulates that every observation x can s p be synthesized as a few diffusion processes, thus, the coefﬁcients associated with the dictionary should be sparse. Accordingly, the second term in the objective function imposes sparsity on the columns of R. Finally, the last term regularizes the unknown Laplacian L. The constraints in (42) basically ensure that L is a well-deﬁned Laplacian and that heat diffusion rates are non-negative; see [63] for more details. The optimization problem in (42) is non-convex, thus potentially having multiple local minima and hindering its solution. Moreover, solving (42) only with respect to L is challenging due to the matrix exponential, rendering the problem non-convex even for ﬁxed and R. This discourages traditional alternating minimization techniques. To overcome this difﬁculty, the approach in [63] is to apply a proximal alternating linearized minimization algorithm, which can be interpreted as alternating the steps of a proximal forward-backward scheme. The basis of the algorithm is alternating minimization between L, R, and , but in each step the non-convex ﬁtting term is linearized with a ﬁrst-order function at the solution obtained from the previous iteration. In turn, each step becomes the proximal regularization of the non- convex function, which can be solved in polynomial time. The computational cost of the aforementioned 29 TABLE I C OMPARISON OF SURVEYED UNDIRECTED NETWORK TOPOLOGY INFERENCE ALGORITHMS Method Equation Observed signals Target Complexity Salient characteristics Correlation network (1) i.i.d. O(N P) X Flexible signal model, intuitive notion of pairwise interaction [29, Ch. 7.3.1] 7 Misses latent effects, limited to linear and symmetric interactions 1 3 Partial correlation network (4) i.i.d O(N ) X Flexible signal model, controlling for latent effects [29, Ch. 7.3.2] 7 Statistical and computational issues of large-scale hypothesis testing 1 1 3 Graphical lasso (7) jointly Gaussian O(N ) X Sparse regularization to handle high dimensional setting (N P ) [2], [14], [64] X Efﬁcient ﬁrst-order algorithms, statistical support consistency 7 Gaussianity may be restrictive, intractable for discrete models 1 1 3 Laplacian-constrained GMRF (8) jointly Gaussian = L O(N ) X Incorporates Laplacian and other structural constraints [11], [30] X Non-negativity of edge weights can aid interpretability 7 Attractive and improper GMRF can be restrictive 1 2 2 Neighborhood-based (11) jointly Gaussian O(N P) X Scalable via per-node parallelization, statistical support consistency regression [36] discrete distributions X Tractable even for discrete or mixed graphical models 7 Symmetry and positive-deﬁniteness is not naturally enforced 3 2 Laplacian-based factor analysis (23) smooth L O(N ) X Natural graph-based factor analysis model (akin to iGFT synthesis) [9] 7 Bi-convex criterion lacking global optimality guarantees 3 2 Smoothness-based graph (25), (30) smooth W O(N ) X General graph learning framework under smoothness prior learning [25] X Efﬁcient, scalable primal-dual solver 7 No explicit generative model for the observations Edge subset selection (28), (29) smooth L O(jEj logjEj) X Explicit handle on edge sparsity [5] 7 No control on graph connectivity or edge weights 3 3 Spectral templates (34), (35) graph stationary S O(N ) X Flexible model, data covariance as analytic function of the shift [40], [53], [56] network diffusion X Robust formulations to accommodate imperfections 7 Limited sample size can hinder covariance eigenvector estimates 3 3 Heat diffusion graphs (42) heat diffusions L O(N ) X Dictionary model of superimposed heat diffusion processes [63] X Can capture localized properties of the data 7 Non-convex criterion lacking global optimality guarantees This is the complexity for dense graphs. In practice, the computation time markedly decreases for sparse graphs. Complexity per node. Complexity per step of an iterative algorithm. 4 2 This complexity is attained for the noiseless case. In the presence of noise, a convex optimization problem with N variables must be solved. graph learning algorithm is O(N ) per iteration, stemming from the computation of matrix exponentials, gradients, and required Lipschitz constants. Savings can be effected by relying on truncated (low-degree) polynomial approximations of the heat diffusion ﬁlters H ; see [63, Sec. IV-C]. E. Comparative summary Inspection of (42) reveals the main differences between the method in [63] and the ones outlined in Sections VI-B and VI-C. Namely, (42) assumes a speciﬁc ﬁlter type (heat diffusion) parametrized by a single scalar (the diffusion rate). Moreover, the inputs to these ﬁlters are required to be sparse. On the other hand, in the previous methods the ﬁlters were arbitrary – thus, not necessarily modeling heat diffusion – while the available information on the inputs was statistical (white or known covariance) instead of structural (like sparsity). In this respect, when there are strong reasons to believe that the true diffusion model is (close to) a heat diffusion, then the more model-speciﬁc approach in [63] would be preferable. Otherwise, a more data-driven approach like the one explained in Sections VI-B and VI-C can attain better estimation performance , possibly at the price of a larger sample size. This trade-off is nicely conveyed through the numerical tests reported in [63]. VII. F URTHER INSIGHTS ON CHOOSING A SUITABLE GRAPH LEARNING METHOD Having presented several methods for (undirected) network topology inference that we summarize in Table I, it is prudent to reﬂect for a moment on a few general questions. First, what is the most 30 suitable algorithm for a given network-analytic task? On a related note, what are the key considerations in making such decision? Second, what are the new perspectives, beneﬁts, and limitations of the GSP-based approaches in Sections V and VI, relative to e.g., the statistical methods for graphical model selection in Section III? While there are certainly no deﬁnite answers to at least some of these questions, here we shed some light based on our experience with graph learning problems. To this end, the qualitative comparison that follows will delve into three central characteristics of the approaches, namely: (i) signal models and their relationships; (ii) computational and sample complexities; and (iii) relevance to applications. A. Graph signal models and their relationships A general principle to unveil (network) structure from data is to adopt a parametric model, thus modeling has been a recurrent theme in our presentation of topology inference algorithms; see the third column in Table I. Correlation networks advocate an intuitive notion of similarity between signal elements, where the interactions are modeled by the covariance matrix . They are widely adopted especially when implemented using simple ad hoc thresholding rules on the ^ to deﬁne edges. If seeking a graph ij reﬂective of direct pairwise inﬂuence among signal elements, then partial-correlation networks represent a more sensible alternative. For both these network models, recall that their scope is limited to linear and symmetric dependencies. Formal network inference in this context requires conducting multiple hypothesis tests (one per vertex pair), so e.g., FDR control procedures should be implemented. A word of caution is due here since classical multiple-testing theory considers independent tests – an assumption that can be grossly violated for network data [29, Ch. 7]. Gaussian models are ubiquitous in machine learning and statistical analysis of real-valued network data, because of their widespread applicability and analytical tractability. Most recent advances to GMRF model selection have explored ways of incorporating Laplacian or otherwise graph topological constraints in the precision matrix estimation task [11], [21], [41], [43]. These approaches are well suited to settings when prior information dictates that e.g., feasible graphs should have a tree structure or edge weights should be positive given the physics of the problem. Interestingly, one can motivate the signal modeling framework in Section V through the lens of Gaussian graphical models. To this end, it sufﬁces to notice that smooth signals have a higher likelihood under GMRF models with a Laplacian-constrained precision matrix. Going back to Section III, it is thus not surprising to see that the ML estimator (6) minimizes trace() / x x , a term that represents a smoothness penalty for graphical models with p=1 p = L [cf. (12)]. This connection notwithstanding, the optimization problems (25) and (30) are motivated by smooth signal priors but there is no explicit generative model for the observations, unlike the graphical models in Section III which have a clear interpretation. Stationarity models on the other hand are suitable when second-order statistical invariance to graph shifts is a suspected property of the data. Moreover, Deﬁnition 2 offers a clear generative mechanism in terms of network diffusion [40], [53], well suited to model observations from cascading or epidemic processes. This perspective also suggests that smoothness models can be recovered via diffusion ﬁlters with low-pass frequency response. Equivalently, stationarity implies a graph-dependent model = (S) 31 for the data covariance, where is some analytic function of the graph-shift operator. Through this lens, one can recover correlation networks and covariance selection as special cases when is the identity or inverse operator, respectively [53]. A similar model = (L) was recently advocated in [12] for graph Laplacian learning within the GMRF framework. Notice how all these insightful links and rich interpretations are facilitated through the fresh perspective GSP brings to the topology inference problem. B. Computational and sample complexities In the current era of information, computation and data have arguably emerged as the key resources over which to optimize performance of signal and information processing algorithms. We encountered this computational versus statistical trade-off in Section III: neigborhood-based regression algorithms for GMRF model selection are faster, while graphical lasso is statistically more efﬁcient. Both of these schemes along with the methods from Section V-B come with efﬁcient solvers that scale relatively well to large-size problems; see the ﬁfth column of Table I for a summary of the incurred computational complexities. Methods in Section VI that require computing eigenvectors from the empirical covariance matrix are likely to fail when there are few data samples, unless some form of regularization is introduced in the process. This is to be contrasted with the P N regime under which sparse GMRFs can be successfully identiﬁed. In this direction, fundamental statistical questions on the sample complexity of GSP-based topology inference algorithms are yet to be addressed. Returning to the approach in Section VI-B, an analytical (even approximate) characterization of recovery performance as a function of P = jXj remains elusive. Such an analysis has to jointly account for the signal model (13) (plus possibly a model for S), the imperfections in estimating V from the empirical covariance, and how these errors affect the result of the optimization (33). The challenges could be compounded for the approaches in [9], [50], [63], which rely on non-convex criteria lacking global optimality guarantees. Methods based on graphical models can be analyzed in theory under the model assumptions, for instance [36], [43], [45] show statistical consistency. Consequently, for given problem size and some prior knowledge on graph sparsity (possibly informed by physical constraints or interpretability considerations), existing sample-complexity bounds can inform the amount of data required to attain a prescribed performance goal. C. Relevance to applications It is ultimately the applications and the characteristics of the data involved that largely dictate what is a suitable graph learning algorithm for the information processing task at hand. For instance, graph-ﬁltering based models of network diffusion have been adopted to unveil urban mobility patterns in New York City from Uber pick-up data [56], [63]. A sparse graph explaining the (presumed smooth) temperature observations collected across weather stations in the French region of Brittany was obtained in [5]. The graph frequency decomposition of neuroimaging data shows promise for analyzing brain signals and connectivity [23]; see also the numerical test in Section IX-C. For supervised classiﬁcation of brain states (in response to different visual stimuli), GFT-based dimensionality reduction of functional magnetic resonance imaging (fMRI) data has been shown to outperform state-of-the art reduction techniques relying 32 on PCA or independent component analysis (ICA) [37]; see also [47] for related approaches dealing with electroencephalogram (EEG) data. Results in [37] indicate that the smooth signal prior along with the graph learning approach in [25] yield the best performance for the aforementioned classiﬁcation task. This is a valuable insight, since most software for constructing functional connectivity network relies on the correlation methods of Section III-A [62]. Graph frequency analyses require a description of the underlying network, which suggests learning graphs that yield orthonormal transforms over which signals admit parsimonious (i.e., bandlimited) rep- resentations. Such a design principle was recently advocated in [50], through the following two-step procedure: i) learn the GFT basis and the sparse signal representation jointly from the observed signals; and ii) infer the graph weighted Laplacian, and then the graph topology, from the estimated Laplacian eigenvectors (much alike [40], [53]). This signal representation perspective to graph learning is also implicit to the factor analysis model (19) that is central to the method in [9]. These ideas have been successfully applied to recovering brain functional connectivity networks associated to epilepsy [50], and to learn climate graphs from evapotranspiration data recorded by meteorological stations in California [9]. GSP tools are also envisioned to have major impact to image, point cloud, and video processing applications [38]. Though a digital image contains pixels that reside on a regular two-dimensional lattice, if one can design an appropriate underlying graph connecting pixels with weights that reﬂect the image structure, then one can interpret the image as a graph signal and apply GSP tools for processing and analysis of the signal in graph spectral domain [6]. For image restoration tasks such as denoising and deblurring, a major challenge is how to design appropriate signal priors to regularize otherwise ill-posed inverse problems. Learning graph Laplacians that endow the signal representations with desired sparsity or smoothness properties is thus well motivated and an active area of research. Increasingly, applications call for learning graph representations of dynamic, multi-aspect data, possibly accounting for nonlinear and directional (causal) effects among nodal signals. While a thorough treatment is beyond the scope of this paper, for completeness we offer a brief account in the next section. For a comprehensive survey of these emerging topics, the reader is referred to [15]. VIII. E MERGING TOPIC AREAS So far the focus has been on learning static and undirected graphs from data. In this section we ﬁrst consider identiﬁcation of digraphs given nodal time series, which is intimately related to the problem of causal inference. We then cross the boundary of linear time-invariant network models and outline recent advances for tracking topologies of dynamic graphs, as well as mechanisms to account for nonlinear pairwise interactions among vertex processes. A. Directed graphs and causality Undirected graphs, like correlation networks, can inform proximity between nodal signals but cannot inform causality. Here we will lift the assumption that graph-shift operators are symmetric and consider estimation of directed graphs with the intent of inferring causality from snapshot observations. 33 To that end, structural equation modeling encapsulates a family of statistical methods that model causal relationships between interacting variables in a complex system. This is pursued through estimation of linear relationships among endogenous as well as exogenous traits, and structural equation models (SEMs) have been extensively adopted in economics, psychometrics, social sciences, and genetics, among others; see e.g., [27]. The appeal of SEMs can be attributed to simplicity and the inherent ability to capture NN edge directionality in graphs, represented through a (generally) asymmetric adjacency matrix W 2 R whose entry w is nonzero only if a directed edge connects nodes i and j (pointing from j to i). ij SEMs postulate a linear time-invariant network model of the form x = w x + ! u + ; i 2 V ) x = Wx + u + ; (43) it ij jt ii it it t t t t j=1;j6=i where x = [x ; : : : ; x ] represents a graph signal of endogenous variables at discrete time t and t 1t Nt u = [u ; : : : ; u ] is a vector of exogenous inﬂuences. The term Wx in (43) models network effects, t 1t Nt t implying x is a linear combination of the instantaneous values x of node i’s in-neighbors j 2 N . The it jt i signal x also depends on u , where weight ! captures the level of inﬂuence of external sources and we it it ii deﬁned := diag(! ; : : : ; ! ). Vector accounts for measurement errors and unmodeled dynamics. 11 NN t Depending on the context, x can be thought of as an output signal while u corresponds to the excitation t t or control input. In the absence of noise and letting = I for simplicity, (43) becomes x = (IW) u , t t where H := (I W) is a polynomial graph ﬁlter in the graph-shift operator S = W. If W is further assumed to be symmetric, one recovers a particular instance of the signal model adopted in Section VI-C; see also [55]. T T Given snapshot observations X := fx ; u g , SEM parameters W and ! := [! ; : : : ; ! ] are t t 11 NN t=1 typically estimated via penalized LS, for instance by solving [4] ( ) min kx Wx + u k + kWk (44) t t t 1 W;! t=1 s. to = diag(!); W = 0; i = 1; : : : ; N ii where the ` -norm penalty promotes sparsity in the adjacency matrix. Both edge sparsity as well as the endogenous inputs play a critical role towards guaranteeing the SEM parameters (43) are uniquely identiﬁable; see also [15]. While SEMs only capture contemporaneous relationships among the nodal variables (i.e., SEMs are memoryless), the class of sparse vector autoregressive models (SVARMs) account for linear time-lagged (causal) inﬂuences instead; see e.g., [3], [32]. Speciﬁcally, for given model order L and unknown sparse (l) L evolution matrices fW g , SVARMs postulate a multivariate linear dynamical model of the form l=1 (l) x = W x + : (45) t tl t l=1 Similar to the neighborhood-based regression approaches we encountered in Section III-C, here a directed (l) edge from vertex j to i is present in G if at least one of fw g is nonzero (the OR rule). The other ij l=1 34 (l) common alternative relies on the AND rule, which requires w 6= 0 for all l = 1; : : : ; L to have (i; j) 2 ij E . The AND rule is often explicitly imposed as a constraint during estimation of SVARM parameters, (l) through the requirement that all matrices W have a common support. This can be achieved for instance (1) (L) via a group lasso penalty, that promotes sparsity over edgewise coefﬁcients w := [w ; : : : ; w ] ij ij ij jointly [3]. The sparsity assumption is often well-justiﬁed due to physical considerations or for the sake of interpretability, but here it is also critical to reliably estimate the graph from limited and noisy data. The beneﬁts of SEMs and SVARMs can be leveraged jointly through so-termed structural VARMs, (0) which augment the right-hand-side of (45) with a term W x to also capture instantaneous relationships among variables as in (43); see also [15]. In [19], the inference of the autoregressive parameters and associated network structure is studied within a generalized SVARM framework that includes discrete Poisson and Bernoulli autoregressive processes. SVARMs are also central to popular digraph topology identiﬁcation approaches based on the principle of Granger causality [18]. Said principle is based on the concept of precedence and predictability, where node j’s time series is said to “Granger-cause” the time series at node i if knowledge of fx g improves the prediction of x compared to using only j;tl it l=1 fx g . Such form of causal dependence deﬁnes the status of a candidate edge from j to i, and it can i;tl l=1 be assessed via judicious hypothesis testing [32]. Recently, a notion different from Granger’s was advocated to associate a graph with causal network effects among vertex time series, effectively blending VARMs with graph ﬁlter-based dynamical models. The so-termed causal graph process (CGP) introduced in [35] has the form L l XX x = h S x + t li tl t l=1 i=0 = (h I + h S)x + : : : + (h I + : : : + h S )x + (46) 10 11 t1 L0 LL tL t where S is the (possibly asymmetric) graph-shift operator encoding the unknown graph topology. The CGP model corresponds to a generalized VARM [cf. (45)], with coefﬁcients given by graph ﬁlters H (S; h) := i T h S ,and where h := [h ; h ; : : : ; h ; : : : h ] . This way, the model can possibly account for li 10 11 li LL i=0 multi-hop nodal inﬂuences per time step. Unlike SVARMs, matrices H (S; h) need not be sparse for larger values of l, even if S is itself sparse. Given data X := fx g and a prescribed value of L, the approach to estimating S entails solving the t=1 non-convex optimization problem ( ) T L X X min x H (S; h)x + kSk + khk : (47) t l tl 1 1 S;h t=L+1 l=1 Similar to sparse SEMs in (44) and SVARMs, the estimator encourages sparse graph topologies. Moreover, the ` -norm regularization on the ﬁlter coefﬁcients h effectively implements a form of model-order selection. A divide-and-conquer heuristic is advocated in [35] to tackle the challenging problem (47), P P L l whereby one: (i) identiﬁes the ﬁlters H := H (S; h) so that x H x , exploiting that H l l l tl l l=1 i=0 and H commute for all l; l ; (ii) recovers a sparse S using the estimates fH g and leveraging the shift- l l 35 ^ ^ invariant property of graph ﬁlters; and (iii) estimates h given fH ; Sg via the lasso. For full algorithmic details and an accompanying convergence analysis under some technical assumptions, please see [35]. B. Dynamic networks and multi-layer graphs As data become more complex and heterogeneous, possibly generated in a streaming fashion by non- stationary sources, it is becoming increasingly common to rely on models comprising multiple related networks describing the interactions between various entities. While dynamic graphs with time-varying topologies naturally fall within this general class of models, the multiple graphs of interest need not be indexed by time, but possibly instead by different subjects, demographic variables, or sensing modalities. This is for instance the case in neuroscience, where observations for different patients are available and the objective is to estimate their functional brain networks; and in computational genomics where the goal is to identify pairwise interactions between genes when measurements for different tissues of the same patient are available. In order to unveil hidden structures, detect anomalies, and interpret the temporal dynamics of such data, it is essential to understand the relationships between the different entities and how these relationships evolve over time or across different modalities. Joint identiﬁcation of multiple graph- shift operators can be useful even when interest is only in one of the networks, since joint formulations exploit additional sources of information and, hence, they are likely to result in more accurate topology estimates. Although noticeably less than its single-network counterpart, joint inference of multiple graphs has attracted attention, especially for the case of GMRFs and in the context of dynamic (time-varying) topologies [1], [15], [20], [26], [58]. All of the aforementioned works consider that the multiple graphs G (V;E ; W ), t = 1; : : : ; T , share a common vertex set while being allowed to have different edge sets t t t and weights, a structure oftentimes referred to as a multi-layer graph. Given the previous motivation, here we extend several of the problem formulations in the previous sections to accommodate (dynamic) multi-layer graphs. To state the joint network topology inference problem in its various renditions, consider a scenario with T different graphs G (V;E ; W ) deﬁned over a common set V of nodes, with jVj = N . This implies the t t t existence of T different graph-shift operators fS g that we want to recover, all represented by N N t=1 matrices, whose sparsity pattern and nonzero values may be different across t. Suppose that for each graph (p) we have access to a set of graph signals X := fx g collecting information associated with the nodes. t p=1 (1) (P ) NP Equivalently, it will be convenient to represent X through the matrix X := [x ; : : : ; x ] 2 R t t t t containing the P signals associated with graph G . A popular approach to joint inference of multi-layer t t networks assumes that graphs G and G are similar in some application-dependent sense, which we t t1 encode as some matrix distance r(S ; S ) being small. For instance, this could be well motivated for t t1 identiﬁcation of a sequence of slowly time-varying graphs. In this context, a general formulation of the multi-layer graph learning problem entails solving ( ) T T X X fS g := arg min (S ; X ) + r(S ; S ) ; (48) t t t t t1 t t=1 fS 2Sg t=1 t=1 t=2 36 where is an often convex objective function stemming from the adopted topology identiﬁcation criterion, and > 0 is a regularization parameter. In [20], the so-termed time-varying graphical lasso estimator was proposed to identify a collection of GMRFs encoded in the precision matrices S = := . Therein, t t (S ; X ) = log det + trace( ) + k k corresponds to the penalized global likelihood for t t t t t t t 1 x Normal(0; ) we encountered in Section III-B. They also propose a comprehensive list of distance t t functions r to encode different network evolutionary patterns including smooth and abrupt topology transitions; see [20] for additional details. From an algorithmic standpoint, an alternating-direction method of multipliers (ADMM) solver is adopted to tackle (48) efﬁciently. A general estimator for learning slowly time-varying graphs over which signals in X exhibit smooth variations was put forth in [26]. Let S = W denote the adjacency matrix of G and recall the Euclidean- t t t distance matrix Z deﬁned in Section V-B. The idea in [26] is to set (W ; X ) = kW Z k t t t t t t 1 T 2 2 1 log(W 1) + kW k in (48) along with r(S ; S ) = kS S k , and rely on the primal-dual t t t t1 t t1 2 F F algorithmic framework of [25] to tackle the resulting separable optimization problem. Through a different choice of (W ; X ), the framework therein can also accommodate a time-varying counterpart of the t t t model in [9]. Network topology inference approaches that rely on observations of stationary signals have (p) been extended to the multi-layer graph setting as well. As done for T = 1, we assume that X := fx g t p=1 are independent realizations of a random process x whose structure is represented by S [cf. the model t t of network diffusion in (13)]. Mimicking the development in Section VI-A2, given estimates fV g of t=1 the eigenvectors of each of the sought graph-shift operators (e.g., obtained from the sample covariances of the different sets of observations fX g ), recovery of the shifts boils down to selecting the optimal t=1 eigenvalues f g . To this end, (32) can be adapted to obtain [54] t=1 ( ) X X fS g := argmin f (S ) + r(S ; S ) (49) t t t t t=1 f ; S 2Sg 0 t t t=1 t=1 t>t ^ ^ s. to d(S ; V V ) ; t = 1; : : : ; T: t t t As discussed in Section VI-A2, the optimality criterion f and the constraint set S can be selected to promote or enforce desirable properties in the sought graphs G . Speciﬁc to formulation (49), choosing the distance function r as kS S k would promote the pair of shifts to have the same sparsity pattern t t 1 and weights, whereas the choice kS S k as in [26] would promote similar weights regardless of the t t sparsity pattern. Check [54] for further details and results including provable guarantees of the associated algorithms. Last but not least, for a recent work dealing with inference of both directed and multi-layer graphs from observations of diffused graph signals, we refer the readers to [51]. On a related note, network inference from temporal traces of infection events has recently emerged as an active area of research, which is relevant to epidemic processes, propagation of viral news events between blogs, or acquisition of new buying habits by consumer groups. It has been observed in these settings that information often spreads in cascades by following implicit links between nodes in a time- varying graph G . Reasoning that infection times depend on both topological (endogenous) and external (exogenous) inﬂuences, a dynamic SEM-based scheme was proposed in [1] for cascade modeling. With 37 c = 1; : : : ; C indexing cascades, similar to (43) we model topological inﬂuences as linear combinations (c) of infection times x of other nodes in the network, whose weights correspond to entries in a time- it (c) varying asymmetric adjacency matrix W . External inﬂuences u such as those due to on-site reporting in news propagation contexts are useful for model identiﬁability, and they are taken to be time invariant for simplicity. It is assumed that the networks G vary slowly with time, facilitating adaptive SEM parameter estimation by minimizing a sparsity-promoting exponentially-weighted LS criterion [1] ( ) C T XX (c) (c) tT (c) 2 min kx W x + u k + kWk (50) t t t 1 t t W ;! t t c=1 t=1 s. to = diag(! ); W = 0; i = 1; : : : ; N; t = 1; : : : ; T t t ii;t where 2 (0; 1] is the forgetting factor that forms estimates using all measurements acquired until time T . Whenever < 1, past data are exponentially discarded thus enabling tracking of dynamic network topologies; see also Section IX-D for a numerical test with real data from blog posts in 2011. Related likelihood-based approaches have been proposed to identify traces of network diffusion [46], as well as tensor-based topology identiﬁcation for dynamic SEMs that can account for (abruptly) switching topological states representing the layers of the graph [58]. C. Nonlinear models of interaction Network models such as SEMs or SVARMs are linear, and the same is true for most measures of pairwise similarity we encountered; notably those based on Pearson or partial correlations. However, in complex systems such as the brain there is ample evidence that dynamics involve nonlinear interactions between neural regions, and accordingly linear models fall short in capturing such dependencies. Measures capable of summarizing nonlinear association, such as mutual information, might be used depending on the suspected dependencies in the data. Building on the relationship between linear prediction and partial correlations, one can by analogy construct nonlinear measures of interaction among nodal time series by relying on nonlinear (e.g., kernel-based) predictors instead [28]. Subsequent hypothesis testing can be performed to decide between presence or absence of edges in the graph. Special care should be exercised when selecting a test statistic, since the challenges faced in determining a (tractable, even approximate) null distribution may be compounded. Issues of multiple-testing should be accounted for as well, similar to those discussed for (partial) correlation networks. Such an approach cannot infer directionality and so results in an undirected graph of nonlinear correlations. Kernelized counterparts of structural VARMs (and subsumed SEMs) have been proposed in [57] to identify the topology of digraphs, while explicitly accounting for nonlinearities. For a comprehensive treatment of the problem of learning graphs from data involving nonlinear dependencies, the interested reader is referred to the recent survey [15], which also touches upon prediction of (nonlinear and dynamic) processes supported on graphs. IX. A PPLICATIONS This section presents numerical tests conducted on real data to demonstrate the effectiveness of selected graph learning methods, ranging from ad hoc thresholding-based network constructions all the way to 38 (a) (b) Fig. 4. (a) Heat map of the graph-shift operator S of the US economic network. It is sparse across the real economic sectors (from sector 1 to 62) while the synthetic sectors AV and FU are highly connected. (b) Disaggregated GDP signal x (blue) and its reconstruction x^ (magenta) when keeping only the ﬁrst 4 frequency components (top). Frequency representation of the graph signal x in the basis of eigenvectors of the graph-shift S (bottom). The signal is approximately bandlimited [33]. algorithms for identiﬁcation of directed, time-varying graphs. Through test cases we show impact to diverse application domains including the economy, computational biology, neuroscience, and online social media. A. Efﬁcient representation of signals supported on a network of US economic sectors The Bureau of Economic Analysis of the US Department of Commerce publishes a yearly table of inputs and outputs organized by economic sectors. More precisely, we have a set of 62 industrial sectors as deﬁned by the North American Industry Classiﬁcation System and a similarity function W : VV ! R , where W represents how much of the production of sector i, expressed in trillions of US dollars per year, ij was used as an input of sector j on average during years 2008-2010. Moreover, for each sector we are given two economic markers: the added value (AV) generated and the level of production destined to the market of ﬁnal users (FU). Thus, we deﬁne a graph G on the set of N = 64 nodes comprising the original 62 sectors plus the two synthetic ones (AV and FU) and an associated symmetric graph-shift operator S deﬁned as S := (W + W )=2. We then threshold S by setting to 0 all the values lower than 0.01 to ij ij ji obtain the sparser, symmetric shift operator S = VV ; see Figure 4 (a). While this is an intriguing network that helps to understand the interactions among sectors and reveals how these sectors are clustered, arguably signals deﬁned on such graph are equally interesting and the subject of economic studies. For instance, consider the disaggregated gross domestic product (GDP) signal x 2 R on G, where x represents the total production (in trillion of dollars) of sector i (including AV and FU) during year 2011. As shown in the bottom plot of Figure 4 (b), signal x is approximately bandlimited in S since most of the elements of x ~ = V x are close to zero. In particular, the reconstructed signal x ^ = x ~ v obtained by just keeping the ﬁrst four GFT coefﬁcients attains a relative reconstruction k k k=1 error of 3:5 10 ; see the top plot of Figure 4 (b) which shows the original GDP signal superimposed 39 1 0.5 0.7 0.6 5 5 10 10 0.9 1 Proposed approach Proposed approach 15 15 20 20 0.6 Mutual information 0.5 Mutual information 25 25 0.8 1.5 30 30 Network deconvolution Network deconvolution 35 35 0.5 0.7 2 40 40 0.4 45 45 50 50 0.6 2.5 10 20 30 40 50 10 20 30 40 50 0.4 0.3 0.5 3 0.3 0.4 3.5 5 5 0.2 10 10 0.2 15 15 0.3 4 20 20 25 25 0.1 0.2 4.5 30 30 0.1 35 35 40 40 0.1 5 45 45 0 0 50 50 0 50 100 150 200 250 0 50 100 150 200 250 0 5.5 10 20 30 40 50 10 20 30 40 50 2 4 6 8 10 Top predictions Top predictions (a) (b) (c) Fig. 5. (a) Real and inferred contact networks between amino-acid residues for protein BPT1 BOVIN. Ground truth contact network (top left), mutual information of the co-variation of amino-acid residues (top right), contact network inferred by network deconvolution [13] (bottom left), contact network inferred by the approach in [53] (bottom right). (b) Fraction of the real contact edges between amino-acids recovered for each method as a function of the number of edges considered. (c) Counterpart of (b) for protein YES HUMAN [53]. to x ^. To present a reasonable scale for illustration, sectors AV and FU are not included in Figure 4 (b), since the signal takes out-of-scale values for these sectors. All in all, this example shows that – while heuristic – the adopted graph construction approach still yields a useful graph to sparsely represent the disaggregated GDP signal. In a way, this serves as validation of G and it also highlights the value of the GFT decomposition. B. Identifying protein structure via network deconvolution The network deconvolution problem is to identify a sparse adjacency matrix S = W that encodes direct dependencies, when given a symmetric adjacency T of indirect relationships. The problem broadens the scope of e.g., channel deconvolution to networks and can be tackled by adopting the model [13] 1 l T = S (I S) = S : (51) l=1 This solution assumes a diffusion as in (13) but for the particular case of a single-pole, single-zero graph ﬁlter, with very speciﬁc ﬁlter coefﬁcients. This way, the indirect dependencies observed in T arise due to 2 3 the higher order terms S + S +: : : superimposed to the fundamental interactions in S. In this numerical test case, we adopt a more general approach in assuming that T can be written as a polynomial in S, but being agnostic to the form of the ﬁlter [53]. This naturally leads back to formulation (32), with V given by the eigenvectors of T and f (S) chosen as an edge sparsity-promoting criterion. Different from the problem dealt with in Section VI, note that matrix T is not necessarily a covariance matrix. Consider identifying the structural properties of proteins from a mutual information graph of the co- variation between the constitutional amino-acids [13], [53]. Pictorially, for a particular protein we want to recover the structural graph in the top left of Figure 5 (a) when given the graph of mutual information in the top right corner. The graph recovered by network deconvolution [13] is illustrated in the bottom left corner of Figure 5 (a), whereas the one recovered using the approach in (32) (with the sparsity-promoting Fraction of recovered edges Fraction of recovered edges 10 (a) (b) (c) Fig. 6. Brain activity patterns for a visual-motor learning task decomposed in (a) low, (b) medium, and (c) high frequency components of the GFT relative to the brain connectivity network. The signals are dominated by low and high frequency components with minimal contribution from medium frequency components [23]. f (S) = kSk ) is depicted in the bottom right corner. The comparison of the recovered graphs demonstrates that using a general ﬁlter model translates to a sparser graph that captures more accurately the desired structure. To quantify this latter assertion, Figure 5 (b) depicts the fraction of the real contact edges recovered for each method as a function of the number of edges considered. For example, if for a given method the 100 edges with largest weight in the recovered graph contain 40% of the edges in the ground Fig. 6. Distribution of decomposed signals for the 6 week experiment. (a) Absolute magnitudes for all brain regions with respect to x – brain signals varing smoothly truth graph, we say that the 100 top edge predictions achieve a fraction of reco L vered edges equal to 0:4. Fig. 6. Distribution of decomposed signals for the 6 week experiment. (a) Absolute magnitudes for all brain regions with respect to x – brain signals varing smoothly Fig. 6. Distribution of decomposed signals for the 6 week experiment. (a) Absolute magnitudes for all brain regions with respect to x – brain signals varing smoothly across the network – averaged across all sample points for each individual and across all participants at the ﬁrst scan session of the 6 week dataset. (b) With respect across the network – averaged across all sample points for each individual and across all participants at the ﬁrst scan session of the 6 week dataset. (b) With respect across the network – averaged across all sample points for each individual and across all participants at the ﬁrst scan session of the 6 week dataset. (b) With respect From Figure 5 (b) it follows that the method in Section VI-A outperforms network deconvolution and the to x and (c) with respect to x – signals ﬂuctuating vibrantly across the brain. (d), (e), and (f) are averaged x , x and x at the last scan session of the 6 week M H L M H to x and (c) with respect to x – signals ﬂuctuating vibrantly across the brain. (d), (e), and (f) are averaged x , x and x at the last scan session of the 6 week M H L M H to x and (c) with respect to x – signals ﬂuctuating vibrantly across the brain. (d), (e), and (f) are averaged x , x and x at the last scan session of the 6 week M H L M H dataset, respectively. Only regions with absolute magnitudes higher than a ﬁxed threshold is colored. dataset, respectively. Only regions with absolute magnitudes higher than a ﬁxed threshold is colored. dataset, respectively.raOnly w mutual regionsinformation with absolute data. magnitudes For instanc higher than e, when a ﬁxed considering threshold is the colored. top 200 edges, the mutual information and the network deconvolution methods recover 36% and 43% of the desired edges, respectively, while the solution of (32) achieves a recovery of 53%. Figure 5 (c) shows the results for a different protein network and similar trends can be appreciated. C. Graph frequency analysis of brain signals during learning Graph frequency analyses have been recently applied to study brain activity signals under the setup of an experiment in which subjects learned a simple motor task [23]. Participants responded to sequentially presented stimuli with their dominant hand. Sequences were presented using a horizontal array of 5 square stimuli with the responses mapped from left to right such that the thumb corresponded to the leftmost stimulus. The next square in the sequence was highlighted immediately following each correct key press; the sequence was paused awaiting the depression of the appropriate key if an incorrect key was pressed. All participants completed the task inside a magnetic resonance imaging (MRI) scanner. Fig. 7. Distribution of decomposed signals for the 3 day experiment. (a), (b), and (c) are x , x and x averaged across all sample points for each subject and across L M H Fig. 7. Distribution of decomposed signals for the 3 day experiment. (a), (b), and (c) are x , x and x averaged across all sample points for each subject and across participants in the 3 day experiment, respectively. Regions with absolute value less than a threshold are not colored. L M H Fig. 7. Distribution of decomposed signals for the 3 day experiment. (a), (b), and (c) are x , x and x averaged across all sample points for each subject and across L M H To construct brain networks, the whole brain is parcellated into a set of N = 112 regions that correspond participants in the 3 day experiment, respectively. Regions with absolute value less than a threshold are not colored. participants in the 3 day experiment, respectively. Regions with absolute value less than a threshold are not colored. to the set V of 112 cortical and subcortical structures speciﬁed in the Harvard-Oxford atlas. For each x and x . At the macro or large timescale, we average the session with different sequence types. The evaluated variance is M H individual functional (f)MRI dataset, the regional mean blood-oxygen-level dependent (BOLD) time series x and x . At the macro or large timescale, we average the session with different sequence types. The evaluated variance is M H x and x . At the macro or large timescale, we average the session with different sequence types. The evaluated variance is decomposed signals M x for H all sample points within each scanning then averaged across all participants of the experiment of interest. is estimated by averaging voxel time series in each of the N regions. Pearson correlations between the decomposed signals x for all sample points within each scanning then averaged across all participants of the experiment of interest. decomposed signals x for all sample points within each scanning then averaged across all participants of the experiment of interest. session with different sequence type, L and evaluate the variance Figure 8 displays the variance of the decomposed signals session with different sequence type, and evaluate the variance Figure 8 displays the variance of the decomposed signals of the magnitudes session of the with averaged different signals sequence acrosstype, all the and scanning evaluate the variance Figure 8 displays the variance of the decomposed signals x , x and x at two different temporal scales of the two L M H of the magnitudes of the averaged signals across all the scanning x , x and x at two different temporal scales of the two L M H sessions and sequence of the magnitudes types [40], [41]. of theFor avthe eraged 6 week signals experiment, across all the scanning x , x and x at two different temporal scales of the two experiments. For the 6 week dataset, 3 session-sequence com- L M H sessions and sequence types [40], [41]. For the 6 week experiment, experiments. For the 6 week dataset, 3 session-sequence com- there are 4 scanning sessionssessions and sequence and 3 dif types ferent [40], sequence [41]. Fortypes, the 6so weekbinations, experiment, with enumber xperiments. proportional For theto6 the week level dataset, of exposure 3 session-sequence of com- there are 4 scanning sessions and 3 different sequence types, so binations, with number proportional to the level of exposure of the variance is with respect to 12 points. For the 3 day experiment, there are 4 scanning sessions and 3 different sequence participants types, soto the binations, sequence with (1-MIN number refers proportional to MIN sequence to the levatel of exposure of the variance is with respect to 12 points. For the 3 day experiment, participants to the sequence (1-MIN refers to MIN sequence at there are 3 scanning sessions and only 1 sequence type, and the variance is with respect to 12 points. For the 3 daysession experiment, 1, 5 denotes participants MIN sequence to the sequence at session(14, -MIN 9 entails refersEXT to MIN sequence at there are 3 scanning sessions and only 1 sequence type, and session 1, 5 denotes MIN sequence at session 4, 9 entails EXT therefore the vthere arianceare is for 3 scanning 3 points. As sessions for theand micro only or minute- 1 sequence sequence type, and at session 3) are selected out of the 12 combinations in session 1, 5 denotes MIN sequence at session 4, 9 entails EXT therefore the variance is for 3 points. As for the micro or minute- sequence at session 3) are selected out of the 12 combinations in scale, we average the decomposed signals x for all sample points therefore the variance is for 3 points. As for the micro total or minute- for a cleaner illustration, but all the other session-sequence L sequence at session 3) are selected out of the 12 combinations in scale, we average the decomposed signals x for all sample points total for a cleaner illustration, but all the other session-sequence within each minute, and evaluate the variance of the magnitudes of L scale, we average the decomposed signals x for all sample combinations points exhibit similar properties. Following the deﬁnition total for a cleaner illustration, but all the other session-sequence within each minute, and evaluate the variance of the magnitudes of combinations exhibit similar properties. Following the deﬁnition the averaged signals across all minute windows for each scanning of frequency decomposition as in (14), it is expected for the low within each minute, and evaluate the variance of the magnitudes of combinations exhibit similar properties. Following the deﬁnition the averaged signals across all minute windows for each scanning of frequency decomposition as in (14), it is expected for the low the averaged signals across all minute windows for each scanning of frequency decomposition as in (14), it is expected for the low 41 activities of all possible pairs of regions are then evaluated and tested (at 5% signiﬁcance level) to construct NN functional connectivity matrices W. The graph-shift operator is deﬁned as the associated Laplacian S := L = VV . Regarding brain signals, we normalize the regional mean BOLD observations x at any time t and consider x := x ^ =kx ^ k , such that the total energy of activities at all structures is consistent t t t 2 at different t to avoid extreme spikes due to head motion or drift artifacts in fMRI; see [23] for details. Signal x is not highly bandlimited in S, however, recall from Section IV-A, when the graph-shift operator S = L, the eigenvalue associated with a given eigenvector v expresses a level of spatial k k variation with respect to the brain network. Following this direction, we analyze the decomposed signals of x associated with different levels of spatial variation. Figure 6 (a) presents the distribution of the (L) decomposed signal x := x ~ v corresponding to smooth spatial variations. Figure 6 (b) displays k k k=1 (M) the decomposed signals x := x ~ v associated with moderate spatial variation; Figure 6 (c) k k k=41 (H) represents x := x ~ v corresponding to the fast spatial variation. k k k=73 A deep analysis yields several interesting observations. First, decomposed signals of a speciﬁc level (L) of variation, e.g. x , are highly similar with respect to different sets of participants [23]. This reﬂects the fact that frequency decomposition is formed by applying graph ﬁlters with different pass bands upon signals and therefore should express some consistent aspects of brain signals. Second, because of the signal (L) (M) (H) normalization at every sample point and for all subjects, x ; x and x would be similarly distributed across the brain if bandpass graph ﬁltering segments brain signals into three equivalent pieces. However, it (L) is observed (see Figure 6) that many brain regions possess magnitudes higher than a threshold in x and (H) (M) x , while not many brain regions exceed the thresholding with respect to x . Besides, brain regions (L) (H) with high magnitude values in x and x are highly alike to the visual and sensorimotor cortices, whose associations with motor learning task have been well recognized; see [23] and references therein. It has long been understood that the brain is a complex system combining some degree of disorganized behavior with some degree of regularity and that the complexity of a system is high when order and (L) disorder coexist [62]. The low-pass signal x varies smoothly across the brain network and therefore can (H) be regarded as regularity (order), whereas x ﬂuctuates vibrantly and consequently can be considered as randomness (disorder). This observation can be leveraged in designing preprocessing steps to extract brain signals that are more informative and pertinent with learning, and to utilize the GFT to further analyze the association between different level of spatial variability with learning success. D. Tracking the propagation of information cascades Here we test the dynamic-SEM estimator (50) for unveiling sparse time-varying topologies, given real information cascade data obtained by monitoring blog posts and news articles on the web between March 2011 and February 2012 (45 weeks). Popular textual phrases (a.k.a. memes) due to globally-popular topics (c) during this period were identiﬁed and the times x when they were mentioned on the websites were it (c) recorded. In order to illustrate tracking of dynamic propagation graphs, we extracted cascade traces x related to the keyword “Kim Jong-un,” the current leader of North Korea whose popularity rose after the death of his father (and predecessor in power) Kim Jong-il. Only signiﬁcant cascades that propagated to 42 Kim Jong−un becomes ruler of N. Korea 5000 Death of Kim Jong−il Kim Jong−un appointed as vice chairman of military commission 0 5 10 15 20 25 30 35 40 45 time (weeks) (a) (b) (c) Fig. 7. Visualization of the estimated networks obtained by tracking information cascades related to the topic “Kim Jong-un” at times (a) t = 10 weeks and (b) t = 40 weeks. The total number of inferred edges per week is shown in (c). The abrupt increase in edge density can be explained by three key events: i) Kim Jong-un was appointed as the vice chairman of the North Korean military commission (t = 28); ii) Kim Jong-il died (t = 38); and iii) Kim Jong-un became the ruler of North Korea (t = 40) [1]. at least 7 websites were retained. This resulted in a dataset with N = 360 websites, C = 466 cascades, and T = 45 weeks. The exogenous inputs typically capture prior knowledge about susceptibility of nodes (c) to contagions. In the web context dealt with here, u could be aptly set to the average search engine ranking of website i on keywords pertaining to c. In the absence of such real data for the observation (c) interval, the signal values u were uniformly sampled over the interval [0; 0:01]; see [1]. The algorithm in [1] was run on the dataset and Figures 7 (a) and (b) show visualizations of the inferred network at t = 10 and t = 40 weeks. Speculation about the possible successor of the dying North Korean ruler, Kim Jong-il, rose until his death on December 17, 2011 (week 38). He was succeeded by Kim Jong-un on December 30, 2011 (week 40). The visualizations show an increasing number of edges over the 45 weeks, illustrating the growing interest of international news websites and blogs in the new ruler, about whom little was known in the ﬁrst 10 weeks. Unfortunately, the observation horizon does not go beyond T = 45 weeks. A longer span of data would have been useful to investigate the rate at which global news coverage on the topic eventually subsided. Figure 7 (c) depicts the time evolution of the total number of edges in the inferred dynamic network. Of particular interest are the weeks during which: i) Kim Jong-un was appointed as the vice chairman of the North Korean military commission; ii) Kim Jong-il died; and iii) Kim Jong-un became the ruler of North Korea. These events were the topics of many online news articles and political blogs, an observation that is reinforced by the experimental results shown in the plot. X. C ONCLUDING REM ARKS AND RESEARCH OUTLOOK Contending that GSP provides novel insights and relevant tools to address network topology inference problems, this paper outlines recent approaches that use information available from graph signals to learn the underlying network structure in a variety of settings. Aligned with current trends in data-driven total number of edges 43 scientiﬁc inquiry into complex networks, the overarching aim is to shift from: (i) descriptive accounts to inferential GSP techniques that can explain as well as predict network behavior; and from (ii) ad hoc graph constructions to rigorous formulations rooted in well-deﬁned models and principles. Accordingly, this tutorial stretches in a comprehensive and unifying manner all the way from (nowadays rather mature) statistical approaches including correlation analyses and graphical model selection, to recent GSP advances facilitated by spectral representations of network diffusion processes. A diverse gamut of network inference challenges and application domains was selectively covered, based on importance and relevance to SP expertise, as well as on our own experience and contributions to the area. Admittedly, some important topics have been overlooked including tomographic network topology identiﬁcation [29, Ch. 7.4], and inference of directed acyclic graphs (a particular favorable class of directed graphical models also known as Bayes networks) [7]. A wide variety of potential research avenues naturally follow from the developments here presented. In terms of formal performance guarantees, the GSP-based methods in Sections V and VI are less understood than their statistical counterparts (Section III), posing a clear opportunity for improvement. In particular, one might investigate if smoothness alone is sufﬁcient to provide topology recovery guarantees, or if there is a fundamental requirement for edge sparsity that cannot be forgone. In practice, it sometimes holds that signals are discrete (such as pre-speciﬁed rating levels) or belong to a ﬁnite alphabet (such as node labels or classes). However, diffusion-based techniques for these types of signals have not been explored in sufﬁcient depth. Moreover, graph topology inference is oftentimes an intermediate step in a larger processing or learning task. In this direction, one can think of bi-level topology inference formulations where the graph is designed explicitly taking into account the ultimate task, e.g., searching for a graph that induces a classiﬁer that is maximally discriminative for some training data. In addition, in line with the diffusion-based methods in Section VI, it would be interesting to explore innovative generative models of nonlinear interactions for network data such as those given by median or other nonlinear graph ﬁlters. In terms of computational complexity, there is room for improving scalability of some of the algorithms described via parallelization and decentralized implementations. Moreover, adaptive algorithms that can track the (possibly) time-varying structure of the network, and achieve both memory and computational savings by processing the signals on-the-ﬂy are naturally desirable, but so far largely unexplored. Lastly, one can explore the links between network deconvolution – as described in Section IX-B – and graph sparsiﬁcation approaches. The latter consists on approximating a given graph via a sparser one while preserving the associated Laplacian-based total-variation measure. From a GSP perspective, this implies approximately preserving the smoothness of signals supported on those graphs. Clearly, this approximation notion is not too different from network deconvolution, where the premise is that the sparse graph approximate should preserve the eigenbasis (hence the GFT) of the original network. Formalizing this intuition could enable further cross-pollination between established graph-theoretical problems and the exciting family of GSP approaches for network topology inference. 44 REFERENCES [1] B. Baingana, G. Mateos, and G. B. Giannakis, “Proximal-gradient algorithms for tracking cascades over social networks,” IEEE J. Sel. Topics Signal Process., vol. 8, no. 4, pp. 563–575, Aug. 2014. [2] O. Banerjee, L. E. Ghaoui, and A. d’Aspremont, “Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data,” J. Mach. Learn. Res., vol. 9, pp. 485–516, 2008. [3] A. Bolstad, B. D. V. Veen, and R. Nowak, “Causal network inference via group sparse regularization,” IEEE Trans. Signal Process., vol. 59, no. 6, pp. 2628–2641, Jun. 2011. [4] X. Cai, J. A. Bazerque, and G. B. Giannakis, “Sparse structural equation modeling for inference of gene regulatory networks exploiting genetic perturbations,” PLoS, Computational Biology, Jun. 2013. [5] S. P. Chepuri, S. Liu, G. Leus, and A. O. Hero, “Learning sparse graphs under smoothness prior,” in Proc. Int. Conf. Acoustics, Speech, Signal Process., Mar. 2017, pp. 6508–6512. [6] G. Cheung, E. Magli, Y. Tanaka, and M. K. Ng, “Graph spectral image processing,” Proc. IEEE, vol. 106, no. 5, pp. 907–930, May 2018. [7] D. M. Chickering, “Optimal structure identiﬁcation with greedy search,” J. Mach. Learn. Res., vol. 3, pp. 507–554, Mar. [8] A. P. Dempster, “Covariance selection,” Biometrics, vol. 28, no. 1, pp. 157–175, 1972. [9] X. Dong, D. Thanou, P. Frossard, and P. Vandergheynst, “Learning Laplacian matrix in smooth graph signal representations,” IEEE Trans. Signal Process., vol. 64, no. 23, pp. 6160–6173, Aug. 2016. [10] B. Efron and T. Hastie, Computer Age Statistical Inference: Algorithms, Evidence, and Data Science. New York, NY: Cambridge University Press, 2016. [11] H. E. Egilmez, E. Pavez, and A. Ortega, “Graph learning from data under Laplacian and structural constraints,” IEEE J. Sel. Topics Signal Process., vol. 11, no. 6, pp. 825–841, Sep. 2017. [12] ——, “Graph learning from ﬁltered signals: Graph system and diffusion kernel identiﬁcation,” IEEE Trans. Signal Inf. Process. Netw., pp. 1–1, Sep. 2018. [13] S. Feizi, D. Marbach, M. Medard, and M. Kellis, “Network deconvolution as a general method to distinguish direct dependencies in networks,” Nat Biotech, vol. 31, no. 8, pp. 726–733, 2013. [14] J. Friedman, T. Hastie, and R. Tibshirani, “Sparse inverse covariance estimation with the graphical lasso,” Biostatistics, vol. 9, no. 3, pp. 432–441, 2008. [15] G. B. Giannakis, Y. Shen, and G. V. Karanikolas, “Topology identiﬁcation and learning over graphs: Accounting for nonlinearities and dynamics,” Proc. IEEE, vol. 106, no. 5, pp. 787–807, May 2018. [16] B. Girault, P. Gonc ¸alves, and E. Fleury, “Translation on graphs: An isometric shift operator,” IEEE Signal Process. Lett., vol. 22, no. 12, pp. 2416–2420, Dec 2015. [17] B. Girault, “Stationary graph signals using an isometric graph translation,” in Proc. of European Signal Process. Conf., Nice, France, Aug. 31-Sep. 4, 2015, pp. 1516–1520. [18] C. W. J. Granger, “Investigating causal relations by econometric models and cross-spectral methods,” Econometrica, vol. 37, no. 3, pp. 424–438, 1969. [19] E. C. Hall, G. Raskuttiy, and R. M. Willett, “Inference of high-dimensional autoregressive generalized linear models,” IEEE Trans. Inf. Theory, 2017 (see also arXiv:1605.02693 [stat.ML]). [20] D. Hallac, Y. Park, S. Boyd, and J. Leskovec, “Network inference via the time-varying graphical lasso,” in Proc. ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, 2017, pp. 205–213. [21] S. Hassan-Moghaddam, N. K. Dhingra, and M. R. Jovanovic, ´ “Topology identiﬁcation of undirected consensus networks via sparse inverse covariance estimation,” in 2016 IEEE 55th Conference on Decision and Control (CDC), Dec. 2016, pp. 4624–4629. [22] C. Hu, X. Hua, J. Ying, P. M. Thompson, G. E. Fakhri, and Q. Li, “Localizing sources of brain disease progression with network diffusion model,” IEEE J. Sel. Topics Signal Process., vol. 10, no. 7, pp. 1214–1225, Oct. 2016. [23] W. Huang, L. Goldsberry, N. F. Wymbs, S. T. Grafton, D. S. Bassett, and A. Ribeiro, “Graph frequency analysis of brain signals,” IEEE J. Sel. Topics Signal Process., vol. 10, no. 7, pp. 1189–1203, Oct. 2016. 45 [24] W. Huang, A. G. Marques, and A. R. Ribeiro, “Rating prediction via graph signal processing,” IEEE Trans. Signal Process., vol. 66, no. 19, pp. 5066–5081, Oct 2018. [25] V. Kalofolias, “How to learn a graph from smooth signals,” in Intl. Conf. Artif. Intel. Stat. (AISTATS). J Mach. Learn. Res., 2016, pp. 920–929. [26] V. Kalofolias, A. Loukas, D. Thanou, and P. Frossard, “Learning time varying graphs,” in Proc. Int. Conf. Acoustics, Speech, Signal Process., March 2017, pp. 2826–2830. [27] D. Kaplan, Structural Equation Modeling: Foundations and Extensions, 2nd ed. Thousand Oaks, CA: Sage Publications, [28] G. V. Karanikolas, G. B. Giannakis, K. Slavakis, and R. M. Leahy, “Multi-kernel based nonlinear models for connectivity identiﬁcation of brain networks,” in Proc. Int. Conf. Acoustics, Speech, Signal Process., March 2016, pp. 6315–6319. [29] E. D. Kolaczyk, Statistical Analysis of Network Data: Methods and Models. New York, NY: Springer, 2009. [30] B. M. Lake and J. B. Tenenbaum, “Discovering structure by learning sparse graphs,” in Annual Cognitive Sc. Conf., 2010, pp. 778 – 783. [31] Z.-Q. Luo, W.-K. Ma, A. M.-C. So, Y. Ye, and S. Zhang, “Semideﬁnite relaxation of quadratic optimization problems,” IEEE Signal Processing Magazine, vol. 27, no. 3, pp. 20–34, 2010. [32] H. Lutkepohl, New Introduction to Multiple Time Series Analysis. New York, NY: Springer, 2005. [33] A. G. Marques, S. Segarra, G. Leus, and A. Ribeiro, “Sampling of graph signals with successive local aggregations,” IEEE Trans. Signal Process., vol. 64, no. 7, pp. 1832–1843, Apr. 2016. [34] ——, “Stationary graph processes and spectral estimation,” IEEE Trans. Signal Process., vol. 65, no. 22, pp. 5911–5926, Nov. 2017. [35] J. Mei and J. M. F. Moura, “Signal processing on graphs: Causal modeling of unstructured data,” IEEE Trans. Signal Process., vol. 65, no. 8, pp. 2077–2092, Apr. 2017. [36] N. Meinshausen and P. Buhlmann, “High-dimensional graphs and variable selection with the lasso,” Ann. Stat., vol. 34, pp. 1436–1462, 2006. [37] M. Menoret, ´ N. Farrugia, B. Pasdeloup, and V. Gripon, “Evaluating graph signal processing for neuroimaging through classiﬁcation and dimensionality reduction,” in 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP), Nov. 2017, pp. 618–622. [38] A. Ortega, P. Frossard, J. Kovace ˇ vic, ´ J. M. F. Moura, and P. Vandergheynst, “Graph signal processing: Overview, challenges and applications,” Proc. IEEE, vol. 106, no. 5, pp. 808–828, Apr. 2018. [39] J. Ortega, Numerical Analysis: A Second Course, ser. Classics in Applied Mathematics. Society for Industrial and Applied Mathematics, 1990. [40] B. Pasdeloup, V. Gripon, G. Mercier, D. Pastor, and M. G. Rabbat, “Characterization and inference of graph diffusion processes from observations of stationary signals,” IEEE Trans. Signal Inf. Process. Netw., vol. PP, no. 99, Sep. 2017. [41] E. Pavez, H. E. Egilmez, and A. Ortega, “Learning graphs with monotone topology properties and multiple connected components,” IEEE Trans. Signal Process., vol. 66, no. 9, pp. 2399–2413, May 2018. [42] N. Perraudin and P. Vandergheynst, “Stationary signal processing on graphs,” IEEE Trans. Signal Process., vol. 65, no. 13, pp. 3462–3477, Jul. 2017. [43] M. G. Rabbat, “Inferring sparse graphs from smooth signals with theoretical guarantees,” in Proc. Int. Conf. Acoustics, Speech, Signal Process., Mar. 2017, pp. 6533–6537. [44] P. Ravikumar, M. J. Wainwright, and J. D. Lafferty, “High-dimensional Ising model selection using ` -regularized logistic regression,” Ann. Statist., vol. 38, no. 3, pp. 1287–1319, Jun. 2010. [45] P. Ravikumar, M. J. Wainwright, G. Raskutti, and B. Yu, “High-dimensional covariance estimation by minimizing ` - penalized log-determinant divergence,” Electron. J. Statist., vol. 5, pp. 935–980, 2011. [46] M. G. Rodriguez, J. Leskovec, and B. Scholkopf, “Structure and dynamics of information pathways in online media,” in Proc. of 6th ACM Intern. Conf. on Web Search and Data Mining, Rome, Italy, Dec. 2010, pp. 23–32. [47] L. Rui, H. Nejati, S. H. Safavi, and N. Cheung, “Simultaneous low-rank component and graph estimation for high- dimensional graph signals: Application to brain imaging,” in Proc. Int. Conf. Acoustics, Speech, Signal Process., Mar. 2017, pp. 4134–4138. 46 [48] A. Sandryhaila and J. M. F. Moura, “Discrete signal processing on graphs,” IEEE Trans. Signal Process., vol. 61, no. 7, pp. 1644–1656, Apr. 2013. [49] ——, “Discrete signal processing on graphs: Frequency analysis,” IEEE Trans. Signal Process., vol. 62, no. 12, pp. 3042– 3054, Jun. 2014. [50] S. Sardellitti, S. Barbarossa, and P. D. Lorenzo, “Graph topology inference based on transform learning,” in Proc. IEEE Global Conf. on Signal and Information Process., Dec. 2016, pp. 356–360. [51] S. Segarra, A. G. Marques, S. Rey-Escudero, and M. Goyal, “Network topology inference from input-output diffusion pairs,” in Proc. IEEE Statistical Signal Process. Workshop, Freiburg, Germany, June 10-13, 2018. [52] S. Segarra, A. G. Marques, and A. Ribeiro, “Optimal graph-ﬁlter design and applications to distributed linear network operators,” IEEE Trans. Signal Process., vol. 65, no. 15, pp. 4117–4131, Aug 2017. [53] S. Segarra, A. Marques, G. Mateos, and A. Ribeiro, “Network topology inference from spectral templates,” IEEE Trans. Signal Inf. Process. Netw., vol. 3, no. 3, pp. 467–483, Aug. 2017. [54] S. Segarra, Y. Wang, C. Uhler, and A. G. Marques, “Joint inference of networks from stationary graph signals,” in Proc. Asilomar Conf. on Signals, Systems, Computers, 2017, pp. 975–979. [55] R. Shaﬁpour, S. Segarra, A. G. Marques, and G. Mateos, “Topology inference of directed networks via graph ﬁlter identiﬁcation,” in Proc. IEEE Data Science Workshop, Lausanne, Switzerland, June 4-6, 2018. [56] R. Shaﬁpour, S. Segarra, A. Marques, and G. Mateos, “Identifying the topology of undirected networks from diffused non-stationary graph signals,” IEEE Trans. Signal Process., 2018 (see also arXiv:1801.03862 [eess.SP]). [57] Y. Shen, B. Baingana, and G. B. Giannakis, “Kernel-based structural equation models for topology identiﬁcation of directed networks,” IEEE Trans. Signal Process., vol. 65, no. 10, pp. 2503–2516, Feb. 2017. [58] ——, “Tensor decompositions for identifying directed graph topologies and tracking dynamic networks,” IEEE Trans. Signal Process., vol. 65, no. 14, pp. 3675–3687, Jul. 2017. [59] D. I. Shuman, B. Ricaud, and P. Vandergheynst, “Vertex-frequency analysis on graphs,” Appl. Comput. Harmonic Anal., vol. 40, no. 2, p. 260291, Mar 2016. [60] D. Shuman, S. Narang, P. Frossard, A. Ortega, and P. Vandergheynst, “The emerging ﬁeld of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains,” IEEE Signal Process. Mag., vol. 30, no. 3, pp. 83–98, May 2013. [61] M. Slawski and M. Hein, “Estimation of positive deﬁnite M-matrices and structure learning for attractive Gaussian Markov Random ﬁelds,” Linear Algebra Appl., vol. 473, pp. 145–179, May 2015. [62] O. Sporns, Networks of the Brain. Cambridge, MA: MIT press, 2011. [63] D. Thanou, X. Dong, D. Kressner, and P. Frossard, “Learning heat diffusion graphs,” IEEE Trans. Signal Inf. Process. Netw., vol. 3, no. 3, pp. 484–499, Sep. 2017. [64] M. Yuan and Y. Lin, “Model selection and estimation in the Gaussian graphical model,” Biometrika, vol. 94, no. 1, pp. 19–35, 2007.

http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png

Electrical Engineering and Systems Science arXiv (Cornell University)

http://www.deepdyve.com/lp/arxiv-cornell-university/connecting-the-dots-identifying-network-structure-via-graph-signal-14q1FK6jw0

Connecting the Dots: Identifying Network Structure via Graph Signal Processing

Loading next page...

References

References for this paper are not available at this time. We will be adding them shortly, thank you for your patience.

ISSN: 1053-5888
eISSN: ARCH-3348
DOI: 10.1109/MSP.2018.2890143
Publisher site: See Article on Publisher Site

Abstract

Journal

Electrical Engineering and Systems Science – arXiv (Cornell University)

Published: Oct 31, 2018

Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Connecting the Dots: Identifying Network Structure via Graph Signal Processing

Connecting the Dots: Identifying Network Structure via Graph Signal Processing

Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Connecting the Dots: Identifying Network Structure via Graph Signal Processing

Connecting the Dots: Identifying Network Structure via Graph Signal Processing

References

Abstract

Journal

Recommended Articles

There are no references for this article.

Our policy towards the use of cookies