Access the full text.

Sign up today, get DeepDyve free for 14 days.

Risks
, Volume 8 (3) – Jun 29, 2020

/lp/multidisciplinary-digital-publishing-institute/neural-networks-and-betting-strategies-for-tennis-gbY6ng0sau

- Publisher
- Multidisciplinary Digital Publishing Institute
- Copyright
- © 1996-2020 MDPI (Basel, Switzerland) unless otherwise stated Disclaimer The statements, opinions and data contained in the journals are solely those of the individual authors and contributors and not of the publisher and the editor(s). Terms and Conditions Privacy Policy
- ISSN
- 2227-9091
- DOI
- 10.3390/risks8030068
- Publisher site
- See Article on Publisher Site

risks Article 1, ,† 2,† Vincenzo Candila * and Lucio Palazzo MEMOTEF Department, Sapienza University of Rome, 00185 Rome, Italy Department of Political Sciences, University of Naples Federico II, 80136 Naples, Italy; lucio.palazzo@unina.it * Correspondence: vincenzo.candila@uniroma1.it † These authors contributed equally to this work. Received: 1 June 2020; Accepted: 22 June 2020; Published: 29 June 2020 Abstract: Recently, the interest of the academic literature on sports statistics has increased enormously. In such a framework, two of the most signiﬁcant challenges are developing a model able to beat the existing approaches and, within a betting market framework, guarantee superior returns than the set of competing speciﬁcations considered. This contribution attempts to achieve both these results, in the context of male tennis. In tennis, several approaches to predict the winner are available, among which the regression-based, point-based and paired comparison of the competitors’ abilities play a signiﬁcant role. Contrary to the existing approaches, this contribution employs artiﬁcial neural networks (ANNs) to forecast the probability of winning in tennis matches, starting from all the variables used in a large selection of the previous methods. From an out-of-sample perspective, the implemented ANN model outperforms four out of ﬁve competing models, independently of the considered period. For what concerns the betting perspective, we propose four different strategies. The resulting returns on investment obtained from the ANN appear to be more broad and robust than those obtained from the best competing model, irrespective of the betting strategy adopted. Keywords: forecasting; artiﬁcial neural networks; betting; tennis 1. Introduction In sports statistics, two of the most signiﬁcant challenges are developing a forecasting model able to robustly beat the existing approaches and, within a betting market framework, guarantee returns superior to the competing speciﬁcations. This contribution attempts to achieve both these results, in the context of male tennis. So far, the approaches to forecasting a winning player in tennis can be divided into three main categories: Regression-based approach, point-based procedure, and comparison of the latent abilities of players. A comprehensive review of these methods with a related comparison is provided by Kovalchik (2016). Contributions belonging to the regression approach usually use probit or logit regressions, as the papers of Lisi and Zanella (2017), Del Corral and Prieto-Rodríguez (2010) and Klaassen and Magnus (2003), Clarke and Dyte (2000) and Boulier and Stekler (1999), among others. In point-based models the interest is in the prediction of winning a single point, as in Knottenbelt et al. (2012), Barnett et al. (2006) and Barnett and Clarke (2005). Approaches relying on the comparison of players’ abilities have been pioneered by the work of McHale and Morton (2011), who make use of the Bradley-Terry (BT)-type model. All these forecasting models are difﬁcult to compare in terms of global results because of the different periods, matches or evaluation criteria involved. Synthesizing only partly the high number of contributions, the model of Del Corral and Prieto-Rodríguez (2010) has a Brier Score (Brier 1950), which is the equivalent of Mean-Squared-Error for binary outcomes, of 17.5% for the Australian Open 2009 while that of Lisi and Zanella (2017) is of 16.5% for the four Grand Slam Championships played in 2013. Knottenbelt et al. (2012) declare a Return–On–Investment (ROI) of 3.8% Risks 2020, 8, 68; doi:10.3390/risks8030068 www.mdpi.com/journal/risks Risks 2020, 8, 68 2 of 19 for 2713 male matches played in 2011 and the work of McHale and Morton (2011) leads to a ROI of 20% in 2006. Despite these promising results, building a comprehensive (and possibly adaptive to the last recent results) forecasting model in tennis is complicated by a large number of variables that may inﬂuence the outcome of the match. A potential solution to this problem is provided by O’Donoghue (2008), which suggests to use the principal component analysis to reduce the number of key variables inﬂuencing tennis matches. Another unexplored possibility in this framework is taking advantage of all the variables at hand by machine learning algorithms to map all the relationships among these variables and the matches’ outcomes. Therefore, this paper introduces the supervised, feed-forward Artiﬁcial Neural Networks (ANNs) (reviewed in Suykens et al. (1996), Paliwal and Kumar (2009), Haykin (2009), and Zhang et al. (1998), among others) trained by backpropagation, in order to forecast the probability of winning in tennis matches. The ANNs can be seen as ﬂexible regression models with the advantage of handling a large number of variables (Liestbl et al. 1994) efﬁciently. Moreover, when the ANNs are used, the non–linear relationships between the output of interest, that is the probability of winning, and all the possible inﬂuential variables are taken into account. Under this aspect, our ANN model beneﬁts of a vast number of input variables, some deriving from a selection of the existing approaches and some others properly created to deal with particular aspects of tennis matches uncovered by the actual literature. In particular, we consider the following forecasting models, both in terms of input variables and competing models: The logit regression of Lisi and Zanella (2017), labelled as “LZR”; the logit regression of Klaassen and Magnus (2003), labelled as “KMR”; the probit regression of Del Corral and Prieto-Rodríguez (2010), labelled as “DCPR”; the BT-type model of McHale and Morton (2011), labelled as “BTM”; the point-based approach of Barnett and Clarke (2005), labelled as “BCA”. Overall, our set of variables consists of more than thirty variables for each player. The contribution of our work is twofold: (i) For the ﬁrst time the ANNs are employed in tennis literature ; (ii) four betting strategies for the favourite and the underdog player are proposed. Through these betting strategies, we test if and how much the estimated probabilities of winning of the proposed approach are economically proﬁtable with respect to the best approach among those considered. Furthermore, the proposed betting strategies constitute a help in the tough task of decision making on which matches to bet on. The ANNs have been recently employed in many different and heterogeneous frameworks: Wind (Cao et al. 2012) and pollution (Zainuddin and Pauline 2011) data, hydrological time series (Jain and Kumar 2007), tourism data (Atsalakis et al. 2018; Palmer et al. 2006), ﬁnancial data for pricing the European options (Liu et al. 2019) or to forecast the exchange rate movements (Allen et al. 2016), betting data to promote the responsible gambling (Hassanniakalager and Newall 2019), and in many other ﬁelds. Moreover, the use of artiﬁcial intelligence for predicting issues related to sports or directly sports outcomes is increasing, proving that neural network modeling can be a useful approach to handle very complex problems. For instance, Nikolopoulos et al. (2007) investigate the performances of ANNs with respect to traditional regression models in forecasting the shares of television programs showing sports matches. Maszczyk et al. (2014) investigate the performance of the ANNs with respect to that of the regression models in the context of javelin throwers. Silva et al. (2007) study the 200 m individual medley and 400 m front crawl events through ANNs to predict the competitive performance in swimming, while Maier et al. (2000) develop a neural network model to predict the distance reached by javelins. The work of Condon et al. (1999) predicts a country’s success at the Olympic Games, comparing the performances of the proposed ANN with those obtained from the linear regression models. In the context of team sports, Sahin ¸ and Erol (2017), Hucaljuk and Rakipovic ´ (2011), and McCullagh et al. (2010) for football and Loeffelholz et al. (2009) for basketball attempt to predict To the best of our knowledge, only other two contributions focus on tennis: Sipko and Knottenbelt (2015) and Somboonphokkaphan et al. (2009). Nevertheless, the former contribution is a master ’s thesis, and the latter is a conference proceeding. Risks 2020, 8, 68 3 of 19 the outcome matches. Generally, all the previously cited works employing the ANNs have better performances than the traditional, parametric approaches. From a statistical viewpoint, the proposed conﬁguration of the ANN outperforms four out of ﬁve competing approaches, independently of the period considered. The best competitor is represented by the LZR model, which is at least as good as the proposed ANN. Economically, the ROIs of the ANN with those of the LRZ are largely investigated according to the four betting strategies proposed. In this respect, the ANN model robustly yields higher, sometimes much higher, ROIs than those of the LZR. The rest of article is structured as follows. Section 2 illustrates the notation and some deﬁnitions we adopt. Section 3 details the design of the ANN used. Section 4 is devoted to the empirical application. Section 5 presents the betting strategies and the results of their application while Section 6 concludes. 2. Notation and Deﬁnitions Let Y = 1 be the event that a player i wins a match j defeating the opponent. Naturally, if player i,j i has been defeated in the match j, then Y = 0. The aim of this paper is to forecast the probability i,j of winning of player i for the match j, that is p . Being p a probability, the probability for the other i,j i,j player will be obtained as complement to one. Let us deﬁne two types of information sets: Deﬁnition 1. The information set including all the information related to the match j when the match is over is deﬁned as F . Deﬁnition 2. The information set including all the information related to the match j before the begin of the match is deﬁned as F . jjj1 It is important to underline that when Deﬁnition 2 holds, the outcome of the match is unknown. The aim of forecasting p takes advantage of a number of variables inﬂuencing the outcome of the i,j match. Let X = X , , X be the N–dimensional vector of variables (potentially) inﬂuencing j 1,i,j N,i,j the match j, according to F or F . Note that X may include information related to each or both j j jjj1 players, but, for ease of notation, we intentionally drop out the sufﬁx i for X . Moreover, X can include j j both quantitative and qualitative variables, like for instance the surface of the match or the handedness of the players. In this latter case, the variables under consideration will be expressed by a dummy. Deﬁnition 3. A generic nth variable X 2 X is deﬁned as “structural” if and only if the following expression n,i,j j holds, 8j: n o X jF = X jF . n,i,j j n,i,j jjj1 By Deﬁnition 3 we focus on variables whose information is known and invariant both before the match and after its conclusion. Therefore, player characteristics (such as height, weight, ranks, and so forth), and tournament speciﬁcations (like the level of the match, the surface, the country where the match is played) are invariant toF andF . Hence, these types of variables are deﬁned as structural jjj1 ones. Instead, information concerning end-of-match statistics (such as the number of aces, the number of points won on serve, on return, and so forth) is unknown for the match j if the information setF jjj1 is used. Let o and o be the published odds for the match j and players i and ii, with i 6= ii, respectively. i,j ii,j The odds o and o denote the amount received by a bettor after an investment of one dollar, for i,j ii,j instance, in case of a victory of player i or ii, respectively. Throughout all the paper, we deﬁne the two players of a match j as favourite and underdog, synthetically denoted as “ f ” and “u”, according to the following deﬁnition: Deﬁnition 4. A player i in the match j becomes the favourite of that match if a given quantitative variable included in X is smaller than the value observed for the opponent ii, with i 6= ii. j ··· ··· ··· Risks 2020, 8, 68 4 of 19 Deﬁnition 4 is left intentionally general to allow different favourite identiﬁcation among the competing models. For instance, one may argue that a favourite is the player i that for the match j has the smallest odd, that is o < o . Otherwise, one may claim that the favourite is the player i,j ii,j with the highest rank. It is important to underline that Deﬁnition 4 does not allow to have players unequivocally deﬁned as favourite or underdog. 3. Design of the Artiﬁcial Neural Network The general structure of the ANN used in this work belongs to the Multilayer Perceptrons class. In particular, the topology of the ANN model we implement, illustrated in Figure 1, consists of an input, a hidden and an output layer. Nodes belonging to the input layer are a large selection of variables (potentially) inﬂuencing the outcomes while the output layer consists of only one neuron with a response of zero, representing the event “player i has lost the match”, and one, representing the event “player i has won the match”. According to Hornik (1991), we use only one single hidden layer. This architecture gives good forecasting performances to the model, when the number of nodes included in the hidden layer is sufﬁciently adequate. Output Layer N-1 Hidden Layer Input Layer Figure 1. Artiﬁcial neural networks (ANN) structure. Note: The ﬁgure shows the ANN structure with N input nodes, a number of nodes belonging to the hidden layer and the output node. Risks 2020, 8, 68 5 of 19 More formally, the ANN structure adopted to forecast the probability of winning of player i in the match j, that is p , taking advantage of the set of variables included in X operates similarly to i,j j a non–linear regression. To simplify the notation, from now on we will always refer to the favourite player (according to Deﬁnition 4), such that the sufﬁx identifying player i will disappear, except when otherwise requested. A comprehensive set of notations used in this work is summarized in Table A1. Therefore, let X 2 X be the nth variable in the match j, potentially inﬂuencing the outcome of that n,j j match. All the variables in X , with j = 1, , J, feed the N–dimensional input nodes. Moreover, let s() be the transfer or activation function, which in this work is the sigmoid logistic. Therefore, the ANN model with N inputs, one hidden layer having N < N nodes and an output layer Y is deﬁned as follows: Y = w s v X + b , j = 1, . . . , J, (1) j å j,r å n,j,r n,j r r=1 n=1 where w represents the weight of the rth hidden neuron, v is the weight associated to the nth j,r n,j,r variable, for the match j and b is the bias vector. The set-up of the ANN model here employed consists of two distinct steps: A learning and L Te L a testing phase. The former uses a dataset of J < J matches, and the latter a dataset of J < J L Te matches, with J + J = J. The learning phase, in turn, encompasses two steps: A training and a validation procedures. In the former phase, the weights of Equation (1) are found on the training Tr L sample whose dimension is of J < J , by means of machine learning algorithms. These learning algorithms ﬁnd the optimal weights minimizing the error between the desired output provided in the training sample and the actual output computed by the model. The error is evaluated in terms of the Brier Score [BS]: BS = p Y . (2) å j j j=1 Unfortunately, the performance of such a model highly depends on: (i) The starting values given to the weights in the ﬁrst step of the estimation routine; (ii) the pre-ﬁxed number of nodes belonging V L Tr to the hidden layer. To overcome this drawback, a subset of matches J = J J is used to evaluate the performance of M different models in a (pseudo) out-of-sample perspective. In other words, M different ANN speciﬁcations are estimated, on the basis of several number of nodes belonging to the hidden layer and to decrease the effect of the initial values of the weights. All these M different ANN speciﬁcations are evaluated in the validation sample. Once got the optimal weights, that is the weights minimizing Equation (2) for the J matches of the learning phase, the resulting speciﬁcation is used to predict the probability of winning in the testing phase. In such a step, the left-hand side of Equation (1) is replaced by p ˆ . A detailed scheme of the overall procedure is presented in Figure 2. The algorithm used to train the neural network is a feedforward procedure with batch training through the Adam Optimization algorithm (Kingma and Ba 2014). The Adam algorithm, whose name comes out from adaptive moment estimation, consists of an optimization method belonging to the stochastic gradient descent class. Such an algorithm shows better performances with respect to several competitors (as the AdaGrad and RMSprop, mainly in ANN settings with sparse gradients and non–convex optimization, as highlighted by Ruder (2016), among others). More in detail, the Adam algorithm computes adaptive learning rates for each model parameter and has been shown to be efﬁcient in different situations (for instance, when the dataset is very large or when there are many parameters to estimate). A typical problem affecting the ANNs is the presence of noise in the training set, which may lead to (fragile) models too specialized on the training data. In the related literature, several procedures have been proposed to weaken such a problem, like the dropout (Srivastava et al. 2014) and early stopping (Caruana et al. 2001) approaches. Dropout is a regularization technique consisting of dropping randomly out some neurons from the optimization. As consequence, when some neurons are randomly ignored during the training phase, the remaining neurons will have more inﬂuence, giving the model Risks 2020, 8, 68 6 of 19 more stability. In the training phase, a 10% dropout regularization rate is used on the hidden layer nodes. The early stopping is a method which helps to determine when the learning phase has to be interrupted. In particular, at the end of each epoch, the validation loss (that is, the BS) is computed. If the loss has not improved after two epochs, the learning phase is stopped and the last model is selected. Start Estimate the th m ANN model on the training sample Evaluate the accuracy of the th Iterate with m model on m = 1, · · · , M the validation sample through the Brier score is m = M ? no yes Find the best model among the M diﬀerent speciﬁcations Go out-of-sample and generate forecasts on Stop the testing sample Figure 2. Summary diagram of the ANN estimation. Note: The ﬁgure shows the estimation, validation, and testing procedures of the mth ANN model, with m = 1, , M denoting the number of different f g ANN speciﬁcations evaluated in the validation sample. 4. Empirical Application The software used in this work is R. The R package for the ANN estimation, validation, and testing procedure is keras (Allaire and Chollet 2020). All the codes are available upon request. Data used in this work come from the merge of two different datasets. The ﬁrst dataset is the historical archive of the site www.tennis-data.co.uk. This archive includes the results of all the most important tennis Risks 2020, 8, 68 7 of 19 tournaments (Masters 250, 500 and 1000, Grand Slams and ATP Finals), closing betting odds of different professional bookmakers, ranks, ATP points, and ﬁnal scores for each player, year by year. The second set of data comes from the site https://github.com/JeffSackmann/tennis_atp. This second archive reports approximately the same set of matches of the ﬁrst dataset but with some information about the players, such as the handedness, the height, and, more importantly, a large set of statistics in terms of points for each match. For instance, the number of won points on serve, breakpoint saved, aces, and so forth are stored in this dataset. As regards the period under consideration, ﬁrst matches were played on 4 July 2005 while the most recent matches on 28 September 2018. After the merge of these two datasets, the initial number of matches is 35,042. As said in the Introduction, we aim at conﬁguring an ANN including all the variables employed in the existing approach to estimate the probability of winning in tennis matches. Therefore, after having removed the uncompleted matches (1493) and the matches with missing values in variables used in at least one approach (among the competing speciﬁcations LZR, KMR, DCPR, BTM, and BCA), the ﬁnal dataset reduces to 26,880 matches. All the variables used by each forecasting model are synthetically described in Table 1, while in the Supplementary Materials, each of them is properly deﬁned. It is worth noting that some variables have been conﬁgured with the speciﬁc intent of exploring some aspects uncovered by the other approaches, so far. These brand new variables are: X –X , X , X , and X . For instance, X and X take into account the fatigue 1 12 17 18 20 17 18 accumulated by the players, in terms of the time of stay on court and number of games played in the last matches. Moreover, the current form of the player (X ) may be a good proxy of the outcome for the upcoming match. This variable considers the current rank of the player with respect to the average rank of the last six months. If the actual ranking is better than the average based on the last six months, then it means that the player is in a good period. The last column of Table 1 reports the test statistics of the non–linearity test of Teräsvirta et al. (1993), which provides a justiﬁcation for using the ANNs. The null hypothesis of this test is the linearity in mean between the dependent variable (that is, the outcome of the match) and the potential variable inﬂuencing this outcome (that is, the variables illustrated in the table). The results of this test, on the basis of all the non–dummy variables included in X , generally suggest rejecting the linearity hypothesis, corroborating the possibility of using the ANNs to take trace of the emerged non–linearity. In the learning phase (alternately named in-sample period), each model uses the variables reported in the Table 1 according to the information setF . In both the learning and testing procedures, with reference to the variables X and X , we only focus on the odds provided by the professional 19 31 bookmaker Bet365. The reason for which we use the odds provided by Bet365 is that it presents the largest betting coverage (over 98%) of the whole set of matches. The implied probabilities (X ) coming from the Bet365 odds have been normalized according to the procedure proposed by Shin (1991, 1992, 1993). Other normalization techniques are discussed in Candila and Scognamillo (2018). All the models are estimated using six expanding windows, each starting from 2005, and at least composed of 8 years (until 2012). The structure of the resulting procedure is depicted in Figure 3, where the sequence of green circles represents the learning sample and the brown circles the testing (or out-of-sample) periods. Globally, the out-of-sample time span is the period 2013–2018, for a total of 9818 matches. It is worth noting that the ﬁnal ANN models for each testing year will have a unique set of optimal weights and may also retrieve a different number of nodes belonging to the hidden layer. The ANN models selected by the validation procedure, as illustrated above, have a number of nodes in the hidden layer varying from 5 to 30. Risks 2020, 8, 68 8 of 19 Table 1. Input variables. Label Description Structural ANN LZR KMR DCPR BTM BCA Non–Lin. Test X Winning frequency on the ﬁrst serve 2365.875 *** X Winning frequency on the second serve 1434.552 *** X Won point return frequency 6358.604 *** X Service points won frequency 6358.604 *** X Winning frequency on break point 574.052 *** X First serve success frequency 4.517 X Completeness of the player 6358.604 *** X Advantage on serving 6358.604 *** X Average number of aces per game 105.830 *** X Minute-based fatigue 5.099 * X Games-based fatigue 3.552 X Head-to-head 20.020 *** p p p X ATP Rank 31.793 *** p p p X ATP Points 113.887 *** p p p p X Age 3.752 p p p X Squared age 3.525 15sq p p p X Height 1.208 p p p X Squared height 4.603 16sq X Surface winning frequency 524.558 *** X Overall winning frequency 165.618 *** p p X Shin implied probability 0.991 X Current form of the players 4.745 * p p X BT probability 24.084 *** p p p X ATP ranking intervals p p p X Home factor p p X BCA winning probability 1.646 p p p X Top-10 former presence p p p X Both players right-handed p p p X Both players left-handed p p p X Right-handed fav. and vice versa p p p X Left-handed fav. and vice versa p p p X Grand Slam match p p X Bookmaker info 103.681 *** Notes: The table shows the set of variables included in each model. The column “Structural” identiﬁes if a variable obeys to Deﬁnition 3. ANN gives the composition of the proposed artiﬁcial neural network, LZR that of the logit regression of Lisi and Zanella (2017); KMR that of the logit regression of Klaassen and Magnus (2003); DCPR that of the probit regression of Del Corral and Prieto-Rodríguez (2010); BTM stands for the BT-type model of McHale and Morton (2011) and BCA for the Barnett and Clarke (2005) point-based approach. The column “Non–lin. test” reports the Teräsvirta test statistics, whose null hypothesis is of “linearity in mean” between Y and each continuous variable. ***, and * denote signiﬁcance at the 1%, and 10% level, respectively. · · · · · · · · · · · · · · 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 Figure 3. Expanding windows diagram. Note: The ﬁgure shows the composition of the learning (green circles) and testing (brown circles) samples. The importance of each input variable, for each learning phase, is depicted in Figure 4, which reports the summed product of the connection weights according to the procedure proposed by Olden et al. (2004). Such a method calculates the variable importance as the product of the raw input-hidden and hidden-output connection weights between each input and output neuron and sums the product Risks 2020, 8, 68 9 of 19 across all hidden neurons. Independently of the learning window, the most important variables appear to be X (Head-to-head), X (Won point return frequency), X (Completeness of the player), and X 12 3 7 8 (Advantage on service). Olden, 2005−2012 Olden, 2005−2013 X12 X12 X3 X4 X7 X3 X8 X8 X4 X7 X1 X1 X2 X2 X19 X19 X5 X5 X6 X6 X20 X20 X26 X9 X9 X26 X31 X31 X29 X29 X32 X32 X23 X23 X21 X21 X11 X16 X22 X33 X14 X11 X10 X10 X33 X13 X16 X14 X18 X22 X13 X18 X17 X17 X24 X25 X15 X15 X28 X28 X25 X24 X30 X30 X27 X27 0.0 2.5 5.0 7.5 10.0 0.0 2.5 5.0 7.5 10.0 Importance Importance Olden, 2005−2014 Olden, 2005−2015 X12 X12 X3 X3 X7 X8 X4 X4 X8 X7 X1 X1 X2 X2 X19 X5 X5 X19 X6 X6 X20 X20 X26 X26 X9 X9 X31 X31 X29 X29 X32 X13 X11 X32 X22 X25 X10 X21 X23 X22 X14 X10 X21 X11 X17 X14 X16 X18 X33 X33 X18 X16 X13 X17 X15 X23 X28 X24 X24 X15 X25 X28 X30 X30 X27 X27 0 4 8 0.0 2.5 5.0 7.5 10.0 Importance Importance Olden, 2005−2016 Olden, 2005−2017 X12 X12 X8 X8 X7 X3 X4 X7 X3 X4 X1 X1 X2 X2 X5 X5 X19 X19 X6 X6 X20 X20 X26 X26 X9 X9 X31 X31 X29 X32 X22 X13 X32 X22 X16 X24 X14 X11 X18 X16 X10 X10 X33 X14 X11 X21 X17 X18 X13 X33 X21 X17 X24 X28 X28 X15 X15 X23 X25 X25 X23 X29 X30 X30 X27 X27 0 4 8 12 0 3 6 9 12 Importance Importance Figure 4. ANN variables’ importance across the learning phases. Note: The ﬁgure shows the importance of the input variables (from X to X ) for each learning phase, according to the procedure 1 30 proposed by Olden et al. (2004). Risks 2020, 8, 68 10 of 19 Out-of-Sample Forecast Evaluation Once estimated all the models and the ANN for each learning period, the out-of-sample estimates are obtained. When we go out-of-sample, the structural variables are invariant such that no predictions are made for these ones. For all the other variables, instead, we need to forecast the values for each match j using the information setF . For some variables, like X , the literature proposed a method jjj1 to forecast them (Barnett and Clarke 2005). For the other variables, we consider either the historical mean of the last year (or less, if that period is unavailable) or the value of the match before. Obviously, a model only based on this predicted information, like the BCA, is expected to perform worse than a model only based on structural variables. The evaluation of the performances of the proposed ANN model with respect to each competing model is employed through the Diebold–Mariano (DM) test, according to version, speciﬁcally indicated for binary outcomes, suggested by Gneiting and Katzfuss (2014) (Equation (11)). The DM test statistics with relative signiﬁcance are reported columns two to ﬁve of Table 2. It results that the proposed model statistically outperforms all the competing models except the LZR. This holds independently of the speciﬁc out-of-sample period. It is interesting to note that the LZR is able to outperform the proposed ANN only in 2013. When the learning sample increases, this superior signiﬁcance vanishes. Given that, from a statistical point of view, only the model of Lisi and Zanella (2017) has a similar performance to that of the proposed ANN, only the LZR will be used for evaluation purposes in the following section dedicated to the betting strategy. Note that the ANN model includes the same set of variables of the LZR, except for variable X (see Table 1). Therefore, it would be worthy of investigation performing an additional analysis between the proposed (full) ANN model and a restricted ANN speciﬁcation, based only on the variables of the LZR. We label this model as “LZR-ANN”. The resulting evaluation is illustrated in the last column of Table 2, where again the DM test statistics are reported. Interestingly, the full ANN model largely outperforms the restricted LZR-ANN, signalling the importance of including as many as possible input variables in the ANN model. Table 2. ANN evaluation with the Diebold–Mariano test. # Matches LZR KMR DCPR BTM BCA LZR-ANN 2013 2128 2.02 ** 1.8 * 1.11 0.86 13.3 *** 3.75 *** 2014 1849 0.91 2.49 ** 2.71 *** 1.7 * 13.52 *** 2.15 ** 2015 1315 0.48 3.11 *** 2.91 *** 3.46 *** 9.81 *** 2.91 *** 2016 1696 0.00 2.86 *** 1.97 ** 2.75 *** 12.39 *** 2.95 *** 2017 1572 0.11 1.15 1.34 0.88 13.55 *** 1.1 2018 1259 0.66 1.54 0.18 1.66 * 14.36 *** 1.44 2013–2018 9818 1.47 5.24 *** 4.06 *** 4.46 *** 31.41 *** 5.96 *** Notes: The table reports the Diebold–Mariano test statistic. Negative values mean that the ANN outperforms the model in column and vice versa. *, ** and *** denote signiﬁcance at the 10%, 5%, and 1% levels„ respectively. 5. Betting Strategies As said before, the variables related to the bookmaker odds used in the learning and testing phases were those provided by Bet365. However, for the same match different odds provided by other professional bookmakers are available. Therefore, let o be the odds provided by the bookmaker k i,k,j for the player i and the match j, with k = 1, , K. Then, the deﬁnition of the best odds is provided: Best Deﬁnition 5. The best odds for player i and the match j, denoted with o , is the maximum value among the i,j K available odds for the match j. Formally: Best o = max o . i,k,j i,j k=1,...,K Risks 2020, 8, 68 11 of 19 Let p ˆ be the estimated probability obtained from the proposed ANN or the LZR for the player i i,j and the match j, for the out-of-sample matches (the period 2013–2018). Let us focus on the probabilities for the favourites p ˆ . If these probabilities are high, the model (ANN or LZR) gives high chances to f ,j the favourite to win the match. Otherwise, low probabilities p ˆ imply that the model signals the other f ,j player as the true favourite. From an economic point of view, it is convenient to choose a threshold above which a bet is placed on the favourite, and below which a bet is placed on the underdog. High thresholds will imply a smaller number of bets, but with greater chances for that player to win the match. These thresholds are based on the sample quantiles of the estimated probabilities, according to the following deﬁnitions: Deﬁnition 6. Let P and P be all the estimated probabilities for a particular (out-of-sample) period, for the favourite and underdog players, respectively. Deﬁnition 7. Let q(a) be the sample quantile corresponding to the probability a, that is: Pr(P q(a)) = a or Pr(P q(a)) = a. So far, we have only identiﬁed the jth match among the total number of matches played. However, for the setting of some betting strategies, it is useful to refer the match j to the day t, by the following deﬁnitions: Deﬁnition 8. Let j(t) and J(t) be, respectively, the jth and the total number of matches played in the day t. Assuming that t = 1, , T, the total number of matches played is J = J(t). t=1 st nd st nd Deﬁnition 9. Let p ˆ , p ˆ , p ˆ and p ˆ be the estimated top-2 probabilities (following Deﬁnition (5)) f ,j(t) f ,j(t) u,j(t) u,j(t) for the favourite and underdog (according to Deﬁnition 4) among all the J(t) matches played on day t, respectively. Finally, the best odds, that is the highest odds on the basis of Deﬁnition 5, whose estimated probabilities follow Deﬁnition 9 are deﬁned as: Best,st Best,nd Deﬁnition 10. According to Deﬁnitions 5 and 8, let o and o be the best odds for player i associated i,j(t) i,j(t) to the matches played on day t satisfying Deﬁnition 9. The four proposed betting strategies are synthetically denoted by S , S , S and S . The ﬁrst two 2 3 1 4 strategies produce gains (or losses) coming from single bets. In this case, an outcome for the match j successfully predicted is completely independent of another outcome, always correctly predicted. Therefore, from an economic viewpoint, the gains coming from two successful bets are equal to the sum of every single bet. However, it is also possible to obtain larger gains if two events are jointly considered in a single bet. In this circumstance, the gains will be obtained from the multiplications (and not from the summation) of the odds. The strategies S and S take advantage of this aspect. In particular, they allow to jointly bet on two matches for each day t, at most. Therefore, S and S 3 4 may be more remunerative than betting on a single event but are much riskier, because they yield some gains only if both the events forming the single bet are correctly predicted. All the strategies will select the matches to bet on the basis of different sample quantiles depending on a (see Deﬁnition 7). For example, let a be close to one. In the case of betting on the favourites, only the probabilities p ˆ f ,j with very high values will be selected. That is, only the matches in which the winning of the favourite player is retained almost sure will be suggested. The same but with opposite meaning will hold for those matches whose estimated probabilities p ˆ are below to a sample quantile when a is close to f ,j zero. The message here is that the model (ANN or the competing speciﬁcation) signals the favourite player (according to Deﬁnition 4) as a potential defeated player, such that it would be more convenient to bet on the adversary. Risks 2020, 8, 68 12 of 19 5.1. Strategy S The strategy S suggests to bet one dollar on the favourite, according to the Deﬁnition 4, in the match j if and only if p ˆ q(a). The returns of the strategy S , labelled as R are: f ,j f ,j Best o 1 if player f wins; (3a) 1 f ,j R = f ,j 1 if player f loses. (3b) The strategy S suggests to bet one dollar on the underdog, according to the Deﬁnition 4, in the match j if and only if p ˆ < q(a). In this case, the returns, labelled as R are: f ,j u,j Best o 1 if player u wins; (4a) S u,j R = u,j 1 if player u loses. (4b) 5.2. Strategy S Best The strategy S , contrary to S , suggests to bet the amount o on the favourite (always satisfying 2 1 f ,j Deﬁnition 4) in the match j if and only if p ˆ q(a). The returns of S for the favourite are labelled as f ,j 2 R and are: f ,j Best Best o 1 o if player f wins; (5a) f ,j f ,j R = f ,j : Best o if player f loses. (5b) f ,j Best The amount o is placed on the underdog satisfying Deﬁnition 4 in the match j if and only if u,j p ˆ < q(a). The returns of such a strategy R are: f ,j u,j Best Best o 1 o if player u wins; (6a) u,j u,j R = u,j : Best o if player u loses. (6b) u,j 5.3. Strategy S For the favourite on the basis of Deﬁnition 4, S suggests to bet one dollar on the top-2 matches of st nd day t both satisfying Deﬁnition 9 and the conditions p ˆ q(a) and p ˆ q(a). The returns for f ,j(t) f ,j(t) the day t, labelled as R , are: f ,t Best,st Best,nd o o 1 if both players f win; (7a) f ,j(t) f ,j(t) R = f ,t 1 if at least one player f loses. (7b) For the underdog selected by Deﬁnition 4, S suggests to bet one dollar on the top-2 matches of st nd day t both satisfying Deﬁnition 9 and the conditions p ˆ < q(a) and p ˆ < q(a). The returns for f ,j(t) f ,j(t) the day t, labelled as R , are: u,t Best,st Best,nd o o 1 if both players u win; (8a) 3 u,j(t) u,j(t) R = u,t 1 if at least one player u loses . (8b) Risks 2020, 8, 68 13 of 19 5.4. Strategy S Best,st Best,nd The strategy S for the favourite suggests to bet the amount o o on the top-2 matches f ,j(t) f ,j(t) st nd of day t both satisfying Deﬁnition 9 and the conditions p ˆ q(a) and p ˆ q(a). The returns f ,j(t) f ,j(t) for the day t, labelled as R , are: f ,t Best,st Best,nd Best,st Best,nd o o 1 o o if both players f win; (9a) f ,j(t) f ,j(t) f ,j(t) f ,j(t) R = f ,t : Best,st Best,nd o o if at least one player f loses. (9b) f ,j(t) f ,j(t) Best,st Best,nd Finally, the strategy S for the underdog suggests to bet the amount o o on the u,j(t) u,j(t) st nd top-2 matches of day t both satisfying Deﬁnition 9 and the conditions p ˆ < q(a) and p ˆ < q(a). f ,j(t) f ,j(t) The returns for the day t, labelled as R , are: u,t Best,st Best,nd Best,st Best,nd o o 1 o o if both players u win; (10a) u,j(t) u,j(t) u,j(t) u,j(t) R = u,t Best,st Best,nd o o if at least one player u loses. (10b) u,j(t) u,j(t) 5.5. Return-On-Investment (ROI) The ROI obtained from a given strategy is calculated as the ratio between the sum of the returns as previously deﬁned and the amount of money invested. Let B be the total number of bets placed on player i, with i = f f , ug, according to the strategy S , with l = f1, 2, 3, 4g. Moreover, let EX P be i,j the amount of money invested on betting on player i, according to strategy S , in the match j. In other words, EX P is nothing else that the summation of the quantities reported in Equations (3b), (5b), (7b) i,j and (9b) for the bets on the favourite and in Equations (4b), (6b), (8b) and (10b) for the bets on the underdogs. The ROI for the player i and the strategy S , expressed in percentage, labelled as ROI , is given by: i l j=1 i,j ROI = 100 , with i = f f , ug and l = f1, 2, 3, 4g . (11) i l å jEX P j j=1 i,j Note that when the strategies S and S are employed, the calculation of the ROI through 3 4 Equation (11) requires the substitution of j with t. The ROI can be positive or negative, depending on the numerator of Equation (11). In the ﬁrst case, it means that the strategy under investigation has yielded positive returns. Otherwise, the strategy has lead to some losses. The ROIs for all the strategies, according to different values of the probability a used to calculate the quantile q(a), for the ANN and LZR methods and for the favourite and underdog players are reported in Panels A of Tables 3 and 4, respectively. The same tables report the ROIs for a number of subsets of matches, for robustness purposes (Panel B to Panel D). Several points can be underlined looking at Panels A. First, note that when a = 0.5, the quantile corresponds to the median. In this case, all the 9818 matches forming the out-of-sample datasets (from 2013 to 2018) are equally divided in bets on the favourites and underdogs. Obviously, betting on all the matches is never a good idea: Independently of the strategy adopted, the ROIs coming from betting on the favourites are always negative. However, those obtained from the matches selected by the ANN model are less negative than those obtained from the LZR. For instance, according to strategy S , the losses for the ANN model are equal to 10.01% of the invested capital, while for the LZR are equal to 12.84%. The occurrence of negative returns in betting markets has been largely investigated in the literature. In terms of expected values, there are positive and negative returns according to the type of bettors. As pointed out by Coleman (2004), there exists a group of skilled or informed bettors, which placing low odds bets have a positive or near zero expected returns. Then, another group of bettors, deﬁned as risk lovers, Risks 2020, 8, 68 14 of 19 being less skilled or informed compared to the ﬁrst group, place bets mainly on longer odds bets. This group of bettors has negative expected returns. Therefore, also negative returns are perfectly consistent with betting markets. Second, the number of matches largely decreases when the probability a increases (for Table 3) or decreases (for Table 4). When the bets are placed only on the matches with a well-deﬁned favourite (that is, p ˆ q(a), with a = 0.95), the ROIs become positive. Considering f ,j the last two columns of Panel A for Table 3, independently of the strategy adopted, the ROIs of the ANN model are always positive and bigger than those of the LRZ method. Betting on the underdogs when the estimated probability for the favourite is below the smallest quantile considered (a = 0.05) lets again positive ROIs, but this time only for the ANN (last two columns of the Panel A for Table 4). Summarizing the results exposed in both the top panels of Tables 3 and 4, it appears clear that among the sixteen considered set of bets, the ANN model outperforms the competing model ﬁfteen times for bets on the favourites (only under S and a = 0.75 the losses are greater for the ANN model) and fourteen times for bets on the underdogs (under S and a = 0.5 and a = 0.25 the LZR speciﬁcation reports positive ROIs while the ANN model reports negative results). Table 3. ANN and LZR ROI (in %) for betting on favourites. ANN LZR ANN LZR ANN LZR ANN LZR a = 0.5 a = 0.75 a = 0.90 a = 0.95 Panel A: All matches S 1.63 2.67 0.96 1.13 0.89 1.60 0.79 1.00 S 1.72 3.52 0.60 0.50 3.69 2.83 10.41 8.57 S 8.29 9.82 5.31 4.85 0.94 2.21 0.76 1.47 S 10.01 12.84 6.26 6.29 4.73 3.45 10.41 8.68 # Bets 4907 4907 2455 2455 984 984 493 493 Panel B: Grand Slam matches S 1.13 0.59 1.41 1.36 0.15 1.35 0.58 3.20 S 1.29 0.33 1.69 1.84 0.18 1.53 0.60 3.36 S 1.67 2.76 1.11 0.32 0.36 2.97 0.62 3.40 S 2.21 3.22 1.06 0.93 0.14 3.33 0.52 3.46 # Bets 1064 1069 594 611 290 278 158 161 Panel C: Matches with a top-50 as favourite S 1.74 2.64 0.95 1.13 0.89 1.60 0.79 1.00 S 1.90 3.47 0.63 0.50 3.69 2.83 10.41 8.57 S 7.69 9.77 5.38 4.85 0.94 2.21 0.76 1.47 S 9.43 12.81 6.35 6.29 4.73 3.45 10.41 8.68 # Bets 4800 4871 2453 2455 984 984 493 493 Panel D: Matches in the ﬁrst six months S 0.59 2.19 0.54 0.29 0.64 1.67 0.13 1.63 S 0.13 2.62 2.07 2.40 6.34 4.99 14.20 11.84 S 7.78 10.30 4.84 5.21 1.37 3.49 0.43 2.59 S 10.35 13.80 5.86 7.06 7.06 4.80 13.44 11.46 # Bets 3266 3248 1653 1688 675 681 330 349 Notes: The table shows the ROI for the ANN and LZR methods, on the basis of four different betting strategies S , S , S , and S . The bets are all placed on the favourite(s), according to 2 3 1 4 Deﬁnition 4. # Bets represents the number of bets placed. The out-of-sample period consists of all the 9818 matches played from 2013 to 2018. Risks 2020, 8, 68 15 of 19 Table 4. ANN and LZR ROI (in %) for betting on underdogs. ANN LZR ANN LZR ANN LZR ANN LZR a = 0.5 a = 0.25 a = 0.10 a = 0.05 Panel A: All matches S 0.32 4.47 0.92 5.22 0.21 4.17 1.65 1.75 S 5.50 13.07 5.99 9.11 2.46 7.14 5.16 3.27 S 2.50 4.44 1.47 1.93 5.09 6.04 1.93 3.88 S 2.65 0.25 0.75 7.24 26.40 8.00 7.68 5.32 # Bets 4907 4907 2455 2455 984 984 493 493 Panel B: Grand Slam and Masters 1000 matches S 1.10 5.89 0.45 7.71 2.30 6.48 0.31 0.87 S 3.08 9.12 3.67 6.64 19.55 10.80 1.94 1.20 S 6.93 0.05 14.94 2.91 15.59 3.64 1.18 3.72 S 22.89 30.78 40.28 35.23 79.51 1.52 13.02 3.03 # Bets 1646 1677 837 856 371 353 202 170 Panel C: Matches with a top-50 as underdog S 2.76 3.40 3.81 3.26 3.16 6.48 4.69 12.98 S 9.68 0.31 6.57 7.83 9.94 9.95 17.00 20.05 S 3.98 9.43 4.54 4.18 6.49 9.68 6.49 13.85 S 2.82 5.30 2.86 2.39 10.70 10.02 19.19 15.52 # Bets 1633 1282 1092 733 619 291 367 136 Panel D: Matches in the ﬁrst six months S 2.92 7.78 3.55 8.32 0.19 4.47 0.64 0.27 S 11.40 21.23 10.23 16.90 6.57 7.59 5.00 0.35 S 13.16 10.57 9.26 6.77 2.60 7.38 0.52 2.47 S 9.02 1.88 4.08 6.14 37.60 9.08 12.39 3.50 # Bets 3206 3224 1635 1636 657 677 343 356 Notes: The table shows the ROI for the ANN and LZR methods, on the basis of four different betting strategies S , S , S , and S . The bets are all placed on the underdog(s), according to Deﬁnition 4. # Bets 1 2 3 4 represents the number of bets placed. The out-of-sample period consists of all the 9818 matches played from 2013 to 2018. Given these prominent achievements, the robustness of these ROIs obtained using the probability of winning estimated by the implemented ANN is extensively evaluated. This issue is addressed by restricting the set of matches to bet on according to three different criteria, shown in Panels B to D of Tables 3 and 4. More in detail, for bets on the favourites and underdogs only the matches played in Grand Slams and in Grand Slams and Masters 1000 are, respectively, selected (Panels B). Panels C depict the ROIs for the bets on matches with a top-50 as favourite (Table 3) or with a top-50 as underdog (Table 4). Finally, Panels D show the ROIs with respect to the matches only played in the ﬁrst six months of each year. Again, the ROIs of the proposed model are generally better, sometimes much better than the corresponding ROIs of the LZR. For instance, betting on the underdogs with the sample quantile chosen for a = 0.10 and the strategy S lets a ROI of 79.51% for the ANN and losses of 1.52% of the capital invested for the LZR. To conclude, even if from a statistical point of view the out-of-sample performance of the ANN is not different from that of the LZR, from an economic viewpoint, the results of the proposed model are very encouraging. Irrespective of the betting strategy adopted, the chosen quantile used to select the matches to bet on, the subset of matches (if all the out-of-sample matches, or a smaller set on the basis of three alternative criteria), the ROIs guaranteed by the ANN are almost always better than those obtained from the LZR method. Risks 2020, 8, 68 16 of 19 6. Conclusions The ultimate goals of a forecasting model aiming at predicting the probability of winning of a team/player before the beginning of the match are: Robustly beating the existing approaches from a statistical and economic point of view. This contribution attempted to pursue both these objectives, in the context of male tennis. So far, three main categories of forecasting models are available within this context: Regression-based, point-based, and paired-based approaches. Each method differs from the other not only for the different statistical methodologies applied (for instance, probit or logit for the regression-based approach, BT-type model for the paired-based speciﬁcation, and so forth) but also for the different variables inﬂuencing the outcome of the match considered. This latter aspect highlights that several variables can potentially inﬂuence the result of the matches, and taking all of them into consideration may be problematic, mainly in the parametric model, such as the standard regressions. In this framework, we investigate the possibility of using the ANNs with a variety of input variables. More in detail, the design of the proposed ANN consists of a feed-forward rule trained by backpropagation, with Adam algorithm incorporated in the optimization procedure. As regards the input nodes, some variables come from a selection of the existing approaches aimed at forecasting the winner of the match, while some other variables are intentionally created for the purpose of taking into account some aspects uncovered by the other approaches. For instance, variables handling the players’ fatigue both in terms of minutes and in terms of games played are conﬁgured. Five models belonging to the previously cited approaches constitute the competing speciﬁcations. From a statistical point of view, the proposed conﬁguration of the ANN beats four out of ﬁve competing approaches while it is at least as good as the regression model labelled as LZR, proposed by Lisi and Zanella (2017). In order to provide help in the complicated issue of the matches’ choice on which placing a bet, four betting strategies are proposed. The chosen matches derive from the overcoming of the estimated probability sample quantiles. Higher quantiles imply fewer matches on which place a bet and vice versa. Moreover, two of these strategies suggest to jointly bet on the two matches played in a day whose estimated probabilities are the most conﬁdent, among all the available probabilities of that day, towards the two players. These two strategies assure higher returns at the price of being riskier because they depend on the outcomes of two matches. In comparing the ROIs of the ANN with those of the LRZ obtained from the four betting strategies proposed, it results that the ANN model implemented guarantees higher, sometimes much higher, net returns than those of the LZR. These superior ROIs are achieved irrespectively of the choice of the player to bet on (if favourite or underdog) and of the subset of matches selected according to three different criteria. Further research may be related to the extension of the ANN tools to other sports. Moreover, the four proposed betting strategies could be applied to other disciplines, taking advantage of the market inefﬁciencies (see the contribution of Cortis et al. (2013) for the inefﬁciency in the soccer betting market, for instance). Supplementary Materials: The Separate Appendix explaining all the input variables is available at http://www. mdpi.com/2227-9091/8/3/68/s1. Author Contributions: Conceptualization, V.C.; methodology, V.C. and L.P.; software, L.P.; validation, L.P.; formal analysis, V.C. and L.P.; investigation, V.C. and L.P.; resources, V.C.; data curation, V.C.; writing—original draft preparation, V.C.; writing—review and editing, V.C. and L.P.; visualization, V.C. and L.P.; supervision, V.C. and L.P. All authors have read and agreed to the published version of the manuscript. Funding: The authors gratefully acknowledge funding from the Italian Ministry of Education University and Research MIUR through PRIN project 201742PW2W_002. Acknowledgments: We would like to thank the Editor and three anonymous referees for their constructive comments and suggestions which greatly helped us in improving our work. We also thank Antonio Scognamillo and the participants of the session “Econometric methods for sport modelling and forecasting” at CFE 2018, Pisa, Italy, for useful comments. Conﬂicts of Interest: The authors declare no conﬂict of interest. Risks 2020, 8, 68 17 of 19 Abbreviations The following abbreviations are used in this manuscript: ANN Artiﬁcial Neural Network BT Bradley-Terry type model ROI Returns–On–Investment BS Brier Score DM Diebold–Mariano LZR Logit regression of Lisi and Zanella (2017) KMR Logit regression of Klaassen and Magnus (2003) DCPR Probit regression of Del Corral and Prieto-Rodríguez (2010) BTM BT-type model of McHale and Morton (2011) BCA Point-based approach of Barnett and Clarke (2005) Appendix A Table A1. Sufﬁx identiﬁcation. Sufﬁx Description Values i Player i = f f , ug j Match j = f1, , Jg J Number of matches in the learning sample Te J Number of matches in the testing sample Tr J Number of matches in the training sample J Number of matches in the validation sample n Variable (potentially) inﬂuencing the outcome n = f1, , Ng r Node in the hidden layer r = f1, , N g m ANN model estimated m = f1, , Mg k Professional bookmaker k = f1, , Kg t Day of the match(es) t = 1, , T f g References Allaire, Joseph J., and François Chollet. 2020. Keras: R Interface to ’Keras’. (R package version 2.3.0.0). Allen, David E, Michael McAleer, Shelton Peiris, and Abhay K. Singh. 2016. Nonlinear time series and neural-network models of exchange rates between the US dollar and major currencies. Risks 4: 7. [CrossRef] Atsalakis, George S., Ioanna G. Atsalaki, and Constantin Zopounidis. 2018. Forecasting the success of a new tourism service by a neuro-fuzzy technique. European Journal of Operational Research 268: 716–27. [CrossRef] Barnett, T., A. Brown, and S. Clarke. 2006. Developing a model that reﬂects outcomes of tennis matches. Paper presented at 8th Australasian Conference on Mathematics and Computers in Sport, Coolangatta, Australia, July 3–5; pp. 178–88. Barnett, Tristan, and Stephen R. Clarke. 2005. Combining player statistics to predict outcomes of tennis matches. IMA Journal of Management Mathematics 16: 113–20. [CrossRef] Boulier, Bryan L., and Herman O. Stekler. 1999. Are sports seedings good predictors? An evaluation. International Journal of Forecasting 15: 83–91. [CrossRef] Brier, Glenn W. 1950. Veriﬁcation of forecasts expressed in terms of probability. Monthly Weather Review 78: 1–3. [CrossRef] Candila, Vincenzo, and Antonio Scognamillo. 2018. Estimating the implied probabilities in the tennis betting market: A new normalization procedure. International Journal of Sport Finance 13: 225–42. Cao, Qing, Bradley T. Ewing, and Mark A. Thompson. 2012. Forecasting wind speed with recurrent neural networks. European Journal of Operational Research 221: 148–54. [CrossRef] Caruana, Rich, Steve Lawrence, and C. Lee Giles. 2001. Overﬁtting in neural nets: Backpropagation, conjugate gradient, and early stopping. In Advances in Neural Information Processing Systems. Cambridge: MIT Press, pp. 402–8. Clarke, Stephen R., and David Dyte. 2000. Using ofﬁcial ratings to simulate major tennis tournaments. International Transactions in Operational Research 7: 585–94. [CrossRef] Risks 2020, 8, 68 18 of 19 Coleman, Les. 2004. New light on the longshot bias. Applied Economics 36: 315–26. [CrossRef] Condon, Edward M., Bruce L. Golden, and Edward A. Wasil. 1999. Predicting the success of nations at the Summer Olympics using neural networks. Computers & Operations Research 26: 1243–65. Cortis, Dominic, Steve Hales, and Frank Bezzina. 2013. Proﬁting on inefﬁciencies in betting derivative markets: The case of UEFA Euro 2012. Journal of Gambling Business & Economics 7: 41–53. Del Corral, Julio, and Juan Prieto-Rodríguez. 2010. Are differences in ranks good predictors for Grand Slam tennis matches? International Journal of Forecasting 26: 551–63. [CrossRef] Gneiting, Tilmann, and Matthias Katzfuss. 2014. Probabilistic forecasting. Annual Review of Statistics and Its Application 1: 125–51. [CrossRef] Hassanniakalager, Arman, and Philip W. S. Newall. 2019. A machine learning perspective on responsible gambling. Behavioural Public Policy 1–24. [CrossRef] Haykin, Simon. 2009. Neural Networks and Learning Machines, 3rd ed. Upper Saddle River: Pearson Education. Hornik, Kurt. 1991. Approximation capabilities of multilayer feedforward networks. Neural Networks 4: 251–57. [CrossRef] Hucaljuk, Josip, and Alen Rakipovic. ´ 2011. Predicting football scores using machine learning techniques. Paper presented at 2011 Proceedings of the 34th International Convention MIPRO, Opatija, Croatia, May 23–27; pp. 1623–27. Jain, Ashu, and Avadhnam Madhav Kumar. 2007. Hybrid neural network models for hydrologic time series forecasting. Applied Soft Computing 7: 585–92. [CrossRef] Kingma, Diederik P., and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv, arXiv:1412.6980. Klaassen, Franc J.G.M., and Jan R. Magnus. 2003. Forecasting the winner of a tennis match. European Journal of Operational Research 148: 257–67. [CrossRef] Knottenbelt, William J., Demetris Spanias, and Agnieszka M Madurska. 2012. A common-opponent stochastic model for predicting the outcome of professional tennis matches. Computers & Mathematics with Applications 64: 3820–27. Kovalchik, Stephanie Ann. 2016. Searching for the GOAT of tennis win prediction. Journal of Quantitative Analysis in Sports 12: 127–38. [CrossRef] Liestbl, Knut, Per Kragh Andersen, and Ulrich Andersen. 1994. Survival analysis and neural nets. Statistics in Medicine 13: 1189–200. [CrossRef] [PubMed] Lisi, Francesco, and Germano Zanella. 2017. Tennis betting: Can statistics beat bookmakers? Electronic Journal of Applied Statistical Analysis 10: 790–808. Liu, Shuaiqiang, Cornelis W. Oosterlee, and Sander M. Bohte. 2019. Pricing options and computing implied volatilities using neural networks. Risks 7: 16. [CrossRef] Loeffelholz, Bernard, Earl Bednar, and Kenneth W. Bauer. 2009. Predicting NBA games using neural networks. Journal of Quantitative Analysis in Sports 5. [CrossRef] Maier, Klaus D., Veit Wank, Klaus Bartonietz, and Reinhard Blickhan. 2000. Neural network based models of javelin ﬂight: Prediction of ﬂight distances and optimal release parameters. Sports Engineering 3: 57–63. doi:10.1046/j.1460-2687.2000.00034.x. [CrossRef] Maszczyk, Adam, Artur Golas, Przemyslaw Pietraszewski, Robert Roczniok, Adam Zajac, and Arkadiusz Stanula. 2014. Application of neural and regression models in sports results prediction. Procedia Social and Behavioral Sciences 117: 482–87. [CrossRef] McCullagh, John. 2010. Data mining in sport: A neural network approach. International Journal of Sports Science and Engineering 4: 131–38. McHale, Ian, and Alex Morton. 2011. A Bradley–Terry type model for forecasting tennis match results. International Journal of Forecasting 27: 619–30. [CrossRef] Nikolopoulos, Konstantinos, P. Goodwin, Alexandros Patelis, and Vassilis Assimakopoulos. 2007. Forecasting with cue information: A comparison of multiple regression with alternative forecasting approaches. European Journal of Operational Research 180: 354–68. [CrossRef] O’Donoghue, Peter. 2008. Principal components analysis in the selection of key performance indicators in sport. International Journal of Performance Analysis in Sport 8: 145–55. [CrossRef] Olden, Julian D., Michael K. Joy, and Russell G. Death. 2004. An accurate comparison of methods for quantifying variable importance in artiﬁcial neural networks using simulated data. Ecological Modelling 178: 389–97. [CrossRef] Risks 2020, 8, 68 19 of 19 Paliwal, Mukta, and Usha A. Kumar. 2009. Neural networks and statistical techniques: A review of applications. Expert Systems with Applications 36: 2–17. [CrossRef] Palmer, Alfonso, Juan Jose Montano, and Albert Sesé. 2006. Designing an artiﬁcial neural network for forecasting tourism time series. Tourism Management 27: 781–90. [CrossRef] Ruder, Sebastian. 2016. An overview of gradient descent optimization algorithms. arXiv, arXiv:1609.04747. Sahin, ¸ Mehmet, and Rızvan Erol. 2017. A comparative study of neural networks and anﬁs for forecasting attendance rate of soccer games. Mathematical and Computational Applications 22: 43. [CrossRef] Shin, Hyun Song. 1991. Optimal Betting Odds Against Insider Traders. The Economic Journal 101: 1179–85. [CrossRef] Shin, Hyun Song. 1992. Prices of State Contingent Claims with Insider Traders, and the Favourite-Longshot Bias. The Economic Journal 102: 426–35. [CrossRef] Shin, Hyun Song. 1993. Measuring the Incidence of Insider Trading in a Market for State-Contingent Claims. The Economic Journal 103: 1141–53. [CrossRef] Silva, António José, Aldo Manuel Costa, Paulo Moura Oliveira, Victor Machado Reis, José Saavedra, Jurgen Perl, Abel Rouboa, and Daniel Almeida Marinho. 2007. The use of neural network technology to model swimming performance. Journal of Sports Science & Medicine 6: 117. Sipko, Michal, and William Knottenbelt. 2015. Machine Learning for the Prediction of Professional Tennis Matches. MEng computing-ﬁnal year project. London: Imperial College London. Somboonphokkaphan, Amornchai, Suphakant Phimoltares, and Chidchanok Lursinsap. 2009. Tennis winner prediction based on time-series history with neural modeling. Paper presented at International MultiConference of Engineers and Computer Scientists, Hong Kong, March 18–20. Srivastava, Nitish, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A simple way to prevent neural networks from overﬁtting. The Journal of Machine Learning Research 15: 1929–58. Suykens, Johan A. K., Joos P. L. Vandewalle, and Bart L. de Moor. 1996. Artiﬁcial Neural Networks for Modelling and Control of Non-Linear Systems. Berlin: Springer Science & Business Media Germany. Teräsvirta, Timo, Chien-Fu Lin, and Clive WJ Granger. 1993. Power of the neural network linearity test. Journal of Time Series Analysis 14: 209–20. [CrossRef] Zainuddin, Zarita, and Ong Pauline. 2011. Modiﬁed wavelet neural network in function approximation and its application in prediction of time-series pollution data. Applied Soft Computing 11: 4866–74. [CrossRef] Zhang, Guoqiang, B. Eddy Patuwo, and Michael Y Hu. 1998. Forecasting with artiﬁcial neural networks: The state of the art. International Journal of Forecasting 14: 35–62. [CrossRef] 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).

Risks – Multidisciplinary Digital Publishing Institute

**Published: ** Jun 29, 2020

Loading...

You can share this free article with as many people as you like with the url below! We hope you enjoy this feature!

Read and print from thousands of top scholarly journals.

System error. Please try again!

Already have an account? Log in

Bookmark this article. You can see your Bookmarks on your DeepDyve Library.

To save an article, **log in** first, or **sign up** for a DeepDyve account if you don’t already have one.

Copy and paste the desired citation format or use the link below to download a file formatted for EndNote

Access the full text.

Sign up today, get DeepDyve free for 14 days.

All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.