 Research
 Open Access
 Published:
Semiautomated approaches to optimize deep brain stimulation parameters in Parkinson’s disease
Journal of NeuroEngineering and Rehabilitation volume 18, Article number: 83 (2021)
Abstract
Background
Deep brain stimulation (DBS) is a treatment option for Parkinson’s disease patients when medication does not sufficiently manage their symptoms. DBS can be a highly effect therapy, but only after a timeconsuming trialanderror stimulation parameter adjustment process that is susceptible to clinician bias. This trialanderror process will be further prolonged with the introduction of segmented electrodes that are now commercially available. New approaches to optimizing a patient’s stimulation parameters, that can also handle the increasing complexity of new electrode and stimulator designs, is needed.
Methods
To improve DBS parameter programming, we explored two semiautomated optimization approaches: a Bayesian optimization (BayesOpt) algorithm to efficiently determine a patient’s optimal stimulation parameter for minimizing rigidity, and a probit Gaussian process (pGP) to assess patient’s preference. Quantified rigidity measurements were obtained using a robotic manipulandum in two participants over two visits. Rigidity was measured, in 5Hz increments, between 10–185Hz (total 30–36 frequencies) on the first visit and at eight BayesOpt algorithmselected frequencies on the second visit. The participant was also asked their preference between the current and previous stimulation frequency. First, we compared the optimal frequency between visits with the participant’s preferred frequency. Next, we evaluated the efficiency of the BayesOpt algorithm, comparing it to random and equal interval selection of frequency.
Results
The BayesOpt algorithm estimated the optimal frequency to be the highest tolerable frequency, matching the optimal frequency found during the first visit. However, the participants’ pGP models indicate a preference at frequencies between 70–110 Hz. Here the stimulation frequency is lowest that achieves nearly maximal suppression of rigidity. BayesOpt was efficient, estimating the rigidity response curve to stimulation that was almost indistinguishable when compared to the longer brute force method.
Conclusions
These results provide preliminary evidence of the feasibility to use BayesOpt for determining the optimal frequency, while pGP patient’s preferences include more difficult to measure outcomes. Both novel approaches can shorten DBS programming and can be expanded to include multiple symptoms and parameters.
Introduction
Deep brain stimulation (DBS) is a highly effective therapeutic option for people with Parkinson’s disease (PD) [1,2,3,4,5,6]. However, efficacy of stimulation is dependent upon the stimulation waveform delivered. Three parameters describe the waveform: amplitude (voltage or current), frequency, and pulse width. These parameters have a wide range of possible values and are determined for each patient, individually, after a prolonged clinical optimization phase following implantation of electrodes in the subthalamic nucleus or globus pallidus interna. Current generation of DBS electrodes have multiple contacts (4 to 8), which the clinician will have to determine the best configuration (anodes and cathodes) as well. Given the range of possible waveform parameters and different electrode configuration, millions of possible setting combinations are possible. From a clinical perspective, the effective parameter space is much smaller. Many settings do not reach clinical effectiveness, have similar motor sign improvement, or are likely to induce sideeffects and thus can be excluded from exploration [7, 8]. Nonetheless, the determination of “optimal” stimulation settings requires the clinician to iteratively modify stimulation parameters to best alleviate the individual’s motor signs. This can require 50 or more hours of parameter tuning [9]. Following this process, improvements in Unified Parkinson’s Disease Rating Scale (UPDRS) motor scores between 2050% are often seen in individuals [2, 6, 10]. While the clinician optimization parameter improve UPDRS scores, it is still uncertain whether the clinician has identified the best stimulation settings using this tuning approach given that a large proportion of the parameter space remains untested.
Selecting the optimum stimulation settings state is further limited by the subjectivity and poor resolution of the motor outcomes measures. The clinical standard to evaluate the efficacy of stimulation is through examination of motor signs such as rigidity, bradykinesia, tremor, and gait. The severity of these motor signs is assessed using the motor UPDRS, which assigns a score to each element of the exam with an ordinal value between 0–4. This method of assessment and ordinal scoring limits the accuracy of outcome measurement, because it is subjective and limited in scope. Methods have been developed for the quantitative assessment of rigidity [11,12,13,14], bradykinesia [15,16,17,18,19,20,21], tremor [22], and gait [23,24,25,26,27], but these are rarely used to determine DBS settings [28, 29].
Several methods to increase the efficiency of DBS programming have previously been proposed. These include algorithms to select stimulation parameters based on iterative clinical assessments of benefits and side effects [7, 8, 30,31,32]. Yet, the parameter space tested with these approaches is still limited, and it is unclear if the greatest efficacy for a given motor sign has been achieved. Others have attempted to use biophysical models to determine settings that create a presumed ideal electrical field within a region of interest [33,34,35,36,37]. These electrical fields are modeled to selectively activate the desired brain tissue and minimize current spread to structures that may cause side effects. However, these techniques rely on highresolution imaging of the lead and brain. This approach also assumes that one particular anatomical stimulation target is the most efficacious. Yet, there is currently a lack of consensus on the best target region(s) [38] or neural elements for symptomatic improvement. Finally, the most effective site for one symptom may be different from the best site for another [39,40,41], and the best target may differ between patients.
We posit that the determination of DBS settings can be substantially improved by using quantitative measures of motor signs obtained during standardized and controlled tasks. This approach increases the resolution of the outcome measure and removes potential bias.
Here we propose a semiautomated Bayesian optimization approach to tune stimulation parameters using quantitative realtime measures of motor function to discover patient specific optimized settings. Additionally, we modeled the patient preference to stimulation parameters using a semiautomated probit Gaussian Process based on pairwise comparisons. The Bayesian optimization approach used here differs from past optimization approaches as it creates a model of motor function response to stimulation parameters. This method of optimization combined with a standardized and controlled task to quantify motor function will provide a more efficient method to consistently model a patient’s motor function response to parameter adjustment. Therefore this method can consistently converge on the most efficacious stimulation settings. Fast convergence could minimize time and cost associated with determining optimal stimulation parameters, and this could also reduce the confounding effects of patient fatigue. Fatigue is known to significantly alter motor function. Consistent outcomes potentially reduce bias from the clinician, reducing the variance in UPDRS motor score improvements. Furthermore, Bayesian optimization can also help optimally resample parameters of interest to improve accuracy as well ensuring that the parameter space is adequately tested so that potentially good therapeutic settings are not missed. The BayesOpt and probit Gaussian Process approaches are described as semiautomated, as it depends on a clinician present to set parameters and to observe potential side effects. This study demonstrates the process and the feasibility of using a Bayesian optimization approach in two patients.
For the purposes of proofofprinciple, we chose to optimize stimulation frequency using realtime measures of forearm rigidity, obtained from a robotic manipulandum [42]. Rigidity was chosen as the motor outcome based on evidence that it rapidly responds to DBS [14], thus providing a reasonable washin period to rapidly assess the effects of stimulation frequency. Additionally, rigidity response to frequency has not been as widely studied as bradykinesia and tremor, and may not be monotonic. Lower frequencies have shown to yield little to no effect, or may even worsen rigidity. Conversely, stimulation at higher frequencies (> 60Hz) can produce a rapid and marked reduction in rigidity [14, 43].
There are two goals of this project, (1) develop a method for rapid and efficient semiautomated optimization of frequency to minimize rigidity, and (2) develop a method to determine an individual’s preferred stimulation frequency. A comparison between approaches will determine if the most efficacious settings differs from the patient’s preference. While the study only looked at one motor sign and stimulation parameter, the benefits of optimization using the Bayesian approach is expected to be greater when generalized to more than one parameter.
Methods
Participant demographics
Two individuals with PD (Table 1) were tested, one with DBS targeting the internal segment of the globus pallidus and the other with DBS targeting the subthalamic nucleus. Both individuals showed significant improvements in motor symptom severity (assessed using part III of the UPDRS) while on clinical stimulation settings compared to off stimulation (Participant 1: off DBS UPDRS III = 56, on DBS UPDRS III = 42; Participant 2: off DBS UPDRS III = 65, on DBS UPDRS III = 30). The protocol was approved by the local institutional review board and both individuals provided informed consent prior to participation. Testing was conducted in the offmedication state, with their last dose of Parkinson’s medication taken at least 16 h prior to their visit dates. Both participants were classified as having the akineticrigid subtype of PD based on the ratio between the participant’s UPDRS tremor and bradykinesia scores [44]. Throughout testing, DBS amplitude, pulse width, and electrode contacts settings were fixed to their clinically optimized settings.
Rigidity measurement
A custommade robotic manipulandum (Entact, Toronto, CA) was used to quantify rigidity. The robotic manipulandum houses a handle attached to a servomotor allowing rotation about the supinationpronation axis of the forearm (Fig. 1a). A strain gauge is attached to the shaft of the handle and is used to measure resistive torque. Torque is obtained from the strain gauge data after it is passed through a 16bit digitizer (National Instrument, Austin, TX) sampling at 1KHz, followed by a digital low pass filter with a cutoff frequency of 20Hz using a 2 pole Butterworth filter (Fig. 1b). To estimate the force the participant imposes on the handle, the torque is rectified and integrated with respect to time, thus obtaining a measure of angular impulse [12]. The slope (vs. time) of the angular impulse was taken as the Robotic Manipulandum Rigidity (RoMaR) value, as shown in Fig. 1c. This method of quantifying rigidity has been validated with PD patient’s UPDRS Upper limb rigidity scores [42].
Optimization
Considerable effort is needed by our PD participants to obtain multiple RoMaR values. Participants were asked to come into lab off PD medication and stimulation turned off prior to the experiment. Furthermore, motor signs are not sufficiently alleviated during the experiment, making it difficult for the participant to reach the end of the experiment. Considering these issues, not all optimization algorithms are viable. An efficient and costeffective algorithm is needed. In this study we used a semiautomated Bayesian optimization approach to sample the participant’s specific rigidityfrequency relationship, as it has been shown to be efficient in terms of number of samples needed and useful when measurements are costly to obtain [45,46,47,48,49].
Our objective function for the semiautomated Bayesian optimization algorithm only includes a quantitative measure of rigidity. However, motor sign improvement and side effects are considered during clinical optimization. To include side effects into Bayesian optimization, a quantitative measure is needed. Side effects are difficult to quantify accurately, and rather than incorporating a coarse measurement into the objective function, a comparison approach can be taken. In conjunction with Bayesian optimization, subjects are asked to select their preferred setting when comparing their current setting to their previous setting. These pairwise comparisons are used to create a preference model at the end of the experiment using a probit Gaussian process.
Bayesian optimization
Bayesian optimization’s (BayesOpt’s) efficiency in sampling arises from incorporating prior beliefs about the input space with observations to build a model using Bayes’ theorem,
This equation states that the posterior probability of the model M, given observations, E, is proportional to the likelihood of observing E given the model, multiplied by the prior probability of M. Once the model M has been built, BayesOpt operates on the model to direct sampling where it is beneficial to the goals of the optimization. Four steps are needed to run BayesOpt: (1) construction of a model from evidence, (2) estimate the mean and standard deviation at each frequency, (3) determine the utility of sampling at various frequencies, and 4) sample where utility is highest. These steps are repeated until some metric of model convergence is achieved.
Various methods can be used to create a model from evidence, but a Gaussian processes (GP) is preferred because it meets many “simple and natural” conditions common in many optimization tasks [45]:
A GP is a generalization of the Gaussian probability distribution and can be thought as a distribution over functions [50]. The GP is completely specified by its mean function, m(x), and covariance function, \(k(x,x')\), which measures the “similarity” between any two frequencies x and \(x'\). The mean function is often set to 0, but was set to the mean RoMaR value after testing four frequencies in our study. For the covariance function, we used the Matérn kernel [51, 52] as it offers flexibility between the smoothness of the inputoutput response and is among the most common kernels for GPs [49]:
where \(\Gamma (\cdot )\) is the Gamma function, and \(H_\nu\) is the Bessel function of order \(\nu\). Smoothness of the covariance function is balanced through the order parameter, \(\nu\), and the lengthconstant \(\ell\). For this study, \(\nu =3/2\) as we expected to observe coarseness in the data but a smooth trend, and estimated \(\ell\) using MATLAB’s hyperparameter optimization (MATLAB 2017b, Mathworks Inc., Natick, MA) for each participant.
Now that we have built a model from our evidence, we can estimate the mean and standard deviation of RoMaR values at each frequency; this estimation is also called the predictive distribution. To calculate the predictive distribution, we incorporate all of our observations, \(\mathcal {D}_{1:n} = {x_i, f(x_i)}\), with our GP model. Let us define a vector containing all values \(\mathbf{f} _{1:n} = [f(x_1),...,f(x_n)]\). An expression for the predictive distribution can be derived as,
where
We denote \(\mathbf {k}\) as a vector of covariance \([k(x_{n+1},x_1),...,k(x_{n+1},x_n)]\), and \(\mathbf {K}\) as a matrix containing all covariance values where the i, j entry is the covariance \(k(x_i,x_j)\).
We use the information contained in the predictive distribution to determine where to sample next. Using the mean and standard deviation, BayesOpt selects the frequency where the utility, u(x), is greatest. In this study, utility was defined as the expected improvement to the model’s estimated minimum at each frequency:
where \(x^ = argmin_{x_i \in x_{1:n}}f(x_i)\), \(\Phi (\cdot )\) is the cumulative density function of a standard normal distribution, and \(\phi (\cdot )\) is the probability density function of a standard normal distribution. Sampling only where it is expected to improve the greatest can oversample an area of the input space, and choose a local minimum as the optimized frequency. MATLAB provides a method to account for oversampling through an exploration ratio that balances exploration and sampling near the estimated minimum. We use the MATLAB’s “bayesopt” function to calculate the utility at all frequencies using MATLAB’s expected improvement function and set an exploration ratio of 0.5. MATLAB returns the frequency with the largest utility to sample:
Sampling where the variance is greatest will provide new evidence and reduce the model uncertainty at that setting; improving the GP model’s estimation of the underlying rigidity response. However, the magnitude of the frequency could induce intolerable side effects in human participants. To safely test the frequency with the highest utility, a clinician was tasked with changing the frequency and monitor the participant for side effects. New evidence from sampling was used to update the GP model. See below for more information regarding the experimental protocol.
Probit gaussian process
An optimization algorithm depends on the metric used to measure the outcome. In previous sections, we have focused on optimizing rigidity, which ignores other symptom reductions and side effects caused by stimulation. The ultimate goal is not just to reduce rigidity, but also to minimize side effects and improve overall quality of life. Unfortunately, side effects and quality of life are difficult to measure, and to optimize for. Even if accurate rigidity and side effect measurements could be obtained during optimization, we would have to choose a function that balances the value of rigidity and side effects into a single scalar value.
Instead, we can reformulate the problem and attempt to optimize directly for the desired outcome: patient preference. Asking patients to provide ratings on a numerical scale is difficult for the patients, often inaccurate, and subject to cognitive biases [53, 54]. However, humans excel at comparing options and expressing preference for one over the others [55]. In applications requiring human judgment, preference between two options is often more accurate than numerical ratings [56, 57].
In order to use binary preference data, we must reformulate the GP into a probit Gaussian process (pGP). In a pGP, instead of being able to directly sample the objective function, we must infer it from a set of binary observations. Our data is no longer a score at each setting, but is a set of ranked pairs \(\mathcal {D} = \{a_i \succ b_i\}^m_{i=1}\), where \(\succ\) indicates that a patient prefers setting a to b. We use \(x_{1:m}\) to denote the m distinct comparisons in the training data, where \(a_i\) and \(b_i\) are two elements of \(x_{1:m}\).
We model the value function \(v(\cdot )\) for any setting as \(v(\cdot ) = f(\cdot ) + \epsilon\), where \(\epsilon \sim \mathcal {N}(0,\sigma ^2)\) is normally distributed noise. The value function describes the value a patient derives from a given setting, with the noise term modeling uncertainty in the participant’s preferences. Here, \(\sigma\) is set to 1, and is not learned. The challenge here is to learn f, where \(f = \{f(x_i)\}_{i=1}^n\) is the value of the objective function at the training points.
We can now relate our binary observations back to the latent objective function using binomialprobit regression. An example of the probit procedure used to model a 1D function from a series of preferences is illustrated in Fig. 2. Using this model, the probability that item a is preferred to b can be calculated as:
where \(\Phi (\cdot )\) is the CDF of the standard normal distribution. The probability that a is preferred to b is proportional to the difference between f(a) and f(b), divided by the magnitude of the noise, \(\sigma\) [49].
Now, we can estimate the posterior distribution of the latent objective function. Our goal is to find the distribution of the objective function which maximizes the posterior probability of our binary observations, known as the maximum a posterior (MAP) estimate. We use NewtonRaphson recursion to learn \(f_\text {MAP}\):
NewtonRaphson recursion is subject to becoming stuck in local minima, so multiple restarts with random initial conditions (\(N=25\)) was performed.
After computing the model of the objective function, \(f_\text {MAP}\), we can derive the predictive distribution of \(P(f_{t+1}f_\text {MAP},\mathcal {D})\):
where \(\mathbf {C}\) is a matrix whose m, nth entry is given by
and
As before, \(\mathbf {k}\) and \(\mathbf {K}\) are the vector and matrix of covariances between inputs x.
Using the predictive distribution, we can then compute the utility and proceed with sampling as described in Bayesian Optimization.
Experimental protocol
This study consisted of two visits. On the first visit, a bruteforce approach was used to measure the RoMaR value at all frequencies, in pseudorandom order, between 10 and 185Hz in increments of 5Hz. Two additional measurements at the participant’s clinical frequency at the beginning and end of the experiment. Frequencies that produced uncomfortable side effects were halted and all higher frequencies were not tested. On the second visit, RoMaR values was obtained at four seed frequencies, 30, 80, 90, and 140 Hz prior to BayesOpt guided programming. These four frequencies were selected prior to the first participant and spanned a range that would be comfortable for most PD patients, with two samples (80Hz and 90Hz) near the anticipated transition between ineffective and suppressive stimulation frequencies that is seen in most patients. After testing at these seed frequencies, BayesOpt selected the next frequency to test for 8 iterations and incorporated frequency boundaries discovered during the first visit. One hour was allocated to testing, which included testing the 4 seed frequencies, data analysis and Bayesian optimization for setting selection, and the 8 tests, for a total of 12 rigidity measurements and 11 preference choices for each participant. The first rigidity measurement on each visit occurred after DBS has been turned off for 1 h. For both visits, frequencies were programmed into the implantable pulse generator by a movement disorder specialist who could observe any notable side effects and terminate the stimulation if necessary (Fig. 3).
Each rigidity measurement follows these steps: clinician sets stimulation frequency and monitors for side effects, 4 min of washin, custom software controlled 25 s of passive movement imposed by the manipulandum with a range of motion of \(\pm \text {40}^\circ\), custom software calculation of the RoMaR value, and relay of the next frequency to the clinician. For visit 2 there are three additional steps: update of the GP model with the calculated RoMaR value, BayesOpt determined next frequency to test, and prompt the participant for frequency preference. Specifically, preference was asked with the following: “Which did you prefer, the current setting or the previous one, meaning the setting that felt best to you in terms of symptom reduction but also side effects?” The total time between each rigidity measurement takes was approximately 5 mins, with the majority of that time dedicated to washin time.
Data analysis
A GP was to fit to the patient data sampled using the bruteforce and the BayesOpt methods, and a pGP was created at the conclusion of the BayesOpt experiment. Two metrics are derived from the GP models: (1) the optimal frequency and (2) the frequency range considered indistinguishable from the minimum. The optimal frequency for rigidity suppression was estimated where the GP model’s mean was at a minimum. The frequency range was estimated as all frequencies whose rigidity scores fell within one standard deviation of the value at the minimum. We then compared the optimal frequency found between BayesOpt and the bruteforce approach.
Next, to analyze the efficiency of the BayesOpt method we simulated two other sampling methods from the bruteforce data and compared the frequency range of the estimated curves. One simulated approach was to sample between 10Hz and the maximum frequency each participant could tolerate in approximately equal intervals. For example, sampling at three points between 10 and the maximum frequency of Participant 1 (155 Hz), we would select bruteforce RoMaR values at 10, 85, and 155 Hz. When the boundary of an interval was not one of the bruteforce frequency tested, the frequency was rounded to the nearest tested setting. The second simulated approach randomly selected frequencies, with repeats allowed. Each sampling method was simulated with increasing number of included bruteforce RoMaR values, fitting a GP at each iteration. Additionally, the random frequency selection was repeated 50 times. The frequency range of the GPs were stored for each method and compared to the BayesOpt method.
Lastly, we analyzed the peak of the participant’s stimulation frequency preference model to the optimal frequency of the BayesOpt GP model.
Results
The objective of the study was to develop two methods: (1) a rapid and efficient semiautomated approach to optimize stimulation frequency to minimize rigidity, and (2) a method to determine an individual’s preferred stimulation frequency. We evaluate the efficiency of the semiautomated approach (BayesOpt) by comparing it to bruteforce methods. Additionally, BayesOpts reliability was also investigated and compared to bruteforce methods. Individual preferred stimulation frequency was compared to the results of BayesOpt. Two participants had two separate visits for optimization. In the first visit, the stimulation frequency was systematically tested at 30 frequencies for Participant 1 and 36 frequencies for Participant 2. For Participant 1, only stimulation frequencies at or below 155Hz were tolerable. In total, visit 1 (bruteforce method) testing took 4 h. In the second visit (BayesOpt approach), the rigidity response curve to stimulation frequencies tested were selected during the study using the BayesOpt algorithm. During the BayesOpt experiment, we also asked patients to report which stimulation setting they preferred, the current stimulation frequency or the previous frequency tested, to estimate their preference for stimulation frequency. The pairwise comparisons were then quantified to provide a value of each setting using a pGP. Visit 2 testing (BayesOpt) took 2.5 h. Here we report four results: (1) how rigidity is dependent on stimulation frequency, (2) a comparison of rigidity’s dependency on frequency fit with GP models from the bruteforce and the BayesOpt sampling, (3) evaluation of the efficiency in estimating the rigidityfrequency curve using BayesOpt, and (4) the participant’s preference for stimulation frequency, as estimated using the pGP.
In both participants we observed that stimulation frequency greater than 80Hz was more effective at reducing rigidity than low frequency stimulation (Fig. 4, Bruteforce). Interestingly, 10Hz in both participants reduces rigidity greater than 20–50Hz stimulation. Rigidity does not follow a steady decrease after 50Hz for Participant 2, where rigidity is higher between 130–155Hz than frequencies around it. Participant 1 does show a steady decrease after 50Hz, where their rigidity suppression was proportional to the stimulation frequency.
Rigidity was minimized at the highest frequency tolerated, or tested, at 155Hz for Participant 1 and185Hz for Participant 2 during their bruteforce visit (Fig. 4, Bruteforce Red dot). These stimulation frequencies were also estimated to minimize the participant’s rigidity from their BayesOpt model, which was determined using less than half of the number of evaluations needed for the bruteforce model. The GP models between the two visits also had comparable accuracy, as evaluated by the model’s frequency range. For the bruteforce model, the frequency range that suppressed rigidity was 39Hz wide for Participant 1 and 94Hz for Participant 2. BayesOpt models had frequency ranges that suppressed rigidity of 53Hz for Participant 1 and 100Hz for Participant 2, a difference of 14Hz and 6Hz.
Efficiency and reliability of the BayesOpt algorithm was evaluated through comparison between two different sampling methods: equal interval and random sampling of the frequency space (Fig. 5). The frequency range of rigidity suppression decreased for each sampling method as the iteration number increased for both participants. BayesOpt results in a large frequency range decrease after 4 iterations for both participants, followed by smaller increases or decreases as the number of iterations increases (blue circles). Equal interval sampling showed a similar performance as BayesOpt in Participant 1, but with larger changes in frequency range as the iteration number increased (green circles). In Participant 2, equal interval sampling achieved the smallest frequency range, but also had the largest variation in frequency range. Random sampling, on average, had the slowest decrease in frequency range of the different sampling methods (orange triangle). The standard deviation of random sampling decreased for Participant 1 as the iteration increased. However, the standard deviation did not change appreciably after 10 iterations for Participant 2.
While testing different stimulation frequencies during Bayesian optimization, we asked patients to evaluate which setting they preferred: the current or previous setting. Based on the pairwise comparisons, the value of settings as a function of frequency was estimated using a probit Gaussian process. Fig. 6 shows the GP fit to the rigidityfrequency and pGP fit for preferencefrequency for both participants. Both participants did not prefer frequencies that provided the minimum rigidity scores at the top of the stimulation frequency range, as one might expect. Instead, they preferred frequencies between 70–110Hz, the lowest frequencies that achieved around 80% of the benefit seen at the maximum rigidity suppression. Participant 1 strongest preference is at 70Hz, and Participant 2 at 89Hz.
Discussion
Here we have demonstrated the feasibility of a semiautomated Bayesian optimization approach to rapidly and efficiently determine a single stimulation parameter (frequency) to minimize a single motor sign of Parkinson’s Disease. The approach was able to model the participant’s rigidity response efficiently and accurately. Additionally, we explored the difference between an individual’s preference and response model. By using Bayesian optimization, the optimal frequency for maximum reduced rigidity was determined from fewer sampled frequencies than those using the bruteforce estimation method. Bayesian optimization also reduced the frequency range it sampled over quickly with small changes with increasing number of samples, improving the confidence that the optimal frequency was found. When compared to random sampling, equal interval sampling, and BayesOpt methods, BayesOpt was able to more efficiently and reliably estimate the rigidity’s sensitivity to frequency and narrow down the frequency range where the minimum rigidity is observed. Considering balancing the accuracy of the curve fit and narrowing the range of the frequency range around the minimum rigidity, this suggests that BayesOpt is the most successful sampling algorithm. When measuring patient preferences between different frequency settings, we found that their preferred stimulation frequency is not at the frequency where rigidity is most suppressed, but at the minimum frequency at which rigidity significantly suppressed.
The pGP models, constructed from the patients’ preference, revealed that both participants preferred stimulation frequencies that differed from the frequency that maximally reduced rigidity. The difference may be explained by the limitation of the RoMaR value to capture side effects of the stimulation. Side effects of DBS include motor and nonmotor effects. Some motor side effects, such as dyskinesia, are easily detectable by an examiner, but more subtle or nonmotor side effects like mood changes [58, 59] may be apparent only to the patient. Impairment of verbal fluency, induced at higher stimulation frequencies, [60] is another subtle symptom that is more easily detected by the patient. Our findings suggest that patients may prefer stimulation settings that balance effects of multiple symptoms and side effects. How patients weigh the significance and severity of multiple factors might differ among individuals and is an open question for future research.
We tested participants with a predominantly akineticrigid subtype of PD because we expected that rigidity in these individuals would have a strong dependence on stimulation parameters. Our findings may only be applicable to people with a similar phenotype. However, the efficacy of DBS on other motor signs, such as tremor and bradykinesia, is also dependent upon stimulation frequency [61, 62]. Accordingly, this semiautomated approach could be applied to optimize other motor signs that can be readily be quantified in realtime.
Limitations
The data set used here is limited and the results may not generalize to other participants, but the optimization approach should. Participants in this study were classified as the akineticrigid subtype of PD and had disease durations of 9 and 16 years. Patients who are tremor dominant may not have rigidity that responds strongly to frequency. Additionally, patients that are in the early stages of PD may not present with RoMaR values greater than healthy older adults. However, the average disease duration prior to receiving DBS therapy is 13 years [63]. This duration is greater than Participant’s 2 disease duration. Also, while tremor dominant subtype patients may not benefit from this approach, our findings indicate that akineticrigid subtypes can benefit. Furthermore, our results also indicate that the BayesOpt approach can be effective regardless of stimulation target. Participant 1 had stimulation target in the internal segment of the globus pallidus, and Participant 2 had stimulation in the subthalamic nucleus. Both subjects showed a similar rigidity response to changes in frequency, which is in broad agreement with previous studies showing that the motor benefits of DBS are similar between the two targets [10, 64,65,66,67,68]. Given the results of the study, we expect similar outcomes in a larger group of akineticrigid PD subtypes for rigidity.
A potential confound in this study was the duration of time between visits. In Participants 1 and 2 the time between visits were 4.5 and 9 months respectively. These time periods are sufficiently long that expression of rigidity may have changed between tests. In a 5year longitudinal study, Holden et al. found that clinical motor scores increased 2.4 points per year [69]. For Participant 1, an increase in the UPDRS III right arm rigidity scores increased by one ordinal point from visit 1 to 2, and this is reflected in the higher RoMaR values seen during visit 2. Participant 2, however, had no change in clinical rigidity score, and but their RoMaR values were lower during visit 2. This may reflect daytoday fluctuations in motor signs and differences in medication washout between visits, which are not captured by the clinical rating scoring system. Nonetheless, despite changes in the mean in RoMaR values, the shape of the response curve was consistent for both the bruteforce and the BayesOpt measured curves.
While this study focused on optimizing RoMaR values alone, total energy delivered (TEED) may also be considered [70] when optimizing stimulation parameters. However, it has also been observed that TEED may not play as critical of a role as the frequency when tuning stimulation parameters [71]. If one desires to add TEED to the optimization, TEED may be scaled and then added to the RoMaR value for a total cost. Alternatively, stimulation amplitude can be adjusted to compensate for changes in frequency to keep TEED the same across the study. In this study, we neither accounted for nor compensated for changes in TEED in the optimization. In a study by Rizzone et al. showed that lower frequencies required a larger stimulation amplitude than higher frequencies to reach clinical effectiveness [30]. Therefore, in our study, the TEED may have been below therapeutic levels with stimulation at low frequencies. However, both participants showed that 10Hz stimulation was more effective at reducing rigidity than 20–50 Hz (Fig. 4, top row). These results may indicate that the rigidity dependence on frequency is not monotonic, but this was not explored in detail. Keeping TEED constant may be beneficial when optimizing for one stimulation parameter but may introduce difficult tradeoff considerations when optimizing over several parameters. For example, shortening the battery life to obtain the greatest reduction in motor symptoms.
Variability in RoMaR values influences the Gaussian process model and can influence the acquisition function within the BayesOpt algorithm. The acquisition function used in this study was the expected improvement function, which selects the next point to sample based on mean and variance. Unfortunately, we could not evaluate how rigidity variability influences the BayesOpt algorithm with our bruteforce and BayesOpt data set. In the bruteforce data set, time was limited given that the participants were in the offmedicate state and due to the amount of time allocated for new stimulation frequency settings to washin. In the BayesOpt data set, we did not control what frequencies to sample rigidity at. Some frequencies were tested more than once, but all frequencies are not guaranteed to be tested when the number of iterations of the BayesOpt algorithm is less than the number of all possible frequencies we could test.
Other optimization approaches may perform as well, or outperform, the BayesOpt algorithm when optimizing one stimulation setting to one motor symptom of Parkinson’s disease. When comparing the frequency range of the Gaussian process models as more data is included (Fig. 5), Equal Interval frequency sampling performed as well as the BayesOpt algorithm. One could predict that Equal Interval sampling with a faster increase in number of intervals could improve the frequency range faster than the BayesOpt algorithm. However, extending the Equal Interval method to more stimulation parameters and motor symptoms will quickly increase the amount of sampling that is needed. This will, in turn, increase the duration needed to optimization parameters. Although the BayesOpt algorithm did not outperform a simple bruteforce approach in the one stimulation parameter one motor symptom case, we expect the efficiency of the BayesOpt algorithm to be more pronounced when additional parameters and symptoms are included in the optimization.
Both approaches in this study are semiautomated to show proofofprincipal, but the goal is to create a fully automated closedloop algorithm that incorporates additional motor signs and stimulation parameters. To achieve a fully automated closedloop BayesOpt algorithm, objective measures of side effects, a single metric of the tested parameter’s efficacy, and external software access to the patient’s implantable pulse generator are needed. Currently, no methods exist for automated side effect detection. A single metric of the parameter’s efficacy can be simple. For example, one could normalize all measures to the patient with their offstimulation baseline, and simply sum the measures to create a single metric. More complex combinations of metrics are possible, such as adding weights to different motor sign measures. Direct programming of an implantable pulse generator from a computer is only available with Medtronic series of brain stimulators, currently limiting an automated approach, but in the future we expect more stimulators will be directly programmable.
Future directions
A fully automated closedloop algorithm may also be built off of patient preference data, rather than quantified metrics of motor scores. A patient could test settings and evaluate their preferences and BayesOpt can be used to suggest new settings to test. The advantage of this approach is that patient preference may account for side effects that may be difficult to measure quantitatively and include in a cost function for optimization.
As implantable stimulators get more complicated and clinicians are provided with more flexibility, the opportunity to create better patient specific settings will be offset by the time it takes to find those optimal parameters and the complexity of the search. Efficient tuning will be necessary, especially when motor signs with long washin and washout times are evaluated. For the motor signs of bradykinesia and tremor, effects of stimulation can be seen within a couple of minutes [72]. Since our protocol allows for 4 mins of washin time, both motor signs can be evaluated after this period with additional time (1 min) for each measurement. If measurements of gait are added, 1 hour of washin time is needed before evaluation [72]. Approximately 30 steps are needed to measure gait, collected over 2 mins [73]. Using an approach like BayesOpt enables testing stimulation setting effects on such motor signs that otherwise would not be possible with other approaches given the constraints of a clinical visit and the endurance of a patient.
Conclusion
In summary, this study provides proofofprinciple of setting selection using a semiautomated BayesOpts for tuning frequency to minimize rigidity scores and pGP for evaluating patient preferences. BayesOpts provides a rigorous approach to efficiently and accurately determining the optimal frequency to reduce rigidity, and pGP can assign a quantitative value to outcomes that are difficult to quantify in an objective optimization of stimulation parameters. BayesOpt efficiently finds optimal stimulation parameters and can be expanded to include additional motor signs and stimulation parameters. This is particularly important given the recent introduction of multisegmented stimulation leads, and this approach may lead to improved patient outcomes.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Abbreviations
 DBS:

Deep brain stimulation
 PD:

Parkinson’s disease
 UPDRS:

Unified Parkinson’s Disease Rating Scale
 STN:

Subthalamic nucleus
 GPi:

globus pallidus interna
 AR:

Akineticrigid
 RoMaR:

Robotic maniplandum rigidity
 BayesOpt:

Bayesian optimization
 GP:

Gaussian process
 pGP:

Probit Gaussian process
 TEED:

Total energy delivered.
References
 1.
The DeepBrain Stimulation for Parkinson's Disease Study Group. DeepBrain Stimulation of the Subthalamic Nucleus or the Pars Interna of the Globus Pallidus in Parkinson’s Disease. N England J Med. 2001;345(13):956–63 . https://0doiorg.brum.beds.ac.uk/10.1056/NEJMoa000827.
 2.
RodriguezOroz MC, Obeso JA, Lang AE, Houeto JL, Pollak P, Rehncrona S, Kulisevsky J, Albanese A, Volkmann J, Hariz MI, Quinn NP, Speelman JD, Guridi J, Zamarbide I, Gironell A, Molet J, PascualSedano B, Pidoux B, Bonnet AM, Agid Y, Xie J, Benabid AL, Lozano AM, SaintCyr J, Romito L, Contarino MF, Scerrati M, Fraix V, Van Blercom N. Bilateral deep brain stimulation in Parkinson’s disease: a multicentre study with 4 years followup. Brain. 2005;128(10):2240–9.
 3.
KleinerFisman G, Herzog J, Fisman DN, Tamma F, Lyons KE, Pahwa R, Lang AE, Deuschl G. Subthalamic nucleus deep brain stimulation: summary and metaanalysis of outcomes. Movement Disord. 2006;21(SUPPL. 14):290–304.
 4.
Durif F, Lemaire JJ, Debilly B, Dordain G. Longterm followup of globus pallidus chronic stimulation in advanced Parkinson’s disease. Movement Disord. 2002;17(4):803–7.
 5.
Lyons KE, Pahwa R. Longterm benefits in quality of life provided by bilateral subthalamic stimulation in patients with Parkinson disease. J Neurosurg. 2005;103(2):252–5.
 6.
Deuschl G, SchadeBrittinger C, Krack P, Volkmann J, Schäfer H, Bötzel K, Daniels C, Deutschländer A, Dillmann U, Eisner W, Gruber D, Hamel W, Herzog J, Hilker R, Klebe S, Kloß M, Koy J, Krause M, Kupsch A, Lorenz D, Lorenzl S, Mehdorn HM, Moringlane JR, Oertel W, Pinsker MO, Reichmann H, Reuß A, Schneider GH, Schnitzler A, Steude U, Sturm V, Timmermann L, Tronnier V, Trottenberg T, Wojtecki L, Wolf E, Poewe W, Voges J. A randomized trial of deepbrain stimulation for Parkinson’s disease. N Engl J Med. 2006;355(9):896–908.
 7.
Volkmann J, Herzog J, Kopper F, Geuschl G. Introduction to the programming of deep brain stimulators. Movement Disord. 2002;17(SUPPL. 3):S1817.
 8.
Volkmann J, Moro E, Pahwa R. Basic algorithms for the programming of deep brain stimulation in Parkinson’s disease. Movement Disord. 2006;21(SUPPL. 14):284–9.
 9.
Nickl RC, Reich MM, Pozzi NG, Fricke P, Lange F, Roothans J, Volkmann J, Matthies C. Rescuing suboptimal outcomes of subthalamic deep brain stimulation in Parkinson disease by surgical lead revision. Neurosurgery. 2019;85(2):314–21.
 10.
Moro E, Lozano AM, Pollak P, Agid Y, Rehncrona S, Volkmann J, Kulisevsky J, Obeso JA, Albanese A, Hariz MI, Quinn NP, Speelman JD, Benabid AL, Fraix V, Mendes A, Welter ML, Houeto JL, Cornu P, Dormont D, Tornqvist AL, Ekberg R, Schnitzler A, Timmermann L, Wojtecki L, Gironell A, RodriguezOroz MC, Guridi J, Bentivoglio AR, Contarino MF, Romito L, Scerrati M, Janssens M, Lang AE. Longterm results of a multicenter study on subthalamic and pallidal stimulation in Parkinson’s disease. Movement Disord. 2010;25(5):578–86.
 11.
Prochazka A, Bennett DJ, Stephens MJ, Patrick SK, SearsDuru R, Roberts T, Jhamandas JH. Measurement of rigidity in Parkinson’s disease. Movement Disord. 1997;12(1):24–32.
 12.
Fung VSC, Burne JA, Morris JGL. Objective quantification of resting and activated Parkinsonian rigidity: a comparison of angular impulse and work scores. Movement Disorders. 2000;15(1):48–55.
 13.
Shapiro MB, Vaillancourt DE, Sturman MM, Metman LV, Bakay RAE, Corcos DM. Effects of STN DBS on rigidity in Parkinson’s Disease. IEEE Trans Neural Syst Rehabil Eng. 2007;15(2):173–81.
 14.
Perera T, Lee WL, Jones M, Tan JL, Proud EL, Begg A, Sinclair NC, Peppard R, McDermott HJ. A PalmWorn Device to Quantify Rigidity in Parkinson’s Disease. J Neurosci Methods. 2019;317:113–120.
 15.
Homann CN, Suppan K, Wenzel K, Giovannoni G, Ivanic G, Horner S, Ott E, Hartung HP. The Bradykinesia Akinesia Incoordination Test (BRAIN TEST), an objective and userfriendly means to evaluate patients with parkinsonism. Movement Disord. 2000;15(4):641–47.
 16.
Jobbágy Á, Harcos P, Karoly R, Fazekas G. Analysis of fingertapping movement. J Neurosci Methods. 2005;141(1):29–39.
 17.
Tavares ALT, Jefferis GSXE, Koop M, Hill BC, Hastie T, Heit G, BronteStewart HM. Quantitative measurements of alternating finger tapping in Parkinson’s disease correlate with UPDRS motor disability and reveal the improvement in fine motor control from medication and deep brain stimulation. Movement Disord. 2005;20(10):1286–98.
 18.
Koop MM, Andrzejewski A, Hill BC, Heit G, BronteStewart HM. Improvement in a quantitative measure of bradykinesia after microelectrode recording in patients with Parkinson’s disease during deep brain stimulation surgery. Movement Disord. 2006;21(5):673–8.
 19.
Papapetropoulos S, Katzen HL, Scanlon BK, Guevara A, Singer C, Levin BE. Objective quantification of neuromotor symptoms in Parkinson's disease: implementation of a portable, computerized measurement tool. Parkinsons Dis. 2010;2010:760196.
 20.
Kim JW, Lee JH, Kwon Y, Kim CS, Eom GM, Koh SB, Kwon DY, Park KW. Quantification of bradykinesia during clinical finger taps using a gyrosensor in patients with Parkinson’s disease. Medical and Biological Engineering and Computing. 2011;49(3):365–71.
 21.
Pal G, Goetz CG. Assessing bradykinesia in Parkinsonian disorders. Front Neurol. 2013;4:54.
 22.
Dai H, Zhang P, Lueth T. Quantitative assessment of Parkinsonian tremor based on an inertial measurement unit. Sensors. 2015;15(10):25055–71.
 23.
Blin O, Ferrandez AM, Pailhous J, Serratrice G. Dopasensitive and Doparesistant gait parameters in Parkinson’s disease. J Neurol Sci. 1991;103(1):51–4.
 24.
Morris ME, Matyas TA, Iansek R, Summers JJ. Temporal stability of gait in Parkinson’s Disease. Phys Ther. 1996;76(7):763–77.
 25.
Hausdorff JM, Cudkowicz ME, Firtion R, Wei JY, Goldberger AL. Gait variability and basal ganglia disorders: Stridetostride variations of gait cycle timing in Parkinson’s disease and Huntington’s disease. Movement Disord. 1998;13(3):428–37.
 26.
Schaafsma JD, Giladi N, Balash Y, Bartels AL, Gurevich T, Hausdorff JM. Gait dynamics in Parkinson’s disease: relationship to Parkinsonian features, falls and response to levodopa. J Neurol Sci. 2003;212(1–2):47–53.
 27.
Plotnik M, Giladi N, Hausdorff JM. A new measure for quantifying the bilateral coordination of human gait: effects of aging and Parkinson’s disease. Exp Brain Res. 2007;181(4):561–70.
 28.
Pulliam CL, Heldman DA, Orcutt TH, Mera TO, Giuffrida JP, Vitek JL. Motion sensor strategies for automated optimization of deep brain stimulation in Parkinson’s disease. Parkinsonism Related Disord. 2015;21(4):378–82.
 29.
Heldman DA, Pulliam CL, Urrea Mendoza E, Gartner M, Giuffrida JP, Montgomery EB, Espay AJ, Revilla FJ. Computerguided deep brain stimulation programming for Parkinson’s disease. Neuromodulation. 2016;19(2):127–32.
 30.
Rizzone M, Lanotte M, Bergamasco B, Tavella A, Torre E, Faccani G, Melcarne A, Lopiano L. Deep brain stimulation of the subthalamic nucleus in Parkinson’s disease: effects of variation in stimulation parameters. J Neurol Neurosurg Psychiatry. 2001;71(2):215–19.
 31.
Moro E, Esselink RJA, Xie J, Hommel M, Benabid AL, Pollak P. The impact on Parkinson’s disease of electrical parameter settings in STN stimulation. Neurology. 2002;59(5):706–13.
 32.
Picillo M, Lozano AM, Kou N, Puppi Munhoz R, Fasano A. Programming Deep Brain Stimulation for Parkinson's Disease: The Toronto Western Hospital Algorithms. Brain Stimul. 2016;9(3):42537.
 33.
Butson CR, McIntyre CC. Current steering to control the volume of tissue activated during deep brain stimulation. Brain Stimul. 2008;1(1):7–15.
 34.
Chaturvedi A, Foutz TJ, McIntyre CC. Current steering to activate targeted neural pathways during deep brain stimulation of the subthalamic region. Brain Stimul. 2012;5(3):369–77.
 35.
Barbe MT, Maarouf M, Alesch F, Timmermann L. Multiple source current steering—a novel deep brain stimulation concept forcustomized programming in a Parkinson’s disease patient. Parkinsonism Related Disord. 2014;20(4):471–3.
 36.
Peña E, Zhang S, Deyo S, Xiao Y, Johnson MD. Particle swarm optimization for programming deep brain stimulation arrays. J Neural Eng. 2017;14(1):016014.
 37.
Anderson DN, Osting B, Vorwerk J, Dorval AD, Butson CR. Optimized programming algorithm for cylindrical and directional deep brain stimulation electrodes. J Neural Eng. 2018;15(2):026005.
 38.
Hamel W, Köppen JA, Alesch F, Antonini A, Barcia JA, Bergman H, Chabardes S, Contarino MF, Cornu P, Demmel W, Deuschl G, Fasano A, Kühn AA, Limousin P, McIntyre CC, Mehdorn HM, Pilleri M, Pollak P, RodríguezOroz MC, Rumià J, Samuel M, Timmermann L, Valldeoriola F, Vesper J, VisserVandewalle V, Volkmann J, Lozano AM. Targeting of the subthalamic nucleus for deep brain stimulation: a survey among Parkinson disease specialists. World Neurosurg. 2017;99:41–6.
 39.
Butson CR, Cooper SE, Henderson JM, Wolgamuth B, McIntyre CC. Probabilistic analysis of activation volumes generated during deep brain stimulation. NeuroImage. 2011;54(3):2096–104.
 40.
Hilliard JD, Frysinger RC, Elias WJ. Effective subthalamic nucleus deep brain stimulation sites may differ for tremor, bradykinesia and gait disturbances in Parkinson’s disease. Stereotactic Functional Neurosurg. 2011;89(6):357–64.
 41.
Eisenstein SA, Koller JM, Black KD, Campbell MC, Lugar HM, Ushe M, Tabbal SD, Karimi M, Hershey T, Perlmutter JS, Black KJ. Functional anatomy of subthalamic nucleus stimulation in Parkinson disease. Ann Neurol. 2014;76(2):279–95.
 42.
LinnEvans ME, Petrucci MN, Amundsen Huffmaster SL, Woo Chung J, Tuite PJ, Howell MJ, Videnovic A, MacKinnon CD. REM sleep without atonia is associated with increased rigidity in patients with mild to moderate Parkinson’s disease. Clin Neurophysiol. 2020;131(8):2008–2016.
 43.
Limousin P, Pollak P, Benazzouz A, Hoffmann D, Le Bas JF, Broussolle E, Perret JE, Benabid AL. Effect of parkinsonian signs and symptoms of bilateral subthalamic nucleus stimulation. Lancet. 1995;345(8942):91–95.
 44.
Schrag A, Jahanshahi M, Quinn N. What contributes to quality of life in patients with Parkinson’s disease? J Neurol Neurosurg Psychiatry. 2000;69(3):308–12.
 45.
Mockus J. Application of Bayesian approach to numerical methods of global and stochastic optimization. J Global Optimization. 1994;4(4):347–65.
 46.
Jones DR, Schonlau M, Welch WJ. Efficient global optimization of expensive blackbox functions. J Global Optimization. 1998;13(4):455–92.
 47.
Streltsov S, Vakili P. A nonmyopic utility function for statistical global optimization algorithms. J Global Optimization. 1999;14(3):283–98.
 48.
Jones DR. A taxonomy of global optimization methods based on response surfaces. J Global Optimization. 2001;21(4):345–83.
 49.
Brochu E, Cora VM, de Freitas N. A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning ;2010 ,arXiv . arXiv:1012.2599.
 50.
Rasmussen CE, Williams CKI. Gaussian processes for machine learning (adaptive computation and machine learning). Cambridge, MA: The MIT Press; 2005.
 51.
Matérn B. Spatial Variation, vol. 36. Lecture Notes in Statistics. New York, NY: Springer; 1986.
 52.
Stein ML. Interpolation of Spatial Data. New York, NY: Springer Series in Statistics. Springer; 1999.
 53.
Siegel S, Castellan Jr NJ. Nonparametric statistics for the behavioural Sciences. McGrawHill international editions statistics series. McGrawHill. 1988.
 54.
Payne, JW, Bettman, JR, Johnson, EJ. The Adaptive Decision Maker. Cambridge University Press. 1993
 55.
Kingsley DC, Brown TC. Preference uncertainty, preference learning, and paired comparison experiments. Land Economics. 2010;86(3):53044.
 56.
Kahneman D, Tversky A. Prospect theory: an analysis of decision under risk. Econometrica. 1979;47(2):263–92.
 57.
Tversky A, Kahneman D. Advances in prospect theory: Cumulative representation of uncertainty. J Risk Uncertainty. 1992;5(4):297–323.
 58.
Okun MS, Green J, Saben R, Gross R, Foote KD, Vitek JL. Mood changes with deep brain stimulation of STN and GPi: results of a pilot study. J Neurol Neurosurg Psychiatry. 2003;74(11):1584–6.
 59.
Merkl A, Röck E, SchmitzHübsch T, Schneider GH, Kühn AA. Effects of subthalamic nucleus deep brain stimulation on emotional working memory capacity and mood in patients with parkinson’s disease. Neuropsychiatric Dis Treatment. 2017;13:1603–11.
 60.
Wojtecki L, Timmermann L, Jörgens S, Südmeyer M, Maarouf M, Treuer H, Gross J, Lehrke R, Koulousakis A, Voges J, Sturm V, Schnitzler A. FrequencyDependent Frequencydependent reciprocal modulation of verbal fluency and motor functions in subthalamic deep brain stimulation. Arch Neurol. 2006;63(9):1273–76.
 61.
Khoo HM, Kishima H, Hosomi K, Maruo T, Tani N, Oshino S, Shimokawa T, Yokoe M, Mochizuki H, Saitoh Y, Yoshimine T. Lowfrequency subthalamic nucleus stimulation in Parkinson’s disease: a randomized clinical trial. Movement Disord. 2014;29(2):270–4.
 62.
Stegemöller EL, Vallabhajosula S, Haq I, Hwynn N, Hass CJ, Okun MS. Selective use of low frequency stimulation in Parkinson’s disease based on absence of tremor. NeuroRehabilitation. 2013;33(2):305–12.
 63.
Groiss SJ, Wojtecki L, Südmeyer M, Schnitzler A. Deep brain stimulation in Parkinson’s disease. Ther Adv Neurol Disord. 2009;2(6):20–8.
 64.
Anderson VC, Burchiel KJ, Hogarth P, Favre J, Hammerstad JP. Pallidal vs subthalamic nucleus deep brain stimulation in parkinson disease. Arch Neurol. 2005;62(4):554–60.
 65.
Follett KA, Weaver FM, Stern M, Hur K, Harris CL, Luo P, Marks WJ, Rothlind J, Sagher O, Moy C, Pahwa R, Burchiel K, Hogarth P, Lai EC, Duda JE, Holloway K, Samii A, Horn S, Bronstein JM, Stoner G, Starr PA, Simpson R, Baltuch G, De Salles A, Huang GD, Reda DJ, CSP 468 Study Group. Pallidal versus subthalamic deepbrain stimulation for Parkinson’s Disease. N England J Med. 2010;362(22):2077–91.
 66.
Okun MS, Fernandez HH, Wu SS, Kirsch L, Bowers D, Bova F, Suelter M, Charles E, Iv J, Wang X Jr, Zeilman CWG, Romrell P, Martin J, Ward P, Rodriguez H, Foote, KD. Cognition and mood in Parkinson Disease in STN versus GPi DBS: the COMPARE trial. Ann Neurol. 2010;65(5):586–95.
 67.
Odekerken VJJ, van Laar T, Staal MJ, Mosch A, Hoffmann CFE, Nijssen PCG, Beute GN, van Vugt JPP, Lenders MWPM, Contarino MF, Mink MSJ, Bour LJ, van den Munckhof P, Schmand BA, de Haan RJ, Schuurman PR, de Bie RMA. Subthalamic nucleus versus globus pallidus bilateral deep brain stimulation for advanced Parkinson’s disease (NSTAPS study): a randomised controlled trial. Lancet Neurol. 2013;12(1):37–44.
 68.
RamirezZamora A, Ostrem JL. Globus pallidus interna or subthalamic nucleus deep brain stimulation for Parkinson disease a review. JAMA Neurol. 2018;75(3):367–72.
 69.
Holden SK, Finseth T, Sillau SH, Berman BD. Progression of MDSUPDRS scores over five years in De Novo Parkinson disease from the Parkinson’s progression markers initiative cohort. Movement Disord Clin Pract. 2018;5(1):47–53.
 70.
Fasano A, Lozano AM. The FM/AM world is shaping the future of deep brain stimulation. Movement Disord. 2014;29(2):161–3.
 71.
Montgomery E, He H. The FM/AM world is shaping the future of deep brain stimulation. Movement Disord. 2014;29(10):1327–1327.
 72.
Temperli P, Ghika J, Villemure JG, Burkhard PR, Bogousslavsky J, Vingerhoets FJG. How do parkinsonian signs return after discontinuation of subthalamic DBS? Neurology. 2003;60(1):78–81.
 73.
Galna B, Lord S, Rochester L. Is gait variability reliable in older adults and Parkinson’s disease? Towards an optimal testing protocol. Gait Posture. 2013;37(4):580–5.
Acknowledgements
We thank both patients who participated in the study.
Funding
This work was supported by Parkinson Study Group and the Parkinson’s Disease Foundation’s Advancing Parkinson’ Treatments Innovations Grant, the MnDRIVE Brain Conditions Fellowship, NIH Grant P50NS098573, CTSI award 26431, and T32MH115886.
Author information
Affiliations
Contributions
KL, MP, CM, SC, and TI made substantial contributions to the conception and design of the work. KL, MP, and CL performed data collection. KL, MP, LG, and AL performed data analysis and interpretation of the data. PJ and SC provided clinical support. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
All participants gave their written informed consent prior to participate in this study. Approval of this study was obtained from the University of Minnesota Institutional Review Board.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Louie, K.H., Petrucci, M.N., Grado, L.L. et al. Semiautomated approaches to optimize deep brain stimulation parameters in Parkinson’s disease. J NeuroEngineering Rehabil 18, 83 (2021). https://0doiorg.brum.beds.ac.uk/10.1186/s12984021008739
Received:
Accepted:
Published:
DOI: https://0doiorg.brum.beds.ac.uk/10.1186/s12984021008739
Keywords
 Bayesian optimization
 Deep brain stimulation
 Gaussian process
 Probit
 Parkinson’s disease
 Rigidity