Detrended fluctuation analysis
In stochastic processes, chaos theory and time series analysis, detrended fluctuation analysis (DFA) is a method for determining the statistical self-affinity of a signal. It is useful for analysing time series that appear to be long-memory processes (diverging , e.g. power-law decaying autocorrelation function) or 1/f noise.
The obtained exponent is similar to the Hurst exponent, except that DFA may also be applied to signals whose underlying statistics (such as mean and variance) or dynamics are non-stationary (changing with time). It is related to measures based upon spectral techniques such as autocorrelation and Fourier transform.
Peng et al. introduced DFA in 1994 in a paper that has been cited over 3,000 times as of 2020[1] and represents an extension of the (ordinary) (FA), which is affected by non-stationarities.
Calculation[]
Given a bounded time series of length , where , integration or summation first converts this into an unbounded process :
where denotes the mean value of the time series. is called cumulative sum or profile. This process converts, for example, an i.i.d. white noise process into a random walk.
Next, is divided into time windows of length samples each, and a local least squares straight-line fit (the local trend) is calculated by minimising the squared errors within each time window. Let indicate the resulting piecewise sequence of straight-line fits. Then, the root-mean-square deviation from the trend, the fluctuation, is calculated:
Finally, this process of detrending followed by fluctuation measurement is repeated over a range of different window sizes , and a log-log graph of against is constructed.[2][3]
A straight line on this log-log graph indicates statistical self-affinity expressed as . The scaling exponent is calculated as the slope of a straight line fit to the log-log graph of against using least-squares. This exponent is a generalization of the Hurst exponent. Because the expected displacement in an uncorrelated random walk of length N grows like , an exponent of would correspond to uncorrelated white noise. When the exponent is between 0 and 1, the result is fractional Gaussian noise, with the precise value giving information about the series self-correlations:
- : anti-correlated
- : uncorrelated, white noise
- : correlated
- : 1/f-noise, pink noise
- : non-stationary, unbounded
- : Brownian noise
Trends of higher order can be removed by higher order DFA, where a linear fit is replaced by a polynomial fit.[4] In the described case, linear fits () are applied to the profile, thus it is called DFA1. To remove trends of higher order, DFA, uses polynomial fits of order . Due to the summation (integration) from to , linear trends in the mean of the profile represent constant trends in the initial sequence, and DFA1 only removes such constant trends (steps) in the . In general DFA of order removes (polynomial) trends of order . For linear trends in the mean of at least DFA2 is needed. The Hurst R/S analysis removes constant trends in the original sequence and thus, in its detrending it is equivalent to DFA1. The DFA method was applied to many systems; e.g., DNA sequences,[5][6] neuronal oscillations,[7] speech pathology detection,[8] and heartbeat fluctuation in different sleep stages.[9] Effect of trends on DFA were studied in[10] and relation to the power spectrum method is presented in.[11]
Since in the fluctuation function the square (root) is used, DFA measures the scaling-behavior of the second moment-fluctuations, this means . The multifractal generalization ()[12] uses a variable moment and provides . Kantelhardt et al. intended this scaling exponent as a generalization of the classical Hurst exponent. The classical Hurst exponent corresponds to the second moment for stationary cases and to the second moment minus 1 for nonstationary cases .[13][7][12]
Relations to other methods[]
In the case of power-law decaying auto-correlations, the correlation function decays with an exponent : . In addition the power spectrum decays as . The three exponents are related by:[5]
- and
- .
The relations can be derived using the Wiener–Khinchin theorem.
Thus, is tied to the slope of the power spectrum and is used to describe the color of noise by this relationship: .
For fractional Gaussian noise (FGN), we have , and thus , and , where is the Hurst exponent. for FGN is equal to .[14]
For fractional Brownian motion (FBM), we have , and thus , and , where is the Hurst exponent. for FBM is equal to .[13] In this context, FBM is the cumulative sum or the integral of FGN, thus, the exponents of their power spectra differ by 2.
Pitfalls in interpretation[]
As with most methods that depend upon line fitting, it is always possible to find a number by the DFA method, but this does not necessarily imply that the time series is self-similar. Self-similarity requires that the points on the log-log graph are sufficiently collinear across a very wide range of window sizes . Furthermore, a combination of techniques including MLE, rather than least-squares has been shown to better approximate the scaling, or power-law, exponent.[15]
Also, there are many scaling exponent-like quantities that can be measured for a self-similar time series, including the divider dimension and Hurst exponent. Therefore, the DFA scaling exponent is not a fractal dimension sharing all the desirable properties of the Hausdorff dimension, for example, although in certain special cases it can be shown to be related to the box-counting dimension for the graph of a time series.
Multifractality and Multifractal Detrended Fluctuation Analysis[]
It isn't always the case that the scaling exponents are independent of the scale of the system. In the case depends on the power extracted from
where the previous DFA is . Multifractal systems scale as a function . To uncover multifractality, Multifractal Detrended Fluctuation Analysis is one possible method.[16]
See also[]
- Multifractal system
- Self-organized criticality
- Self-affinity
- Time series analysis
- Hurst exponent
References[]
- ^ Peng, C.K.; et al. (1994). "Mosaic organization of DNA nucleotides". Phys. Rev. E. 49 (2): 1685–1689. Bibcode:1994PhRvE..49.1685P. doi:10.1103/physreve.49.1685. PMID 9961383. S2CID 3498343.
- ^ Peng, C.K.; et al. (1994). "Quantification of scaling exponents and crossover phenomena in nonstationary heartbeat time series". Chaos. 49 (1): 82–87. Bibcode:1995Chaos...5...82P. doi:10.1063/1.166141. PMID 11538314. S2CID 722880.
- ^ Bryce, R.M.; Sprague, K.B. (2012). "Revisiting detrended fluctuation analysis". Sci. Rep. 2: 315. Bibcode:2012NatSR...2E.315B. doi:10.1038/srep00315. PMC 3303145. PMID 22419991.
- ^ Kantelhardt J.W.; et al. (2001). "Detecting long-range correlations with detrended fluctuation analysis". Physica A. 295 (3–4): 441–454. arXiv:cond-mat/0102214. Bibcode:2001PhyA..295..441K. doi:10.1016/s0378-4371(01)00144-3.
- ^ a b Buldyrev; et al. (1995). "Long-Range Correlation-Properties of Coding And Noncoding Dna-Sequences- Genbank Analysis". Phys. Rev. E. 51 (5): 5084–5091. Bibcode:1995PhRvE..51.5084B. doi:10.1103/physreve.51.5084. PMID 9963221.
- ^ Bunde A, Havlin S (1996). "Fractals and Disordered Systems, Springer, Berlin, Heidelberg, New York". Cite journal requires
|journal=
(help) - ^ a b Hardstone, Richard; Poil, Simon-Shlomo; Schiavone, Giuseppina; Jansen, Rick; Nikulin, Vadim V.; Mansvelder, Huibert D.; Linkenkaer-Hansen, Klaus (1 January 2012). "Detrended Fluctuation Analysis: A Scale-Free View on Neuronal Oscillations". Frontiers in Physiology. 3: 450. doi:10.3389/fphys.2012.00450. PMC 3510427. PMID 23226132.
- ^ Little, M.; McSharry, P.; Moroz, I.; Roberts, S. (2006). "Nonlinear, Biophysically-Informed Speech Pathology Detection" (PDF). 2006 IEEE International Conference on Acoustics Speed and Signal Processing Proceedings. 2. pp. II-1080–II-1083. doi:10.1109/ICASSP.2006.1660534. ISBN 1-4244-0469-X.
- ^ Bunde A.; et al. (2000). "Correlated and uncorrelated regions in heart-rate fluctuations during sleep". Phys. Rev. E. 85 (17): 3736–3739. Bibcode:2000PhRvL..85.3736B. doi:10.1103/physrevlett.85.3736. PMID 11030994. S2CID 21568275.
- ^ Hu, K.; et al. (2001). "Effect of trends on detrended fluctuation analysis". Phys. Rev. E. 64 (1): 011114. arXiv:physics/0103018. Bibcode:2001PhRvE..64a1114H. doi:10.1103/physreve.64.011114. PMID 11461232.
- ^ Heneghan; et al. (2000). "Establishing the relation between detrended fluctuation analysis and power spectral density analysis for stochastic processes". Phys. Rev. E. 62 (5): 6103–6110. Bibcode:2000PhRvE..62.6103H. doi:10.1103/physreve.62.6103. PMID 11101940. S2CID 10791480.
- ^ a b H.E. Stanley, J.W. Kantelhardt; S.A. Zschiegner; E. Koscielny-Bunde; S. Havlin; A. Bunde (2002). "Multifractal detrended fluctuation analysis of nonstationary time series". Physica A. 316 (1–4): 87–114. arXiv:physics/0202070. Bibcode:2002PhyA..316...87K. doi:10.1016/s0378-4371(02)01383-3.
- ^ a b Movahed, M. Sadegh; et al. (2006). "Multifractal detrended fluctuation analysis of sunspot time series". Journal of Statistical Mechanics: Theory and Experiment. 02.
- ^ Taqqu, Murad S.; et al. (1995). "Estimators for long-range dependence: an empirical study". Fractals. 3 (4): 785–798. doi:10.1142/S0218348X95000692.
- ^ Clauset, Aaron; Rohilla Shalizi, Cosma; Newman, M. E. J. (2009). "Power-Law Distributions in Empirical Data". SIAM Review. 51 (4): 661–703. arXiv:0706.1062. Bibcode:2009SIAMR..51..661C. doi:10.1137/070710111.
- ^ Kantelhardt, J.W.; et al. (2002). "Multifractal detrended fluctuation analysis of nonstationary time series". Physica A: Statistical Mechanics and Its Applications. 316 (1–4): 87–114. arXiv:physics/0202070. Bibcode:2002PhyA..316...87K. doi:10.1016/S0378-4371(02)01383-3.
External links[]
- Tutorial on how to calculate detrended fluctuation analysis in Matlab using the Neurophysiological Biomarker Toolbox.
- FastDFA MATLAB code for rapidly calculating the DFA scaling exponent on very large datasets.
- Physionet A good overview of DFA and C code to calculate it.
- MFDFA Python implementation of (Multifractal) Detrended Fluctuation Analysis.
- Autocorrelation
- Fractals