{"id":255,"date":"2023-12-31T19:05:11","date_gmt":"2023-12-31T19:05:11","guid":{"rendered":"https:\/\/alandix.com\/aibook\/?page_id=255"},"modified":"2023-12-31T19:05:11","modified_gmt":"2023-12-31T19:05:11","slug":"chap14","status":"publish","type":"page","link":"https:\/\/alandix.com\/aibook\/second-edition\/toc2e\/chap14\/","title":{"rendered":"Chapter 14 \u2013 Time Series and Sequential Data"},"content":{"rendered":"<div class=\"embedurl\" data-url=\"https:\/\/alandix.com\/books\/aibook\/content\/chaps\/chap14.html\" ><!--  Chapter 14 Time Series and Sequential Data  -->\n\n<script>\nvar chapnos = 14;\nvar json_url = \"https:\\\/\\\/alandix.com\\\/books\\\/aibook\\\/content\\\/chaps\\\/chap14.json\";\n<\/script>\n\n\n\n\n\t<object style=\"width:100%; aspect-ratio: 10 \/ 7;\" type=\"application\/pdf\" data=\"https:\/\/alandix.com\/books\/aibook\/content\/slides-pdf\/AI-chap-14.pdf\"><\/object>\n\t<p> Download <a href=\"https:\/\/alandix.com\/books\/aibook\/content\/slides-pptx\/AI-chap-14.pptx\" download>chapter slides<\/a><\/p>\n\n\n<h3> Contents <\/h3>\n<div class=\"toc\">\n<dl>\n<dt>14.1&nbsp;&nbsp;Overview<\/dt>\n<dt>14.2&nbsp;&nbsp;General Properties<\/dt><dd><dl>\n<dt>14.2.1&nbsp;&nbsp;Kinds of Temporal and Sequential Data<\/dt>\n<dt>14.2.2&nbsp;&nbsp;Looking through Time<\/dt>\n<dt>14.2.3&nbsp;&nbsp;Processing Temporal Data<\/dt><dd><dl>\n<dt>14.2.3.1&nbsp;&nbsp;Windowing<\/dt>\n<dt>14.2.3.2&nbsp;&nbsp;Hidden State<\/dt>\n<dt>14.2.3.3&nbsp;&nbsp;Non-time Domain Transformations<\/dt>\n<\/dl><\/dd>\n<\/dl><\/dd>\n<dt>14.3&nbsp;&nbsp;Probability Models<\/dt><dd><dl>\n<dt>14.3.1&nbsp;&nbsp;Markov Model<\/dt>\n<dt>14.3.2&nbsp;&nbsp;Higher-order Markov Model<\/dt>\n<dt>14.3.3&nbsp;&nbsp;Hidden Markov Model<\/dt>\n<\/dl><\/dd>\n<dt>14.4&nbsp;&nbsp;Grammar and Pattern-Based Approaches<\/dt><dd><dl>\n<dt>14.4.1&nbsp;&nbsp;Regular Expressions<\/dt>\n<dt>14.4.2&nbsp;&nbsp;More Complex Grammars<\/dt>\n<\/dl><\/dd>\n<dt>14.5&nbsp;&nbsp;Neural Networks<\/dt><dd><dl>\n<dt>14.5.1&nbsp;&nbsp;Window-based Methods<\/dt>\n<dt>14.5.2&nbsp;&nbsp;Recurrent Neural Networks<\/dt>\n<dt>14.5.3&nbsp;&nbsp;Long-term Short-term Memory Networks<\/dt>\n<dt>14.5.4&nbsp;&nbsp;Transformer Models<\/dt>\n<\/dl><\/dd>\n<dt>14.6&nbsp;&nbsp;Statistical and Numerical Techniques<\/dt><dd><dl>\n<dt>14.6.1&nbsp;&nbsp;Simple Data Cleaning Techniques<\/dt>\n<dt>14.6.2&nbsp;&nbsp;Logarithmic Transformations and Exponential Growth<\/dt>\n<dt>14.6.3&nbsp;&nbsp;ARMA Models<\/dt>\n<dt>14.6.4&nbsp;&nbsp;Mixed Statistics\/ML Models<\/dt>\n<\/dl><\/dd>\n<dt>14.7&nbsp;&nbsp;Multi-stage\/Multi-scale<\/dt>\n<dt>14.8&nbsp;&nbsp;Summary<\/dt>\n<\/dl><\/div>\n\n\n<h3> Glossary items referenced in this chapter <\/h3>\n<div class=\"toc\">\n<a href=\"https:\/\/alandix.com\/glossary\/aibook\/accuracy\">accuracy<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/alphafold\">AlphaFold<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/arma\">ARMA (Auto Regressive Moving Average)<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/attention%20mechanisms\">attention mechanisms<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/auto-regressive%20model\">auto-regressive model<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/babbage-charles\">Babbage, Charles<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/bias\">bias<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/bootstrapping\">bootstrapping<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/bottom-up%20reasoning\">bottom-up reasoning<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/chatgpt\">ChatGPT<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/computer%20chess\">computer chess<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/data%20cleaning\">data cleaning<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/database\">database<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/decibel\">decibel<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/deep%20neural%20network\">deep neural network<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/difference%20engine\">Difference Engine<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/discontinuous\">discontinuous<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/ecg\">ECG <\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/event\">event<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/event%20stream\">event stream<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/expert%20knowledge\">expert knowledge<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/expert%20system\">expert system<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/explainable%20ai\">explainable AI<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/exponential%20decay\">exponential decay<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/exponential%20growth\">exponential growth<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/fast%20fourier%20transform\">Fast Fourier Transform<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/feedback\">feedback<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/finite%20impulse%20response\">finite impulse response<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/finite%20state%20machine\">finite state machine<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/first-order%20difference\">first-order difference<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/fitness%20function\">fitness function<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/fourier%20transform\">Fourier transform<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/frequency%20domain\">frequency domain<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/genetic%20algorithm\">genetic algorithm<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/genetic%20programming\">genetic programming<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/google%20gemini\">Google Gemini<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/grammar\">grammar<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/haar%20wavelets\">Harr wavelets<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/handwriting%20recognition\">handwriting recognition<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/heterogeneous%20events\">heterogeneous events<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/heuristic%20evaluation%20function\">heuristic evaluation function<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/hidden%20markov%20model\">hidden Markov model<\/a><\/strong>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/hidden%20state\">hidden state<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/hierarchical%20grammars\">hierarchical grammars<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/homogeneous%20events\">homogeneous events<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/hybrid%20ai%2Fstatistical%20system\">hybrid AI\/statistical system<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/infinite%20impulse%20response\">infinite impulse response<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/information%20preserving\">information preserving<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/lego-style%20matching\">Lego-style matching<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/linear%20regression\">linear regression<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/logarithm%20base\">logarithm base<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/logarithmic%20transform\">logarithmic transform<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/long-term%20memory\">long-term memory<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/long-term%20potentiation\">long-term potentiation<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/long-term%20short-term%20memory%20networks\">long-term short-term memory networks<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/machine%20learning\">machine learning<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/markov%20model\">Markov model<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/markov%2C%20andrey\">Markov, Andrey<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/moving%20average\">moving average<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/moving%20average%20model\">moving average model<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/n-gram\">n-gram<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/natural%20logarithm\">natural logarithm<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/neural%20network\">neural network<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/neural-network%20architecture\">neural-network architecture<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/non-overlapping%20windows\">non-overlapping windows<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/non-time%20domain%20transformations\">non-time domain transformations<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/normal%20distribution\">Normal distribution<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/outliers\">outliers<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/pattern%20matching\">pattern matching<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/periodicity\">periodicity<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/phase\">phase<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/phase%20changes\">phase changes<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/pre-processing\">pre-processing<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/probability\">probability<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/probability%20theory\">probability theory<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/probability%20transition\">probability transition<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/quasi-periodic\">quasi-periodic<\/a><\/strong>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/recurrent%20neural%20network\">recurrent neural network<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/regular%20expression\">regular expression<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/scale-related%20variability\">scale-related variability<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/seasonal%20adjustments\">seasonal adjustments<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/sequence\">sequence<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/signal%20processing\">signal processing<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/smoothing\">smoothing<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/spectrogram\">spectrogram<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/speech%20recognition\">speech recognition<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/sporadic%20sample\">sporadic sample<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/stationarity\">stationarity<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/statistical%20techniques\">statistical techniques<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/stochastic%20process\">stochastic process<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/substructure\">substructure<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/supervised%20learning\">supervised learning<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/surrogate%20expert\">surrogate expert<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/synapse%20weights\">synapse weights<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/time%20domain\">time domain<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/time%20series\">time series<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/time%20series%20analysis\">time series analysis<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/time%20series%20data\">time series data<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/transformer%20model\">transformer model<\/a><\/strong>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/transition%20probabilities\">transition probabilities<\/a><\/strong>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/trend%20removal\">trend removal<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/trigger\">trigger<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/uniform%20sampling%20rate\">uniform sampling rate<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/unsupervised%20classifier\">unsupervised classifier<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/unsupervised%20learning\">unsupervised learning<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/variable-order%20markov%20models\">variable-order markov models<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/wavelength\">wavelength<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/wavelet\">wavelet<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/wavelet%20transform\">wavelet transform<\/a><\/strong>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/windowing\">windowing<\/a><\/strong><\/div>\n\n\n\n\n<\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":2,"featured_media":0,"parent":221,"menu_order":14,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_themeisle_gutenberg_block_has_review":false,"footnotes":""},"class_list":["post-255","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/pages\/255","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/comments?post=255"}],"version-history":[{"count":3,"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/pages\/255\/revisions"}],"predecessor-version":[{"id":304,"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/pages\/255\/revisions\/304"}],"up":[{"embeddable":true,"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/pages\/221"}],"wp:attachment":[{"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/media?parent=255"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}