{"id":1178,"date":"2017-05-14T00:43:26","date_gmt":"2017-05-14T00:43:26","guid":{"rendered":"http:\/\/intelligentonlinetools.com\/blog\/?p=1178"},"modified":"2017-12-05T02:00:49","modified_gmt":"2017-12-05T02:00:49","slug":"time-series-prediction-with-convolutional-neural-networks","status":"publish","type":"post","link":"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/","title":{"rendered":"Forecasting Time Series Data with Convolutional Neural Networks"},"content":{"rendered":"<p><b>Convolutional neural networks(CNN)<\/b> is increasingly important concept in computer science and finds more and more applications in different fields. Many posts on the web are about applying convolutional neural networks for image classification as CNN is very useful type of neural networks for image classification. But convolutional neural networks can also be used for applications other than images, such as <b>time series prediction<\/b>. This post is reviewing existing papers and web resources about applying CNN for <strong>forecasting time series data<\/strong>. Some resources also contain python source code.<\/p>\n<p>Deep neural networks opened new opportunities for time series prediction. New types of neural networks such as LSTM (variant of the RNN), CNN were applied for time series forecasting.  For example here is the link for <strong>predicting time series with LSTM<\/strong>. [1] You can find here also the code. The code provides nice graph with ability to compare actual data and predicted data. (See figure below, sourced from <a href=http:\/\/www.jakob-aungiers.com\/articles\/a\/LSTM-Neural-Network-for-Time-Series-Prediction target=\"_blank\">[1]<\/a>) Predictions start at different points of time so you can see and compare performance for several predictions.<br \/>\n<figure id=\"attachment_1253\" aria-describedby=\"caption-attachment-1253\" style=\"width: 890px\" class=\"wp-caption alignnone\"><img data-attachment-id=\"1253\" data-permalink=\"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/time-series-lstm\/#main\" data-orig-file=\"http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/time-series-LSTM.png\" data-orig-size=\"1126,617\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Time Series with LSTM\" data-image-description=\"&lt;p&gt;Time series LSTM&lt;\/p&gt;\n\" data-image-caption=\"&lt;p&gt;Time series with LSTM&lt;\/p&gt;\n\" data-medium-file=\"http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/time-series-LSTM-300x164.png\" data-large-file=\"http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/time-series-LSTM-1024x561.png\" decoding=\"async\" loading=\"lazy\" src=\"http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/time-series-LSTM-300x164.png\" alt=\"\" width=\"900\" height=\"592\" class=\"size-medium wp-image-1253\" \/><figcaption id=\"caption-attachment-1253\" class=\"wp-caption-text\">Time series with LSTM<\/figcaption><\/figure><\/p>\n<p>Below review is showing different approaches that can be used for forecasting time series data with convolutional neural networks.<\/p>\n<p>1. <strong>Raw Data<\/strong><br \/>\nThe simplest way to feed data into neural network is to use <strong>raw data<\/strong>. Here is the link [2] to results of experiments with different types of neural networks including CNN. In this study  stock data such as <strong>Date,Open,High,Low,Close,Volume,Adj Close<\/strong>  were used with 3 types of networks: MLP, CNN and RNN.<\/p>\n<p>CNN <strong>architecture<\/strong> was used as 2-layer convolutional neural network (combination of convolution and max-pooling layers) with one fully-connected layer. To improve performance the author suggests using different features (not only scaled time series) like some technical indicators, volume of sales.<br \/>\nAccording to <a href=\"http:\/\/cs231n.github.io\/convolutional-networks\/#pool\" target=\"blank\">[12]<\/a> it is common to periodically insert a <strong>Pooling layer<\/strong> in-between successive Convolution layers in a CNN architecture. Its function is to progressively reduce the spatial size of the representation to reduce the amount of parameters and computation in the network, and hence to also control overfitting. The Pooling Layer operates independently on every depth slice of the input and resizes it spatially, using the MAX operation.<\/p>\n<p>2. <strong>Automatic Selection of Features<\/strong><br \/>\nTransforming data before inputting to neural network is common practice. We can use feature based methods like described here in <a href=\"http:\/\/machinelearningmastery.com\/feature-selection-time-series-forecasting-python\/\" target=\"_blank\">Feature-selection-time-series-forecasting-python<\/a> or filtering methods like removing trend, seasonality  or low pass \/ high pass filtering.<br \/>\nWith deep learning it is possible to lean features automatically. For example in one research the authors introduce a deep learning framework for multivariate time series classification: <strong>Multi-Channels Deep Convolutional Neural Networks (MCDCNN)<\/strong>. Multivariate time series are separated into univariate ones and perform feature learning on each univariate series individually. Then  a<br \/>\nnormal MLP is concatenated at the end of feature learning to do classification. [3]<br \/>\nThe CNN <strong>architecture<\/strong> consists of 2 layer CNN (combination of filter, activation and pooling layers) and 2 Fully connected layers that represent classification MLP.<\/p>\n<p>3. <strong>Fully Convolutional Neural Network (FCN)<\/strong><br \/>\nIn this study different neural network architectures such as Multilayer Perceptrons, <strong>Fully convolutional NN (FCN)<\/strong>, Residual Network are proposed. For FCN authors build the final networks by stacking three convolution blocks with the filter sizes {128, 256, 128} in each block. Unlike the MCNN and MC-CNN, any <strong>pooling operation<\/strong> is excluded. This strategy  helps to prevent overfitting. <a href=\"https:\/\/standardfrancis.wordpress.com\/2015\/04\/16\/batch-normalization\/\" target=blank>Batch normalization<\/a> is applied to speed up the convergence speed and help improve generalization.<\/p>\n<p>After the convolution blocks, the features are fed into a <strong>global average pooling layer<\/strong>  instead of a fully connected layer, which largely reduces the number of weights. The final label is produced by a softmax layer. [4] Thus the <strong>architecture<\/strong> of neural network consists of three convolution blocks and global average pooling and softmax layers in the end.<\/p>\n<p>4. <strong>Different Data Transformations<\/strong><br \/>\nIn this study [5] CNNs were trained with different data transformations, which included: the entire dataset, spatial clustering, and PCA decomposition. Data was also fit to the hidden modules of a <strong>Clockwork Recurrent Neural Network<\/strong>. This type of recurrent network (CRNN) has the advantage of maintaining a high-temporal-resolution memory in its hidden layers after training. <\/p>\n<p>This network also overcomes the problem of the vanishing gradient found in other RNNs by partitioning the neurons in its hidden layers as different \u201dsub-clocks\u201d that are able to capture the input to the network at different time steps.  Here you can find more about CRNN [11]. According to this paper a <strong>clockwork RNN architecture<\/strong> is similar to a simple RNN with an input, output and hidden layer. The hidden layer is partitioned into g modules each with its own clock rate. Within each module the neurons are fully interconnected.<\/p>\n<p>5. <strong>Analysing Multiple Time Series Relationships<\/strong><br \/>\nThis paper [6] focuses on analyzing multiple time series relationships such as <strong>correlations<\/strong> between them. Authors show that deep learning methods for time series processing are comparable to the other approaches and have wide opportunities for further improvement. Range of methods is discussed and code optimisations is applied for the convolutional neural network for the forecasting time series data domain.<\/p>\n<p>6.   <strong>Data Augmentation<\/strong><br \/>\nIn this study two approaches are proposed to artificially increase the size of training sets. The first one is based on data-augmentation techniques. The second one consists in mixing different training sets and learning the network in a semi-supervised way. The authors show that these two approaches improve the overall classification performance.<\/p>\n<p>7. <strong>Encoding data as image<\/strong><br \/>\nAnother methodology for time series  with convolutional neural networks that got popular with deep learning is <strong>encoding data as the image<\/strong>. Here data is encoded as images which feed to neural network.  This enables the use of techniques from computer vision for classification.<br \/>\nHere [8] is the link where python script can be found for encoding data as image. It encodes data into formats such as GAF, MTF. The script has the dependencies on python modules such as Numpy, Pandas,  Matplolib and Cpickle.<\/p>\n<p>Theory of using image encoded data is described in [9]. In this paper a novel framework proposes  to encode time series data as different types of images, namely, <strong>Gramian Angular Fields (GAF) and Markov Transition Fields (MTF)<\/strong>. <\/p>\n<p><strong>Learning Traffic as Images<\/strong>:<br \/>\nThis paper [10] proposes a convolutional neural network (CNN)-based method that learns traffic as images and predicts large-scale, network-wide traffic speed with a high accuracy. Spatiotemporal traffic dynamics are converted to images describing the time and space relations of traffic flow via a <strong>two-dimensional time-space matrix<\/strong>. A CNN is applied to the image following two consecutive steps: abstract traffic feature extraction and network-wide traffic speed prediction. CNN <strong>architecture<\/strong> consists of several convolutional and pooling layers and fully connected layer in the end for prediction.<\/p>\n<p><strong>Conclusion<\/strong><\/p>\n<p>Deep learning and convolutional neural networks created new opportunities for forecasting time series data domain. The above text presents different techniques that can be used in time series prediction with convolutional neural networks. The common part that we can see in most of studies is that feature extraction can be done via deep learning automatically in CNN or in other words, CNNs can learn features on their own. Below you can see architecture of CNN at very high level. The actual implementations can vary in different ways, some of them were shown above.<\/p>\n<figure id=\"attachment_1246\" aria-describedby=\"caption-attachment-1246\" style=\"width: 1090px\" class=\"wp-caption alignnone\"><img data-attachment-id=\"1246\" data-permalink=\"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/cnn\/#main\" data-orig-file=\"http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/CNN.png\" data-orig-size=\"1061,342\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"CNN Architecture\" data-image-description=\"&lt;p&gt;CNN architecture at very high level&lt;\/p&gt;\n\" data-image-caption=\"&lt;p&gt;CNN Architecture&lt;\/p&gt;\n\" data-medium-file=\"http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/CNN-300x97.png\" data-large-file=\"http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/CNN-1024x330.png\" decoding=\"async\" loading=\"lazy\" src=\"http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/CNN-300x97.png\" alt=\"CNN Architecture for Forecasting Time Series Data\" width=\"1400\" height=\"450\" class=\"size-medium wp-image-1246\" srcset=\"http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/CNN-300x97.png 300w, http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/CNN-768x248.png 768w, http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/CNN-1024x330.png 1024w, http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/CNN.png 1061w\" sizes=\"(max-width: 1400px) 100vw, 1400px\" \/><figcaption id=\"caption-attachment-1246\" class=\"wp-caption-text\">CNN Architecture for Forecasting Time Series Data<\/figcaption><\/figure>\n<p><strong>References<\/strong><\/p>\n<p>1. <a href=http:\/\/www.jakob-aungiers.com\/articles\/a\/LSTM-Neural-Network-for-Time-Series-Prediction target=\"_blank\"> LSTM NEURAL NETWORK FOR TIME SERIES PREDICTION<\/a><br \/>\n2. <a href=https:\/\/medium.com\/@alexrachnog\/neural-networks-for-algorithmic-trading-part-one-simple-time-series-forecasting-f992daa1045a target=\"_blank\">Neural networks for algorithmic trading. Part One\u200a\u2014\u200aSimple time series forecasting <\/a><br \/>\n3. <a href=http:\/\/staff.ustc.edu.cn\/~cheneh\/paper_pdf\/2014\/Yi-Zheng-WAIM2014.pdf target=\"_blank\">Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks<\/a><br \/>\n4. <a href=https:\/\/arxiv.org\/pdf\/1611.06455.pdf target=\"_blank\">Time Series Classification from Scratch with Deep Neural Networks: A Strong Baseline <\/a><br \/>\n5. <a href=http:\/\/cs231n.stanford.edu\/reports\/2016\/pdfs\/334_Report.pdf target=\"_blank\">Assessing Neuroplasticity with Convolutional and Recurrent Neural Networks <\/a><br \/>\n6. <a href=http:\/\/proceedings.mlr.press\/v46\/romaszko15.pdf target=\"_blank\">Signal Correlation Prediction Using Convolutional Neural Networks <\/a><br \/>\n7. <a href=https:\/\/halshs.archives-ouvertes.fr\/halshs-01357973\/document target=\"_blank\">Data Augmentation for Time Series Classification using Convolutional Neural Networks. <\/a><br \/>\n8. <a href=https:\/\/github.com\/cauchyturing\/Imaging-time-series-to-improve-classification-and-imputation\/wiki target=\"_blank\">Imaging-time-series-to-improve-classification-and-imputation<\/a><br \/>\n9. <a href=https:\/\/pdfs.semanticscholar.org\/32e7\/b2ddc781b571fa023c205753a803565543e7.pdf target=\"_blank\">Encoding Time Series as Images for Visual Inspection and Classification Using<br \/>\nTiled Convolutional Neural Networks<\/a><br \/>\n10. <a href=https:\/\/arxiv.org\/ftp\/arxiv\/papers\/1701\/1701.04245.pdf target=\"_blank\">Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction<\/a><br \/>\n11. <a href=\"http:\/\/proceedings.mlr.press\/v32\/koutnik14.pdf\"target=\"_blank\">A Clockwork RNN<\/a><br \/>\n12. <a href=\"http:\/\/cs231n.github.io\/convolutional-networks\/\" target=\"blank\">CS231n Convolutional Neural Networks for Visual Recognition<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Convolutional neural networks(CNN) is increasingly important concept in computer science and finds more and more applications in different fields. Many posts on the web are about applying convolutional neural networks for image classification as CNN is very useful type of neural networks for image classification. But convolutional neural networks can also be used for applications &#8230; <a title=\"Forecasting Time Series Data with Convolutional Neural Networks\" class=\"read-more\" href=\"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/\">Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":[]},"categories":[5,9,3],"tags":[15,17,42,18,14,16],"jetpack_publicize_connections":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Forecasting Time Series Data with Convolutional Neural Networks - Machine Learning Applications<\/title>\n<meta name=\"description\" content=\"Forecasting time series data with convolutional neural networks - different approaches that can be used for time series with convolutional neural nets.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Forecasting Time Series Data with Convolutional Neural Networks - Machine Learning Applications\" \/>\n<meta property=\"og:description\" content=\"Forecasting time series data with convolutional neural networks - different approaches that can be used for time series with convolutional neural nets.\" \/>\n<meta property=\"og:url\" content=\"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/\" \/>\n<meta property=\"og:site_name\" content=\"Machine Learning Applications\" \/>\n<meta property=\"article:published_time\" content=\"2017-05-14T00:43:26+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2017-12-05T02:00:49+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/time-series-LSTM-300x164.png\" \/>\n<meta name=\"author\" content=\"owygs156\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"owygs156\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/\",\"url\":\"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/\",\"name\":\"Forecasting Time Series Data with Convolutional Neural Networks - Machine Learning Applications\",\"isPartOf\":{\"@id\":\"http:\/\/intelligentonlinetools.com\/blog\/#website\"},\"datePublished\":\"2017-05-14T00:43:26+00:00\",\"dateModified\":\"2017-12-05T02:00:49+00:00\",\"author\":{\"@id\":\"http:\/\/intelligentonlinetools.com\/blog\/#\/schema\/person\/7a886dc5eb9758369af2f6d2cb342478\"},\"description\":\"Forecasting time series data with convolutional neural networks - different approaches that can be used for time series with convolutional neural nets.\",\"breadcrumb\":{\"@id\":\"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"http:\/\/intelligentonlinetools.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Forecasting Time Series Data with Convolutional Neural Networks\"}]},{\"@type\":\"WebSite\",\"@id\":\"http:\/\/intelligentonlinetools.com\/blog\/#website\",\"url\":\"http:\/\/intelligentonlinetools.com\/blog\/\",\"name\":\"Machine Learning Applications\",\"description\":\"Artificial intelligence, data mining and machine learning for building web based tools and services.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"http:\/\/intelligentonlinetools.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"http:\/\/intelligentonlinetools.com\/blog\/#\/schema\/person\/7a886dc5eb9758369af2f6d2cb342478\",\"name\":\"owygs156\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"http:\/\/intelligentonlinetools.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"http:\/\/2.gravatar.com\/avatar\/b351def598609cb4c0b5bca26497c7e5?s=96&d=mm&r=g\",\"contentUrl\":\"http:\/\/2.gravatar.com\/avatar\/b351def598609cb4c0b5bca26497c7e5?s=96&d=mm&r=g\",\"caption\":\"owygs156\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Forecasting Time Series Data with Convolutional Neural Networks - Machine Learning Applications","description":"Forecasting time series data with convolutional neural networks - different approaches that can be used for time series with convolutional neural nets.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/","og_locale":"en_US","og_type":"article","og_title":"Forecasting Time Series Data with Convolutional Neural Networks - Machine Learning Applications","og_description":"Forecasting time series data with convolutional neural networks - different approaches that can be used for time series with convolutional neural nets.","og_url":"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/","og_site_name":"Machine Learning Applications","article_published_time":"2017-05-14T00:43:26+00:00","article_modified_time":"2017-12-05T02:00:49+00:00","og_image":[{"url":"http:\/\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/05\/time-series-LSTM-300x164.png"}],"author":"owygs156","twitter_card":"summary_large_image","twitter_misc":{"Written by":"owygs156","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/","url":"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/","name":"Forecasting Time Series Data with Convolutional Neural Networks - Machine Learning Applications","isPartOf":{"@id":"http:\/\/intelligentonlinetools.com\/blog\/#website"},"datePublished":"2017-05-14T00:43:26+00:00","dateModified":"2017-12-05T02:00:49+00:00","author":{"@id":"http:\/\/intelligentonlinetools.com\/blog\/#\/schema\/person\/7a886dc5eb9758369af2f6d2cb342478"},"description":"Forecasting time series data with convolutional neural networks - different approaches that can be used for time series with convolutional neural nets.","breadcrumb":{"@id":"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/"]}]},{"@type":"BreadcrumbList","@id":"http:\/\/intelligentonlinetools.com\/blog\/2017\/05\/14\/time-series-prediction-with-convolutional-neural-networks\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"http:\/\/intelligentonlinetools.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Forecasting Time Series Data with Convolutional Neural Networks"}]},{"@type":"WebSite","@id":"http:\/\/intelligentonlinetools.com\/blog\/#website","url":"http:\/\/intelligentonlinetools.com\/blog\/","name":"Machine Learning Applications","description":"Artificial intelligence, data mining and machine learning for building web based tools and services.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"http:\/\/intelligentonlinetools.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"http:\/\/intelligentonlinetools.com\/blog\/#\/schema\/person\/7a886dc5eb9758369af2f6d2cb342478","name":"owygs156","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/intelligentonlinetools.com\/blog\/#\/schema\/person\/image\/","url":"http:\/\/2.gravatar.com\/avatar\/b351def598609cb4c0b5bca26497c7e5?s=96&d=mm&r=g","contentUrl":"http:\/\/2.gravatar.com\/avatar\/b351def598609cb4c0b5bca26497c7e5?s=96&d=mm&r=g","caption":"owygs156"}}]}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p7h1IJ-j0","jetpack-related-posts":[{"id":1446,"url":"http:\/\/intelligentonlinetools.com\/blog\/2017\/11\/06\/10-new-top-resources-on-machine-learning-from-around-the-web\/","url_meta":{"origin":1178,"position":0},"title":"10 New Top Resources on Machine Learning from Around the Web","date":"November 6, 2017","format":false,"excerpt":"For this post I put new and most interesting machine learning resources that I recently found on the web. This is the list of useful resources in such areas like stock market forecasting, text mining, deep learning, neural networks and getting data from Twitter. Hope you enjoy the reading. 1.\u2026","rel":"","context":"In &quot;Machine Learning&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1257,"url":"http:\/\/intelligentonlinetools.com\/blog\/2017\/06\/17\/time-series-prediction-with-convolutional-neural-networks-and-keras\/","url_meta":{"origin":1178,"position":1},"title":"Time Series Prediction with Convolutional Neural Networks and Keras","date":"June 17, 2017","format":false,"excerpt":"A convolutional neural network (CNNs) is a type of network that has recently gained popularity due to its success in classification problems (e.g. image recognition or time series classification) [1]. One of the working examples how to use Keras CNN for time series can be found at this link[2]. This\u2026","rel":"","context":"In &quot;Artificial Intelligence&quot;","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2017\/06\/CNN22-300x212.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":621,"url":"http:\/\/intelligentonlinetools.com\/blog\/2016\/10\/09\/online-resources-for-neural-networks-with-python\/","url_meta":{"origin":1178,"position":2},"title":"Online Resources for Neural Networks with Python","date":"October 9, 2016","format":false,"excerpt":"The neural network field enjoys now a resurgence of interest. New training techniques made training deep networks feasible. With deeper networks, more training data and powerful new hardware to make it all work, deep neural networks (or \u201cdeep learning\u201d systems) suddenly began making rapid progress in areas such as speech\u2026","rel":"","context":"In &quot;Artificial Intelligence&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1783,"url":"http:\/\/intelligentonlinetools.com\/blog\/2018\/01\/19\/machine-learning-stock-prediction-lstm-keras\/","url_meta":{"origin":1178,"position":3},"title":"Machine Learning Stock Prediction with LSTM and Keras","date":"January 19, 2018","format":false,"excerpt":"In this post I will share experiments on machine learning stock prediction with LSTM and Keras with one step ahead. I tried to do first multiple steps ahead with few techniques described in the papers on the web. But I discovered that I need fully understand and test the simplest\u2026","rel":"","context":"In &quot;Machine Learning&quot;","img":{"alt_text":"Forecasting one step ahead LSTM 60","src":"https:\/\/i0.wp.com\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2018\/01\/Forecasting-one-step-ahead-LSTM-60-3_1_2018.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":1754,"url":"http:\/\/intelligentonlinetools.com\/blog\/2018\/02\/27\/time-series-prediction-lstm-keras\/","url_meta":{"origin":1178,"position":4},"title":"Time Series Prediction with LSTM and Keras for Multiple Steps Ahead","date":"February 27, 2018","format":false,"excerpt":"In this post I will share experiment with Time Series Prediction with LSTM and Keras. LSTM neural network is used in this experiment for multiple steps ahead for stock prices data. The experiment is based on the paper [1]. The authors of the paper examine independent value prediction approach. With\u2026","rel":"","context":"In &quot;Machine Learning&quot;","img":{"alt_text":"Multiple step prediction with separate neural networks","src":"https:\/\/i0.wp.com\/intelligentonlinetools.com\/blog\/wp-content\/uploads\/2018\/02\/multiple-step-prediction.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":9,"url":"http:\/\/intelligentonlinetools.com\/blog\/2016\/01\/30\/general-regression-neural-networks\/","url_meta":{"origin":1178,"position":5},"title":"General Regression Neural Networks","date":"January 30, 2016","format":false,"excerpt":"General Regression Neural Networks (GRNN) is one of the type of neural networks with a one pass learning algorithm. The simplicity of algorithm for GRNN is one of the advantage of this neural network and many researchers use it. In one of recent paper was proposed algorithm that is using\u2026","rel":"","context":"Similar post","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"http:\/\/intelligentonlinetools.com\/blog\/wp-json\/wp\/v2\/posts\/1178"}],"collection":[{"href":"http:\/\/intelligentonlinetools.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/intelligentonlinetools.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/intelligentonlinetools.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/intelligentonlinetools.com\/blog\/wp-json\/wp\/v2\/comments?post=1178"}],"version-history":[{"count":78,"href":"http:\/\/intelligentonlinetools.com\/blog\/wp-json\/wp\/v2\/posts\/1178\/revisions"}],"predecessor-version":[{"id":1608,"href":"http:\/\/intelligentonlinetools.com\/blog\/wp-json\/wp\/v2\/posts\/1178\/revisions\/1608"}],"wp:attachment":[{"href":"http:\/\/intelligentonlinetools.com\/blog\/wp-json\/wp\/v2\/media?parent=1178"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/intelligentonlinetools.com\/blog\/wp-json\/wp\/v2\/categories?post=1178"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/intelligentonlinetools.com\/blog\/wp-json\/wp\/v2\/tags?post=1178"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}