Summary

This operator calculates a regression model for a time series. The regression model tries to explain observations with the help of trends, seasonal variations and other influencing factors, and creates a forecast for future dates.

A time series is a sequence of data points, measured typically at successive times spaced at uniform time intervals [1], e.g., temperature measured at every hour, or weekly sales figures.

The seasonal regression model allows also to analyze whether the observed data depend on other influencing factors (e.g., training, marketing campaigns, number of employees).

A detailed description of regression analysis methods can be found at [2].

Requirements for data to be analyzed

  • Input data must be scaled, i.e., the time stamps in columns 'Date + time (from)' and 'Date + time (to)' represent uniform time intervals of the same duration. (see Scaling 8.0)
  • Input data must be sorted by time stamps in the columns 'Date + time (from)' and 'Date + time (to)'.
  • The columns 'Date + time (from)' and 'Date + time (to)' must not contain missing entries.
  • The underlying data must comprise at least one complete season.
  • If one or several observations are missing, the corresponding time stamps will be inserted into the data. The inserted entries are treated as missing observations.

Configuration

Input settings of existing table

Settings

Remarks

  • Additional information, such as training and validation errors, and warnings, are reported in the description field of the operation within the TIS-GUI.
  • If the column of an influencing factor contains the same constant value for each observation no regression analysis can be carried out. Thus, constant factors are excluded automatically.


Want to learn more?

This operator calculates a regression model for a time series. The regression model tries to explain observations with the help of trends, seasonal variations and other influencing factors, and creates a forecast for future dates.

Examples

Example: Regression model with trend and season

Situation

We consider the number of incoming phone calls at a call center over a time period. We are given the number of incoming calls for each week during the last four years.

  • We see that in general the number of calls has been rising during the last years. However, the number of incoming calls varies strongly over an entire year. Usually, the number of incoming calls is greater during the first half year than during the second half year.
  • With the regression analysis operation we want to build a model explaining the number of incoming calls over the last four years. Furthermore, we want to estimate and forecast the number of incoming calls for future periods of time.

Settings
  • Add the operation 'Regression analysis 6.0' to the current data node.
  • A single season seems to last an entire year. Since we are dealing with weekly data, we must select '52 weeks' for the Duration of the season.
  • As a result of the operation we would like to obtain the historical number of phone calls, the forecast for the next season (= 52 weeks), and the historical forecasts, i.e., the estimated number of incoming phone calls for the last four years. For that purpose we select the option 'Forecast + history + hist. forecast + confidence intervals' as the result to be delivered by the operation.
  • In this step we want to start with a simple regression model. Thus, our model shall only include a linear trend and season.
  • All other settings keep their default values

Result

The result table shows the forecast (G), and the lower and upper limits of the confidence intervals (E and F).

By adding a chart operation Chart: Histogram Time Pattern the visualization shows that the historical forecasts (orange line) estimated with the obtained regression model show a similar trend and seasonal behaviour as the historic observations (blue line). The red line shows the estimated number of phone calls for the next 52 weeks.

Project-File

...


Example: Regression model with trend, season and influencing factors

Situation
  • In the previous example many high values within the history could not be explained by the regression model with linear trend and season.
  • After careful investigation of the data, we suspect that the high historical values occur in weeks in which the company runs advertising campaigns for their products. Thus we extended our original input table for the regression analysis by an additional column, which contains a '1' whenever a campaign took place in the respective week and an '0' otherwise. Moreover, we recorded also the campaigns planned for the next 52 weeks and inserted a distinction column in order to separate historical observations (marked with an 'H') from future entries (marked with an 'F').

On the basis of that modified input we can now build an extended regression model. We specify advertising campaigns as an addtional influencing factor and the distinction column in the settings of the regression operation.

Settings

Result

The resulting data node shows the forecast (G), and the lower and upper CI limits (E, F).

In the histogram visualizing the results (added with the operation Chart: Histogram Time Pattern) we see that campaigns could indeed explain an increased number of incoming calls in the past (compare orange and blue line). Also the forecast for the next 52 weeks (red line) contains high values whenever an advertising campaign will be run.


Troubleshooting

Problem

Frequent Cause

Solutions

Error message: "Object reference not set to an instance of an object."
in TIS 5.8.2, this error message occurs when the box "Output the validation result in data nodes" is checked. This is a bug, see ticket BugFLEX-505 - Regressionsanalyse 6.0 - Fehler Validierung AUCH in Regression Open

...

Forecast for excluded days, e.g., holiday.

The operator does not consider if a day in the future period is a day to be excluded or not.

In our TIS Forecast solution not additional influcencing factors for days to be exlcuded are provided. If a regression model is based on at least of these influencing factor, the forecasted value for that day will be null.

If a regression model does not use any additional influencing factors, e.g., they are all elminated due a high p-value, then will be a forecasted value for an excluded day.

In the TIS forecasting solution those forecasted rows representing excluded days will be eliminated after the regression forecast (merge data, rows without a common key in data node 2).

Month October is included in quarter 3 instead of quarter 4

Affects results only when option "Include quarters" is checked in TIS versions up to 6.8. This bug was fixed in TIS 6.9

Fixed in TIS 6.9

Related topics