Nonsensical Excel and Statistica Default Output and Algorithm for an Adequate Display

Abstract

The purpose of this paper is to present an algorithm that determines the necessary and sufficient number of significant digits in the coefficients of a polynomial trend to achieve a pre-specified precision for the polynomial trend. Thus, the obtained coefficients should be presented in the default output when fitting the experimental data with the polynomial trend. Namely, when finding the best fitting function for a certain type of data, there is a real possibility of making significant errors when using the default output of the Excel 2003, 2007, 2010, and 2013 and Statistica for Windows 2007-2012 software packages. Conversely, the software package Mathematica (version 6) has been very good at dealing with precision problems, although the default output sometimes shows more significant digits than necessary.

0

Turn this paper into a lesson

ArcXiv compiles a structured reading guide from this paper's metadata: plain-English importance, contributions, prerequisite concepts, which sections to read first, flashcards, and a quiz. Grounded in the abstract, never invented.

Discussion (0)

Sign in to join the discussion.

Loading comments…