|
Title: Ask Reuben 84 - Precision Post by: Reuben B. on June 18, 2021, 05:44:15 am We have a new promotional video (https://vimeo.com/555734404/a72ceb5d53) on the front of our website that has some large numbers, but it reminded me of some extremely small numbers from a recent support case. When Genero is evaluating expressions, the datatype of an intermediate or resultant expression maybe an INTEGER or a DECIMAL(16), that is be accurate to 16 digits. This can lead to a result you might not be expecting. In this article I take the numbers from this interesting support case and explain how they can lead to an unexpected result. I then look at some of the strategies you can adopt.
Read more at https://4js.com/ask-reuben/ig-84/ |