Precision¶
There are two variables that configure the precision of the decimal and fractional results:
/**
* Highest denominator to attempt to match on
* @type {Number}
* @private
*
* @properties={typeid:35,uuid:"D2D263FE-7078-410E-A130-5DC6427D39D2",variableType:4}
*/
var _fractionPrecision = 64;
/**
* Highest number of decimals
* @type {Number}
* @private
*
* @properties={typeid:35,uuid:"B3D8AC4E-18C4-42EF-A643-26B531D7F733",variableType:4}
*/
var _decimalPrecision = 6;