1 min readApr 8, 2020
I am sure you know it but still, there is difference between datatype conversion from float
to uint8
. But essentially we want a quantizied int8
. Most of the AI frameworks have such function so that the data is ready for edge devices, this is special type of conversion where scale down happens for a float datatype based on the precision range.
Tensorflow has tf.quantization.quantize()
you can find more details here.