There is an attribute of the input element called "step" that controls this. You can see this behavior by using the browser inspect element functionality to edit this value on the input element. It starts as step="any" and if you change it to things like step="5" or step="0.01" you can see that behavior changing. What you would need for your desired behavior is for step="0.01" to be the setting.
Unfortunately, that change isn't currently possible in the Forms Layout Designer (as of Forms 11 Update 3). The Forms Layout Designer does not include a setting to configure the step value and it cannot be changed via Javascript because that setting is not one that has been included in the LFForm Object's changeFieldSettings interface, and the Javascript cannot directly manipulate field elements.
This would be a nice thing to be able to control, so hopefully Laserfiche adds this to the list of functions that can be managed in the future by a configuration on the field or via the LFForm Object's changeFieldSettings interface (I'm tagging @████████and @████████to hopefully consider that addition). But until that happens, this is not going to be possible in the Forms Layout Designer.
If it's a big problem for your process, here is some CSS to hide the buttons within the field. If you add this to your form, if will hide it on any field with the CSS Class of hideNumberScroll.
.hideNumberScroll input::-webkit-outer-spin-button,
.hideNumberScroll input::-webkit-inner-spin-button {
-webkit-appearance: none;
margin: 0;
}