Are you sure the volume adjustment you are seeing is the TV? Or is it the Kodi volume? Kodi volume should be 100% in almost all cases when volume is actually controlled by other devices, and most particularly when audio passthrough is in use.
If you are not terribly familiar with the config options, you should try to use this guide to make sure you config is optimized for your use/case.