Here is the media info for 2 example files. First video has green splodges and video stuttering, second just has video stuttering. both have good audio.
Well both files are not MPEG2 so it is not the licence issue.
I assume you already have played them with another machine (e.g. your PC) and they are playing fine there, or?
If that is the case than next step is that you enable debugging play the two movies each for a minute and the upload the logs with grab-logs -A or via MyOSMC
If it shows a crash then I have no idea why that happened, it hasnt happened before and i’ll try and get to the bottom of that if it becomes a recurrent issue.
In the meantime, can you tell me how you go about forcing SW decoding?
As a first step to avoid issues I would take out the overclocking. While it might not help your decoding issue it could still be an issue leading to overheating and therefore down throttling.
Can you try to copy one of the files not working to the SD Card and try to play it then.
Are you sure that your Pi is getting enough power? Can you try unplugging that USB Hub/Device?
In regards to enforcing sw decoding. Those codecs can not be decoded in Hardware so they automatically are decoded in software. The only thing you can play around with is MMAL or OMX as players in Settings → Video Output.
Pretty sure my pi is getting enough power. I’m running a portable HDD on it and was having issues with my 1A power supply (it wasnt even mounting on osmc). I bought a 2.5A one from raspberry pi and its been mounting and reading fine since and the power light on the pi has been rock steady.
Turning off overclocking and copying to SD card hasnt changed anything either.
Is there an ideal video format to use? if so what is it?
Well not directly and H.264 that you have there is what 99% of people will use for most of their stuff.
I still would say your issue must be some how related to your USB either not enough power or a bad Hub.
So if you unplug all USB devices and play from the SD Card the issue still exists?
If that is the case maybe you can upload a 5 Minute sample of one file that has problems so that we can check on another device.
Meanwhile, I can’t seem to find how to change mmal or omx in the settings anywhere. I may be being blind about it but I have looked all over the menus.