Queue Trigger starting with too many jobs

Just to analyse the scenario - Try changing the Minimum number of items to trigger the first job as 5 and see how it is behaving

Does all the 6 process were running at the same time or one after other?

If it ran one after the other - during retry there could be some delay and that could be the reason. See the behaviour closely after changing the count as 5 and let us know the details