Josh not enjoying himself after the altercation