The orbital effect on the anomalous magnetism and evolution of single crystals with low La doping, LaxY1-xVO3 (x = 0, 0.1, and 0.2), has been studied using single-crystal X-ray diffraction, specific heat, mag-netization, and Raman-scattering techniques. It is found that substituting Y3+ by La3+ increases the de-generacy of the yz/zx orbitals and decreases the Jahn-Teller distortion. These weakens the G-type (antiphase ordering along the c axis) orbital ordering phase. Meanwhile, the substituting decreases the magnetism entropy, indicating the shrinking of the t2g and eg orbital hybridization, eventually destabilizing the C-type (in-phase ordering along the c axis) antiferromagnetic ordering phase. In addition, the mechanism for the shrinking of the diamagnetism with increasing x is analyzed. It may attribute to the competition between the antisymmetric Dzyaloshinsky-Moriya interaction and the single-ion anisotropy.