In this paper, we address robust design of symbol-level precoding (SLP) for the downlink of multiuser multiple-input single-output wireless channels, when imperfect channel state information (CSI) is available at the transmitter. In particular, we consider a well known model for the CSI imperfection, namely, stochastic Gaussian-distributed uncertainty. Our design objective is to minimize the total (per-symbol) transmission power subject to constructive interference (CI) constraints as well as the users' quality-of-service requirements in terms of signal-to-interference-plus-noise ratio. Assuming stochastic channel uncertainties, we first define probabilistic CI constraints in order to achieve robustness to statistically known CSI errors. Since these probabilistic constraints are difficult to handle, we resort to their convex approximations in the form of tractable (deterministic) robust constraints. Three convex approximations are obtained based on different conservatism levels, among which one is introduced as a benchmark for comparison. We show that each of our proposed approximations is tighter than the other under specific robustness settings, while both of them always outperform the benchmark. Using the proposed CI constraints, we formulate the robust SLP optimization problem as a second-order cone program. Extensive simulation results are provided to validate our analytic discussions and to make comparisons with conventional block-level robust precoding schemes. We show that the robust design of symbol-level precoder leads to an improved performance in terms of energy efficiency at the cost of increasing the computational complexity by an order of the number of users in the large system limit, compared to its non-robust counterpart.