Understanding the morphology and flow behavior of cellulose nanofibers (CNFs) dispersed in organic solvents can improve the process of fabricating new cellulose-based nanocomposites. In this study, jute-based 2,2,6,6-tetramethylpiperidinyl-1-oxyl (TEMPO)-oxidized CNFs with two different charge densities (0.64 and 1.03 mmol/g) were dispersed in ethylene glycol (EG) and propylene glycol (PG) using the solvent exchange method. The morphology and dimensions of CNFs in dry and suspension states were characterized using transmission electron microscopy, atomic force microscopy, and small-angle X-ray scattering techniques. The results showed that the cross-sectional dimensions remained the same in different solvents. Rheological measurements revealed that CNF suspensions in water or glycol (EG and PG) behaved similar to typical polymer solutions with a solvent-independent overlap concentration corresponding to the crowding factor of about 14. Furthermore, a thixotropic behavior was found in the concentrated CNF/glycol systems as observed in typical CNF aqueous suspensions. The fact that TEMPO-oxidized CNFs can be well dispersed in organic solvents opens up new possibilities to improve the CNF–polymer matrix blending, where the use of a viscous solvent can delay the transition to turbulence in processing and improve the control of fiber orientation because of a slower Brownian diffusive motion.