Thanks @BMThiker for encouraging me to stir the pot. Like you, I went without a swaybar for most of the time I owned my FJC. And, I waffled on how much I felt the impact of when I decided to re-install it and without. Also, keep in mind that I also went through all of the OME front spring options, eventually winding up with ICON adjustable coilovers.
My personal experience was the combination of the correct spring weight in combination of removing the swaybar gave the front end suspension the best opportunity to flex/articulate. I found OME 886's too heavy to allow much movement, 884's soft but not enough spring weight to run larger tires. Having ICON's allowed me to run a spring that allowed full compression, using the adjustment ring to give me just enough lift to run the 35X10.50 tires.
Running without a swaybar had me adjusting my highway/freeway driving habits to allow plenty of space since the tall/skinny tires I ran + no swaybar + "softish" springs made the FJC something I would NOT want to perform a high-speed emergency avoidance maneuver. Instead, I pretty much knew I'd be relying upon ABS and Demello bumper up front.
With that said, I did drive it across he country several times without the front swaybar and never felt uncomfortable or unsafe while doing so.