Will these things prevent fat loss?

Can somebody give me a straight answer and not technicalities and outliers? Simply put, is it possible, and/ or a normal occurrence, for people to not be able to lose fat while being at a caloric deficit(and burning calories through workouts) to still not be able to lose fat? If there aren't enough calories for your body to sustain its current weight. Why would it matter how many carbs, sodium, sugar, etc you're getting? Yes, I get that those things can matter for general health, but I'm talking strictly about fat loss. Also, I'm not talking about WATER weight, which sodium can affect. I'm talking about actual FAT!

I've lost tons of weight/Fat from simple calories in vs calories out. Not counting carbs, sodium, sugar, etc. But it's crazy to me the level of strictness that so many people seem to advise.