My belief is that courage is needed, not confidence, to go do the things that seem hard.
When you walk into a room full of people, do you notice those who are present and focused, rather than distracted? Do you sense those who are engaged in the moment?
The word stress has become a catch all for lots of emotions. Get more discerning - rename it as irritation, fear, anger, worry, sadness... or another description.