I would say, if you made the tea and it sat out, yes. Like days. Because there is bacteria and you can grow mold on tea. (Learned that by leaving a pot on the counter when we went out of town).
If you are talking bags, I suppose it depends on how old, where they were kept, etc.
Its much better to be safe than sorry. Toss that box and head to the store for more.
Cause who can ever have too much tea?