No, I don't suggest removing cards from your deck. Even cards that we may consider "negative" can represent positive opportunities for you. Every Tarot card can carry both positive and negative energies, and it's important to be mindful of that and to try to interpret it in the best way possible. It is true that the Tower and Three of Swords can signify difficult times, but they can also symbolize breaking away from outdated mentalities, and the opportunity to find peace and growth. Try to look beyond the "negative" and focus on what the cards are teaching you.