I have a lot of anxiety including social anxiety.

It's easy for me to rationalize that I shouldn't be afraid, but the symptoms still come. Taking deep breaths does not help at all.

How can I get rid of it all?

Maybe doing something like yoga would help. I cannot claim to practice it myself but I have heard that it and other of these kind of meditative practices can be of great help. Also visiting a councillor to get to the bottom of why you ache the anxiety might help too. I agree with you that drugs should be a last resort although they certainly do have a role to play in the short term after a traumatic went for instance.

Yoga and Meditation will be best natural medicine to get rid of anxiety and depression. It may take some time. It needs patience. But you surely will get rid of your problem. Find some Yoga instructor in your area.

Yes I do agree that these kinds of relaxation exercises can be greatly beneficial and it is sometimes too easy to reach for medicine when really we can get things greatly improved by some sort of relaxation technique. I think the best thing would be to see someone who knows all about relaxation techniques and see what they suggest for you!