Why do i always feel negative energy when i visit my family ?

your family is probably very toxic.

Why are you go there in the first place?

Food, seeing family, needing to talk to your Dad, or Mother, or just walking around familiar things?

Then the conversation, especially on some succinct subject....

No satisfaction as you expected?

Think it  all through.

The adjustments come from you.

Someone is toxic there..... 

Do they tell you what to do, how to do it, and then have a go at you for doing whatever it is, all wrong? Because if they do, that would be my answer to your question.

The same thing happens to me, but not with my fam, but with some people.

Some people are just bad people and you, as an empath, can feel that energy.