First analyze your links in google webmaster there is an option internal links go there and check out each link one by one, remove those who are unnatural ,low quality,irrelevant
You can also notice that if a webmaster is showing some message about links then you have been hitted by manual penalty, if there is no message and you have seen sudden drop in traffic then algorithmic penalty must.
Also analyse your analytics account if there is sudden drop in traffic.