I like studying physics but I do not have good base in maths? should I leave science?

Science and Math are very intertwined. If you are not good at math you will have a very hard time with science. Generally there is a lot of math that is pre-requisite to a sciece majors.