I'm in life science and didn't take any high school physics.
I took phys 1L03 during the school year and had no problems with it. Some of the content will be assumed knowledge to those who took it in high school but the prof still reteaches it, so no worries. Plus, there are tutorials + a quiz every week, which keep you up-to-date on the material.
I took phys 1B03 in the summer and again, wasn't too bad.