Lol so this one is an interesting topic. I do physics SL and have actively worked with students who are doing HL and checked the HL parts out. First of all, Physics in general is ALOT of work. My teacher struggled to finish the course and actually ended up making the students teach themselves the HL topic. If your grade is better in Chem for grade 10(year 11), go for that because your foundation knowledge needs to be very strong for Physics.