Xulane - My patch fell off, am I protected from sex I had previously?

I had my patch and I had a lot of sex the day of and then it fell out several hours later so I want to know if I'm protected from that or if I should be worried