Anti skate question for Fluance RT82

Can’t tell if my anti skate is off on this new TT. If I let a record play almost to the end of an album I’ll lift up the cueing lever and every so often the the needle will actually make this slight skipping sound like it’s skipping out of the grooves when the arm raises. When I lift the cueing lever when it’s playing towards the end of the record the arm seems to have a slight drift to the left or towards the center of the platter instead of lifting straight up