Ive pulled up to passengers, just after their original driver was leaving because Lyft switched as he was pulling up. It might not be dudes fault, and you should always leave extra early for things that are important!