work hours with your team

i need help understanding the work hour dynamic between teams. so i’m usually an early bird and like to get started by 8am so i can be done by 5 during non busy season. however my team usually likes to start around 9/10am. does it look bad that i leave at 5 and they all stay till 6/7? idk i’ve been given the look before on why im leaving early but just want to see how everyone else perceives this. any help is appreciated!