Choosing altitudes based on winds aloft can make all the difference. Smaller headwind or crosswind one direction, the get into a strong tailwind the other direction and the assumption that out and back equalizes the speeds goes out the window.