Study finds 90% of ChatGPT-generated travel itineraries inaccurate

Planning a trip can be a daunting task, with so many things to consider and organize. That’s why many travelers are turning to AI tools like ChatGPT to help create their travel itineraries. However, a recent survey conducted by SEO Travel found that 90% of ChatGPT-generated travel itineraries were inaccurate, with a range of errors that could potentially derail a trip.

The research involved requesting ChatGPT to create 10 two-day itineraries for each of 10 city destinations, including popular locations like London, Paris, and New York. However, when the results were analyzed, researchers were shocked to find that the majority of the itineraries were “riddled with inaccuracies”.

One of the most common errors found in the itineraries was recommendations for restaurants, cafes, or attractions that had permanently or temporarily closed. For example, in Berlin, ChatGPT suggested visiting the Pergamon Museum, which is actually closed until 2026, and Café Einstein, which shut down last year. Additionally, over half of the itineraries included suggestions to visit attractions, cafes, or restaurants outside of their opening hours.

Other errors included including Michelin-starred restaurants despite their high cost, recommending unnecessary detours or backtracking, suggesting non-existent places, and even proposing staying in different hotels each night on trips to certain cities.

SEO Travel director Tom McLoughlin highlighted the importance of not solely relying on AI tools for travel planning. While AI can be a helpful tool, it lacks the personal insight and tailored recommendations that a human travel expert can provide. McLoughlin emphasized the need for operators and agents to communicate their expertise and personalized service to travelers, especially in a world where AI is becoming more prevalent.

The survey was conducted using the ChatGPT-3.5 version, which was launched to great fanfare in November 2022. While AI technology continues to advance, this study serves as a reminder that human expertise and personalization are still invaluable in the travel industry.

In conclusion, while AI tools like ChatGPT can certainly be useful for travel planning, it’s essential for travelers and travel companies to remain vigilant and not rely solely on AI-generated itineraries. Personalized recommendations and expert knowledge are key components of a successful and enjoyable trip, and should not be overlooked in the age of AI.