instruction: Find all events taking place in New York City during the month of September.

judge_verdict: fail

agent_status: timeout

agent_error: timeout after 300 seconds


instruction: Find help page about buying tickets.

judge_verdict: pass

agent_status: success


instruction: check two ticket with best seat that has promo code first show happening in Hamilton New York on April.

judge_verdict: pass

agent_status: failed


instruction: Find the cheapest women's plus size brown color loungewear in 3xl size.

judge_verdict: fail

agent_status: timeout

agent_error: timeout after 300 seconds


instruction: Rent a truck with the lowest rent with two dozen furniture pads for 100 miles at zip 08817 on April 12 at 2:30 pm rented truck is to be returned to the exact location and date, and the pickup and drop off will be at the nearest location.

judge_verdict: fail

agent_status: timeout

agent_error: timeout after 300 seconds


instruction: search gas pickup truck in Fremont with 2010 and 2017 with less than 80000 mile

judge_verdict: fail

agent_status: success


instruction: find my trip with confirmation number SFTBAO including first and last name Joe Lukeman

judge_verdict: fail

agent_status: failed


instruction: Find the status of March 25 flights from New York airports to Columbus in Ohio.

judge_verdict: fail

agent_status: timeout

agent_error: timeout after 300 seconds


instruction: Browse the venues that are playing the Wicked show from Oct 5 to Oct 24 2023

judge_verdict: fail

agent_status: failed


instruction: Buy a diamond pass in New York's, Great escape park, add one meal dining plan to it, and select the flexible payment plan for Jame Jones. The email address is jame_jones@hotmail.com, zip code 10005 and age is 35.

judge_verdict: fail

agent_status: failed


instruction: Add to my wish list the highest rated activity in Amsterdam.

judge_verdict: pass

agent_status: success


instruction: Find the movie Donnie Darko and show its complete cast.

judge_verdict: pass

agent_status: success


instruction: Browse the list of top 250 movies and add the first one to my watchlist.

judge_verdict: fail

agent_status: failed


instruction: see Nissan and Honda cars for sale near Kentwood, MI 49512

judge_verdict: fail

agent_status: success


instruction: Build an entry-level pc with an windows 11 64 bit intel i7 CPU with a256gb ssd drive +  4gb ram and adding cheapest component and accessories available.

judge_verdict: fail

agent_status: timeout

agent_error: timeout after 300 seconds


instruction: Find 32" Curved monitor and add the third one to the wish list.

judge_verdict: fail

agent_status: success


instruction: Search the cheapest Curry brand unisex athletic shoes with the number 5.5, add to cart and checkout.

judge_verdict: fail

agent_status: timeout

agent_error: timeout after 300 seconds


instruction: Browse spider-man toys for kids and sort by lowest price.

judge_verdict: pass

agent_status: success


instruction: Find the store location and hours of the closest Gamestop to zip code 90028 and set as home store

judge_verdict: fail

agent_status: failed


instruction: Find and view the biography for the Host of the Price  is Right.

judge_verdict: pass

agent_status: success


instruction: Find a private room in New York for 1 April and checkout on 2 April for 2 adults

judge_verdict: fail

agent_status: success


instruction: Check the status of train S92 for any disruptions.

judge_verdict: pass

agent_status: success


instruction: Get the report from the final environmental impact statement for the Jamaica Bus Depot expansion.

judge_verdict: pass

agent_status: success


instruction: Plan a trip to reach JFK airport from central park by 11am on April 12

judge_verdict: fail

agent_status: timeout

agent_error: timeout after 300 seconds


instruction: Rent " The Whale " movie on demand with format "high definition".

judge_verdict: fail

agent_status: timeout

agent_error: timeout after 300 seconds


instruction: Browse the page with event planning tips.

judge_verdict: fail

agent_status: timeout

agent_error: timeout after 300 seconds


instruction: Search for a paid fishing class event on chicago

judge_verdict: fail

agent_status: timeout

agent_error: timeout after 300 seconds