Semantic Role Labels for "Waffle Grilled Cheese"

Instructions
Step 1: [ 00:00 - 00:08 ] - in a large bowl combine waffle mix rosemary egg oil and milk.
Step 2: [ 00:08 - 00:10 ] - stir until well combined.
Step 3: [ 00:10 - 00:13 ] - pour about ½ cup of the batter into the waffle iron .
Step 4: [ 00:13 - 00:16 ] - cook until the waffle is golden brown.
Step 5: [ 00:16 - 00:20 ] - add slices of cheese on half of the waffle.
Step 6: [ 00:20 - 00:21 ] - carefully fold the other half on top and close the lid.
Step 7: [ 00:21 - 00:25 ] - cook until the cheese is melted.
Video
Ground Truth
Step 1-1: combine - waffle mix, rosemary, egg, oil, milk -
Step 2-1: stir - waffle mix, rosemary, egg, oil, milk -
Step 3-1: pour - waffle mix, rosemary, egg, oil, milk -
Step 4-1: cook - waffle mix, rosemary, egg, oil, milk -
Step 5-1: add - cheese slices - waffle mix, rosemary, egg, oil, milk
Step 6-1: fold - waffle mix, rosemary, egg, oil, milk -
Step 7-1: cook - waffle mix, rosemary, egg, oil, milk, cheese slices -
GPT-4o (V)
Step 1-1: combine - waffle mix, rosemary, egg, vegetable oil, milk -
Step 2-1: stir - waffle mix, rosemary, egg, vegetable oil, milk -
Step 3-1: pour - waffle mix, rosemary, egg, vegetable oil, milk -
Step 4-1: cook - waffle mix, rosemary, egg, vegetable oil, milk -
Step 5-1: add - cheese - waffle
Step 6-1: fold - waffle - cheese
Step 7-1: cook - waffle, cheese -
GPT-4o (V+T)
Step 1-1: combine - waffle mix, rosemary, egg, oil, milk -
Step 2-1: stir - waffle mix, rosemary, egg, oil, milk -
Step 3-1: pour - batter -
Step 4-1: cook - waffle -
Step 5-1: add - slices of cheese - half of the waffle
Step 6-1: fold - other half of the waffle - slices of cheese
Step 7-1: cook - waffle, cheese -
Qwnen2-VL-7B (V+T)
Step 1-1: combine - waffle mix, rosemary, egg, vegetable oil, milk -
Step 2-1: stir - waffle mix, rosemary, egg, vegetable oil, milk -
Step 3-1: pour - waffle mix, rosemary, egg, vegetable oil, milk - waffle iron
Step 4-1: cook - waffle mix, rosemary, egg, vegetable oil, milk -
Step 5-1: add - cheddar cheese - waffle mix, rosemary, egg, vegetable oil, milk
Step 6-1: fold - waffle mix, rosemary, egg, vegetable oil, milk, cheddar cheese -
Step 7-1: cook - waffle mix, rosemary, egg, vegetable oil, milk, cheddar cheese -
iSRL-Qwnen2-VL-7B (V+T)
Step 1-1: combine - waffle mix, rosemary, egg, oil, milk -
Step 2-1: stir - waffle mix, rosemary, egg, oil, milk -
Step 3-1: pour - waffle mix, rosemary, egg, oil, milk - waffle iron
Step 4-1: cook - waffle mix, rosemary, egg, oil, milk -
Step 5-1: add - cheese - waffle mix, rosemary, egg, oil, milk
Step 6-1: fold - waffle mix, rosemary, egg, oil, milk, cheese -
Step 7-1: cook - waffle mix, rosemary, egg, oil, milk, cheese -

Semantic Role Labels for "Mixed Berry Crepe Cones"

Instructions
Step 1: [ 00:00 - 00:10 ] - make the crepes by sifting the flour salt and sugar and then slowly stir in the egg and butter.
Step 2: [ 00:10 - 00:23 ] - slowly add the milk into the mixture.
Step 3: [ 00:23 - 00:27 ] - in a nonstick pan over medium heat pour in ⅓ cup of the batter and turn it to cover the whole surface.
Step 4: [ 00:27 - 00:29 ] - cook until the bottom is brown and flip.
Step 5: [ 00:29 - 00:31 ] - set the crepes aside to cool.
Step 6: [ 00:31 - 00:36 ] - lay out a crepe and spread the berries in a quarter section.
Step 7: [ 00:36 - 00:42 ] - fold the crepe in half and then slowly roll it into a cone.
Step 8: [ 00:42 - 00:50 ] - top with more berries if desired whipped cream and powdered sugar.
Video
Ground Truth
Step 1-1: add - flour, salt, sugar -
Step 1-2: stir in - egg, butter - flour, salt, sugar
Step 2-1: whisk in - milk - flour, salt, sugar, egg, butter
Step 3-1: pour - flour, salt, sugar, egg, butter, milk -
Step 3-2: cook - flour, salt, sugar, egg, butter, milk -
Step 4-1: flip - flour, salt, sugar, egg, butter, milk -
Step 5-1: set - flour, salt, sugar, egg, butter, milk - aside
Step 6-1: spread - berries - flour, salt, sugar, egg, butter, milk
Step 7-1: fold - flour, salt, sugar, egg, butter, milk, berries -
Step 7-2: roll - flour, salt, sugar, egg, butter, milk, berries -
Step 8-1: top - flour, salt, sugar, egg, butter, milk, berries - berries, whipped cream, powdered sugar
GPT-4o (V)
Step 1-1: add - flour, salt, sugar -
Step 1-2: stir in - flour, salt, sugar -
Step 2-1: whisk in - eggs, butter - flour, salt, sugar
Step 3-1: pour - batter -
Step 3-2: cook - batter -
Step 4-1: flip - crepe -
Step 5-1: set - crepe -
Step 6-1: spread - berries - crepe
Step 7-1: fold - crepe - berries
Step 7-2: roll - crepe - berries
Step 8-1: top - crepe - whipped cream, berries
GPT-4o (V+T)
Step 1-1: add - flour, salt, sugar -
Step 1-2: stir in - egg, butter - flour, salt, sugar
Step 2-1: whisk in - milk - flour, salt, sugar, egg, butter
Step 3-1: pour - batter -
Step 3-2: cook - batter -
Step 4-1: flip - crepe -
Step 5-1: set - crepes -
Step 6-1: spread - berries - crepe
Step 7-1: fold - crepe - berries
Step 7-2: roll - crepe - berries
Step 8-1: top - crepe - berries, whipped cream, powdered sugar
Qwnen2-VL-7B (V+T)
Step 1-1: add - flour, salt, sugar, eggs, butter, milk -
Step 1-2: stir in - ?? - flour, salt, sugar, eggs, butter, milk
Step 2-1: whisk in - ?? - flour, salt, sugar, eggs, butter, milk
Step 3-1: pour - flour, salt, sugar, eggs, butter, milk - pan
Step 3-2: cook - flour, salt, sugar, eggs, butter, milk -
Step 4-1: flip - flour, salt, sugar, eggs, butter, milk -
Step 5-1: set - flour, salt, sugar, eggs, butter, milk -
Step 6-1: spread - strawberries, blackberries, raspberries - flour, salt, sugar, eggs, butter, milk
Step 7-1: fold - flour, salt, sugar, eggs, butter, milk, strawberries, blackberries, raspberries -
Step 7-2: roll - flour, salt, sugar, eggs, butter, milk, strawberries, blackberries, raspberries -
Step 8-1: top - flour, salt, sugar, eggs, butter, milk, strawberries, blackberries, raspberries - whipped cream, powdered sugar
iSRL-Qwnen2-VL-7B (V+T)
Step 1-1: sift - flour, salt, sugar -
Step 1-2: add - egg, butter - flour, salt, sugar
Step 1-3: stir in - milk - flour, salt, sugar, egg, butter
Step 3-1: pour - flour, salt, sugar, egg, butter, milk - pan
Step 3-2: cook - flour, salt, sugar, egg, butter, milk -
Step 4-1: flip - flour, salt, sugar, egg, butter, milk -
Step 5-1: set - flour, salt, sugar, egg, butter, milk -
Step 6-1: spread - berries - flour, salt, sugar, egg, butter, milk
Step 7-1: fold - flour, salt, sugar, egg, butter, milk, berries -
Step 7-2: roll - flour, salt, sugar, egg, butter, milk, berries -
Step 8-1: top - flour, salt, sugar, egg, butter, milk, berries - whipped cream, powdered sugar

Semantic Role Labels for "Double Chocolate Box Brownies"

Instructions
Step 1: [ 00:00 - 00:10 ] - in a large bowl combine the cake mix milk oil and egg.
Step 2: [ 00:10 - 00:16 ] - add ½ cup chopped dark chocolate and the chopped white chocolate and mix until combined.
Step 3: [ 00:16 - 00:25 ] - spread the brownie batter in the prepared pan.
Step 4: [ 00:25 - 00:27 ] - sprinkle the remaining chopped dark chocolate on top.
Video
Ground Truth
Step 1-1: combine - cake mix, milk, oil, egg -
Step 2-1: add - chopped dark chocolate, chopped white chocolate - cake mix, milk, oil, egg
Step 2-2: mix - cake mix, milk, oil, egg, chopped dark chocolate, chopped white chocolate -
Step 3-1: spread - cake mix, milk, oil, egg, chopped dark chocolate, chopped white chocolate -
Step 4-1: sprinkle - chopped dark chocolate - cake mix, milk, oil, egg, chopped dark chocolate, chopped white chocolate
GPT-4o (V)
Step 1-1: combine - chocolate cake mix -
Step 2-1: add - whole milk, canola oil, egg - chocolate cake mix
Step 2-2: mix - chocolate cake mix, whole milk, canola oil, egg -
Step 3-1: spread - chocolate cake mix, whole milk, canola oil, egg -
Step 4-1: sprinkle - dark chocolate - chocolate cake mix, whole milk, canola oil, egg
GPT-4o (V+T)
Step 1-1: combine - cake mix, milk, oil, egg -
Step 2-1: add - chopped dark chocolate, chopped white chocolate - cake mix, milk, oil, egg
Step 2-2: mix - cake mix, milk, oil, egg, chopped dark chocolate, chopped white chocolate -
Step 3-1: spread - brownie batter -
Step 4-1: sprinkle - remaining chopped dark chocolate - brownie batter
Qwnen2-VL-7B (V+T)
Step 1-1: combine - chocolate cake mix, whole milk, canola oil, egg -
Step 2-1: add - chocolate cake mix, whole milk, canola oil, egg -
Step 2-2: mix - chocolate cake mix, whole milk, canola oil, egg -
Step 3-1: spread - chocolate cake mix, whole milk, canola oil, egg -
Step 4-1: sprinkle - chocolate - chocolate cake mix, whole milk, canola oil, egg
iSRL-Qwnen2-VL-7B (V+T)
Step 1-1: combine - cake mix, milk, oil, egg -
Step 2-1: add - dark chocolate, white chocolate - cake mix, milk, oil, egg
Step 2-2: mix - cake mix, milk, oil, egg, dark chocolate, white chocolate -
Step 3-1: spread - cake mix, milk, oil, egg, dark chocolate, white chocolate -
Step 4-1: sprinkle - dark chocolate - cake mix, milk, oil, egg, dark chocolate, white chocolate

Semantic Role Labels for "Make Pad Thai"

Instructions
Step 1: [ 00:41 - 00:56 ] - place thai noodles in a bowl and pour water on top
Step 2: [ 01:52 - 02:24 ] - add tamarind paste fish sauce chilli sauce palm sugar to a pan and stir
Step 3: [ 02:27 - 02:42 ] - add some oil chopped shallots garlic and salt to pan
Step 4: [ 02:44 - 02:58 ] - add shrimp and fried tofu and stir
Step 5: [ 02:59 - 03:16 ] - add the soaked thai noodles and water toss and push the mixture to one side of the pan
Step 6: [ 03:18 - 03:43 ] - scramble an egg with oil and mix with the ingredients
Step 7: [ 03:45 - 04:05 ] - pour the sauce over the cooked items and stir until the sauce gets coated on the noodles
Step 8: [ 04:06 - 04:28 ] - add the bean sprouts and the garlic chives and toss
Step 9: [ 04:33 - 04:43 ] - plate the dish and garnish with roasted peanuts chives bean sprouts and lime wedges
Video
Ground Truth
Step 1-1: place - thai noodles -
Step 1-2: pour - water - thai noodles
Step 2-1: combine - tamarind paste, fish sauce, chilli sauce, palm sugar -
Step 3-1: combine - oil, chopped shallots, garlic, salt -
Step 4-1: add - shrimp, fried tofu - oil, shallots, garlic, salt
Step 4-2: stir - shrimp, fried tofu, oil, shallots, garlic, salt -
Step 5-1: add - thai noodles, water - shrimp, fried tofu, oil, shallots, garlic, salt
Step 5-2: toss - thai noodles, water, shrimp, fried tofu, oil, shallots, garlic, salt -
Step 5-3: push - thai noodles, water, shrimp, fried tofu, oil, shallots, garlic, salt -
Step 6-1: scramble - egg - oil
Step 6-2: mix - egg, oil - thai noodles, water, shrimp, fried tofu, oil, shallots, garlic, salt
Step 7-1: pour - tamarind paste, fish sauce, chilli sauce, palm sugar - thai noodles, water, shrimp, fried tofu, oil, shallots, garlic, salt, egg
Step 7-2: stir - tamarind paste, fish sauce, chilli sauce, palm sugar, thai noodles, water, shrimp, fried tofu, oil, shallots, garlic, salt, egg -
Step 8-1: add - bean sprouts, garlic, chives - tamarind paste, fish sauce, chilli sauce, palm sugar, thai noodles, water, shrimp, fried tofu, oil, shallots, garlic, salt, egg
Step 8-2: toss - bean sprouts, garlic, chives, tamarind paste, fish sauce, chilli sauce, palm sugar, thai noodles, water, shrimp, fried tofu, oil, shallots, garlic, salt, egg -
Step 9-1: garnish - bean sprouts, garlic, chives, tamarind paste, fish sauce, chilli sauce, palm sugar, thai noodles, water, shrimp, fried tofu, oil, shallots, garlic, salt, egg - roasted peanuts, chives, bean sprouts, lime wedges
GPT-4o (V)
Step 1-1: place - noodles -
Step 1-2: pour - water - noodles
Step 2-1: combine - sauce -
Step 3-1: combine - onions - sauce
Step 4-1: add - shrimp - onions, sauce
Step 4-2: stir - shrimp, onions, sauce -
Step 5-1: add - tofu - shrimp, onions, sauce
Step 5-2: toss - tofu, shrimp, onions, sauce -
Step 5-3: push - tofu, shrimp, onions, sauce -
Step 6-1: scramble - egg -
Step 6-2: mix - egg, tofu, shrimp, onions, sauce -
Step 7-1: pour - sauce - egg, tofu, shrimp, onions
Step 7-2: stir - sauce, egg, tofu, shrimp, onions -
Step 8-1: add - noodles - sauce, egg, tofu, shrimp, onions
Step 8-2: toss - noodles, sauce, egg, tofu, shrimp, onions -
Step 9-1: garnish - bean sprouts, chives - noodles, sauce, egg, tofu, shrimp, onions
GPT-4o (V+T)
Step 1-1: place - thai noodles -
Step 1-2: pour - water - thai noodles
Step 2-1: combine - tamarind paste, fish sauce, chilli sauce, palm sugar -
Step 3-1: combine - oil, chopped shallots, garlic, salt -
Step 4-1: add - shrimp, fried tofu - oil, chopped shallots, garlic, salt
Step 4-2: stir - shrimp, fried tofu, oil, chopped shallots, garlic, salt -
Step 5-1: add - soaked thai noodles, water - shrimp, fried tofu, oil, chopped shallots, garlic, salt
Step 5-2: toss - soaked thai noodles, shrimp, fried tofu, oil, chopped shallots, garlic, salt -
Step 5-3: push - soaked thai noodles, shrimp, fried tofu, oil, chopped shallots, garlic, salt -
Step 6-1: scramble - egg - oil
Step 6-2: mix - egg, soaked thai noodles, shrimp, fried tofu, oil, chopped shallots, garlic, salt -
Step 7-1: pour - sauce - egg, soaked thai noodles, shrimp, fried tofu, oil, chopped shallots, garlic, salt
Step 7-2: stir - sauce, egg, soaked thai noodles, shrimp, fried tofu, oil, chopped shallots, garlic, salt -
Step 8-1: add - bean sprouts, garlic chives - sauce, egg, soaked thai noodles, shrimp, fried tofu, oil, chopped shallots, garlic, salt
Step 8-2: toss - bean sprouts, garlic chives, sauce, egg, soaked thai noodles, shrimp, fried tofu, oil, chopped shallots, garlic, salt -
Step 9-1: garnish - roasted peanuts, chives, bean sprouts, lime wedges - pad thai
Qwnen2-VL-7B (V+T)
Step 1-1: place - rice noodles -
Step 1-2: pour - water - rice noodles
Step 2-1: combine - soya sauce, sugar, fish sauce, garlic, chili flakes, sesame oil -
Step 3-1: combine - soya sauce, sugar, fish sauce, garlic, chili flakes, sesame oil -
Step 4-1: add - chili flakes, garlic, sugar, fish sauce, soy sauce, sesame oil - soya sauce, sugar, fish sauce, garlic, chili flakes, sesame oil
Step 4-2: stir - chili flakes, garlic, sugar, fish sauce, soy sauce, sesame oil - soya sauce, sugar, fish sauce, garlic, chili flakes, sesame oil
Step 5-1: add - shrimp, tofu - chili flakes, garlic, sugar, fish sauce, soy sauce, sesame oil
Step 5-2: toss - shrimp, tofu - chili flakes, garlic, sugar, fish sauce, soy sauce, sesame oil
Step 5-3: push - shrimp, tofu, chili flakes, garlic, sugar, fish sauce, soy sauce, sesame oil - pan side
Step 6-1: scramble - shrimp, tofu, chili flakes, garlic, sugar, fish sauce, soy sauce, sesame oil -
Step 6-2: mix - shrimp, tofu, chili flakes, garlic, sugar, fish sauce, soy sauce, sesame oil -
Step 7-1: pour - soya sauce, sugar, fish sauce, garlic, chili flakes, sesame oil - shrimp, tofu, chili flakes, garlic, sugar, fish sauce, soy sauce, sesame oil
Step 7-2: stir - soya sauce, sugar, fish sauce, garlic, chili flakes, sesame oil - shrimp, tofu, chili flakes, garlic, sugar, fish sauce, soy sauce, sesame oil
Step 8-1: add - rice noodles - shrimp, tofu, chili flakes, garlic, sugar, fish sauce, soy sauce, sesame oil, soya sauce, sugar, fish sauce, garlic, chili flakes, sesame oil
Step 8-2: toss - rice noodles - shrimp, tofu, chili flakes, garlic, sugar, fish sauce, soy sauce, sesame oil, soya sauce, sugar, fish sauce, garlic, chili flakes, sesame oil
Step 9-1: garnish - chives, peanuts - shrimp, tofu, chili flakes, garlic, sugar, fish sauce, soy sauce, sesame oil, soya sauce, sugar, fish sauce, garlic, chili flakes, sesame oil, rice noodles
iSRL-Qwnen2-VL-7B (V+T)
Step 1-1: place - thai noodles -
Step 1-2: pour - water - thai noodles
Step 2-1: combine - tamarind paste, fish sauce, chilli sauce, palm sugar -
Step 3-1: combine - oil, chopped shallots, garlic, salt -
Step 4-1: add - shrimp, fried tofu - oil, chopped shallots, garlic, salt
Step 4-2: stir - shrimp, fried tofu, oil, chopped shallots, garlic, salt -
Step 5-1: add - thai noodles, water - shrimp, fried tofu, oil, chopped shallots, garlic, salt
Step 5-2: toss - thai noodles, water, shrimp, fried tofu, oil, chopped shallots, garlic, salt -
Step 5-3: push - thai noodles, water, shrimp, fried tofu, oil, chopped shallots, garlic, salt - pan side
Step 6-1: scramble - egg - oil
Step 6-2: mix - egg, oil - shrimp, fried tofu, oil, chopped shallots, garlic, salt, thai noodles, water
Step 7-1: pour - tamarind paste, fish sauce, chilli sauce, palm sugar - egg, oil, shrimp, fried tofu, oil, chopped shallots, garlic, salt, thai noodles, water
Step 7-2: stir - tamarind paste, fish sauce, chilli sauce, palm sugar, egg, oil, shrimp, fried tofu, oil, chopped shallots, garlic, salt, thai noodles, water -
Step 8-1: add - bean sprouts, garlic chives - tamarind paste, fish sauce, chilli sauce, palm sugar, egg, oil, shrimp, fried tofu, oil, chopped shallots, garlic, salt, thai noodles, water
Step 8-2: toss - bean sprouts, garlic chives, tamarind paste, fish sauce, chilli sauce, palm sugar, egg, oil, shrimp, fried tofu, oil, chopped shallots, garlic, salt, thai noodles, water -
Step 9-1: garnish - roasted peanuts, chives, bean sprouts, lime wedges - tamarind paste, fish sauce, chilli sauce, palm sugar, egg, oil, shrimp, fried tofu, oil, chopped shallots, garlic, salt, thai noodles, water, bean sprouts, garlic chives

Semantic Role Labels for "Pretzels And Beer Cheese Spread"

Instructions
Step 1: [ 00:02 - 00:17 ] - in a large bowl whisk together the melted butter worcestershire sauce sesame seeds garlic powder onion powder sesame seeds salt and black pepper.
Step 2: [ 00:17 - 00:23 ] - add the pretzels and toss to coat.
Step 3: [ 00:23 - 00:30 ] - transfer to a baking sheet and spread evenly.
Step 4: [ 00:30 - 00:33 ] - bake until the pretzels are crisp and the seeds golden stirring often 10-15 minutes.
Step 5: [ 00:33 - 00:57 ] - in a food processor combine the cheese garlic worcestershire sauce mustard paprika cayenne pepper salt and black pepper and pulse to combine.
Step 6: [ 00:57 - 01:08 ] - with the processor running slowly pour in the beer blending until the mixture is smooth and spreadable.
Step 7: [ 01:08 - 01:14 ] - season with salt pepper and cayenne to taste.
Step 8: [ 01:14 - 01:27 ] - transfer the beer cheese to a serving bowl and cover with plastic wrap.
Video
Ground Truth
Step 1-1: whisk - melted butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper -
Step 2-1: add - pretzels - melted butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper
Step 2-2: toss - melted butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper, pretzels -
Step 3-1: transfer - melted butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper, pretzels -
Step 3-2: spread - melted butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper, pretzels -
Step 4-1: bake - melted butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper, pretzels -
Step 5-1: combine - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper -
Step 6-1: pour - beer - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper
Step 6-2: blend - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper, beer -
Step 7-1: season - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper, beer - salt, pepper, cayenne
Step 8-1: serve - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper, beer - melted butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper, pretzels
Step 8-2: cover - beer cheese mixture - plastic wrap
GPT-4o (V)
Step 1-1: whisk - butter, Worcestershire sauce, sesame seeds, garlic powder, onion powder, salt, pepper -
Step 2-1: add - pretzel sticks - butter, Worcestershire sauce, sesame seeds, garlic powder, onion powder, salt, pepper
Step 2-2: toss - pretzel sticks - butter, Worcestershire sauce, sesame seeds, garlic powder, onion powder, salt, pepper
Step 3-1: transfer - pretzel sticks -
Step 3-2: spread - pretzel sticks -
Step 4-1: bake - pretzel sticks -
Step 5-1: combine - cheddar cheese, garlic, Worcestershire sauce, mustard, paprika, cayenne pepper, salt, pepper -
Step 6-1: pour - beer - cheddar cheese, garlic, Worcestershire sauce, mustard, paprika, cayenne pepper, salt, pepper
Step 6-2: blend - cheddar cheese, garlic, Worcestershire sauce, mustard, paprika, cayenne pepper, salt, pepper, beer -
Step 7-1: season - cheddar cheese, garlic, Worcestershire sauce, mustard, paprika, cayenne pepper, salt, pepper, beer - salt, pepper
Step 8-1: serve - cheddar cheese, garlic, Worcestershire sauce, mustard, paprika, cayenne pepper, salt, pepper, beer - scallions, sesame seeds, jalapeños
Step 8-2: cover - cheddar cheese, garlic, Worcestershire sauce, mustard, paprika, cayenne pepper, salt, pepper, beer - scallions, sesame seeds, jalapeños
GPT-4o (V+T)
Step 1-1: whisk - melted butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, salt, black pepper -
Step 2-1: add - pretzels - melted butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, salt, black pepper
Step 2-2: toss - pretzels - melted butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, salt, black pepper
Step 3-1: transfer - pretzels -
Step 3-2: spread - pretzels -
Step 4-1: bake - pretzels -
Step 5-1: combine - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper -
Step 6-1: pour - beer - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper
Step 6-2: blend - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper, beer -
Step 7-1: season - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper, beer - salt, pepper, cayenne
Step 8-1: serve - beer cheese -
Step 8-2: cover - beer cheese - plastic wrap
Qwnen2-VL-7B (V+T)
Step 1-1: whisk - butter, worcestershire sauce, sesame seeds, garlic powder, salt, pepper -
Step 2-1: add - pretzel sticks - butter, worcestershire sauce, sesame seeds, garlic powder, salt, pepper
Step 2-2: toss - pretzel sticks, butter, worcestershire sauce, sesame seeds, garlic powder, salt, pepper -
Step 3-1: transfer - pretzel sticks, butter, worcestershire sauce, sesame seeds, garlic powder, salt, pepper -
Step 3-2: spread - pretzel sticks, butter, worcestershire sauce, sesame seeds, garlic powder, salt, pepper -
Step 4-1: bake - pretzel sticks, butter, worcestershire sauce, sesame seeds, garlic powder, salt, pepper -
Step 5-1: combine - cheddar cheese, garlic -
Step 6-1: pour - cheddar cheese, garlic -
Step 6-2: blend - cheddar cheese, garlic -
Step 7-1: season - cheddar cheese, garlic - mustard, paprika, salt, pepper
Step 8-1: serve - cheddar cheese, garlic, mustard, paprika, salt, pepper -
Step 8-2: cover - cheddar cheese, garlic, mustard, paprika, salt, pepper -
iSRL-Qwnen2-VL-7B (V+T)
Step 1-1: whisk - butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper -
Step 2-1: add - pretzels - butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper
Step 2-2: toss - pretzels, butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper -
Step 3-1: transfer - pretzels, butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper - baking sheet
Step 3-2: spread - pretzels, butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper -
Step 4-1: bake - pretzels, butter, worcestershire sauce, sesame seeds, garlic powder, onion powder, sesame seeds, salt, black pepper -
Step 5-1: combine - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper -
Step 6-1: pour - beer - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper
Step 6-2: blend - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper, beer -
Step 7-1: season - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper, beer -
Step 8-1: serve - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper, beer -
Step 8-2: cover - cheese, garlic, worcestershire sauce, mustard, paprika, cayenne pepper, salt, black pepper, beer -

Semantic Role Labels for "Cinnamon Sugar Butter Braid"

Instructions
Step 1: [ 00:00 - 00:01 ] - lay your pizza dough flat on your work surface.
Step 2: [ 00:01 - 00:05 ] - spread softened butter all over the dough then sprinkle with cinnamon and sugar.
Step 3: [ 00:05 - 00:19 ] - roll up the dough split down the middle and twist one half over the other with the layers exposed.
Step 4: [ 00:19 - 00:22 ] - twist and join the dough into a circle.
Step 5: [ 00:22 - 00:27 ] - place on parchment paper brush on egg wash and sprinkle more sugar on top.
Step 6: [ 00:27 - 00:29 ] - bake at 350°f for 40 to 45 minutes.
Step 7: [ 00:29 - 00:36 ] - let the braid cool for a bit before dusting with powdered sugar.
Video
Ground Truth
Step 1-1: lay - dough -
Step 2-1: spread - softened butter - dough
Step 2-2: sprinkle - cinnamon, sugar - dough, butter
Step 3-1: roll up - dough, butter, cinnamon, sugar -
Step 3-2: split - dough, butter, cinnamon, sugar -
Step 3-3: twist - dough, butter, cinnamon, sugar -
Step 4-1: loop - dough, butter, cinnamon, sugar -
Step 5-1: place - dough, butter, cinnamon, sugar -
Step 5-2: brush - dough, butter, cinnamon, sugar - egg wash
Step 5-3: sprinkle - sugar - dough, butter, cinnamon, sugar, egg wash
Step 6-1: bake - dough, butter, cinnamon, egg wash, sugar -
Step 7-1: transfer - dough, butter, cinnamon, sugar, egg wash, sugar -
Step 7-2: dust - powdered sugar - dough, butter, cinnamon, sugar, egg wash, sugar
GPT-4o (V)
Step 1-1: lay - dough -
Step 2-1: spread - butter - dough
Step 2-2: sprinkle - cinnamon sugar - butter, dough
Step 3-1: roll up - dough, butter, cinnamon sugar -
Step 3-2: split - rolled dough -
Step 3-3: twist - split dough -
Step 4-1: loop - twisted dough -
Step 5-1: place - looped dough -
Step 5-2: brush - egg wash - looped dough
Step 5-3: sprinkle - sugar - egg wash, looped dough
Step 6-1: bake - prepared dough -
Step 7-1: transfer - baked braid -
Step 7-2: dust - powdered sugar - baked braid
GPT-4o (V+T)
Step 1-1: lay - pizza dough -
Step 2-1: spread - softened butter - pizza dough
Step 2-2: sprinkle - cinnamon, sugar - softened butter, pizza dough
Step 3-1: roll up - pizza dough, softened butter, cinnamon, sugar -
Step 3-2: split - pizza dough, softened butter, cinnamon, sugar -
Step 3-3: twist - pizza dough, softened butter, cinnamon, sugar -
Step 4-1: loop - pizza dough, softened butter, cinnamon, sugar -
Step 5-1: place - pizza dough, softened butter, cinnamon, sugar -
Step 5-2: brush - egg wash - pizza dough, softened butter, cinnamon, sugar
Step 5-3: sprinkle - sugar - egg wash, pizza dough, softened butter, cinnamon, sugar
Step 6-1: bake - pizza dough, softened butter, cinnamon, sugar, egg wash -
Step 7-1: transfer - pizza dough, softened butter, cinnamon, sugar, egg wash -
Step 7-2: dust - powdered sugar - pizza dough, softened butter, cinnamon, sugar, egg wash
Qwnen2-VL-7B (V+T)
Step 1-1: lay - dough - flour
Step 2-1: spread - butter - dough
Step 2-2: sprinkle - cinnamon, sugar - dough, butter
Step 3-1: roll up - dough, butter, cinnamon, sugar -
Step 3-2: split - dough, butter, cinnamon, sugar -
Step 3-3: twist - dough, butter, cinnamon, sugar -
Step 4-1: loop - dough, butter, cinnamon, sugar -
Step 5-1: place - dough, butter, cinnamon, sugar - parchment paper
Step 5-2: brush - egg wash - dough, butter, cinnamon, sugar
Step 5-3: sprinkle - sugar - dough, butter, cinnamon, sugar, egg wash
Step 6-1: bake - dough, butter, cinnamon, sugar, egg wash, sugar -
Step 7-1: transfer - dough, butter, cinnamon, sugar, egg wash, sugar - parchment paper
Step 7-2: dust - powdered sugar - dough, butter, cinnamon, sugar, egg wash, sugar
iSRL-Qwnen2-VL-7B (V+T)
Step 1-1: lay - pizza dough -
Step 2-1: spread - butter - pizza dough
Step 2-2: sprinkle - cinnamon, sugar - pizza dough, butter
Step 3-1: roll up - pizza dough, butter, cinnamon, sugar -
Step 3-2: split - pizza dough, butter, cinnamon, sugar -
Step 3-3: twist - pizza dough, butter, cinnamon, sugar -
Step 4-1: loop - pizza dough, butter, cinnamon, sugar -
Step 5-1: place - pizza dough, butter, cinnamon, sugar - parchment paper
Step 5-2: brush - egg wash - pizza dough, butter, cinnamon, sugar
Step 5-3: sprinkle - sugar - pizza dough, butter, cinnamon, sugar, egg wash
Step 6-1: bake - pizza dough, butter, cinnamon, sugar, egg wash, sugar -
Step 7-1: transfer - pizza dough, butter, cinnamon, sugar, egg wash, sugar -
Step 7-2: dust - powdered sugar - pizza dough, butter, cinnamon, sugar, egg wash, sugar

Semantic Role Labels for "Cinnamon Roll Poke Cake"

Instructions
Step 1: [ 00:00 - 00:13 ] - prepare white cake mix according to the box instructions and bake according to the 9x13 inch dish instructions.
Step 2: [ 00:13 - 00:25 ] - in a bowl mix the butter sugar vanilla cinnamon and condensed milk until smooth.
Step 3: [ 00:25 - 00:30 ] - with the end of a wooden spoon poke 24 holes in the cooled white cake.
Step 4: [ 00:30 - 00:35 ] - pour the butter mixture over the cake smoothing it out into the holes.
Step 5: [ 00:35 - 00:41 ] - cover with a layer of whipped topping.
Step 6: [ 00:41 - 00:42 ] - chill for 4 hours.
Step 7: [ 00:42 - 00:49 ] - slice cake and serve.
Video
Ground Truth
Step 1-1: combine - white cake mix, water, eggs, sugar -
Step 1-2: trasfer - white cake mix, water, eggs, sugar -
Step 1-3: bake - white cake mix, water, eggs, sugar -
Step 2-1: add - brown sugar, vanilla, cinnamon, condensed milk - butter
Step 2-2: mix - butter, sugar, vanilla, cinnamon, condensed milk -
Step 3-1: pierce - white cake mix, water, eggs, sugar -
Step 4-1: pour - butter, sugar, vanilla, cinnamon, condensed milk - white cake mix, water, eggs, sugar
Step 5-1: top - white cake mix, water, eggs, sugar, butter, sugar, vanilla, cinnamon, condensed milk - whipped cream
Step 6-1: chill - white cake mix, water, eggs, sugar, butter, sugar, vanilla, cinnamon, condensed milk, whipped cream -
Step 7-1: slice - white cake mix, water, eggs, sugar, butter, sugar, vanilla, cinnamon, condensed milk, whipped cream -
Step 7-2: serve - white cake mix, water, eggs, sugar, butter, sugar, vanilla, cinnamon, condensed milk, whipped cream -
GPT-4o (V)
Step 1-1: combine - white cake mix, water, oil, eggs -
Step 1-2: transfer - white cake mix, water, oil, eggs -
Step 1-3: bake - white cake mix, water, oil, eggs -
Step 2-1: add - butter, brown sugar, vanilla, cinnamon, condensed milk -
Step 2-2: mix - butter, brown sugar, vanilla, cinnamon, condensed milk -
Step 3-1: pierce - cake -
Step 4-1: pour - butter, brown sugar, vanilla, cinnamon, condensed milk - cake
Step 5-1: top - cake - whipped topping
Step 6-1: chill - cake, whipped topping -
Step 7-1: slice - cake, whipped topping -
Step 7-2: serve - cake, whipped topping -
GPT-4o (V+T)
Step 1-1: combine - white cake mix -
Step 1-2: trasfer - white cake mix -
Step 1-3: bake - white cake mix -
Step 2-1: add - butter, sugar, vanilla, cinnamon, condensed milk -
Step 2-2: mix - butter, sugar, vanilla, cinnamon, condensed milk -
Step 3-1: pierce - white cake -
Step 4-1: pour - butter, sugar, vanilla, cinnamon, condensed milk - white cake
Step 5-1: top - white cake, butter, sugar, vanilla, cinnamon, condensed milk - whipped topping
Step 6-1: chill - white cake, butter, sugar, vanilla, cinnamon, condensed milk, whipped topping -
Step 7-1: slice - white cake, butter, sugar, vanilla, cinnamon, condensed milk, whipped topping -
Step 7-2: serve - white cake, butter, sugar, vanilla, cinnamon, condensed milk, whipped topping -
Qwnen2-VL-7B (V+T)
Step 1-1: combine - white cake -
Step 1-2: trasfer - white cake -
Step 1-3: bake - white cake -
Step 2-1: add - butter, brown sugar, cinnamon, condensed milk - white cake
Step 2-2: mix - butter, brown sugar, cinnamon, condensed milk, white cake -
Step 3-1: pierce - white cake -
Step 4-1: pour - butter, brown sugar, cinnamon, condensed milk, white cake - white cake
Step 5-1: top - whipped topping - butter, brown sugar, cinnamon, condensed milk, white cake
Step 6-1: chill - butter, brown sugar, cinnamon, condensed milk, white cake, whipped topping -
Step 7-1: slice - butter, brown sugar, cinnamon, condensed milk, white cake, whipped topping -
Step 7-2: serve - butter, brown sugar, cinnamon, condensed milk, white cake, whipped topping -
iSRL-Qwnen2-VL-7B (V+T)
Step 1-1: combine - white cake mix - water, oil, eggs, vanilla
Step 1-2: bake - white cake mix, water, oil, eggs, vanilla -
Step 2-1: add - butter, sugar, vanilla, cinnamon, condensed milk - white cake mix, water, oil, eggs, vanilla
Step 2-2: mix - butter, sugar, vanilla, cinnamon, condensed milk, white cake mix, water, oil, eggs, vanilla -
Step 3-1: pierce - white cake mix, water, oil, eggs, vanilla -
Step 4-1: pour - butter, sugar, vanilla, cinnamon, condensed milk, white cake mix, water, oil, eggs, vanilla - white cake mix, water, oil, eggs, vanilla
Step 5-1: top - whipped topping - white cake mix, water, oil, eggs, vanilla, butter, sugar, vanilla, cinnamon, condensed milk
Step 6-1: chill - white cake mix, water, oil, eggs, vanilla, butter, sugar, vanilla, cinnamon, condensed milk, whipped topping -
Step 7-1: slice - white cake mix, water, oil, eggs, vanilla, butter, sugar, vanilla, cinnamon, condensed milk, whipped topping -
Step 7-2: serve - white cake mix, water, oil, eggs, vanilla, butter, sugar, vanilla, cinnamon, condensed milk, whipped topping -

Semantic Role Labels for "Chicken Fajita Salad"

Instructions
Step 1: [ 00:00 - 00:11 ] - cook the chicken bell peppers onion salt chili powder cumin and garlic powder for five minutes stirring constantly.
Step 2: [ 00:11 - 00:16 ] - flip the chicken and cook for another five minutes until chicken is cooked and vegetables are slightly soft.
Step 3: [ 00:16 - 00:23 ] - remove from heat and slice the chicken into strips.
Step 4: [ 00:23 - 00:31 ] - in a small bowl combine the olive oil lime juice brown sugar chili and salt stirring until evenly mixed.
Step 5: [ 00:31 - 00:44 ] - in a large bowl toss the romaine lettuce with the chicken peppers & onions avocado and dressing.
Step 6: [ 00:47 - 00:48 ] - enjoy!
Video
Ground Truth
Step 1-1: combine - chicken, red bell peppers, yellow bell peppers, onion, salt, chili powder, cumin, garlic powder -
Step 2-1: flip - chicken, salt, chili powder, cumin, garlic powder -
Step 2-2: cook - chicken, red bell peppers, yellow bell peppers, onion, salt, chili powder, cumin, garlic powder -
Step 3-1: remove - chicken, red bell peppers, yellow bell peppers, onion, salt, chili powder, cumin, garlic powder -
Step 3-2: slice - chicken, salt, chili powder, cumin, garlic powder -
Step 4-1: combine - olive oil, lime juice, brown sugar, chili, salt -
Step 5-1: add - chicken, red bell peppers, yellow bell peppers, onion, salt, chili powder, cumin, garlic powder, avocado - romaine lettuce
Step 5-2: pour - olive oil, lime juice, brown sugar, chili, salt - romaine lettuce, chicken, red bell peppers, yellow bell peppers, onion, salt, chili powder, cumin, garlic powder, avocado
Step 5-3: toss - olive oil, lime juice, brown sugar, chili, romaine lettuce, chicken, red bell peppers, yellow bell peppers, onion, salt, chili powder, cumin, garlic powder, avocado -
GPT-4o (V)
Step 1-1: combine - chicken breast, red pepper, yellow pepper, onion, salt, pepper, chili powder, cumin, garlic powder -
Step 2-1: flip - chicken breast -
Step 2-2: cook - chicken breast, red pepper, yellow pepper, onion -
Step 3-1: remove - chicken breast -
Step 3-2: slice - chicken breast -
Step 4-1: combine - olive oil, lime juice, brown sugar, chili flakes, salt -
Step 5-1: add - cooked peppers, onion, sliced chicken, avocado - lettuce
Step 5-2: pour - dressing - lettuce, cooked peppers, onion, sliced chicken, avocado
Step 5-3: toss - lettuce, cooked peppers, onion, sliced chicken, avocado, dressing -
GPT-4o (V+T)
Step 1-1: combine - chicken, bell peppers, onion, salt, chili powder, cumin, garlic powder -
Step 2-1: flip - chicken -
Step 2-2: cook - chicken, bell peppers, onion -
Step 3-1: remove - chicken, bell peppers, onion -
Step 3-2: slice - chicken -
Step 4-1: combine - olive oil, lime juice, brown sugar, chili, salt -
Step 5-1: add - romaine lettuce, chicken, peppers, onions, avocado -
Step 5-2: pour - dressing - romaine lettuce, chicken, peppers, onions, avocado
Step 5-3: toss - romaine lettuce, chicken, peppers, onions, avocado, dressing -
Qwnen2-VL-7B (V+T)
Step 1-1: combine - chicken breast, red pepper, yellow pepper, onion, salt, chili powder, cumin, garlic powder -
Step 2-1: flip - chicken breast, red pepper, yellow pepper, onion, salt, chili powder, cumin, garlic powder -
Step 2-2: cook - chicken breast, red pepper, yellow pepper, onion, salt, chili powder, cumin, garlic powder -
Step 3-1: remove - chicken breast, red pepper, yellow pepper, onion, salt, chili powder, cumin, garlic powder -
Step 3-2: slice - chicken breast, red pepper, yellow pepper, onion, salt, chili powder, cumin, garlic powder -
Step 4-1: combine - olive oil, lime juice, brown sugar, chili flakes, salt -
Step 5-1: add - olive oil, lime juice, brown sugar, chili flakes, salt - chicken breast, red pepper, yellow pepper, onion, salt, chili powder, cumin, garlic powder
Step 5-2: pour - olive oil, lime juice, brown sugar, chili flakes, salt, chicken breast, red pepper, yellow pepper, onion, salt, chili powder, cumin, garlic powder -
Step 5-3: toss - olive oil, lime juice, brown sugar, chili flakes, salt, chicken breast, red pepper, yellow pepper, onion, salt, chili powder, cumin, garlic powder -
iSRL-Qwnen2-VL-7B (V+T)
Step 1-1: combine - chicken, bell peppers, onion, salt, chili powder, cumin, garlic powder -
Step 2-1: flip - chicken, bell peppers, onion, salt, chili powder, cumin, garlic powder -
Step 2-2: cook - chicken, bell peppers, onion, salt, chili powder, cumin, garlic powder -
Step 3-1: remove - chicken, bell peppers, onion, salt, chili powder, cumin, garlic powder -
Step 3-2: slice - chicken, bell peppers, onion, salt, chili powder, cumin, garlic powder -
Step 4-1: combine - olive oil, lime juice, brown sugar, chili, salt -
Step 5-1: add - romaine lettuce, chicken, bell peppers, onion, salt, chili powder, cumin, garlic powder, olive oil, lime juice, brown sugar, chili, salt -
Step 5-2: pour - avocado - romaine lettuce, chicken, bell peppers, onion, salt, chili powder, cumin, garlic powder, olive oil, lime juice, brown sugar, chili, salt
Step 5-3: toss - romaine lettuce, chicken, bell peppers, onion, salt, chili powder, cumin, garlic powder, olive oil, lime juice, brown sugar, chili, salt, avocado -

Semantic Role Labels for "Cheese Stuffed Jalapeno Poppers"

Instructions
Step 1: [ 00:00 - 00:15 ] - cut the top off each jalapeño and core it scraping out all the seeds with the back side of a spoon.
Step 2: [ 00:15 - 00:19 ] - fill the jalapeños with pepper jack cheese either melted or cubed.
Step 3: [ 00:19 - 00:24 ] - place the top back on the jalapeños and secure with two toothpicks inserted diagonally.
Step 4: [ 00:24 - 00:28 ] - dredge in flour eggs then breadcrumbs.
Step 5: [ 00:28 - 00:33 ] - fry each jalapeño popper until golden brown .
Step 6: [ 00:33 - 00:35 ] - cool and allow extra oil to drip off on a plate lined with paper towels.
Step 7: [ 00:35 - 00:36 ] - remove the toothpicks.
Step 8: [ 00:36 - 00:40 ] - season with salt and serve immediately once cooled enough to handle.
Video
Ground Truth
Step 1-1: cut - jalapeño head -
Step 1-2: scape out - seeds - jalapeño core
Step 2-1: fill - pepper jack cheese - jalapeños
Step 3-1: secure - jalapeños, pepper jack cheese -
Step 4-1: dredge - jalapeños, pepper jack cheese - flour, eggs, breadcrumbs
Step 5-1: fry - jalapeños, pepper jack cheese, flour, eggs, breadcrumbs - oil
Step 6-1: transfer - jalapeños, pepper jack cheese, flour, eggs, breadcrumbs -
Step 7-1: remove - toothpicks - jalapeños, pepper jack cheese, flour, eggs, breadcrumbs
Step 8-1: season - jalapeños, pepper jack cheese, flour, eggs, breadcrumbs - salt
Step 8-2: serve - jalapeños, pepper jack cheese, flour, eggs, breadcrumbs, salt -
GPT-4o (V)
Step 1-1: cut - jalapenos -
Step 1-2: scape out - seeds - jalapenos
Step 2-1: fill - pepper jack cheese - jalapenos
Step 3-1: secure - jalapenos - toothpicks
Step 4-1: dredge - jalapenos - flour, eggs, bread crumbs
Step 5-1: fry - jalapenos -
Step 6-1: transfer - jalapenos -
Step 7-1: remove - toothpicks - jalapenos
Step 8-1: season - jalapenos - salt
Step 8-2: serve - jalapenos -
GPT-4o (V+T)
Step 1-1: cut - top - jalapeño
Step 1-2: scape out - seeds - jalapeño
Step 2-1: fill - jalapeños - pepper jack cheese
Step 3-1: secure - top - jalapeños
Step 4-1: dredge - jalapeños - flour, eggs, breadcrumbs
Step 5-1: fry - jalapeño popper - golden brown
Step 6-1: transfer - jalapeño popper - plate
Step 7-1: remove - toothpicks -
Step 8-1: season - jalapeño popper - salt
Step 8-2: serve - jalapeño popper -
Qwnen2-VL-7B (V+T)
Step 1-1: cut - jalapeños -
Step 1-2: scape out - seeds, membranes - jalapeños
Step 2-1: fill - pepper jack cheese - jalapeños
Step 3-1: secure - jalapeños, pepper jack cheese -
Step 4-1: dredge - jalapeños, pepper jack cheese - flour, salt, pepper
Step 5-1: fry - jalapeños, pepper jack cheese, flour, salt, pepper - oil
Step 6-1: transfer - jalapeños, pepper jack cheese, flour, salt, pepper - paper towels
Step 7-1: remove - paper towels - jalapeños, pepper jack cheese, flour, salt, pepper
Step 8-1: season - jalapeños, pepper jack cheese, flour, salt, pepper - chili powder, garlic powder, onion powder, cumin, paprika, salt, pepper
Step 8-2: serve - jalapeños, pepper jack cheese, flour, salt, pepper, chili powder, garlic powder, onion powder, cumin, paprika, salt, pepper -
iSRL-Qwnen2-VL-7B (V+T)
Step 1-1: cut - jalapeños -
Step 1-2: scape out - seeds - jalapeños
Step 2-1: fill - pepper jack cheese - jalapeños
Step 3-1: secure - jalapeños, pepper jack cheese -
Step 4-1: dredge - jalapeños, pepper jack cheese - flour, eggs, breadcrumbs
Step 5-1: fry - jalapeños, pepper jack cheese, flour, eggs, breadcrumbs - oil
Step 6-1: transfer - jalapeños, pepper jack cheese, flour, eggs, breadcrumbs - paper towels
Step 7-1: remove - toothpicks - jalapeños, pepper jack cheese, flour, eggs, breadcrumbs
Step 8-1: season - jalapeños, pepper jack cheese, flour, eggs, breadcrumbs - salt
Step 8-2: serve - jalapeños, pepper jack cheese, flour, eggs, breadcrumbs, salt -

Semantic Role Labels for "Make Hot Dogs"

Instructions
Step 1: [ 01:05 - 01:52 ] - in pan take 1 pound ground beef add 1 finely chopped onions 2 cloves finely minced garlic cook 5 mins
Step 2: [ 01:53 - 02:15 ] - now add 2 tbls of chili powder 1 tbls of cumin powder and cook for 3 minutes
Step 3: [ 02:16 - 02:45 ] - add 1 cup of water and 6 ounce of canned tomato paste blend it well and season it with salt
Step 4: [ 02:46 - 03:40 ] - add 1 tbls prepared yellow mustard 1 tbls worcestershire sauce 2 tsp brown sugar mix simmer 5 minutes
Step 5: [ 03:42 - 04:38 ] - steam frankfurters for 4 minutes in same steamer place the hot dog buns and steam for a couple of minutes
Step 6: [ 04:39 - 05:23 ] - place frankfurter in middle of bun cover sausage with chili prepared earlier top with mustard sauce garnish with chopped onions
Video
Ground Truth
Step 1-1: add - onions, garlic - ground beef
Step 1-2: cook - ground beef, onions, garlic -
Step 2-1: add - chilli powder, cumin powder - ground beef, onions, garlic
Step 2-2: cook - ground beef, onions, garlic, chilli powder, cumin powder -
Step 3-1: add - water, tomato paste - ground beef, onions, garlic, chilli powder, cumin powder
Step 3-2: season - ground beef, onions, garlic, chilli powder, cumin powder, water, tomato paste - salt
Step 4-1: add - yellow mustard, worcestershire sauce, brown sugar - ground beef, onions, garlic, chilli powder, cumin powder, water, tomato paste, salt
Step 4-2: mix - ground beef, onions, garlic, chilli powder, cumin powder, water, tomato paste, salt, yellow mustard, worcestershire sauce, brown sugar -
Step 4-3: simmer - ground beef, onions, garlic, chilli powder, cumin powder, water, tomato paste, salt, yellow mustard, worcestershire sauce, brown sugar -
Step 5-1: steam - sausage, hot dog buns -
Step 5-2: place - hot dog buns - sausage
Step 5-3: steam - sausage, hot dog buns -
Step 6-1: place - sausage - hot dog bun
Step 6-2: cover - hot dog bun, sausage - ground beef, onions, garlic, chilli powder, cumin powder, water, tomato paste, salt, yellow mustard, worcestershire sauce, brown sugar
Step 6-3: top - sausage, hot dog bun, ground beef, onions, garlic, chilli powder, cumin powder, water, tomato paste, salt, yellow mustard, worcestershire sauce, brown sugar - mustard sauce
Step 6-4: garnish - sausage, hot dog bun, ground beef, onions, garlic, chilli powder, cumin powder, water, tomato paste, salt, yellow mustard, worcestershire sauce, brown sugar - chopped onions
GPT-4o (V)
Step 1-1: add - ground meat -
Step 1-2: cook - ground meat -
Step 2-1: add - onions - ground meat
Step 2-2: cook - onions, ground meat -
Step 3-1: add - seasoning - onions, ground meat
Step 3-2: season - onions, ground meat - seasoning
Step 4-1: add - water - onions, ground meat, seasoning
Step 4-2: mix - onions, ground meat, seasoning, water -
Step 4-3: simmer - onions, ground meat, seasoning, water -
Step 5-1: steam - hot dogs -
Step 5-2: place - buns - steamer
Step 5-3: steam - buns -
Step 6-1: place - hot dog - bun
Step 6-2: cover - hot dog - onions, ground meat, seasoning, water
Step 6-3: top - hot dog - sauce
Step 6-4: garnish - hot dog - cheese
GPT-4o (V+T)
Step 1-1: add - ground beef, chopped onions, minced garlic -
Step 1-2: cook - ground beef, chopped onions, minced garlic -
Step 2-1: add - chili powder, cumin powder - ground beef, chopped onions, minced garlic
Step 2-2: cook - ground beef, chopped onions, minced garlic, chili powder, cumin powder -
Step 3-1: add - water, canned tomato paste - ground beef, chopped onions, minced garlic, chili powder, cumin powder
Step 3-2: season - ground beef, chopped onions, minced garlic, chili powder, cumin powder, water, canned tomato paste - salt
Step 4-1: add - prepared yellow mustard, worcestershire sauce, brown sugar - ground beef, chopped onions, minced garlic, chili powder, cumin powder, water, canned tomato paste, salt
Step 4-2: mix - ground beef, chopped onions, minced garlic, chili powder, cumin powder, water, canned tomato paste, salt, prepared yellow mustard, worcestershire sauce, brown sugar -
Step 4-3: simmer - ground beef, chopped onions, minced garlic, chili powder, cumin powder, water, canned tomato paste, salt, prepared yellow mustard, worcestershire sauce, brown sugar -
Step 5-1: steam - frankfurters -
Step 5-2: place - hot dog buns -
Step 5-3: steam - hot dog buns -
Step 6-1: place - frankfurter - bun
Step 6-2: cover - sausage - chili
Step 6-3: top - chili - mustard sauce
Step 6-4: garnish - chili - chopped onions
Qwnen2-VL-7B (V+T)
Step 1-1: add - ground beef, onions, garlic, chili powder, cumin, oregano, salt, pepper - oil
Step 1-2: cook - ground beef, onions, garlic, chili powder, cumin, oregano, salt, pepper, oil -
Step 2-1: add - ketchup, tomato paste, worcestershire sauce, mustard, brown sugar - ground beef, onions, garlic, chili powder, cumin, oregano, salt, pepper, oil
Step 2-2: mix - ketchup, tomato paste, worcestershire sauce, mustard, brown sugar, ground beef, onions, garlic, chili powder, cumin, oregano, salt, pepper, oil -
Step 2-3: simmer - ketchup, tomato paste, worcestershire sauce, mustard, brown sugar, ground beef, onions, garlic, chili powder, cumin, oregano, salt, pepper, oil -
Step 3-1: steam - hot dogs -
Step 3-2: place - hot dogs -
Step 3-3: steam - hot dogs -
Step 4-1: place - hot dogs -
Step 4-2: cover - hot dogs -
Step 4-3: top - hot dogs - mustard, ketchup, relish, onions, pickles
Step 4-4: garnish - hot dogs, mustard, ketchup, relish, onions, pickles - bun
iSRL-Qwnen2-VL-7B (V+T)
Step 1-1: add - ground beef, onions, garlic -
Step 1-2: cook - ground beef, onions, garlic -
Step 2-1: add - chili powder, cumin powder - ground beef, onions, garlic
Step 2-2: cook - ground beef, onions, garlic, chili powder, cumin powder -
Step 3-1: add - water, tomato paste - ground beef, onions, garlic, chili powder, cumin powder
Step 3-2: blend - ground beef, onions, garlic, chili powder, cumin powder, water, tomato paste -
Step 4-1: add - mustard, worcestershire sauce, brown sugar - ground beef, onions, garlic, chili powder, cumin powder, water, tomato paste
Step 4-2: mix - ground beef, onions, garlic, chili powder, cumin powder, water, tomato paste, mustard, worcestershire sauce, brown sugar -
Step 4-3: simmer - ground beef, onions, garlic, chili powder, cumin powder, water, tomato paste, mustard, worcestershire sauce, brown sugar -

Semantic Role Labels for "Chicken Veggie Spring Rolls"

Instructions
Step 1: [ 00:00 - 00:05 ] - in a medium pan sauté minced garlic and ginger until fragrant.
Step 2: [ 00:05 - 00:10 ] - add in diced chicken salt and pepper to taste then cook until about 80% done.
Step 3: [ 00:10 - 00:12 ] - add mushrooms and cook off the moisture.
Step 4: [ 00:12 - 00:19 ] - add cabbage until soft then toss in carrots and scallions.
Step 5: [ 00:20 - 00:36 ] - fill egg roll wrapper with filling fold and seal with egg wash then deep fry until golden brown.
Step 6: [ 00:36 - 00:39 ] - serve immediately with hoisin sauce or sauce of choice.
Video
Ground Truth
Step 1-1: sauté - garlic, ginger - oil
Step 2-1: add - chicken, salt, pepper - minced garlic, ginger
Step 2-2: stir - chicken, salt, pepper, garlic, ginger -
Step 3-1: stir in - mushrooms - chicken, salt, pepper, garlic, ginger
Step 4-1: toss in - cabbage - chicken, salt, pepper, garlic, ginger, mushrooms
Step 4-2: toss in - carrots, scallions - chicken, salt, pepper, garlic, ginger, mushrooms, cabbage
Step 5-1: fill - chicken, salt, pepper, garlic, ginger, mushrooms, cabbage - egg roll wrapper
Step 5-2: fold - egg roll wrapper, chicken, salt, pepper, garlic, ginger, mushrooms, cabbage -
Step 5-3: seal - egg roll wrapper, chicken, salt, pepper, garlic, ginger, mushrooms, cabbage - egg wash
Step 5-4: fry - egg roll wrapper, chicken, salt, pepper, garlic, ginger, mushrooms, cabbage, egg wash - oil
Step 6-1: serve - egg roll wrapper, chicken, salt, pepper, garlic, ginger, mushrooms, cabbage, egg wash - hoisin sauce
GPT-4o (V)
Step 1-1: sauté - garlic, ginger - oil
Step 2-1: add - chicken breasts, salt, black pepper - garlic, ginger, oil
Step 2-2: stir - chicken breasts, salt, black pepper, garlic, ginger, oil -
Step 3-1: stir in - shiitake mushrooms - chicken breasts, salt, black pepper, garlic, ginger, oil
Step 4-1: toss in - cabbage - shiitake mushrooms, chicken breasts, salt, black pepper, garlic, ginger, oil
Step 4-2: toss in - carrots, scallions - cabbage, shiitake mushrooms, chicken breasts, salt, black pepper, garlic, ginger, oil
Step 5-1: fill - egg roll wrapper - carrots, scallions, cabbage, shiitake mushrooms, chicken breasts, salt, black pepper, garlic, ginger, oil
Step 5-2: fold - egg roll wrapper - carrots, scallions, cabbage, shiitake mushrooms, chicken breasts, salt, black pepper, garlic, ginger, oil
Step 5-3: seal - egg roll wrapper - egg wash
Step 5-4: fry - spring rolls -
Step 6-1: serve - spring rolls - dipping sauce
GPT-4o (V+T)
Step 1-1: sauté - garlic, ginger -
Step 2-1: add - chicken, salt, pepper -
Step 2-2: stir - chicken, salt, pepper -
Step 3-1: stir in - mushrooms - chicken, salt, pepper
Step 4-1: toss in - cabbage - mushrooms, chicken, salt, pepper
Step 4-2: toss in - carrots, scallions - cabbage, mushrooms, chicken, salt, pepper
Step 5-1: fill - egg roll wrapper - cabbage, mushrooms, chicken, salt, pepper, carrots, scallions
Step 5-2: fold - egg roll wrapper - cabbage, mushrooms, chicken, salt, pepper, carrots, scallions
Step 5-3: seal - egg roll wrapper - egg wash
Step 5-4: fry - egg roll wrapper - cabbage, mushrooms, chicken, salt, pepper, carrots, scallions
Step 6-1: serve - spring rolls - hoisin sauce
Qwnen2-VL-7B (V+T)
Step 1-1: sauté - oil, garlic, ginger -
Step 2-1: add - chicken breasts - oil, garlic, ginger
Step 2-2: stir - chicken breasts, oil, garlic, ginger -
Step 3-1: toss in - salt, pepper - chicken breasts, oil, garlic, ginger
Step 4-1: toss in - shredded cabbage, carrots, mushrooms - chicken breasts, oil, garlic, ginger, salt, pepper
Step 4-2: toss in - scallions - chicken breasts, oil, garlic, ginger, salt, pepper, shredded cabbage, carrots, mushrooms
Step 5-1: fill - chicken breasts, oil, garlic, ginger, salt, pepper, shredded cabbage, carrots, mushrooms, scallions - egg roll wrappers
Step 5-2: fold - chicken breasts, oil, garlic, ginger, salt, pepper, shredded cabbage, carrots, mushrooms, scallions, egg roll wrappers -
Step 5-3: seal - chicken breasts, oil, garlic, ginger, salt, pepper, shredded cabbage, carrots, mushrooms, scallions, egg roll wrappers -
Step 5-4: fry - chicken breasts, oil, garlic, ginger, salt, pepper, shredded cabbage, carrots, mushrooms, scallions, egg roll wrappers -
Step 6-1: serve - chicken breasts, oil, garlic, ginger, salt, pepper, shredded cabbage, carrots, mushrooms, scallions, egg roll wrappers - soy sauce, scallions
iSRL-Qwnen2-VL-7B (V+T)
Step 1-1: sauté - garlic, ginger -
Step 2-1: add - chicken, salt, pepper - garlic, ginger
Step 2-2: stir - chicken, salt, pepper, garlic, ginger -
Step 3-1: stir in - mushrooms - chicken, salt, pepper, garlic, ginger
Step 3-2: stir in - cabbage, carrots, scallions - chicken, salt, pepper, garlic, ginger, mushrooms
Step 5-1: fill - chicken, salt, pepper, garlic, ginger, mushrooms, cabbage, carrots, scallions - egg roll wrapper
Step 5-2: fold - chicken, salt, pepper, garlic, ginger, mushrooms, cabbage, carrots, scallions, egg roll wrapper -
Step 5-3: seal - chicken, salt, pepper, garlic, ginger, mushrooms, cabbage, carrots, scallions, egg roll wrapper - egg wash
Step 5-4: fry - chicken, salt, pepper, garlic, ginger, mushrooms, cabbage, carrots, scallions, egg roll wrapper, egg wash -
Step 6-1: serve - chicken, salt, pepper, garlic, ginger, mushrooms, cabbage, carrots, scallions, egg roll wrapper, egg wash - hoisin sauce