| 0 | Questionperception | What are the important objects in the current scene? Those objects will be considered for the future reasoning and driving decision. |
| GT Answer | There is a white sedan car to the back of the ego vehicle, a gray sedan to the front of the ego vehicle, a white small truck to the front of the ego vehicle, a red car to the front right of the ego vehicle, and a black car to the back of the ego vehicle. The IDs of these objects are <c1,CAM_BACK,888.3,520.8>, <c2,CAM_FRONT,779.4,556.4>, <c3,CAM_FRONT,1129.2,495.8>, <c4,CAM_FRONT_RIGHT,347.8,634.6>, and <c5,CAM_BACK,254.0,653.3>. |
| InternVL2-2B | In the current scene, the important objects include:
1. **Traffic Cones**: These are placed in the foreground on the right side of the image, indicating a construction or roadwork area. They serve as a warning to drivers to be cautious and slow down.
2. **Vehicles**: The red sedan in the foreground is a critical object. It is moving in the same direction as the traffic cones, suggesting that drivers should be aware of the construction area and adjust their speed accordingly.
3. **Buildings**: The multi-story buildings in the background are significant as they indicate the location is a city or urban area. The presence of construction scaffolding on one of the buildings suggests ongoing development or renovation work.
4. **Road and Sidewalk**: The road and sidewalk are essential for navigation and safety. The presence of traffic cones and the need to slow down indicate that the road is likely to be busy and potentially hazardous.
5. **Pedestrians and Other Vehicles**: While not directly visible, the presence of other vehicles and pedestrians in the background suggests that the area is a busy urban street.
These objects collectively provide important context for the driving decision, emphasizing the need for caution and careful navigation through the construction area. |
| Mini-InternVL2-2B-DA-DriveLM | There is a white SUV to the back of the ego vehicle, a gray SUV to the front right of the ego vehicle, a gray sedan to the front of the ego vehicle, a white truck to the front of the ego vehicle, a black SUV to the back of the ego vehicle, and a red traffic cone to the front of the ego vehicle. The IDs of these objects are 0, 1, 2, 3, 4, and 5. |
| llama_adapter_v2_multimodal7b | In the current scene, the important objects to consider for future reasoning and driving decisions include the cars, trucks, and traffic lights. The cars and trucks are driving on a busy street, and the traffic lights are present at various locations to control the flow of traffic. The presence of these objects highlights the need for drivers to be attentive, follow traffic rules, and be prepared for sudden changes in traffic conditions. Additionally, the cars and trucks should maintain a safe distance from each other and be aware of the traffic lights to ensure smooth and safe driving. |
| InternVL2-2b-LoRA-25k-drivelm | There is a black SUV to the back of the ego vehicle, a white truck to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a white truck to the front of the ego vehicle, and a red car to the front of the ego vehicle. The IDs of these objects are <c1,CAM_BACK,1080.0,525.8>, <c2,CAM_FRONT,1080.0,495.0>, <c3,CAM_FRONT,1080.0,495.0>, <c4,CAM_FRONT,1080.0,495.0>, and <c5,CAM_FRONT,1080.0,495.0>. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | There is a white SUV to the back of the ego vehicle, a gray sedan to the front of the ego vehicle, a white truck to the front of the ego vehicle, a red car to the front right of the ego vehicle, and a black SUV to the back of the ego vehicle. The IDs of these objects are <c1,CAM_BACK,888.3,520.8>, <c2,CAM_FRONT,779.4,556.4>, <c3,CAM_FRONT,1129.2,495.8>, <c4,CAM_FRONT_RIGHT,347.8,634.6>, and <c5,CAM_BACK,254.0,653.3>. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | There is a white truck to the front of the ego vehicle, a black sedan to the front of the ego vehicle, a red sedan to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a white sedan to the front of the ego vehicle, and a black sedan to the front of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT,1080.0,525.0>, <c2,CAM_FRONT,1080.0,505.0>, <c3,CAM_FRONT,1080.0,505.0>, <c4,CAM_FRONT,1080.0,505.0>, <c5,CAM_FRONT,1080.0,505.0>, and <c6,CAM_FRONT,1080.0,505.0>. |
| InternVL2-2b-LoRA-300k-drivelm | There is a white truck to the front of the ego vehicle, a black SUV to the back of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the back of the ego vehicle, and a white truck to the front of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT,1080.0,495.8>, <c2,CAM_BACK,1010.8,520.0>, <c3,CAM_FRONT,1010.8,505.8>, <c4,CAM_FRONT,1010.8,505.8>, <c5,CAM_FRONT,1010.8,505.8>, <c6,CAM_FRONT,1010.8,505.8>, and <c7,CAM_FRONT,1010.8,505.8>. |
| llava-v1.6-mistral-7b-hf | In the current scene, the important objects to consider for future reasoning and driving decisions include:
1. Vehicles: There are various types of vehicles, including cars, trucks, and a bus, which are relevant for understanding traffic flow and potential obstacles.
2. Traffic lights: There are multiple traffic lights visible, which are crucial for understanding when it is safe to proceed or when to stop.
3. Pedestrians: There are a few pedestrians visible, which require drivers to be cautious and aware of their surroundings.
4. Construction zones: There are construction zones indicated by orange cones, which may require drivers to slow down or change lanes.
5. Road signs: There are several road signs visible, which provide information about speed limits, directions, and other important information.
6. Buildings: The presence of buildings suggests that this is an urban area, which may have specific traffic patterns or rules.
7. Infrastructure: The presence of bridges and overpasses indicates that this is a complex road network, which may require drivers to be aware of multiple lanes and potential merging points.
8. Weather conditions: The overcast sky suggests that the weather might be cloudy or potentially rainy, which could affect visibility and road conditions.
9. Road markings: There are white lines on the road, which indicate lanes and help drivers maintain their position.
10. Other road users: There are other vehicles and road users that drivers need to be aware of to ensure safe driving.
These objects are important for drivers to navigate the scene safely and efficiently. |
| 1 | Questionperception | What is the moving status of object <c1,CAM_BACK,888.3,520.8>? Please select the correct answer from the following options: A. Stopped. B. Reverse parking. C. Going ahead. D. Turn right. |
| GT Answer | C |
| InternVL2-2B | The moving status of object <c1,CAM_BACK,888.3,520.8> is C. Going ahead. |
| Mini-InternVL2-2B-DA-DriveLM | C |
| llama_adapter_v2_multimodal7b | The moving status of object <c1,CAM_BACK,888.3,520.8> is "Going ahead." |
| InternVL2-2b-LoRA-25k-drivelm | C |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | C |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | C |
| InternVL2-2b-LoRA-300k-drivelm | C. Going ahead. |
| llava-v1.6-mistral-7b-hf | A. Stopped. |
| 2 | Questionprediction | What object should the ego vehicle notice first when the ego vehicle is getting to the next possible location? What is the state of the object that is first noticed by the ego vehicle and what action should the ego vehicle take? What object should the ego vehicle notice second when the ego vehicle is getting to the next possible location? What is the state of the object perceived by the ego vehicle as second and what action should the ego vehicle take? What object should the ego vehicle notice third? What is the state of the object perceived by the ego vehicle as third and what action should the ego vehicle take? |
| GT Answer | Firstly, notice that <c4,CAM_FRONT_RIGHT,347.8,634.6>. The object is going ahead, so the ego vehicle should slow down and go ahead. Secondly, notice that <c2,CAM_FRONT,779.4,556.4>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Thirdly, notice that <c3,CAM_FRONT,1129.2,495.8>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. |
| InternVL2-2B | When the ego vehicle is getting to the next possible location, it should notice the traffic light first. The state of the traffic light is green, indicating that vehicles can proceed. The ego vehicle should proceed with caution. The object that should be noticed second is the traffic light itself. The state of the traffic light is green, indicating that vehicles can proceed. The ego vehicle should proceed with caution. The object that should be noticed third is the traffic light's signal. The state of the traffic light's signal is green, indicating that vehicles can proceed. The ego vehicle should proceed with caution. |
| Mini-InternVL2-2B-DA-DriveLM | Firstly, notice that the object in front of the ego vehicle is going ahead. The ego vehicle should continue going ahead at the same speed. Secondly, notice that the object in front of the ego vehicle is going ahead. The ego vehicle should continue going ahead at the same speed. Thirdly, notice that the object in front of the ego vehicle is going ahead. The ego vehicle should continue going ahead at the same speed. |
| llama_adapter_v2_multimodal7b | When the ego vehicle is getting to the next possible location, it should first notice the traffic light, which is in the process of turning red. The ego vehicle should then take the appropriate action, which is to stop at the red light. Next, the ego vehicle should notice the car in front of it, which is stopped at the red light. The ego vehicle should then take the appropriate action, which is to wait for the car in front to move before proceeding. Finally, the ego vehicle should notice the car behind it, which is also stopped at the red light. The ego vehicle should then take the appropriate action, which is to wait for the car behind to move before proceeding. |
| InternVL2-2b-LoRA-25k-drivelm | Firstly, notice that <c3,CAM_FRONT,1080.8,480.8>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Secondly, notice that <c2,CAM_FRONT,1080.8,480.8>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Thirdly, notice that <c1,CAM_BACK,1080.8,480.8>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Firstly, notice that <c4,CAM_FRONT_RIGHT,347.8,634.6>. The object is stationary, so the ego vehicle should continue ahead at the same speed. Secondly, notice that <c2,CAM_FRONT,779.4,556.4>. The object is stationary, so the ego vehicle should continue ahead at the same speed. Thirdly, notice that <c3,CAM_FRONT,1129.2,495.8>. The object is stationary, so the ego vehicle should continue ahead at the same speed. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | Firstly, notice that <c3,CAM_FRONT,1080.0,525.0>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. Secondly, notice that <c1,CAM_FRONT,1080.0,525.0>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. Thirdly, notice that <c2,CAM_BACK,1080.0,525.0>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. |
| InternVL2-2b-LoRA-300k-drivelm | Firstly, notice that <c3,CAM_FRONT,1080.0,525.8>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. Secondly, notice that <c1,CAM_FRONT,1080.0,505.8>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. Thirdly, notice that <c2,CAM_FRONT,1080.0,505.8>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a series of snapshots from a vehicle's camera, showing different views of a busy city street. Here's a description of the objects and actions that the ego vehicle should consider:
1. First object: The first object the ego vehicle should notice is the traffic light. The state of the traffic light is red, indicating that the ego vehicle should stop.
2. Second object: The second object is the construction zone ahead. The state of the construction zone is active, with construction equipment and barriers visible. The ego vehicle should slow down and be prepared to merge into the appropriate lane as directed by the traffic light.
3. Third object: The third object is the traffic in the adjacent lanes. The traffic appears to be heavy, with multiple vehicles. The ego vehicle should be cautious and maintain a safe distance from the vehicles in front of it.
4. Fourth object: The fourth object is the pedestrian crossing. The state of the pedestrian crossing is clear, with no pedestrians visible. The ego vehicle should be prepared to yield to pedestrians if they appear.
5. Fifth object: The fifth object is the traffic light ahead. The state of the traffic light is red, indicating that the ego vehicle should stop.
6. Sixth object: The sixth object is the construction zone ahead. The state of the construction zone is active, with construction equipment and barriers visible. The ego vehicle should slow down and be prepared to merge into the appropriate lane as directed by the traffic light.
7. Seventh object: The seventh object is the traffic in the adjacent lanes. The traffic appears to be heavy, with multiple vehicles. The ego vehicle should be cautious and maintain a safe distance from the vehicles in front of it.
8. Eighth object: The eighth object is the pedestrian crossing. The state of the pedestrian crossing is clear, with no pedestrians visible. The ego vehicle should be prepared to yield to pedestrians if they appear.
9. Ninth object: The ninth object is the traffic light ahead. The state of the traffic light is red, indicating that the ego vehicle should stop.
10. Tenth object: The tenth object is the construction zone ahead. The state of the construction zone is active, with construction equipment and barriers visible. The ego vehicle should slow down and be prepared to merge into the appropriate |
| 3 | Questionprediction | Is <c1,CAM_BACK,888.3,520.8> a traffic sign or a road barrier? |
| GT Answer | No. |
| InternVL2-2B | To determine if the sequence of numbers and letters provided in the question is a traffic sign or a road barrier, let's analyze the context and the visual clues in the image.
1. **Traffic Sign Analysis**:
- **Traffic signs** typically have specific symbols and text that indicate directions, warnings, or regulations. They are usually placed on poles or mounted on buildings.
- The sequence of numbers and letters in the question does not appear to be a standard traffic sign. It does not have any recognizable symbols or text that would indicate a direction or regulation.
2. **Road Barrier Analysis**:
- **Road barriers** are usually placed at intersections, on the sides of roads, or in other locations to control traffic flow. They often have specific shapes or symbols.
- The sequence of numbers and letters in the question does not appear to be a typical shape or symbol associated with road barriers.
3. **Contextual Clues**:
- The sequence of numbers and letters is placed in a way that suggests it is part of a larger sequence, possibly a set of instructions or a code.
- The image shows a busy urban street with multiple lanes, construction activity, and vehicles, which is typical of a city environment.
4. **Conclusion**:
- Given the context of the image and the sequence of numbers and letters, it is highly unlikely that this sequence is a standard traffic sign or a road barrier. It appears to be part of a larger set of instructions or a code, possibly related to navigation or traffic control.
In conclusion, the sequence of numbers and letters provided in the question is most likely not a traffic sign or a road barrier. It seems to be part of a larger set of instructions or a code, possibly related to navigation or traffic control in a city environment. |
| Mini-InternVL2-2B-DA-DriveLM | No. |
| llama_adapter_v2_multimodal7b | The traffic sign in the image is a "CAM BACK" sign, which is placed to indicate that drivers should back up to a specific location or area. |
| InternVL2-2b-LoRA-25k-drivelm | No. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | No. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | No. |
| InternVL2-2b-LoRA-300k-drivelm | No. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to show a traffic sign rather than a road barrier. The sign is labeled "CAM_BACK_LEFT," which suggests it is a camera system designed to capture images of vehicles from the rear, likely for traffic monitoring or enforcement purposes. It is not a physical barrier that would obstruct traffic. |
| 4 | Questionplanning | What actions could the ego vehicle take based on <c1,CAM_BACK,888.3,520.8>? Why take this action and what's the probability? |
| GT Answer | The action is to keep going at the same speed. The reason is to avoid a collision, which is high in probability. |
| InternVL2-2B | The ego vehicle, represented by the car in the foreground, is currently facing a traffic light that is red. Based on the given information, the ego vehicle should stop and wait for the traffic light to turn green. This action is necessary to ensure the safety of the vehicle and other road users.
### Probability of Stopping:
To determine the probability of stopping, we need to consider the following factors:
1. **Current Traffic Conditions**: The traffic light is red, indicating that vehicles are stopped.
2. **Speed of Other Vehicles**: The ego vehicle is moving at a moderate speed, and other vehicles are also stopped.
3. **Speed of Ego Vehicle**: The ego vehicle is moving at a moderate speed, and it is not necessary to stop immediately.
### Chain of Thought (CoT) Analysis:
1. **Current Traffic Conditions**: The traffic light is red, indicating that vehicles are stopped.
2. **Speed of Other Vehicles**: Other vehicles are also stopped, suggesting that the ego vehicle is not in a hurry.
3. **Speed of Ego Vehicle**: The ego vehicle is moving at a moderate speed, and it is not necessary to stop immediately.
Given these factors, the probability of stopping is relatively high. The ego vehicle is not in a hurry, and the current traffic conditions do not require immediate action. Therefore, the ego vehicle should stop and wait for the traffic light to turn green.
### Conclusion:
The ego vehicle should stop and wait for the traffic light to turn green. The probability of stopping is high due to the current traffic conditions and the moderate speed of the ego vehicle. |
| Mini-InternVL2-2B-DA-DriveLM | The action is to keep going at the same speed. The reason is that there is no safety issue. The probability is high. |
| llama_adapter_v2_multimodal7b | Based on the given coordinates, the ego vehicle is likely to take the action of turning left. The coordinates indicate that the vehicle is in the left lane, and turning left would be the most logical and safe maneuver for the vehicle to take. The probability of the vehicle taking this action is high, as it is in the left lane and turning left would be the most direct route to its destination. However, it is important to note that the vehicle's decision to turn left could be influenced by other factors, such as traffic conditions, road signs, or the presence of other vehicles in the lane. |
| InternVL2-2b-LoRA-25k-drivelm | The action is to keep going at the same speed. The reason is that there is no safety issue, and the probability is high. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | The action is to keep going at the same speed. The reason is that there is no safety issue. The probability is high. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | The action is to keep going at the same speed. The reason is that there is no safety issue. The probability is high. |
| InternVL2-2b-LoRA-300k-drivelm | The action is to keep going at the same speed. The reason is that there is no safety issue. The probability is high. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a sequence of images showing a vehicle's perspective while navigating through traffic. The sequence is labeled with different actions that the ego vehicle could take:
1. CAM_BACK_LEFT: This action suggests that the vehicle should change lanes to the left, as indicated by the "CAM_BACK" label, which likely refers to the rear-facing camera of the vehicle. The "888.3" and "520.8" labels might refer to the position of the vehicle relative to the lane markings or other vehicles.
2. CAM_BACK_RIGHT: This action suggests that the vehicle should change lanes to the right. The reasoning behind this action is similar to the first, with the vehicle using its rear-facing camera to assess the traffic situation.
3. CAM_FRONT_LEFT: This action suggests that the vehicle should change lanes to the left while facing forward. The vehicle might be using its front-facing camera to make this decision.
4. CAM_FRONT_RIGHT: This action suggests that the vehicle should change lanes to the right while facing forward. The vehicle is again using its front-facing camera to make this decision.
5. CAM_BACK_RIGHT: This action is a repeat of the second action, suggesting that the vehicle should change lanes to the right while facing backward.
6. CAM_BACK_LEFT: This action is a repeat of the first action, suggesting that the vehicle should change lanes to the left while facing backward.
The probability of these actions depends on the traffic conditions, the vehicle's intended destination, and the driver's decision-making process. The vehicle might be changing lanes to avoid a congested area, to merge into a different lane, or to make a turn. The exact probability of each action would require more context, such as the current traffic situation, the vehicle's intended route, and the driver's intentions. |
| 5 | Questionplanning | What actions taken by the ego vehicle can lead to a collision with <c1,CAM_BACK,888.3,520.8>? |
| GT Answer | Brake suddenly. |
| InternVL2-2B | The ego vehicle, a gray sedan, is positioned in the middle of the road, facing a white van and a red sedan. The white van is positioned on the right side of the road, and the red sedan is on the left side. The ego vehicle is traveling straight ahead, and the white van is positioned directly in front of it.
Given the following actions:
1. The ego vehicle is moving straight ahead.
2. The white van is moving straight ahead.
3. The red sedan is moving straight ahead.
The ego vehicle is not aware of the white van and the red sedan, and it is not aware of the position of the red sedan. The ego vehicle is also not aware of the white van, which is positioned directly in front of it.
The collision risk is high because the ego vehicle is moving straight ahead and the white van is moving straight ahead, potentially blocking the ego vehicle's path. The red sedan is also moving straight ahead, potentially obstructing the ego vehicle's path. The ego vehicle is not aware of the white van and the red sedan, and it is not aware of the position of the red sedan.
Therefore, the ego vehicle is at risk of a collision with the white van and the red sedan due to the following actions:
- The white van is moving straight ahead.
- The red sedan is moving straight ahead.
- The ego vehicle is moving straight ahead. |
| Mini-InternVL2-2B-DA-DriveLM | Back up. |
| llama_adapter_v2_multimodal7b | The ego vehicle is driving in the wrong direction on a one-way street, which can lead to a collision with <c1,CAM_BACK,888.3,520.8>. The vehicle is moving in the opposite direction of the traffic flow, which increases the risk of an accident as other vehicles on the street are moving in the correct direction. Additionally, the ego vehicle is positioned close to the camera, which might make it difficult for other drivers to see it and react in time to avoid a collision. |
| InternVL2-2b-LoRA-25k-drivelm | Back up. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Brake suddenly. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | No such action will lead to a collision. |
| InternVL2-2b-LoRA-300k-drivelm | Back up. |
| llava-v1.6-mistral-7b-hf | The image you've provided shows a sequence of photos that depict a vehicle's movement through an intersection. The sequence is labeled as "CAM_BACK_LEFT," "CAM_BACK_RIGHT," "CAM_BACK_888.3," and "CAM_BACK_888.8." These labels suggest that the camera is positioned at different angles and distances from the vehicle, likely from a rear-view camera mounted on the vehicle itself.
From the sequence, it appears that the vehicle is making a left turn at an intersection. The actions that could lead to a collision with the vehicle labeled as "CAM_BACK_888.3" include:
1. **Failure to Yield**: If the vehicle does not yield to the oncoming traffic when it is required to do so, it could collide with the vehicle labeled as "CAM_BACK_888.3."
2. **Inadequate Signaling**: If the vehicle does not use its turn signals to indicate its intention to turn left, other drivers may not anticipate the turn and could collide with the vehicle.
3. **Poor Lane Positioning**: If the vehicle is not in the correct lane for a left turn, it could be in the path of oncoming traffic, increasing the risk of a collision.
4. **Exceeding the Turning Radius**: If the vehicle does not maintain a safe distance from the curb while turning, it could veer into the path of the vehicle labeled as "CAM_BACK_888.3."
5. **Inattentive Driving**: If the driver is not paying attention to the traffic conditions, they may not notice the vehicle labeled as "CAM_BACK_888.3" in time to avoid a collision.
6. **Speeding**: If the vehicle is traveling at a speed that is too high for the turn, it may not be able to stop in time to avoid a collision.
7. **Mechanical Failure**: If the vehicle's brakes or steering fail, it could lead to a collision with the vehicle labeled as "CAM_BACK_888.3."
8. **Distracted Driving**: If the driver is distracted by something inside or outside the vehicle, they may not be able to react in time to avoid a collision.
9. **Poor Road Conditions |
| 6 | Questionplanning | In this scenario, what are safe actions to take for the ego vehicle? |
| GT Answer | Decelerate gradually without braking. |
| InternVL2-2B | Based on the image, the safe actions for the ego vehicle would include maintaining a safe following distance from the vehicle in front of it, as indicated by the "CAM_FRONT_LEFT" and "CAM_FRONT_RIGHT" labels. The ego vehicle should also be prepared to yield to the vehicle in front, as suggested by the "CAM_FRONT" label. Additionally, the ego vehicle should be cautious of the construction site in the background, as indicated by the "CAM_FRONT" label, and should not attempt to pass through the construction zone. |
| Mini-InternVL2-2B-DA-DriveLM | Slightly offset to the left, slightly offset to the right, and brake gently to a stop are safe actions to take for the ego vehicle in this scenario. |
| llama_adapter_v2_multimodal7b | In the image, the ego vehicle is driving in a busy city street with multiple cars, trucks, and pedestrians. To ensure safety, the ego vehicle should follow these actions:1. Maintain a safe distance from other vehicles, especially larger ones like trucks, to avoid collisions.2. Be cautious when changing lanes or making turns, as there are other vehicles and pedestrians nearby.3. Pay attention to traffic signals and signs, obeying them to avoid accidents and ensure smooth traffic flow.4. Be prepared for sudden stops or changes in traffic conditions, such as construction zones or pedestrians crossing the street.5. Keep an eye on blind spots and use mirrors to check for any vehicles or pedestrians that may be hidden from view.By following these safe actions, the ego vehicle can navigate the busy city street more effectively and reduce the risk of accidents or traffic violations. |
| InternVL2-2b-LoRA-25k-drivelm | Keep going at the same speed, accelerate, and proceed. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Decelerate gradually without braking and maintain the same speed. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | Keep going at the same speed, decelerate gradually without braking. |
| InternVL2-2b-LoRA-300k-drivelm | Keep going at the same speed, decelerate gradually without braking. |
| llava-v1.6-mistral-7b-hf | In the given scenario, the ego vehicle is a car driving on a busy city street with various other vehicles, including cars, trucks, and a bus. To ensure safe driving, the following actions should be taken:
1. **Maintain a Safe Following Distance**: Keep a safe distance from the vehicle in front to allow for adequate reaction time in case of sudden braking or changes in traffic flow.
2. **Stay in the Right Lane**: Since the image shows a left-hand drive country, the right lane is typically the slow lane. Staying in the right lane unless turning or changing lanes is safer as it allows for better visibility of oncoming traffic.
3. **Use Turn Signals**: When changing lanes or making turns, use the appropriate turn signals to communicate your intentions to other drivers.
4. **Be Aware of Blind Spots**: Large vehicles like trucks and buses have larger blind spots. Be cautious when driving near them, especially when they are turning or changing lanes.
5. **Watch for Pedestrians**: Be vigilant for pedestrians crossing the street or walking along the sidewalks.
6. **Obey Traffic Signs and Signals**: Follow all traffic signs and signals, including speed limits, stop signs, and traffic lights.
7. **Be Prepared for Construction Zones**: If there are construction zones, slow down and be prepared for changes in traffic patterns.
8. **Stay Alert**: Be constantly aware of your surroundings, including the actions of other drivers, pedestrians, and cyclists.
9. **Use Defensive Driving Techniques**: Anticipate potential hazards and be prepared to react accordingly.
10. **Keep Your Vehicle Maintained**: Regularly check and maintain your vehicle's brakes, tires, lights, and other essential components to ensure safe driving.
Remember, defensive driving is key in busy urban environments. Always prioritize safety over speed. |
| 7 | Questionbehavior | Predict the behavior of the ego vehicle. Please select the correct answer from the following options: A. The ego vehicle is going straight. The ego vehicle is driving slowly. B. The ego vehicle is going straight. The ego vehicle is driving fast. C. The ego vehicle is steering to the left. The ego vehicle is driving fast. D. The ego vehicle is steering to the right. The ego vehicle is driving fast. |
| GT Answer | A |
| InternVL2-2B | The ego vehicle is going straight. The ego vehicle is driving slowly. |
| Mini-InternVL2-2B-DA-DriveLM | A |
| llama_adapter_v2_multimodal7b | The ego vehicle is driving fast, as it is seen speeding through the traffic. |
| InternVL2-2b-LoRA-25k-drivelm | A |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | A |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | B |
| InternVL2-2b-LoRA-300k-drivelm | A. The ego vehicle is going straight. The ego vehicle is driving slowly. |
| llava-v1.6-mistral-7b-hf | Based on the image provided, the ego vehicle is driving straight and appears to be maintaining a moderate speed, as it is in the middle of the lane and not making any sudden turns or accelerating rapidly. Therefore, the correct answer is A: The ego vehicle is going straight. The ego vehicle is driving slowly. |
