| 0 | Questionperception | What are the important objects in the current scene? Those objects will be considered for the future reasoning and driving decision. |
| GT Answer | There is a white commercial vehicle to the back of the ego vehicle, a black SUV to the front of the ego vehicle, a no entry to the front of the ego vehicle, a gray SUV to the front of the ego vehicle, a blue sedan to the front left of the ego vehicle, and a red light to the front of the ego vehicle. The IDs of these objects are <c1,CAM_BACK,970.8,544.2>, <c2,CAM_FRONT,442.5,535.8>, <c3,CAM_FRONT,1515.0,780.8>, <c4,CAM_FRONT,874.2,551.7>, <c5,CAM_FRONT_LEFT,947.9,665.1>, and <c6,CAM_FRONT,1302.0,336.9>. |
| InternVL2-2B | In the current scene, the important objects include:
1. The blue car in the foreground on the left side of the image.
2. The red car in the foreground on the right side of the image.
3. The construction barriers and orange cones in the middle of the image.
4. The tall buildings in the background, including the one with the large glass windows.
5. The street and road markings, including the dashed white line and the center line.
6. The traffic lights and pedestrian crossing signals in the background.
These objects are crucial for understanding the current traffic situation and planning the driving decision. |
| Mini-InternVL2-2B-DA-DriveLM | There is a black SUV to the front of the ego vehicle, a blue sedan to the front left of the ego vehicle, a silver SUV to the back of the ego vehicle, a black SUV to the front of the ego vehicle, and a red light to the front of the ego vehicle. The IDs of these objects are 0, 1, 2, 3, and 4. |
| llama_adapter_v2_multimodal7b | In the current scene, the important objects to consider for future reasoning and driving decisions include the parked cars, the traffic lights, and the street signs. The parked cars are located on both sides of the street, and their positions and sizes should be noted. The traffic lights are present at various locations along the street, and their colors and positions should be observed. Street signs, such as the stop sign, are also present in the scene, and their locations and messages should be recorded. By considering these objects, drivers can make informed decisions about their driving behavior, such as stopping at the stop sign, yielding to pedestrians, and being aware of the parked cars when maneuvering around the street. |
| InternVL2-2b-LoRA-25k-drivelm | There is a black SUV to the back of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, and a red light to the front of the ego vehicle. The IDs of these objects are <c1,CAM_BACK,1080.0,525.8>, <c2,CAM_FRONT,1080.0,505.8>, <c3,CAM_FRONT,1080.0,505.8>, <c4,CAM_FRONT,1080.0,505.8>, and <c5,CAM_FRONT,1080.0,500.0>. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | There is a white SUV to the back of the ego vehicle, a black SUV to the front of the ego vehicle, a white construction vehicle to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a blue sedan to the front left of the ego vehicle, and a traffic signal to the front of the ego vehicle. The IDs of these objects are <c1,CAM_BACK,970.8,544.2>, <c2,CAM_FRONT,470.8,528.3>, <c3,CAM_FRONT,1515.0,780.8>, <c4,CAM_FRONT,874.2,551.7>, <c5,CAM_FRONT_LEFT,947.9,665.1>, and <c6,CAM_FRONT,1302.0,336.9>. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | There is a black SUV to the front of the ego vehicle, a black sedan to the front of the ego vehicle, a red car to the back of the ego vehicle, and a black sedan to the front of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT,1010.0,525.0>, <c2,CAM_FRONT,1010.0,505.0>, <c3,CAM_BACK,1010.0,520.0>, and <c4,CAM_FRONT,1010.0,505.0>. |
| InternVL2-2b-LoRA-300k-drivelm | There is a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the back of the ego vehicle, a black SUV to the back of the ego vehicle, and a red light to the front of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT,1080.0,520.0>, <c2,CAM_FRONT,1080.0,505.8>, <c3,CAM_BACK,1010.8,545.8>, <c4,CAM_BACK,1010.8,530.8>, and <c5,CAM_FRONT,1010.8,325.8>. |
| llava-v1.6-mistral-7b-hf | In the current scene, the important objects to consider for future reasoning and driving decisions include:
1. The blue car in the foreground, which is the vehicle the driver is currently operating.
2. The orange traffic cones, which indicate a construction zone or a temporary change in traffic patterns.
3. The construction barriers, which are used to guide traffic around the construction area.
4. The other vehicles, including the cars and trucks, which are sharing the road and may require attention to their movements.
5. The pedestrians, who are navigating the sidewalks and may need to cross the street.
6. The traffic lights, which control the flow of traffic at intersections.
7. The buildings and infrastructure, which provide context for the location and the type of road.
These objects are crucial for the driver to navigate safely and efficiently through the scene. |
| 1 | Questionprediction | What object should the ego vehicle notice first when the ego vehicle is getting to the next possible location? What is the state of the object that is first noticed by the ego vehicle and what action should the ego vehicle take? What object should the ego vehicle notice second when the ego vehicle is getting to the next possible location? What is the state of the object perceived by the ego vehicle as second and what action should the ego vehicle take? What object should the ego vehicle notice third? What is the state of the object perceived by the ego vehicle as third and what action should the ego vehicle take? |
| GT Answer | Firstly, notice <c6,CAM_FRONT,1302.0,336.9>. The object is a traffic sign, so the ego vehicle should remain stationary. Secondly, notice <c5,CAM_FRONT_LEFT,947.9,665.1>. The object is stationary, so the ego vehicle should remain stationary. Thirdly, notice <c3,CAM_FRONT,1515.0,780.8>. The object is stationary, so the ego vehicle should remain stationary. |
| InternVL2-2B | When the ego vehicle is getting to the next possible location, it should first notice the construction barriers and the roadwork ahead. The state of the object perceived by the ego vehicle as the first object to be noticed is the construction barriers and the roadwork. The action the ego vehicle should take is to slow down and prepare to stop or change lanes to avoid the construction area. The object that the ego vehicle should notice second is the traffic light. The state of the object perceived by the ego vehicle as the second object to be noticed is the traffic light. The action the ego vehicle should take is to stop or prepare to change lanes to safely pass through the intersection. The object that the ego vehicle should notice third is the pedestrian crossing. The state of the object perceived by the ego vehicle as the third object to be noticed is the pedestrian crossing. The action the ego vehicle should take is to stop or prepare to cross the pedestrian crossing to ensure safety. |
| Mini-InternVL2-2B-DA-DriveLM | Firstly, notice that the object in front of the ego vehicle is stationary. The ego vehicle should remain stationary. Secondly, notice that the object in front of the ego vehicle is stationary. The ego vehicle should remain stationary. Thirdly, notice that the object in front of the ego vehicle is stationary. The ego vehicle should remain stationary. |
| llama_adapter_v2_multimodal7b | When the ego vehicle is getting to the next possible location, it should first notice the parked car on the side of the street. The ego vehicle should then take the appropriate action, such as slowing down or stopping, to ensure the safety of the parked car and other vehicles and pedestrians in the area. Next, the ego vehicle should notice the traffic light, which is currently green. The ego vehicle should continue driving, following the traffic light's signal, and obeying the traffic rules. Finally, the ego vehicle should notice the truck on the side of the street. The ego vehicle should maintain a safe distance from the truck and be prepared to react to any sudden movements or changes in the truck's direction. |
| InternVL2-2b-LoRA-25k-drivelm | Firstly, notice that <c3,CAM_FRONT,1080.8,525.0>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Secondly, notice that <c2,CAM_FRONT,1080.8,505.0>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Thirdly, notice that <c1,CAM_BACK,1080.8,525.0>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Firstly, notice <c3,CAM_FRONT,1515.0,780.8>. The object is a traffic sign, so the ego vehicle should decelerate gradually until it comes to a stop. Secondly, notice <c4,CAM_FRONT,874.2,551.7>. The object is going ahead, so the ego vehicle should decelerate gradually until it comes to a stop. Thirdly, notice <c2,CAM_FRONT,470.8,524.2>. The object is going ahead, so the ego vehicle should decelerate gradually until it comes to a stop. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | Firstly, notice <c3,CAM_FRONT,1015.0,525.0>. The object is a traffic sign, so the ego vehicle should continue ahead at the same speed. Secondly, notice <c1,CAM_FRONT,1015.0,505.0>. The object is stationary, so the ego vehicle should continue ahead at the same speed. Thirdly, notice <c2,CAM_FRONT,1015.0,505.0>. The object is stationary, so the ego vehicle should continue ahead at the same speed. |
| InternVL2-2b-LoRA-300k-drivelm | Firstly, notice that <c3,CAM_FRONT,1080.0,520.0>. The object is a traffic sign, so the ego vehicle should continue going ahead at the same speed. Secondly, notice that <c1,CAM_FRONT,1080.0,520.0>. The object is a traffic sign, so the ego vehicle should continue going ahead at the same speed. Thirdly, notice that <c2,CAM_FRONT,1080.0,510.0>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a series of snapshots from a vehicle's camera system, showing different views of a city street. Here's a description of the objects and actions that the ego vehicle should consider:
1. First object: The ego vehicle should notice the traffic light first when approaching the next possible location. The traffic light is currently red, indicating that the ego vehicle should stop.
2. Second object: The ego vehicle should notice the construction barrier next. The barrier is currently blocking the road ahead, so the ego vehicle should prepare to turn left or find an alternative route.
3. Third object: The ego vehicle should notice the pedestrian crossing next. The crossing is currently clear, so the ego vehicle should proceed with caution, ensuring it doesn't obstruct the pedestrian crossing.
4. Fourth object: The ego vehicle should notice the parked cars next. The cars are parked on the side of the road, and the ego vehicle should be aware of the parked cars when maneuvering around the construction area.
5. Fifth object: The ego vehicle should notice the traffic light again as it continues to move. The traffic light is still red, so the ego vehicle should continue to stop if it's still in the intersection.
6. Sixth object: The ego vehicle should notice the construction barrier again as it continues to move. The barrier is still blocking the road ahead, so the ego vehicle should continue to follow the detour signs.
7. Seventh object: The ego vehicle should notice the parked cars again as it continues to move. The cars are still parked on the side of the road, and the ego vehicle should be aware of the parked cars when maneuvering around the construction area.
8. Eighth object: The ego vehicle should notice the traffic light again as it continues to move. The traffic light is still red, so the ego vehicle should continue to stop if it's still in the intersection.
9. Ninth object: The ego vehicle should notice the pedestrian crossing again as it continues to move. The crossing is still clear, so the ego vehicle should proceed with caution, ensuring it doesn't obstruct the pedestrian crossing.
10. Tenth object: The ego vehicle should notice the construction barrier again as it continues to move. The barrier is still blocking the road ahead, so the ego vehicle should continue to follow the detour signs. |
| 2 | Questionprediction | Is <c1,CAM_BACK,970.8,544.2> a traffic sign or a road barrier? |
| GT Answer | No. |
| InternVL2-2B | To determine if the coordinates provided in the question are a traffic sign or a road barrier, let's analyze the image in detail.
1. **Traffic Sign Analysis**:
- **Location**: The coordinates provided are (c1, CAM_BACK, 970.8, 544.2).
- **Visual Inspection**: Upon examining the image, it appears to be a street scene with vehicles and buildings. There is no clear indication of a traffic sign.
- **Conclusion**: The coordinates provided are not a traffic sign.
2. **Road Barrier Analysis**:
- **Location**: The coordinates provided are (c1, CAM_BACK, 970.8, 544.2).
- **Visual Inspection**: Upon examining the image, it appears to be a street scene with construction barriers and vehicles. There is a clear indication of a road barrier.
- **Conclusion**: The coordinates provided are a road barrier.
In conclusion, the coordinates (c1, CAM_BACK, 970.8, 544.2) are a road barrier, not a traffic sign. |
| Mini-InternVL2-2B-DA-DriveLM | No. |
| llama_adapter_v2_multimodal7b | The image does not provide enough information to confidently determine whether the object is a traffic sign or a road barrier. However, it is clear that the object is located on the side of the road, which could be either a traffic sign or a road barrier. |
| InternVL2-2b-LoRA-25k-drivelm | No. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | No. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | No. |
| InternVL2-2b-LoRA-300k-drivelm | No. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to show a series of photographs with various traffic signs and road barriers. The specific sign or barrier you're referring to, <c1,CAM_BACK,970.8,544.2>, is not visible in the image you've provided.
However, I can tell you that the image contains a variety of traffic signs and barriers, including:
- A "CAM_BACK" sign, which is a type of traffic sign used to indicate that a camera is monitoring the area for traffic enforcement.
- A "CAM_FRONT" sign, which is similar to the "CAM_BACK" sign but indicates that a camera is monitoring the area for traffic enforcement from the front.
- A "CAM_LEFT" sign, which is used to indicate that a camera is monitoring the area for traffic enforcement from the left side of the road.
- A "CAM_RIGHT" sign, which is used to indicate that a camera is monitoring the area for traffic enforcement from the right side of the road.
- A "CAM_FRONT_LEFT" sign, which is used to indicate that a camera is monitoring the area for traffic enforcement from the front and left side of the road.
- A "CAM_FRONT_RIGHT" sign, which is used to indicate that a camera is monitoring the area for traffic enforcement from the front and right side of the road.
- A "CAM_BACK_LEFT" sign, which is used to indicate that a camera is monitoring the area for traffic enforcement from the back and left side of the road.
- A "CAM_BACK_RIGHT" sign, which is used to indicate that a camera is monitoring the area for traffic enforcement from the back and right side of the road.
These signs are typically used to inform drivers that they are entering an area where their actions are being monitored for traffic enforcement purposes. |
| 3 | Questionplanning | What actions could the ego vehicle take based on <c1,CAM_BACK,970.8,544.2>? Why take this action and what's the probability? |
| GT Answer | The action is to remain stationary. The reason for taking this action is to follow the traffic rules. The probability of taking this action is high. |
| InternVL2-2B | The ego vehicle, represented by the car in the image, is currently positioned at the intersection of a street with a pedestrian crossing. Based on the given information, the ego vehicle can take the following actions:
1. **Slow Down**: The ego vehicle is approaching the intersection, and slowing down would help ensure a safe distance from the pedestrian crossing. This action is likely to be taken to avoid any potential collisions.
2. **Stop**: If the ego vehicle is approaching the pedestrian crossing and the pedestrian is not visible, stopping the vehicle would be the appropriate action to ensure the safety of the pedestrian. This is a standard safety protocol in urban environments.
3. **Wait**: The ego vehicle could also choose to wait at the intersection, especially if the pedestrian is not visible or if the pedestrian is crossing the street. Waiting allows the ego vehicle to assess the situation and decide on the next course of action.
**Probability**: The probability of taking these actions can be calculated based on the current state of the scene. Assuming the pedestrian is not visible and the ego vehicle is approaching the intersection, the probability of slowing down is high (close to 100% since the pedestrian is not visible). The probability of stopping is also high, as the pedestrian is not visible and the ego vehicle is approaching the intersection. The probability of waiting is also high, as the pedestrian is not visible and the ego vehicle is approaching the intersection.
In summary, the ego vehicle should take the following actions:
- Slow down
- Stop
- Wait
These actions are likely to be taken to ensure the safety of the pedestrian and to avoid any potential collisions. |
| Mini-InternVL2-2B-DA-DriveLM | The action is to remain stationary. The reason for this action is to follow the traffic rules, which has a high probability. |
| llama_adapter_v2_multimodal7b | Based on the given coordinates, the ego vehicle is at the intersection of a one-way street and a two-way street. The vehicle could take several actions, such as turning left or right, or continuing straight ahead. The probability of the vehicle taking a specific action depends on the vehicle's current position relative to the intersection and the presence of other vehicles or pedestrians in the area. For example, if the vehicle is close to the intersection and there are no other vehicles or pedestrians nearby, it is more likely that the vehicle will turn left or right. However, if the vehicle is further away from the intersection or if there are other vehicles or pedestrians nearby, the vehicle might continue straight ahead or turn the other way. The specific action taken by the vehicle would depend on the driver's decision, the traffic conditions, and the vehicle's position relative to the intersection. |
| InternVL2-2b-LoRA-25k-drivelm | The action is to keep going at the same speed. The reason is that there is no safety issue, and the probability is high. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | The action is to remain stationary. The reason for this action is to follow the traffic rules, which has a high probability. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | The action is to keep going at the same speed. The reason is that there is no safety issue. The probability is high. |
| InternVL2-2b-LoRA-300k-drivelm | The action is to keep going at the same speed. The reason is that there is no safety issue. The probability is high. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a sequence of images showing a vehicle's perspective as it moves through an urban environment. The sequence includes a car driving down a street, making a left turn, and then backing up.
Based on the image <c1,CAM_BACK,970.8,544.2>, the ego vehicle is currently in a situation where it is backing up. This action is typically taken when a vehicle is maneuvering in a tight space or trying to park. The probability of this action depends on the context of the situation, such as the presence of other vehicles, pedestrians, or obstacles.
The ego vehicle might be backing up for several reasons:
1. Parking: The driver might be trying to park the vehicle in a tight space where the front of the car is facing the curb.
2. Reversing out of a parking spot: The driver might have parked the car in a spot that is too tight to exit forward, so they are backing up to get out of the spot.
3. Avoiding an obstacle: The driver might have encountered an obstacle, such as a parked car or a pedestrian, and is backing up to avoid a collision.
The probability of this action depends on the driver's skill, the visibility of the surroundings, and the presence of any obstacles or other vehicles that might require the driver to back up. It's important for the driver to be aware of their surroundings and to use their mirrors and sensors to ensure safe maneuvering. |
| 4 | Questionplanning | What actions taken by the ego vehicle can lead to a collision with <c1,CAM_BACK,970.8,544.2>? |
| GT Answer | Back up. |
| InternVL2-2B | The ego vehicle, a Ford F-150, is approaching a construction zone on the right side of the road. The construction zone is marked by orange barriers and a temporary road surface. The vehicle is traveling at a moderate speed, and there are no other vehicles immediately visible in the vicinity.
Here are the actions that could lead to a collision with the vehicle:
1. **Driving too fast**: The ego vehicle is currently traveling at a moderate speed. If the driver were to speed up, especially at the intersection, it could lead to a collision with the construction zone.
2. **Driving too close to the edge**: The vehicle is approaching the orange barriers, which are meant to guide traffic away from the construction zone. If the driver were to drive too close to the barriers, it could lead to a collision.
3. **Driving recklessly**: The driver could be seen driving aggressively, such as swerving or making sudden turns, which could lead to a collision with the construction zone.
4. **Not paying attention**: The driver could be distracted or not paying attention to the road, leading to a collision with the construction zone.
Given these potential scenarios, the driver must remain vigilant and adhere to the traffic rules and signals to avoid a collision with the construction zone. |
| Mini-InternVL2-2B-DA-DriveLM | Back up. |
| llama_adapter_v2_multimodal7b | The ego vehicle is driving down the street, and it is approaching a red traffic light at the intersection. If the driver of the ego vehicle does not stop or slow down in time, they may collide with the red traffic light. This can lead to severe consequences, such as property damage, injuries, or even fatalities. It is crucial for drivers to obey traffic signals and follow traffic rules to ensure the safety of themselves and others on the road. |
| InternVL2-2b-LoRA-25k-drivelm | Back up. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Brake suddenly. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | No such action will lead to a collision. |
| InternVL2-2b-LoRA-300k-drivelm | Back up. |
| llava-v1.6-mistral-7b-hf | The image you've provided shows a sequence of images that depict a vehicle's rear view, indicating that the vehicle is backing up. In the context of autonomous driving, the actions that could lead to a collision with the object labeled as <c1,CAM_BACK,970.8,544.2> are:
1. **Failure to Monitor Surroundings**: If the autonomous vehicle does not have a comprehensive view of its surroundings, it may not detect the object in its path.
2. **Inadequate Sensor Performance**: If the vehicle's sensors, such as cameras and lidar, are not functioning properly, they may not accurately detect the object.
3. **Incorrect Decision-Making**: If the vehicle's decision-making system misinterprets the data from its sensors, it may not recognize the object in its path.
4. **Inability to Stop or Reverse**: If the vehicle's braking or reversing systems fail to operate correctly, it may not be able to stop or reverse in time to avoid a collision.
5. **Lack of Safe Distance**: If the vehicle does not maintain a safe distance from the object, it may not have enough time to react if the object moves or if the vehicle's sensors are not accurate.
6. **Incorrect Lane Change**: If the vehicle is changing lanes and does not properly assess the traffic conditions, it may end up in the path of the object.
7. **Incorrect Turn Execution**: If the vehicle is turning and does not properly assess the traffic conditions, it may end up in the path of the object.
8. **Incorrect Speed Control**: If the vehicle is moving at an incorrect speed, it may not be able to stop or reverse in time to avoid a collision.
9. **Incorrect Traffic Signal Interpretation**: If the vehicle does not correctly interpret traffic signals, it may not stop or reverse when required.
10. **Incorrect Road Marking Interpretation**: If the vehicle does not correctly interpret road markings, it may not be able to judge the correct position to stop or reverse.
11. **Incorrect Lane Marking Interpretation**: If the vehicle does not correctly interpret lane markings, it may not be able to judge the correct position to stop or reverse.
12 |
| 5 | Questionplanning | In this scenario, what are safe actions to take for the ego vehicle? |
| GT Answer | Decelerate gradually without braking and brake gently to a stop. |
| InternVL2-2B | Based on the image, the safe actions for the ego vehicle would include maintaining a safe following distance from the vehicles ahead, ensuring that the vehicle ahead is not in a position to cross the road, and being prepared to stop if necessary. The ego vehicle should also be aware of the construction area and any potential hazards, such as pedestrians or other vehicles, and avoid entering the construction zone. Additionally, the ego vehicle should be prepared to adjust its speed and position to avoid any potential collisions with the construction vehicles or pedestrians. |
| Mini-InternVL2-2B-DA-DriveLM | Slightly offset to the left, slightly offset to the right, and brake gently to a stop are safe actions to take for the ego vehicle in this scenario. |
| llama_adapter_v2_multimodal7b | In the image, the ego vehicle is parked on a city street with other cars and a truck nearby. To ensure safety, the driver should consider the following actions:1. Check for any pedestrians or cyclists in the vicinity before opening the car door or moving the vehicle.2. Be cautious of the parked cars and trucks around the vehicle, as they may be in the way or obstruct the driver's view.3. When moving the vehicle, ensure that it is parked legally and not obstructing traffic or causing any inconvenience to other drivers.4. If the driver needs to leave the vehicle, they should do so cautiously, checking for any pedestrians or cyclists in the area before opening the door.5. If the driver needs to reverse the vehicle, they should do so slowly and carefully, checking for any obstacles or pedestrians behind the vehicle before moving.By following these safe actions, the driver can minimize the risk of accidents and ensure the safety of themselves, their passengers, and other road users. |
| InternVL2-2b-LoRA-25k-drivelm | Keep going at the same speed, accelerate, and proceed. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Brake gently to a stop, slightly offset to the right. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | Keep going at the same speed, decelerate gradually without braking. |
| InternVL2-2b-LoRA-300k-drivelm | Keep going at the same speed, decelerate gradually without braking. |
| llava-v1.6-mistral-7b-hf | In the scenario depicted in the image, the ego vehicle is a blue car driving down a city street with construction work and barriers. Here are some safe actions the driver of the ego vehicle should take:
1. **Slow Down**: The driver should reduce their speed to match the flow of traffic and to be prepared for any sudden changes in traffic conditions.
2. **Stay Alert**: The driver should be attentive to the road, watching for any workers, equipment, or changes in the road layout.
3. **Follow Traffic Signs**: The driver should obey all traffic signs and signals, including any temporary signs or signals related to the construction work.
4. **Maintain a Safe Distance**: The driver should keep a safe distance from the vehicle in front, as well as any construction equipment or barriers.
5. **Be Prepared for Lane Changes**: The driver should be prepared for any lane changes that may be required due to the construction work.
6. **Use Turn Signals**: If the driver needs to make a turn, they should use their turn signals well in advance to alert other drivers.
7. **Be Patient**: The driver should be patient and allow for any delays caused by the construction work.
8. **Avoid Distractions**: The driver should avoid any distractions, such as using a mobile phone, to ensure they are fully focused on the road.
9. **Use Caution at Intersections**: The driver should be cautious when approaching intersections, as construction work may affect the visibility of other vehicles or pedestrians.
10. **Be Prepared for Emergencies**: The driver should be prepared for any emergency situations that may arise due to the construction work, such as sudden changes in traffic patterns or the need to stop quickly.
By following these safety measures, the driver can navigate the construction zone safely and minimize the risk of accidents. |
| 6 | Questionbehavior | Predict the behavior of the ego vehicle. Please select the correct answer from the following options: A. The ego vehicle is slightly steering to the right. The ego vehicle is driving fast. B. The ego vehicle is slightly steering to the left. The ego vehicle is driving very fast. C. The ego vehicle is going straight. The ego vehicle is not moving. D. The ego vehicle is slightly steering to the left. The ego vehicle is driving fast. |
| GT Answer | C |
| InternVL2-2B | Based on the image, the ego vehicle is driving fast. The image shows the ego vehicle in the middle of a busy street with multiple lanes, and the surrounding environment indicates that it is navigating through a construction zone. The presence of construction barriers and the fact that the ego vehicle is in the middle of a multi-lane road suggest that it is driving at a high speed to maintain control and avoid potential hazards. |
| Mini-InternVL2-2B-DA-DriveLM | C |
| llama_adapter_v2_multimodal7b | The ego vehicle is slightly steering to the left, and it is driving fast. |
| InternVL2-2b-LoRA-25k-drivelm | C |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | C |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | C |
| InternVL2-2b-LoRA-300k-drivelm | D. The ego vehicle is slightly steering to the left. The ego vehicle is driving fast. |
| llava-v1.6-mistral-7b-hf | A. The ego vehicle is slightly steering to the right. The ego vehicle is driving fast. |
