| 0 | Questionperception | What are the important objects in the current scene? Those objects will be considered for the future reasoning and driving decision. |
| GT Answer | There is a black Jeep to the back of the ego vehicle, a yellow construction truck to the front of the ego vehicle, a pedestrian wearing a yellow shirt to the front of the ego vehicle, and a white sedan to the front left of the ego vehicle. The IDs of these objects are <c1,CAM_BACK,893.3,512.5>, <c2,CAM_FRONT,962.5,465.8>, <c3,CAM_FRONT,1458.3,478.3>, and <c4,CAM_FRONT_LEFT,570.8,692.6>. |
| InternVL2-2B | In the current scene, the important objects include:
1. **The Car**: The white car in the foreground is a critical object for future reasoning and driving decisions. It is moving towards the camera, which suggests it is in the path of the vehicle. The car's position and movement can help in determining the vehicle's speed, direction, and potential hazards.
2. **The Building**: The large building with the glass facade is another significant object. It is located on the right side of the image and has a prominent sign that reads "DYCKS CAFE." The building's presence and the signage can help in identifying the location and potentially the type of establishment.
3. **The Street**: The road is the primary setting for the scene. It is a two-lane road with a solid yellow line, indicating it is a one-way street. The road's condition, including the wet surface, suggests recent rain, which can affect driving conditions.
4. **The Pedestrian**: The person walking on the sidewalk is an important object for future reasoning. The pedestrian's presence indicates that the area is accessible and safe for pedestrians. The pedestrian's direction and movement can help in understanding the traffic flow and potential hazards.
5. **The Traffic Light**: The traffic light is visible in the background, indicating the presence of traffic control. The light's position and the direction of the traffic can help in understanding the current traffic conditions and potential hazards.
These objects are crucial for future reasoning and driving decisions as they provide essential information about the environment, traffic, and potential hazards. |
| Mini-InternVL2-2B-DA-DriveLM | There is a white sedan to the front left of the ego vehicle, a black SUV to the back of the ego vehicle, a white sedan to the back left of the ego vehicle, and a yellow construction vehicle to the front of the ego vehicle. The IDs of these objects are 1, 2, 3, and 4. |
| llama_adapter_v2_multimodal7b | In the current scene, the important objects to consider for future reasoning and driving decisions include the cars, traffic lights, and the building. The cars are parked or moving along the street, and the traffic lights are present at various locations to control the flow of traffic. The building in the background may also be a landmark or a point of interest that drivers should be aware of. By observing these objects and their positions, drivers can make informed decisions about their driving behavior, such as maintaining a safe distance from other vehicles, obeying traffic signals, and being aware of potential obstacles or hazards in the area. |
| InternVL2-2b-LoRA-25k-drivelm | There is a white SUV to the front of the ego vehicle, a black SUV to the back of the ego vehicle, a white sedan to the front of the ego vehicle, a white sedan to the front left of the ego vehicle, a black SUV to the back of the ego vehicle, and a white sedan to the front of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT,1080.0,495.8>, <c2,CAM_BACK,1080.0,495.8>, <c3,CAM_FRONT,1080.0,495.8>, <c4,CAM_FRONT_LEFT,1080.0,495.8>, <c5,CAM_BACK,1080.0,495.8>, and <c6,CAM_FRONT,1080.0,495.8>. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | There is a black car to the back of the ego vehicle, a white construction vehicle to the front of the ego vehicle, a person wearing a white shirt to the front of the ego vehicle, and a white sedan to the front left of the ego vehicle. The IDs of these objects are <c1,CAM_BACK,893.3,512.5>, <c2,CAM_FRONT,1109.2,475.0>, <c3,CAM_FRONT,1458.3,478.3>, and <c4,CAM_FRONT_LEFT,570.8,692.6>. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | There is a white sedan to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a white sedan to the back of the ego vehicle, a white sedan to the front of the ego vehicle, a white sedan to the front of the ego vehicle, and a white sedan to the front of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT,1011.7,525.0>, <c2,CAM_FRONT,1011.7,505.0>, <c3,CAM_BACK,1011.7,525.0>, <c4,CAM_FRONT,1011.7,505.0>, <c5,CAM_FRONT,1011.7,505.0>, and <c6,CAM_FRONT,1011.7,505.0>. |
| InternVL2-2b-LoRA-300k-drivelm | There is a white sedan to the back of the ego vehicle, a white sedan to the front of the ego vehicle, a black sedan to the back of the ego vehicle, a white sedan to the front left of the ego vehicle, a white sedan to the front of the ego vehicle, a white sedan to the back left of the ego vehicle, and a white sedan to the front left of the ego vehicle. The IDs of these objects are <c1,CAM_BACK,1080.8,520.0>, <c2,CAM_FRONT,1010.8,505.8>, <c3,CAM_BACK,1015.8,520.0>, <c4,CAM_FRONT_LEFT,1010.8,530.8>, <c5,CAM_FRONT,1010.8,525.8>, <c6,CAM_BACK_LEFT,1015.8,520.0>, and <c7,CAM_FRONT_LEFT,1010.8,530.8>. |
| llava-v1.6-mistral-7b-hf | In the current scene, the important objects to consider for future reasoning and driving decisions include:
1. Vehicles: There are several cars and a truck visible in the image. These vehicles are important for understanding traffic flow and potential obstacles.
2. Pedestrians: There are a few people visible in the image. They are important for ensuring pedestrian safety and being aware of their movements.
3. Traffic lights: There are traffic lights visible in the image. These are crucial for understanding when it is safe to proceed or when you need to stop.
4. Road markings: The image shows road markings, which are important for understanding lane boundaries and where to position your vehicle.
5. Buildings: The presence of buildings indicates that this is an urban area. This information can be used to anticipate the types of roads and intersections you might encounter.
6. Weather conditions: The image shows a rainy day, which can affect visibility, road conditions, and the behavior of other drivers.
7. Signage: There are signs visible in the image, which can provide information about speed limits, directions, or other important information.
8. Streetlights: There are streetlights visible in the image, which can be used to navigate at night or in low-light conditions.
9. Parking: There are parking spaces visible in the image, which can be used for parking or for understanding where other vehicles might be parked.
10. Road surface: The image shows the road surface, which can be important for understanding potential hazards such as potholes or slippery conditions.
These objects, along with the overall layout of the street and the position of your vehicle, will be crucial for making safe and informed driving decisions. |
| 1 | Questionperception | What is the moving status of object <c1,CAM_BACK,893.3,512.5>? Please select the correct answer from the following options: A. Turn right. B. Going ahead. C. Back up. D. Turn left. |
| GT Answer | B |
| InternVL2-2B | The moving status of object <c1,CAM_BACK,893.3,512.5> is C. Back up. |
| Mini-InternVL2-2B-DA-DriveLM | B |
| llama_adapter_v2_multimodal7b | The moving status of object <c1,CAM_BACK,893.3,512.5> is "Going ahead." |
| InternVL2-2b-LoRA-25k-drivelm | B |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | B |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | B |
| InternVL2-2b-LoRA-300k-drivelm | C. Back up. |
| llava-v1.6-mistral-7b-hf | B. Going ahead. |
| 2 | Questionprediction | What object should the ego vehicle notice first when the ego vehicle is getting to the next possible location? What is the state of the object that is first noticed by the ego vehicle and what action should the ego vehicle take? What object should the ego vehicle notice second when the ego vehicle is getting to the next possible location? What is the state of the object perceived by the ego vehicle as second and what action should the ego vehicle take? What object should the ego vehicle notice third? What is the state of the object perceived by the ego vehicle as third and what action should the ego vehicle take? |
| GT Answer | Firstly notice that <c4,CAM_FRONT_LEFT,570.8,692.6>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Secondly notice that <c3,CAM_FRONT,1458.3,478.3>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Thirdly notice that <c2,CAM_FRONT,962.5,465.8>. The object is stationary, so the ego vehicle should keep going ahead at the same speed. |
| InternVL2-2B | When the ego vehicle is getting to the next possible location, it should notice the "DYCKED CAFE" building first. The state of the object perceived by the ego vehicle as the first object is that the building is closed, as indicated by the "5-11" sign on the building. The action the ego vehicle should take is to proceed straight ahead to the next possible location.
The second object that the ego vehicle should notice is the "DYCKED CAFE" building. The state of the object perceived by the ego vehicle as the second object is that the building is closed, as indicated by the "5-11" sign on the building. The action the ego vehicle should take is to proceed straight ahead to the next possible location.
The third object that the ego vehicle should notice is the "DYCKED CAFE" building. The state of the object perceived by the ego vehicle as the third object is that the building is closed, as indicated by the "5-11" sign on the building. The action the ego vehicle should take is to proceed straight ahead to the next possible location. |
| Mini-InternVL2-2B-DA-DriveLM | Firstly, notice that the object in front of the ego vehicle is going ahead. The ego vehicle should continue going ahead at the same speed. Secondly, notice that the object in front of the ego vehicle is going ahead. The ego vehicle should continue going ahead at the same speed. Thirdly, notice that the object in front of the ego vehicle is going ahead. The ego vehicle should continue going ahead at the same speed. |
| llama_adapter_v2_multimodal7b | When the ego vehicle is getting to the next possible location, it should first notice the traffic light, which is in the state of "red." The ego vehicle should then take the appropriate action, which is to stop at the red light. Next, the ego vehicle should notice the building, which is in the state of "closed." The ego vehicle should then take the appropriate action, which is to continue driving. Finally, the ego vehicle should notice the car, which is in the state of "parked." The ego vehicle should then take the appropriate action, which is to park the vehicle safely and legally, if possible. |
| InternVL2-2b-LoRA-25k-drivelm | Firstly, notice that <c3,CAM_FRONT,1080.8,525.0>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Secondly, notice that <c2,CAM_FRONT,1080.8,505.0>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Thirdly, notice that <c1,CAM_BACK,1080.8,525.0>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Firstly, notice that <c4,CAM_FRONT_LEFT,570.8,692.6>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Secondly, notice that <c3,CAM_FRONT,1458.3,478.3>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Thirdly, notice that <c2,CAM_FRONT,1105.0,485.0>. The object is stationary, so the ego vehicle should keep going ahead at the same speed. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | Firstly, notice <c1, CAM_FRONT, 1400.0, 530.0>. The object is approaching, so the ego should slow down. Secondly, notice <c2, CAM_FRONT, 1400.0, 530.0>. The object is approaching, so the ego should slow down. Thirdly, notice <c3, CAM_FRONT, 1400.0, 530.0>. The object is approaching, so the ego should slow down. |
| InternVL2-2b-LoRA-300k-drivelm | Firstly, notice <c3,CAM_FRONT,1080.0,490.8>. It is stationary, so the ego vehicle should continue ahead at the same speed. Secondly, notice <c2,CAM_FRONT,1080.0,490.8>. It is stationary, so the ego vehicle should continue ahead at the same speed. Thirdly, notice <c1,CAM_FRONT,1080.0,490.8>. It is stationary, so the ego vehicle should continue ahead at the same speed. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a collage of different scenes, likely taken from a vehicle's camera system. The scenes show various road conditions and traffic situations.
When the ego vehicle is getting to the next possible location, it should first notice the traffic lights. The state of the traffic lights in the first image is red, indicating that the ego vehicle should stop.
The second object the ego vehicle should notice is the pedestrian crossing. The pedestrian crossing is clear in the second image, so the ego vehicle should proceed with caution, ensuring it is safe to do so.
The third object the ego vehicle should notice is the road ahead. In the third image, the road appears to be clear with no immediate obstacles. The ego vehicle should continue to monitor the road for any potential hazards.
The fourth object the ego vehicle should notice is the parked cars on the side of the road. The parked cars are visible in the fourth image, and the ego vehicle should be prepared to slow down or stop if necessary to avoid any potential hazards.
The fifth object the ego vehicle should notice is the building in the background. The building is visible in the fifth image, and the ego vehicle should be aware of its surroundings and any potential pedestrians or cyclists that might be near the building.
The sixth object the ego vehicle should notice is the traffic lights again. The traffic lights are red in the sixth image, indicating that the ego vehicle should stop.
The seventh object the ego vehicle should notice is the pedestrian crossing. The pedestrian crossing is clear in the seventh image, so the ego vehicle should proceed with caution, ensuring it is safe to do so.
The eighth object the ego vehicle should notice is the parked cars on the side of the road. The parked cars are visible in the eighth image, and the ego vehicle should be aware of its surroundings and any potential pedestrians or cyclists that might be near the parked cars.
The ninth object the ego vehicle should notice is the building in the background. The building is visible in the ninth image, and the ego vehicle should be aware of its surroundings and any potential pedestrians or cyclists that might be near the building.
The tenth object the ego vehicle should notice is the traffic lights again. The traffic lights are red in the tenth image, indicating that the ego vehicle should stop.
The eleventh object the ego vehicle |
| 3 | Questionprediction | Is <c1,CAM_BACK,893.3,512.5> a traffic sign or a road barrier? |
| GT Answer | No. |
| InternVL2-2B | To determine if the coordinates <c1,CAM_BACK,893.3,512.5> represent a traffic sign or a road barrier, let's analyze the image in detail:
1. **Location and Orientation**:
- The coordinates are given in the format (x, y, z), where x, y, and z are the coordinates of the point in the image.
- The coordinates provided are (893.3, 512.5).
2. **Visual Inspection**:
- **Traffic Sign**: A traffic sign typically has a distinct shape, color, or text that indicates a specific rule or regulation.
- **Road Barrier**: A road barrier is usually a physical structure that prevents vehicles from passing through, often with a distinct shape or color.
3. **Image Analysis**:
- **Traffic Sign**: The coordinates provided do not correspond to any recognizable shape or text that would indicate a traffic sign.
- **Road Barrier**: The coordinates do not correspond to any recognizable shape or color that would indicate a road barrier.
4. **Conclusion**:
- Given the coordinates provided, it is not possible to definitively determine if they represent a traffic sign or a road barrier. The coordinates do not match any typical visual characteristics of either.
In conclusion, the coordinates <c1,CAM_BACK,893.3,512.5> do not correspond to a traffic sign or a road barrier in the provided image. |
| Mini-InternVL2-2B-DA-DriveLM | No. |
| llama_adapter_v2_multimodal7b | The image does not provide enough information to confidently determine whether the object is a traffic sign or a road barrier. However, it is clear that the object is located on the side of the road and is part of the street scene. |
| InternVL2-2b-LoRA-25k-drivelm | No. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | No. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | No. |
| InternVL2-2b-LoRA-300k-drivelm | No. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a collage of different scenes, possibly from a security camera, showing various views of a street and its surroundings. The image labeled as <c1,CAM_BACK,893.3,512.5> does not show a traffic sign or a road barrier. Instead, it seems to be a view of a street with parked cars and a building in the background. If you are looking for a specific object or feature in this image, please provide more details or clarify your question. |
| 4 | Questionplanning | What actions could the ego vehicle take based on <c1,CAM_BACK,893.3,512.5>? Why take this action and what's the probability? |
| GT Answer | The action is to keep going at the same speed. The reason is to avoid a collision, which is high probability. |
| InternVL2-2B | The ego vehicle, represented by the car in the foreground, is currently positioned at the intersection of a two-way street. Based on the given information, the ego vehicle can take the following actions:
1. **Turn Left**: The ego vehicle is currently on the left side of the intersection. If the ego vehicle decides to turn left, it would be heading towards the intersection on the right side. This action is likely because the ego vehicle is currently on the left side of the intersection and needs to move to the right side to continue on the road.
**Probability**: The probability of taking this action is relatively high. The ego vehicle is currently on the left side of the intersection, and there is no immediate traffic on the right side. Turning left would allow the ego vehicle to continue on the road without encountering any traffic or pedestrians. The probability of this action occurring is high, as the ego vehicle is in a favorable position to make a turn. |
| Mini-InternVL2-2B-DA-DriveLM | The action is to keep going at the same speed. The reason is that there is no safety issue. The probability is high. |
| llama_adapter_v2_multimodal7b | Based on the given input, the ego vehicle could take the action of turning right at the intersection. This action is indicated by the <c1,CAM_BACK,893.3,512.5> command, which represents the vehicle's current position, orientation, and heading. The probability of the vehicle taking this action is 100%, as the vehicle is already at the intersection and the command specifies the desired action. |
| InternVL2-2b-LoRA-25k-drivelm | The action is to keep going at the same speed. The reason is that there is no safety issue, and the probability is high. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | The action is to keep going at the same speed. The reason is that there is no safety issue. The probability is high. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | The action is to keep going at the same speed. The reason is that there is no safety issue. The probability is high. |
| InternVL2-2b-LoRA-300k-drivelm | The action is to keep going at the same speed. The reason is that there is no safety issue, and the probability is high. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a sequence of images showing a vehicle's perspective as it moves through an urban environment. The sequence includes a car driving down a street, turning left, and then turning right.
Based on the information provided (<c1,CAM_BACK,893.3,512.5>), it seems like the vehicle is using a camera mounted on the back of the car to monitor its surroundings. This is a common practice in autonomous vehicles to ensure they are aware of their environment and can make safe decisions.
The actions the ego vehicle could take based on this information are:
1. **Drive Straight**: If the vehicle is currently driving straight and there are no obstacles or other vehicles in its path, it could continue driving straight.
2. **Turn Left**: If the vehicle is approaching a turn and the turn is clear, it could initiate a left turn.
3. **Turn Right**: If the vehicle is approaching a turn and the turn is clear, it could initiate a right turn.
The probability of each action depends on the current state of the vehicle and its surroundings. For example:
- If the vehicle is approaching a turn and there are no obstacles or other vehicles in its path, the probability of turning left or right would be high.
- If the vehicle is driving straight and there are no obstacles or other vehicles in its path, the probability of continuing straight would be high.
- If the vehicle is approaching a turn and there are obstacles or other vehicles in its path, the probability of turning left or right would be low.
- If the vehicle is driving straight and there are obstacles or other vehicles in its path, the probability of turning left or right would be low.
The actual probability of each action would be determined by the vehicle's sensors and the algorithms it uses to make decisions based on its environment. These algorithms would take into account the vehicle's speed, the position of other vehicles and obstacles, and the road markings to determine the safest and most appropriate action. |
| 5 | Questionplanning | What actions taken by the ego vehicle can lead to a collision with <c1,CAM_BACK,893.3,512.5>? |
| GT Answer | Back up. |
| InternVL2-2B | The ego vehicle, a white sedan, is approaching a pedestrian crossing. The pedestrian crossing is marked with a yellow line, indicating that it is a designated area for pedestrians to cross the road. The vehicle is positioned directly in front of the pedestrian crossing, and there is no visible indication of the pedestrian's presence or movement.
Given the following observations:
1. The pedestrian crossing is clearly marked with a yellow line.
2. The ego vehicle is positioned directly in front of the pedestrian crossing.
3. There is no visible pedestrian or any indication of their presence or movement.
Based on these observations, the ego vehicle could potentially collide with the pedestrian crossing due to the following reasons:
- The vehicle is in close proximity to the pedestrian crossing without any visible warning signs or signals.
- The vehicle is not paying attention to the pedestrian crossing, as it is not aware of the pedestrian's presence or movement.
- The vehicle's speed and trajectory are not aligned with the pedestrian crossing, potentially leading to a collision.
To avoid a collision, the ego vehicle should:
- Slow down and ensure it is aware of the pedestrian crossing.
- Use appropriate signals or signals to alert pedestrians of its presence.
- Maintain a safe distance from the pedestrian crossing to avoid sudden movements or changes in speed. |
| Mini-InternVL2-2B-DA-DriveLM | Back up. |
| llama_adapter_v2_multimodal7b | The ego vehicle is driving down the street, and it is approaching a red traffic light at an intersection. If the driver of the ego vehicle does not stop or slow down in time, they may collide with the <c1,CAM_BACK,893.3,512.5> object, which is likely a traffic light or a pedestrian crossing sign. This collision could result in damage to the vehicle, injury to the occupants, or even fatalities. It is crucial for drivers to obey traffic signals and be aware of their surroundings to avoid such incidents. |
| InternVL2-2b-LoRA-25k-drivelm | Back up. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Brake suddenly. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | No such action will lead to a collision. |
| InternVL2-2b-LoRA-300k-drivelm | Back up. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a series of snapshots from a vehicle's camera system, showing different views of the road ahead. The vehicle's camera system is likely designed to provide the driver with a 360-degree view of the surroundings, which can be helpful for maneuvering in tight spaces or for monitoring traffic conditions.
In the context of the image, the actions that could lead to a collision with the vehicle labeled as <c1,CAM_BACK,893.3,512.5> include:
1. **Failure to Yield**: If the driver of the vehicle with the camera system does not yield to the vehicle labeled <c1,CAM_BACK,893.3,512.5> when required, such as at an intersection or when merging onto a road, a collision could occur.
2. **Lane Change**: If the driver of the vehicle with the camera system changes lanes without checking their blind spots or without signaling, they could collide with the vehicle labeled <c1,CAM_BACK,893.3,512.5>.
3. **Following Too Close**: If the driver of the vehicle with the camera system follows the vehicle labeled <c1,CAM_BACK,893.3,512.5> too closely, they may not have enough time to react if the other vehicle suddenly stops or changes direction.
4. **Distracted Driving**: If the driver of the vehicle with the camera system is distracted by something inside the vehicle, they may not notice the vehicle labeled <c1,CAM_BACK,893.3,512.5> in time to avoid a collision.
5. **Speeding**: If the driver of the vehicle with the camera system is speeding, they may not have enough time to react to the vehicle labeled <c1,CAM_BACK,893.3,512.5> if it suddenly stops or changes direction.
6. **Inattentive Driving**: If the driver of the vehicle with the camera system is not paying full attention to the road, they may not notice the vehicle labeled <c1,CAM_BACK,893.3,512.5> in time to avoid a collision.
7. **Mechanical Failure |
| 6 | Questionplanning | In this scenario, what are safe actions to take for the ego vehicle? |
| GT Answer | Keep going at the same speed, brake gently to a stop, decelerate gradually without braking, slightly offset to the right. |
| InternVL2-2B | Based on the image, the safe actions for the ego vehicle would include maintaining a safe following distance from the vehicle in front of it, as indicated by the "CAM_FRONT_LEFT" and "CAM_FRONT" labels. The vehicle should also be prepared to react to any potential hazards, such as the construction vehicle, by increasing its speed or changing lanes if necessary. Additionally, the vehicle should be cautious of pedestrians and other vehicles, especially given the wet conditions, which could increase the risk of accidents. |
| Mini-InternVL2-2B-DA-DriveLM | Keep going at the same speed, decelerate gradually without braking. |
| llama_adapter_v2_multimodal7b | In the image, there are multiple cars and a truck on the road, with some of them stopped at a red light. To ensure safety, the ego vehicle should follow these actions:1. Obey traffic signals: The ego vehicle should stop at red lights and follow the traffic signals to avoid accidents and maintain a safe distance from other vehicles.2. Be cautious at intersections: The ego vehicle should be vigilant at intersections, looking out for pedestrians, cyclists, and other vehicles that may be turning or crossing the road.3. Maintain a safe speed: The ego vehicle should drive at a safe speed, taking into account the road conditions, visibility, and the presence of other vehicles.4. Keep a safe distance: The ego vehicle should maintain a safe distance from other vehicles, especially when they are stopped at a red light or in traffic.5. Be prepared for sudden stops: The ego vehicle should be prepared for sudden stops, as seen in the image, to avoid rear-end collisions.By following these safe actions, the ego vehicle can navigate the busy street and reduce the risk of accidents. |
| InternVL2-2b-LoRA-25k-drivelm | Keep going at the same speed, accelerate, and proceed. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Keep going at the same speed, accelerate, and proceed. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | Keep going at the same speed, decelerate gradually without braking. |
| InternVL2-2b-LoRA-300k-drivelm | Keep going at the same speed, decelerate gradually without braking. |
| llava-v1.6-mistral-7b-hf | In the given scenario, the ego vehicle is a car driving on a city street. Here are some safe actions the driver should take:
1. **Maintain a Safe Following Distance**: The driver should keep a safe distance from the vehicle in front to allow for adequate reaction time in case of sudden braking or changes in traffic flow.
2. **Stay in the Lane**: The driver should stay within the lane markings and avoid drifting into other lanes, which could lead to collisions.
3. **Obey Traffic Signs and Signals**: The driver should follow all traffic signs and signals, including speed limits, stop signs, and traffic lights.
4. **Be Aware of Pedestrians**: The driver should be cautious around crosswalks and pedestrian areas, yielding to pedestrians when required.
5. **Use Turn Signals**: When changing lanes or making turns, the driver should use the appropriate turn signals to communicate their intentions to other road users.
6. **Watch for Cyclists and Motorcycles**: The driver should be vigilant for cyclists and motorcycles, especially when turning or changing lanes.
7. **Be Prepared for Weather Conditions**: If the weather is poor, as suggested by the rain in the images, the driver should reduce speed, increase following distance, and turn on headlights to improve visibility.
8. **Stay Alert**: The driver should stay focused on the road and avoid distractions such as using a mobile phone or engaging in other activities that could divert attention from the road.
9. **Regular Vehicle Maintenance**: The driver should ensure that the car is in good working condition, including checking the brakes, tires, lights, and other essential components.
10. **Practice Defensive Driving**: The driver should anticipate potential hazards and be prepared to react accordingly. This includes being aware of blind spots, watching for sudden stops, and being prepared for unexpected changes in traffic flow.
By following these safety guidelines, the driver can significantly reduce the risk of accidents and ensure a safer journey. |
| 7 | Questionbehavior | Predict the behavior of the ego vehicle. Please select the correct answer from the following options: A. The ego vehicle is steering to the left. The ego vehicle is driving fast. B. The ego vehicle is steering to the right. The ego vehicle is driving very fast. C. The ego vehicle is going straight. The ego vehicle is driving fast. D. The ego vehicle is going straight. The ego vehicle is driving with normal speed. |
| GT Answer | C |
| InternVL2-2B | Based on the image, the ego vehicle is driving straight. The image shows the ego vehicle in the center of the road with no visible signs of steering to the left, right, or very fast driving. The vehicle is also not shown driving fast or with normal speed. Therefore, the correct answer is D. The ego vehicle is going straight. The ego vehicle is driving with normal speed. |
| Mini-InternVL2-2B-DA-DriveLM | C |
| llama_adapter_v2_multimodal7b | The ego vehicle is steering to the left and driving fast. |
| InternVL2-2b-LoRA-25k-drivelm | C |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | C |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | C |
| InternVL2-2b-LoRA-300k-drivelm | C. The ego vehicle is going straight. The ego vehicle is driving fast. |
| llava-v1.6-mistral-7b-hf | Based on the image provided, the ego vehicle is steering to the left. |
