| 0 | Questionperception | What are the important objects in the current scene? Those objects will be considered for the future reasoning and driving decision. |
| GT Answer | There is a red truck to the back of the ego vehicle, a black SUV to the back of the ego vehicle, a gray pickup truck to the front of the ego vehicle, a unable to see clearly to the front of the ego vehicle, and a white truck to the front of the ego vehicle. The IDs of these objects are <c1,CAM_BACK,340.0,454.2>, <c2,CAM_BACK,762.5,491.7>, <c3,CAM_FRONT,226.7,526.7>, <c4,CAM_FRONT,949.2,480.8>, and <c5,CAM_FRONT,1178.3,444.2>. |
| InternVL2-2B | In the current scene, the important objects include:
1. **Road**: The primary road is wet, indicating recent or ongoing rain. This is crucial for understanding the driving conditions and potential hazards.
2. **Vehicles**: The presence of multiple vehicles, including a truck and a car, suggests that the road is in use and potentially busy.
3. **Buildings**: The buildings lining the road provide context and help orient the viewer. They also indicate the location and possibly the type of area.
4. **Streetlights and Sidewalks**: These elements are essential for navigation and safety, as they help in identifying the direction and distance of the vehicles.
5. **Traffic Signs**: Although not clearly visible, traffic signs are typically important for ensuring adherence to traffic rules and safety.
These objects are crucial for future reasoning and driving decisions as they provide essential information about the current road conditions, traffic, and surroundings. |
| Mini-InternVL2-2B-DA-DriveLM | There is a white truck to the front of the ego vehicle, a white truck to the front of the ego vehicle, and a black sedan to the front of the ego vehicle. The IDs of these objects are 1, 2, and 3. |
| llama_adapter_v2_multimodal7b | In the current scene, the important objects to consider for future reasoning and driving decisions include the cars, traffic lights, and the street. The cars are positioned at various distances from the traffic lights, and some are moving or stopped. The traffic lights are crucial for controlling the flow of traffic and ensuring safety. The street itself is a vital component of the scene, as it provides the context for the vehicles' movements and the traffic lights' functions. By observing these objects and their interactions, drivers can make informed decisions about their driving behavior and anticipate potential hazards or changes in traffic conditions. |
| InternVL2-2b-LoRA-25k-drivelm | There is a white truck to the front of the ego vehicle, a white SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the back of the ego vehicle, a white truck to the back of the ego vehicle, and a white truck to the front of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT,1080.0,495.8>, <c2,CAM_FRONT,1080.0,505.0>, <c3,CAM_FRONT,1080.0,495.8>, <c4,CAM_BACK,1080.0,495.8>, <c5,CAM_BACK,1080.0,495.8>, and <c6,CAM_FRONT,1080.0,495.8>. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | There is a white sedan to the back of the ego vehicle, a black sedan to the back of the ego vehicle, a black sedan to the front of the ego vehicle, a white truck to the front of the ego vehicle, and a green light to the front of the ego vehicle. The IDs of these objects are <c1,CAM_BACK,330.0,442.5>, <c2,CAM_BACK,762.5,491.7>, <c3,CAM_FRONT,226.7,526.7>, <c4,CAM_FRONT,949.2,480.0>, and <c5,CAM_FRONT,1178.3,444.2>. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | There is a white truck to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, and a white truck to the front of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT,1010.0,495.8>, <c2,CAM_FRONT,1010.0,495.8>, <c3,CAM_FRONT,1010.0,495.8>, <c4,CAM_FRONT,1010.0,495.8>, and <c5,CAM_FRONT,1010.0,495.8>. |
| InternVL2-2b-LoRA-300k-drivelm | There is a white SUV to the front of the ego vehicle, a white truck to the back of the ego vehicle, a black sedan to the front of the ego vehicle, and a black sedan to the back of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT,1080.0,520.0>, <c2,CAM_BACK,1010.8,490.0>, <c3,CAM_FRONT,1010.8,490.0>, and <c4,CAM_BACK,1010.8,490.0>. |
| llava-v1.6-mistral-7b-hf | In the current scene, the important objects to consider for future reasoning and driving decisions include:
1. Vehicles: There are several cars and a truck visible in the image. Their positions and movements can affect traffic flow and safety.
2. Traffic lights: There are multiple traffic lights in the scene, which control the flow of traffic and indicate when vehicles should stop or proceed.
3. Pedestrians: There are a few pedestrians visible, who may be crossing the street or waiting to do so.
4. Road markings: The road has clear lane markings, which are important for maintaining proper lane usage and avoiding accidents.
5. Street signs: There are street signs visible, which provide information about road conditions, directions, or other important information for drivers.
6. Buildings: The presence of buildings suggests that this is an urban area, which may have specific traffic rules or regulations.
7. Weather conditions: The image shows a rainy day, which can affect visibility, road conditions, and the behavior of other drivers.
8. Streetlights: There are streetlights visible, which can provide illumination during nighttime or low-light conditions.
9. Parking meters: There are parking meters visible, which indicate where parking is allowed and how much it costs.
10. Road surface: The road appears to be wet, which can affect traction and braking distance.
These objects, along with the overall traffic conditions and the driver's own vehicle, are crucial for making safe and informed driving decisions. |
| 1 | Questionperception | What is the moving status of object <c1,CAM_BACK,340.0,454.2>? Please select the correct answer from the following options: A. Going ahead. B. Stopped. C. Reverse parking. D. Drive backward. |
| GT Answer | A |
| InternVL2-2B | The moving status of object <c1,CAM_BACK,340.0,454.2> is B. Stopped. |
| Mini-InternVL2-2B-DA-DriveLM | A |
| llama_adapter_v2_multimodal7b | The moving status of object <c1,CAM_BACK,340.0,454.2> is "Reverse parking." |
| InternVL2-2b-LoRA-25k-drivelm | A |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | A |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | A |
| InternVL2-2b-LoRA-300k-drivelm | A. Going ahead. |
| llava-v1.6-mistral-7b-hf | B. Stopped |
| 2 | Questionprediction | What object should the ego vehicle notice first when the ego vehicle is getting to the next possible location? What is the state of the object that is first noticed by the ego vehicle and what action should the ego vehicle take? What object should the ego vehicle notice second when the ego vehicle is getting to the next possible location? What is the state of the object perceived by the ego vehicle as second and what action should the ego vehicle take? What object should the ego vehicle notice third? What is the state of the object perceived by the ego vehicle as third and what action should the ego vehicle take? |
| GT Answer | Firstly, notice that <c3,CAM_FRONT,226.7,526.7>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. Secondly, notice that <c5,CAM_FRONT,1178.3,444.2>. The object is stationary, so the ego vehicle should continue going ahead at the same speed. Thirdly, notice that <c4,CAM_FRONT,949.2,480.8>. The object is stationary, so the ego vehicle should continue going ahead at the same speed. |
| InternVL2-2B | When the ego vehicle is getting to the next possible location, it should notice the traffic light first. The state of the traffic light is green, indicating that vehicles can proceed. The ego vehicle should proceed as per traffic rules. The object that should be noticed second is the traffic light itself. The state of the traffic light is green, indicating that vehicles can proceed. The ego vehicle should proceed as per traffic rules. The object that should be noticed third is the street sign. The state of the street sign is not visible, but it should be in a position to indicate the direction of traffic flow. The ego vehicle should proceed as per traffic rules. |
| Mini-InternVL2-2B-DA-DriveLM | Firstly, notice that the object in front of the ego vehicle is stationary. The ego vehicle should continue ahead at the same speed. Secondly, notice that the object in front of the ego vehicle is stationary. The ego vehicle should continue ahead at the same speed. Thirdly, notice that the object in front of the ego vehicle is stationary. The ego vehicle should continue ahead at the same speed. |
| llama_adapter_v2_multimodal7b | When the ego vehicle is getting to the next possible location, it should first notice the traffic light, which is in the state of red. The ego vehicle should come to a complete stop at the red light. Next, the ego vehicle should notice the car in front of it, which is also stopped at the red light. The ego vehicle should continue to observe the traffic light and wait for it to turn green before proceeding. After the ego vehicle notices the car behind it, it should also observe the traffic light and wait for it to turn green before moving. Finally, the ego vehicle should notice the car on the right side of the road and wait for it to pass before moving. |
| InternVL2-2b-LoRA-25k-drivelm | Firstly, notice that <c3,CAM_FRONT,1080.8,525.0>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Secondly, notice that <c2,CAM_FRONT,1080.8,505.0>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Thirdly, notice that <c1,CAM_FRONT,1080.8,505.0>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Firstly, notice that <c3,CAM_FRONT,226.7,526.7>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Secondly, notice that <c4,CAM_FRONT,949.2,480.0>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Thirdly, notice that <c5,CAM_FRONT,1178.3,444.2>. The object is a traffic sign, so the ego vehicle should keep going ahead at the same speed. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | Firstly, notice <c3,CAM_FRONT,1016.7,525.0>. The object is going ahead, so the ego vehicle should continue at the same speed. Secondly, notice <c2,CAM_FRONT,1016.7,525.0>. The object is going ahead, so the ego vehicle should continue at the same speed. Thirdly, notice <c1,CAM_BACK,1016.7,525.0>. The object is going ahead, so the ego vehicle should continue at the same speed. |
| InternVL2-2b-LoRA-300k-drivelm | Firstly, notice <c3,CAM_FRONT,1080.0,520.8>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. Secondly, notice <c2,CAM_FRONT,1080.0,505.0>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. Thirdly, notice <c1,CAM_FRONT,1080.0,505.0>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. |
| llava-v1.6-mistral-7b-hf | The images provided show a series of traffic camera snapshots with various road conditions and traffic situations. Here's a description of the objects and actions the ego vehicle should consider:
1. First object: The ego vehicle should notice the traffic lights first when approaching the next possible location. The state of the traffic lights is red, indicating that the ego vehicle must stop.
2. Second object: The ego vehicle should notice the pedestrian crossing signal next. The signal is red, which means that pedestrians are not currently allowed to cross the street. The ego vehicle should proceed with caution, ensuring that no pedestrians are crossing.
3. Third object: The ego vehicle should notice the parked cars on the side of the road next. The cars are parked, and the ego vehicle should be prepared to navigate around them, especially if there is limited space on the road.
4. Fourth object: The ego vehicle should notice the traffic on the road ahead. There are several cars in the distance, and the ego vehicle should be aware of their presence and maintain a safe following distance.
5. Fifth object: The ego vehicle should notice the buildings and the overall urban environment. This is important for the ego vehicle to be aware of the surroundings and any potential hazards or obstacles.
6. Sixth object: The ego vehicle should notice the weather conditions, which appear to be rainy. This affects visibility and road conditions, so the ego vehicle should drive cautiously and at a slower speed.
7. Seventh object: The ego vehicle should notice the road markings and any potential hazards such as potholes or debris. The road appears to be wet, which could make it slippery, so the ego vehicle should be prepared to react accordingly.
8. Eighth object: The ego vehicle should notice the parked truck on the side of the road. The truck is large and could obstruct the view of other vehicles or pedestrians. The ego vehicle should be cautious when approaching or passing the truck.
9. Ninth object: The ego vehicle should notice the pedestrians on the sidewalk. They are walking, and the ego vehicle should be prepared to yield to them if they are crossing the street or if they are about to cross.
10. Tenth object: The ego vehicle should notice the traffic lights in the distance. The lights are red, indicating that the ego vehicle should stop if it is approaching an |
| 3 | Questionprediction | Is <c1,CAM_BACK,340.0,454.2> a traffic sign or a road barrier? |
| GT Answer | No. |
| InternVL2-2B | To determine if the coordinates <c1,CAM_BACK,340.0,454.2> represent a traffic sign or a road barrier, let's analyze the image in detail:
1. **Location and Orientation**:
- The coordinates are given in the format (x, y, z), where x, y, and z are the coordinates of the point in the image.
- The coordinates provided are (340.0, 454.2).
2. **Visual Inspection**:
- **Traffic Sign**: A traffic sign typically has a distinct shape, color, or text that indicates it is meant to be seen by drivers. In this image, there is no clear indication of a traffic sign.
- **Road Barrier**: A road barrier is usually a physical structure that is meant to prevent vehicles from entering a certain area. In the image, there is no visible barrier structure.
3. **Contextual Analysis**:
- The coordinates are located in the middle of the road, which is a common location for traffic signs or road barriers.
- The surrounding environment does not show any signs of a road barrier or traffic sign that would typically be seen in such a location.
4. **Conclusion**:
- Given the coordinates and the context of the image, it is reasonable to conclude that the coordinates <c1,CAM_BACK,340.0,454.2> represent a road barrier rather than a traffic sign.
In conclusion, the coordinates <c1,CAM_BACK,340.0,454.2> are most likely a road barrier. |
| Mini-InternVL2-2B-DA-DriveLM | No. |
| llama_adapter_v2_multimodal7b | The image does not provide enough information to confidently determine whether the <c1,CAM_BACK,340.0,454.2> is a traffic sign or a road barrier. It could be either, depending on the context and the specific location within the image. |
| InternVL2-2b-LoRA-25k-drivelm | No. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | No. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | No. |
| InternVL2-2b-LoRA-300k-drivelm | No. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a collage of different street scenes, and it's not clear what the specific context is for the sign or barrier labeled as <c1,CAM_BACK,340.0,454.2>. However, based on the visible elements in the image, it seems to be a traffic sign rather than a road barrier. The sign is mounted on a pole and is positioned on the side of the road, which is typical for traffic signs. Road barriers are usually larger and more substantial, often used to block off roads or lanes for construction, maintenance, or other purposes. |
| 4 | Questionplanning | What actions could the ego vehicle take based on <c1,CAM_BACK,340.0,454.2>? Why take this action and what's the probability? |
| GT Answer | The action is to keep going at the same speed. The reason is that the object has little reference value for the ego vehicle, with a high probability. |
| InternVL2-2B | The ego vehicle, indicated by the vehicle number 340.0, is currently positioned at the center of the road, facing the direction of the camera. The action it can take is to continue straight, as it is currently on the road and there are no immediate obstacles or signs of turning.
The probability of taking this action is relatively high, as the vehicle is not in a position to turn or change lanes immediately. The road appears to be clear, and there are no other vehicles or pedestrians in the immediate vicinity. The ego vehicle can safely continue straight, maintaining its current position and orientation.
In summary, the ego vehicle can take the action of continuing straight, with a high probability of success given the current road conditions and its position. |
| Mini-InternVL2-2B-DA-DriveLM | The action is to keep going at the same speed. The reason is that there is no safety issue. The probability is high. |
| llama_adapter_v2_multimodal7b | Based on the given input, the ego vehicle is at a position <c1,CAM_BACK,340.0,454.2> in the image. The vehicle could take several actions, such as:1. Turning left: The vehicle is currently facing the left side of the street. If the vehicle wants to turn left, it would need to move its steering wheel to the left and continue driving in that direction. The probability of the vehicle turning left is 100% since it is already facing the left side of the street.2. Turning right: The vehicle is currently facing the right side of the street. If the vehicle wants to turn right, it would need to move its steering wheel to the right and continue driving in that direction. The probability of the vehicle turning right is 100% since it is already facing the right side of the street.3. Continuing straight: The vehicle is currently facing the right side of the street. If the vehicle wants to continue straight, it would need to maintain its current position and continue driving in the same direction. The probability of the vehicle continuing straight is 100% since it is already facing the right side of the street.4. Turning around: The vehicle is currently facing the right side of the street. If the vehicle wants to turn around, it would need to move its steering wheel to the left and continue driving in the opposite direction. The probability of the vehicle turning around is 0% since it is already facing the right side of the street. |
| InternVL2-2b-LoRA-25k-drivelm | The action is to keep going at the same speed. The reason is that there is no safety issue, and the probability is high. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | The action is to keep going at the same speed. The reason is that there is no safety issue. The probability is high. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | The action is to keep going at the same speed. The reason is that there is no safety issue. The probability is high. |
| InternVL2-2b-LoRA-300k-drivelm | The action is to keep going at the same speed. The reason is that there is no safety issue, and the probability is high. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a sequence of images showing a vehicle's perspective of a road with various conditions, such as rain, construction, and different camera angles.
Based on the first image, which shows a "CAM_BACK" view with a "LEFT" lane marker, the ego vehicle could take the following actions:
1. **Slow down**: The vehicle should reduce its speed due to the wet road conditions, which can increase the risk of hydroplaning and reduce visibility.
2. **Maintain a safe following distance**: The vehicle should increase the distance between it and the vehicle in front to allow for more reaction time in case of sudden braking.
3. **Turn on headlights**: Even during the day, turning on headlights can improve visibility for the vehicle and other road users.
4. **Activate hazard lights**: If the vehicle is experiencing any technical issues or if the road conditions are particularly hazardous, it might be necessary to activate the hazard lights to alert other drivers.
The probability of these actions being necessary depends on the actual road conditions and the driver's ability to assess the situation. If the road is indeed wet and slippery, slowing down and maintaining a safe following distance are prudent actions to take to ensure safety. The probability of these actions being necessary is high in the context of the image, as it shows a rainy day which typically requires more cautious driving. |
| 5 | Questionplanning | What actions taken by the ego vehicle can lead to a collision with <c1,CAM_BACK,340.0,454.2>? |
| GT Answer | No such action will lead to a collision. |
| InternVL2-2B | The ego vehicle is driving on a wet road, and the camera is positioned at the front left. The camera is facing straight ahead, and the road ahead appears to be clear. The vehicle is traveling at a moderate speed, and there are no other vehicles or obstacles in the immediate vicinity.
Given the current position of the ego vehicle and the clear road ahead, there are no immediate actions that could lead to a collision with the vehicle in the background. The ego vehicle is not in a position to collide with the vehicle in the background, as it is not directly in the path of the vehicle and there are no other vehicles or obstacles in the immediate vicinity.
However, it is essential to remain vigilant and aware of the surroundings to avoid any potential hazards. The ego vehicle should continue to monitor the road ahead and be prepared to react if any unexpected changes occur. |
| Mini-InternVL2-2B-DA-DriveLM | No such action will lead to a collision. |
| llama_adapter_v2_multimodal7b | The ego vehicle is driving down the street, and it is approaching a red traffic light at the intersection. If the ego vehicle continues to drive forward without stopping, it may collide with the <c1,CAM_BACK,340.0,454.2> position, which represents the back of the vehicle. This is because the vehicle is moving in the same direction as the traffic light, which is red, indicating that it should stop. The driver should pay attention to the traffic light and follow the traffic rules to avoid collisions and ensure the safety of all road users. |
| InternVL2-2b-LoRA-25k-drivelm | Back up. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | No such action will lead to a collision. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | No such action will lead to a collision. |
| InternVL2-2b-LoRA-300k-drivelm | Back up. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a series of snapshots from a vehicle's camera system, showing different views of the road ahead. The snapshots are labeled with different camera angles:
1. CAM_FRONT_LEFT
2. CAM_FRONT_RIGHT
3. CAM_BACK_LEFT
4. CAM_BACK_RIGHT
To avoid a collision with the vehicle labeled as <c1,CAM_BACK,340.0,454.2>, the ego vehicle should take the following actions:
1. **Maintain a Safe Following Distance**: The ego vehicle should ensure it maintains a safe distance from the vehicle in front of it, especially when the vehicle is ahead in the CAM_FRONT_LEFT and CAM_FRONT_RIGHT views. This will allow for sufficient reaction time in case the vehicle in front suddenly stops or slows down.
2. **Monitor the CAM_BACK_LEFT and CAM_BACK_RIGHT Views**: The driver should regularly check the CAM_BACK_LEFT and CAM_BACK_RIGHT views to be aware of the position and movement of the vehicle labeled as <c1,CAM_BACK,340.0,454.2>. This will help the driver anticipate any changes in the vehicle's position or direction.
3. **Use Turn Signals**: If the ego vehicle needs to change lanes or make a turn, it should use its turn signals well in advance to alert the vehicle in front and other road users.
4. **Slow Down or Stop**: If the vehicle in front suddenly stops or slows down, the ego vehicle should slow down or stop as soon as it is safe to do so. This is particularly important when the vehicle is ahead in the CAM_FRONT_LEFT and CAM_FRONT_RIGHT views.
5. **Be Prepared for Sudden Stops**: The driver should be prepared for the possibility of the vehicle in front making a sudden stop. This can be done by keeping a safe speed, anticipating potential hazards, and being ready to react to any changes in the vehicle's behavior.
6. **Use Mirrors and Blind Spot Checks**: Regularly checking mirrors and performing blind spot checks can help the driver ensure they are aware of the vehicle in front and other road users. |
| 6 | Questionplanning | In this scenario, what are safe actions to take for the ego vehicle? |
| GT Answer | Keep going at the same speed, decelerate gradually without braking, and slightly offset to the left. |
| InternVL2-2B | Based on the image, the safe actions for the ego vehicle would include maintaining a safe following distance from the vehicle in front of it, as indicated by the "CAM_FRONT_LEFT" and "CAM_FRONT" labels. The vehicle should also be prepared to react to any sudden changes in traffic, such as the vehicle in the foreground turning or stopping, by maintaining a safe following distance and possibly slowing down or stopping if necessary. Additionally, the vehicle should be cautious of pedestrians and other vehicles, especially in the "CAM_FRONT_LEFT" and "CAM_FRONT" sections, where the pedestrian is visible. The "CAM_BACK_LEFT" and "CAM_BACK_RIGHT" sections suggest that the vehicle should be aware of the presence of the pedestrian and any potential hazards in those areas. |
| Mini-InternVL2-2B-DA-DriveLM | Keep going at the same speed, decelerate gradually without braking. |
| llama_adapter_v2_multimodal7b | In this scenario, the ego vehicle is driving down a wet road with a steady rain. To ensure safety, the driver should take the following actions:1. Reduce speed: Driving at a slower speed allows for better control and reaction time on wet roads, reducing the risk of skidding or hydroplaning.2. Maintain a safe following distance: Increasing the distance between the vehicle and the one ahead helps to avoid collisions if the vehicle in front suddenly stops or slows down.3. Use headlights: Turning on the headlights helps improve visibility for the driver and other road users, especially in low-light conditions like rain.4. Avoid sudden braking or acceleration: Sudden movements can cause the vehicle to lose traction on wet roads, increasing the risk of skidding or hydroplaning.5. Be cautious at intersections: Wet roads can make it more challenging to judge the distance and speed of other vehicles, so the driver should be extra vigilant at intersections and give themselves extra time to react.6. Keep a clear windshield: Ensure the windshield is free of any obstructions, such as wipers, to provide the best visibility possible.By following these safety guidelines, the ego vehicle driver can minimize the risk of accidents and ensure a safer driving experience during the rainy weather. |
| InternVL2-2b-LoRA-25k-drivelm | Keep going at the same speed, accelerate, and proceed. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Keep going at the same speed, slightly offset to the right. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | Keep going at the same speed, decelerate gradually without braking. |
| InternVL2-2b-LoRA-300k-drivelm | Keep going at the same speed, decelerate gradually without braking. |
| llava-v1.6-mistral-7b-hf | In the image you've provided, it appears to be a series of photos showing a vehicle's perspective of a road during rainy conditions. Here are some safe actions to take for the ego vehicle in such a scenario:
1. **Slow Down**: Reduce speed to maintain control of the vehicle and to allow for longer braking distances on wet roads.
2. **Keep a Safe Following Distance**: Increase the distance between your vehicle and the one in front of you to allow for more reaction time in case of sudden braking.
3. **Use Headlights**: Turn on the vehicle's headlights to improve visibility for the driver and to make the vehicle more visible to other road users.
4. **Avoid Sudden Maneuvers**: Make smooth and gentle steering inputs to avoid skidding or losing control of the vehicle.
5. **Use Windshield Wipers**: Ensure the windshield wipers are in good working condition and are used to clear water from the windshield.
6. **Avoid Hydroplaning**: If the road is wet enough to cause hydroplaning, steer straight and avoid sudden braking or acceleration.
7. **Check Tires**: Ensure that the tires have adequate tread depth and are properly inflated to maintain traction on wet roads.
8. **Stay Alert**: Pay close attention to the road ahead, watching for puddles, standing water, and other potential hazards.
9. **Use Caution at Intersections**: Be extra cautious at intersections, as other drivers may also be having difficulty seeing the road ahead.
10. **Turn on Hazard Lights**: If the vehicle is experiencing mechanical issues or if visibility is extremely poor, turn on the hazard lights to alert other drivers.
Remember, driving in rainy conditions requires heightened attention and caution to ensure the safety of the driver, passengers, and other road users. |
| 7 | Questionbehavior | Predict the behavior of the ego vehicle. Please select the correct answer from the following options: A. The ego vehicle is steering to the right. The ego vehicle is driving with normal speed. B. The ego vehicle is steering to the left. The ego vehicle is driving fast. C. The ego vehicle is steering to the left. The ego vehicle is driving with normal speed. D. The ego vehicle is going straight. The ego vehicle is driving very fast. |
| GT Answer | D |
| InternVL2-2B | Based on the image, the ego vehicle is driving straight. The road markings and the absence of any other vehicles or signs of steering to the left or right suggest that the ego vehicle is maintaining a straight path. |
| Mini-InternVL2-2B-DA-DriveLM | D |
| llama_adapter_v2_multimodal7b | The ego vehicle is steering to the left, driving with normal speed. |
| InternVL2-2b-LoRA-25k-drivelm | D |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | D |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | D |
| InternVL2-2b-LoRA-300k-drivelm | D. The ego vehicle is going straight. The ego vehicle is driving very fast. |
| llava-v1.6-mistral-7b-hf | Based on the image provided, the ego vehicle is steering to the left. The vehicle is driving with normal speed. |
