| 0 | Questionperception | What are the important objects in the current scene? Those objects will be considered for the future reasoning and driving decision. |
| GT Answer | There is a white pickup truck to the front of the ego vehicle, a gold SUV to the back left of the ego vehicle, a black pickup truck to the front right of the ego vehicle, and a black truck to the front of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT,756.7,498.3>, <c2,CAM_BACK_LEFT,1287.5,675.0>, <c3,CAM_FRONT_RIGHT,270.0,617.5>, and <c4,CAM_FRONT,922.5,473.3>. |
| InternVL2-2B | In the current scene, the important objects include:
1. **Truck**: The black pickup truck is parked on the right side of the street. It is a significant object as it is stationary and occupies a central position in the image.
2. **Street and Road**: The street and road are the primary elements in the scene. They provide the context for the other objects and are essential for understanding the environment.
3. **Pedestrian**: The person walking on the sidewalk is an important object. They are moving towards the camera, indicating the presence of people in the area.
4. **Building**: The multi-story building on the left side of the street is an important object. It provides context for the location and helps to establish the urban setting.
5. **Traffic Cone**: The traffic cone is an important object as it is placed on the sidewalk, indicating a potential hazard or construction area.
6. **Street Sign**: The street sign is an important object as it provides information about the street, such as the name or direction.
7. **Pedestrian Crossing**: The pedestrian crossing is an important object as it indicates a designated area for pedestrians to cross the street safely.
These objects collectively provide a comprehensive view of the scene, helping to understand the environment and the potential hazards or important elements in the area. |
| Mini-InternVL2-2B-DA-DriveLM | There is a black pickup truck to the front right of the ego vehicle, a white SUV to the back left of the ego vehicle, a white sedan to the front of the ego vehicle, a black pickup truck to the front of the ego vehicle, and a black pickup truck to the front of the ego vehicle. The IDs of these objects are 1, 2, 3, 4, and 5. |
| llama_adapter_v2_multimodal7b | In the current scene, the important objects to consider for future reasoning and driving decisions include the parked truck, the car, the traffic light, and the buildings. The truck is parked on the side of the road, and the car is driving past it. The traffic light is present, indicating the flow of traffic and potential changes in direction. The buildings in the background suggest that the scene is taking place in an urban environment, which may have specific traffic rules and regulations. The driver should be aware of these objects and their potential impact on the driving situation to make safe and informed decisions while navigating the city streets. |
| InternVL2-2b-LoRA-25k-drivelm | There is a black SUV to the back of the ego vehicle, a black SUV to the front right of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, and a white sedan to the front of the ego vehicle. The IDs of these objects are <c1,CAM_BACK,1080.0,525.8>, <c2,CAM_FRONT_RIGHT,1080.0,525.8>, <c3,CAM_FRONT,1080.0,500.8>, <c4,CAM_FRONT,1080.0,500.8>, <c5,CAM_FRONT,1080.0,500.8>, and <c6,CAM_FRONT,1080.0,500.8>. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | There is a white SUV to the front of the ego vehicle, a white SUV to the back left of the ego vehicle, a black pickup truck to the front right of the ego vehicle, and a black SUV to the front of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT,769.2,473.3>, <c2,CAM_BACK_LEFT,1287.5,675.0>, <c3,CAM_FRONT_RIGHT,270.0,617.5>, and <c4,CAM_FRONT,922.5,473.3>. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | There is a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, a black SUV to the front of the ego vehicle, and a black SUV to the front of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT,1011.7,525.0>, <c2,CAM_FRONT,1011.7,525.0>, <c3,CAM_FRONT,1011.7,525.0>, <c4,CAM_FRONT,1011.7,525.0>, <c5,CAM_FRONT,1011.7,525.0>, and <c6,CAM_FRONT,1011.7,525.0>. |
| InternVL2-2b-LoRA-300k-drivelm | There is a black SUV to the front right of the ego vehicle, a black pickup truck to the front of the ego vehicle, a black sedan to the front of the ego vehicle, a white sedan to the front of the ego vehicle, a white truck to the front of the ego vehicle, a black sedan to the front of the ego vehicle, a black sedan to the front of the ego vehicle, a black sedan to the front of the ego vehicle, and a white truck to the front of the ego vehicle. The IDs of these objects are <c1,CAM_FRONT_RIGHT,10.8,625.0>, <c2,CAM_FRONT,1080.0,525.8>, <c3,CAM_FRONT,1080.0,525.8>, <c4,CAM_FRONT,1080.0,525.8>, <c5,CAM_FRONT,1080.0,525.8>, <c6,CAM_FRONT,1080.0,525.8>, <c7,CAM_FRONT,1080.0,525.8>, <c8,CAM_FRONT,1080.0,525.8>, and <c9,CAM_FRONT,1080.0,525.8>. |
| llava-v1.6-mistral-7b-hf | In the current scene, the important objects to consider for future reasoning and driving decisions include:
1. Vehicles: There are several cars and a truck visible in the image. The positioning of these vehicles can affect traffic flow and require attention to avoid collisions.
2. Pedestrians: There are at least two pedestrians visible in the image. Their presence requires drivers to be cautious and yield to them when necessary.
3. Traffic lights: There are traffic lights at various points in the image. These will control the flow of traffic and require drivers to obey the signals.
4. Road signs: There are road signs visible in the image, which provide information about traffic rules, directions, and other important information.
5. Construction barriers: There are orange barriers indicating construction work ahead. Drivers should be prepared for potential changes in traffic patterns or road conditions.
6. Fire hydrants: There are fire hydrants visible in the image. These are important for emergency services and should not be obstructed.
7. Buildings: The buildings lining the street can affect visibility around corners and may have entrances or exits that drivers should be aware of.
8. Parking meters: There is a parking meter visible in the image, which indicates a designated parking area. Drivers should be aware of parking regulations in this area.
9. Street markings: There are white lines on the road, which indicate lanes and can be used to guide parking or to separate lanes of traffic.
10. Personal belongings: There is a backpack visible in the image, which could be a potential obstacle for pedestrians or a sign of someone carrying valuable items.
These objects, along with the general layout of the street, will be important for drivers to navigate safely and efficiently. |
| 1 | Questionperception | What is the moving status of object <c1,CAM_FRONT,756.7,498.3>? Please select the correct answer from the following options: A. Turn left. B. Drive backward. C. Back up. D. Going ahead. |
| GT Answer | D |
| InternVL2-2B | The moving status of object <c1,CAM_FRONT,756.7,498.3> is C. Back up. |
| Mini-InternVL2-2B-DA-DriveLM | D |
| llama_adapter_v2_multimodal7b | The moving status of object <c1,CAM_FRONT,756.7,498.3> is "Going ahead." |
| InternVL2-2b-LoRA-25k-drivelm | D |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | D |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | D |
| InternVL2-2b-LoRA-300k-drivelm | D. Going ahead. |
| llava-v1.6-mistral-7b-hf | D. Going ahead |
| 2 | Questionprediction | What object should the ego vehicle notice first when the ego vehicle is getting to the next possible location? What is the state of the object that is first noticed by the ego vehicle and what action should the ego vehicle take? What object should the ego vehicle notice second when the ego vehicle is getting to the next possible location? What is the state of the object perceived by the ego vehicle as second and what action should the ego vehicle take? What object should the ego vehicle notice third? What is the state of the object perceived by the ego vehicle as third and what action should the ego vehicle take? |
| GT Answer | Firstly, notice that <c3,CAM_FRONT_RIGHT,270.0,617.5>. The object is stationary, so the ego vehicle should continue going ahead at the same speed. Secondly, notice that <c2,CAM_BACK_LEFT,1287.5,675.0>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. Thirdly, notice that <c4,CAM_FRONT,922.5,473.3>. The object is stationary, so the ego vehicle should continue going ahead at the same speed. |
| InternVL2-2B | When the ego vehicle is getting to the next possible location, it should notice the orange traffic cone first. The state of the object perceived by the ego vehicle as the first object is that the traffic cone is on the ground. The action the ego vehicle should take is to stop and check the traffic cone for any signs of damage or tampering. |
| Mini-InternVL2-2B-DA-DriveLM | Firstly, notice that the object in front of the ego vehicle is stationary. The ego vehicle should continue ahead at the same speed. Secondly, notice that the object in front of the ego vehicle is stationary. The ego vehicle should continue ahead at the same speed. Thirdly, notice that the object in front of the ego vehicle is stationary. The ego vehicle should continue ahead at the same speed. |
| llama_adapter_v2_multimodal7b | When the ego vehicle is getting to the next possible location, it should first notice the truck on the left side of the road. The ego vehicle should then take the appropriate action, such as changing lanes or slowing down, to ensure safe navigation around the truck. Next, the ego vehicle should notice the car on the right side of the road. The ego vehicle should then take the appropriate action, such as changing lanes or slowing down, to ensure safe navigation around the car. Finally, the ego vehicle should notice the traffic light. The ego vehicle should then take the appropriate action, such as stopping or slowing down, depending on the traffic light's signal. |
| InternVL2-2b-LoRA-25k-drivelm | Firstly, notice that <c3,CAM_FRONT,1080.8,525.0>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Secondly, notice that <c2,CAM_FRONT,1080.8,500.8>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. Thirdly, notice that <c1,CAM_FRONT,1080.8,500.8>. The object is going ahead, so the ego vehicle should keep going ahead at the same speed. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Firstly, notice that <c3,CAM_FRONT_RIGHT,270.0,617.5>. The object is stationary, so the ego vehicle should continue ahead at the same speed. Secondly, notice that <c1,CAM_FRONT,793.3,473.3>. The object is going ahead, so the ego vehicle should continue ahead at the same speed. Thirdly, notice that <c4,CAM_FRONT,922.5,473.3>. The object is going ahead, so the ego vehicle should continue ahead at the same speed. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | Firstly, notice <c1, CAM_FRONT, 1200.0, 530.0>. The object is approaching, so the ego should slow down. Secondly, notice <c2, CAM_FRONT, 1200.0, 530.0>. The object is approaching, so the ego should slow down. Thirdly, notice <c3, CAM_FRONT, 1200.0, 530.0>. The object is approaching, so the ego should slow down. |
| InternVL2-2b-LoRA-300k-drivelm | Firstly, notice <c3,CAM_FRONT,1080.0,520.0>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. Secondly, notice <c2,CAM_FRONT,1080.0,505.0>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. Thirdly, notice <c1,CAM_BACK,1035.0,520.0>. The object is going ahead, so the ego vehicle should continue going ahead at the same speed. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a collage of different street scenes, each with a different focus. However, without specific context or a clear understanding of the intended actions of the "ego vehicle," it's difficult to provide precise answers to your questions.
In general, when approaching a new location, a vehicle should first notice any traffic signs or signals, such as traffic lights or stop signs, to ensure it follows the right of way and complies with traffic regulations. The state of these objects would be important for the vehicle to determine if it needs to stop or proceed.
Next, the vehicle should notice other vehicles and pedestrians in the vicinity to ensure safe navigation. The state of these objects would determine if the vehicle needs to yield, slow down, or proceed with caution.
Finally, the vehicle should be aware of any road conditions or obstacles, such as construction zones or parked cars, to avoid accidents or traffic violations. The state of these objects would dictate if the vehicle needs to change lanes, slow down, or take an alternative route.
In the context of the images provided, the "ego vehicle" would need to interpret the traffic signs and signals, observe the other vehicles and pedestrians, and be aware of any road conditions or obstacles to safely navigate the streets. |
| 3 | Questionprediction | Is <c1,CAM_FRONT,756.7,498.3> a traffic sign or a road barrier? |
| GT Answer | No. |
| InternVL2-2B | To determine if the coordinates provided (c1, CAM_FRONT, 756.7, 498.3) represent a traffic sign or a road barrier, let's analyze the image closely.
1. **Location and Orientation**:
- The coordinates are given in a format (x, y, z), where x and y are the horizontal and vertical coordinates respectively, and z is the depth or height.
- The coordinates (756.7, 498.3) are located in the bottom right corner of the image.
2. **Visual Inspection**:
- **Traffic Sign**: A traffic sign typically has a distinct shape, color, or text that clearly indicates a specific rule or regulation. In this image, there is no such distinct feature.
- **Road Barrier**: A road barrier is typically a physical structure that is meant to restrict or guide traffic. In this image, there is no visible barrier structure.
3. **Contextual Analysis**:
- The coordinates are located in the bottom right corner of the image, which is typically where traffic signs and road barriers are placed.
- The image shows a street scene with vehicles and pedestrians, but there is no indication of a traffic sign or road barrier in this specific area.
4. **Conclusion**:
- Given the coordinates and the visual context, it is reasonable to conclude that the coordinates (c1, CAM_FRONT, 756.7, 498.3) do not represent a traffic sign or a road barrier. They are likely part of the image's metadata or a specific location within the image itself.
In conclusion, the coordinates provided (c1, CAM_FRONT, 756.7, 498.3) do not represent a traffic sign or a road barrier. |
| Mini-InternVL2-2B-DA-DriveLM | No. |
| llama_adapter_v2_multimodal7b | The image does not provide enough information to confidently determine whether the <c1,CAM_FRONT,756.7,498.3> is a traffic sign or a road barrier. It could be either, depending on the context and the specific location within the image. |
| InternVL2-2b-LoRA-25k-drivelm | No. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | No. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | No. |
| InternVL2-2b-LoRA-300k-drivelm | No. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a collage of different scenes, and it's not clear from this image alone whether the object labeled as <c1,CAM_FRONT,756.7,498.3> is a traffic sign or a road barrier. It looks like a traffic sign, but without more context or a clearer image, it's difficult to definitively say what it is. |
| 4 | Questionplanning | What actions could the ego vehicle take based on <c1,CAM_FRONT,756.7,498.3>? Why take this action and what's the probability? |
| GT Answer | The action is to keep going at the same speed. The reason is to avoid a collision, high. |
| InternVL2-2B | The ego vehicle, indicated by the camera's position and orientation, is positioned at the intersection of Cam Front Left and Cam Front Right. Based on the image, the ego vehicle is facing the intersection and appears to be stationary.
Given this information, the ego vehicle could take several actions:
1. **Stop**: The vehicle could potentially stop at the intersection to ensure safety and avoid any potential hazards.
2. **Slow Down**: The vehicle might need to slow down to ensure it doesn't collide with any vehicles or pedestrians crossing the intersection.
3. **Check for Pedestrians**: The vehicle could be cautious of pedestrians crossing the intersection, especially if it's a busy area.
4. **Observe Traffic**: The vehicle might need to observe traffic signals or other vehicles to ensure it's following traffic rules and not causing any disruption.
The probability of taking these actions can be estimated based on the current state of the intersection and the surrounding environment. For instance, if the intersection is well-lit and there are no visible pedestrians or vehicles, the vehicle might be more likely to stop. Conversely, if there are pedestrians or vehicles crossing the intersection, the vehicle might be more cautious.
In summary, the ego vehicle could potentially stop, slow down, or observe traffic at the intersection based on the current state of the intersection and the surrounding environment. |
| Mini-InternVL2-2B-DA-DriveLM | The action is to keep going at the same speed. The reason is that there is no safety issue, and the probability is high. |
| llama_adapter_v2_multimodal7b | Based on the given coordinates, the ego vehicle is at the intersection of a one-way street and a two-way street. The vehicle could take several actions, such as turning left, turning right, or continuing straight. The probability of the vehicle taking a specific action depends on the traffic rules and regulations in the area, as well as the driver's intentions. For example, if the driver intends to turn left, the probability of the vehicle turning left is higher than if the driver intends to turn right or continue straight. However, without more context, it is difficult to determine the exact action the vehicle will take. |
| InternVL2-2b-LoRA-25k-drivelm | The action is to keep going at the same speed. The reason is that there is no safety issue, and the probability is high. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | The action is to keep going at the same speed. The reason is that there is no safety issue, and the probability is high. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | The action is to keep going at the same speed. The reason is that there is no safety issue, and the probability is high. |
| InternVL2-2b-LoRA-300k-drivelm | The action is to keep going at the same speed. The reason is that there is no safety issue, and the probability is high. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a sequence of images showing a vehicle's perspective as it moves through an urban environment. The sequence is labeled with various actions that the vehicle could take, such as "CAM_FRONT_LEFT," "CAM_FRONT_RIGHT," "CAM_BACK_LEFT," "CAM_BACK_RIGHT," and "CAM_BACK_RIGHT."
Based on the label "CAM_FRONT_LEFT," the vehicle is likely to make a left turn. This action is typically taken when the vehicle needs to change lanes or make a turn at an intersection. The probability of this action depends on the traffic conditions, the presence of pedestrians or cyclists, and the vehicle's intended destination.
The vehicle might take this action because it has reached the end of its lane and needs to turn left to continue its journey. The driver would have assessed the traffic situation, checked for oncoming traffic, and signaled their intention to turn left before initiating the maneuver.
The probability of this action is high if the vehicle is approaching a left turn only lane, a left turn signal, or if the driver has already signaled their intention to turn left. However, the actual probability would depend on the specific traffic conditions at the time the image was taken. |
| 5 | Questionplanning | What actions taken by the ego vehicle can lead to a collision with <c1,CAM_FRONT,756.7,498.3>? |
| GT Answer | Changing to the left lane, accelerating, and going straight can lead to a collision with <c1,CAM_FRONT,756.7,498.3>. |
| InternVL2-2B | The ego vehicle, a black pickup truck, is positioned on the right side of the road, facing the direction of the camera. The image shows a pedestrian crossing the street, which is a common area for vehicles to be present. The pedestrian is crossing the street, and the truck is positioned directly in front of the pedestrian, potentially blocking the pedestrian's path.
Here are the actions that could lead to a collision with the truck:
1. **Driving too fast**: The truck is stationary, and the pedestrian is crossing the street. If the truck were to suddenly accelerate, it could collide with the pedestrian.
2. **Driving too close**: The truck is positioned directly in front of the pedestrian, and if the driver were to overreact and drive too close to the pedestrian, it could result in a collision.
3. **Driving in the wrong lane**: The truck is in the right lane, and if the driver were to change lanes or drive into the pedestrian's path, it could lead to a collision.
4. **Driving recklessly**: The truck is stationary, and if the driver were to drive recklessly, such as swerving or making sudden turns, it could lead to a collision with the pedestrian.
5. **Driving under the influence**: The truck is stationary, and if the driver were to drive under the influence of alcohol or drugs, it could impair the driver's judgment and lead to a collision.
In summary, the truck's position in the right lane, the pedestrian's crossing, and the potential for sudden movements or actions by the driver are all factors that could lead to a collision with the truck. |
| Mini-InternVL2-2B-DA-DriveLM | Slight right turn. |
| llama_adapter_v2_multimodal7b | The ego vehicle is driving down the street, and it is approaching a red traffic light at an intersection. If the ego vehicle continues to drive forward without stopping, it may collide with the <c1,CAM_FRONT,756.7,498.3> object, which is likely another vehicle or a pedestrian. The driver should come to a complete stop at the red light and check for any oncoming traffic or pedestrians before proceeding. This action would help avoid a collision and ensure the safety of all road users. |
| InternVL2-2b-LoRA-25k-drivelm | Accelerating and going straight. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Changing to the left lane. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | Accelerating and going straight. |
| InternVL2-2b-LoRA-300k-drivelm | Accelerating and going straight. |
| llava-v1.6-mistral-7b-hf | The image you've provided appears to be a series of snapshots from a vehicle's camera system, showing different views of the road ahead. The vehicle's camera system is likely designed to provide the driver with a 360-degree view of the surroundings, which can be helpful for maneuvering in tight spaces or for monitoring traffic conditions.
In the snapshots, we can see the following:
1. The vehicle is driving on a city street with other vehicles and pedestrians.
2. The vehicle is approaching a construction zone with a detour sign.
3. The vehicle is making a left turn onto a one-way street.
4. The vehicle is driving on a one-way street with a pedestrian crossing.
5. The vehicle is approaching a crosswalk with a pedestrian.
6. The vehicle is driving on a city street with a fire hydrant.
To avoid a collision with the object labeled as <c1,CAM_FRONT,756.7,498.3>, the driver should be aware of the following:
- In the first snapshot, the driver should maintain a safe distance from the vehicle in front and be prepared to slow down or stop if necessary.
- In the second snapshot, the driver should follow the detour signs and avoid entering the construction zone.
- In the third snapshot, the driver should signal their intention to turn left and yield to any pedestrians or vehicles that have the right of way.
- In the fourth snapshot, the driver should be cautious of the pedestrian crossing and ensure they yield to the pedestrian.
- In the fifth snapshot, the driver should be aware of the pedestrian crossing and be prepared to stop if necessary.
- In the sixth snapshot, the driver should be cautious of the fire hydrant and ensure they do not park or obstruct it.
In all cases, the driver should be attentive to the road conditions, traffic signals, and other road users to ensure safe navigation. |
| 6 | Questionplanning | In this scenario, what are safe actions to take for the ego vehicle? |
| GT Answer | Brake gently to a stop, decelerate gradually without braking, or brake suddenly. |
| InternVL2-2B | Based on the image, the safe actions for the ego vehicle would include maintaining a safe following distance from the moving vehicle in the foreground, as indicated by the "CAM_FRONT_LEFT" text. The vehicle should also be prepared to react to any sudden movements or changes in traffic, as suggested by the "CAM_FRONT" text. Additionally, the vehicle should be cautious of pedestrians and other vehicles, as indicated by the "CAM_FRONT" text, and should avoid any potential hazards such as construction zones or pedestrians crossing the road. |
| Mini-InternVL2-2B-DA-DriveLM | Keep going at the same speed, decelerate gradually without braking. |
| llama_adapter_v2_multimodal7b | In the image, there are multiple vehicles on the road, including cars, trucks, and a bus. The ego vehicle is driving down a city street, and it is important for the driver to take safe actions to ensure the safety of themselves and others on the road. Some safe actions to take include:1. Maintaining a safe distance from other vehicles, especially larger ones like trucks and buses, to avoid collisions.2. Paying attention to traffic signals and signs, such as stop signs and traffic lights, to follow the rules and avoid accidents.3. Being cautious when changing lanes or making turns, as other vehicles may be in close proximity or have limited visibility.4. Keeping an eye on blind spots and using mirrors to check for any vehicles that may be hidden from view.5. Being prepared for sudden stops or changes in traffic flow, and adjusting speed accordingly.By following these safe actions, the ego vehicle driver can minimize the risk of accidents and ensure a smooth and secure driving experience. |
| InternVL2-2b-LoRA-25k-drivelm | Keep going at the same speed, accelerate, and proceed. |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | Keep going at the same speed, decelerate gradually without braking. |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | Keep going at the same speed, decelerate gradually without braking. |
| InternVL2-2b-LoRA-300k-drivelm | Keep going at the same speed, decelerate gradually without braking. |
| llava-v1.6-mistral-7b-hf | In the given scenario, the ego vehicle is a car driving down a city street with various other vehicles and pedestrians. To ensure safe actions, the driver should:
1. **Maintain a Safe Following Distance**: Keep a safe distance from the vehicle in front to allow for adequate reaction time in case of sudden braking or changes in traffic flow.
2. **Stay in the Lane**: The driver should stay within the lane markings and avoid drifting into other lanes or onto the sidewalk.
3. **Obey Traffic Signs and Signals**: The driver should follow all traffic signs and signals, including speed limits, stop signs, and traffic lights.
4. **Be Aware of Pedestrians**: The driver should be vigilant for pedestrians crossing the street or walking along the sidewalk, especially at crosswalks.
5. **Use Turn Signals**: When making turns, the driver should use the appropriate turn signals to communicate their intentions to other road users.
6. **Check Blind Spots**: Before changing lanes or making turns, the driver should check their blind spots and mirrors to ensure no other vehicles are in their path.
7. **Yield to Other Vehicles**: When required by traffic rules, the driver should yield to other vehicles, such as when merging onto a road or when a pedestrian has the right of way.
8. **Stay Alert**: The driver should stay focused on the road and avoid distractions, such as using a mobile phone or engaging in other activities that could divert their attention.
9. **Slow Down in Construction Zones**: If there are construction zones ahead, the driver should reduce their speed to comply with any posted speed limits and to be prepared for any changes in traffic patterns.
10. **Be Prepared for Unexpected Events**: The driver should be prepared for unexpected events, such as sudden stops or changes in traffic flow, and be ready to react accordingly.
By following these safety guidelines, the driver can help ensure a safe journey for themselves and others on the road. |
| 7 | Questionbehavior | Predict the behavior of the ego vehicle. Please select the correct answer from the following options: A. The ego vehicle is steering to the left. The ego vehicle is driving fast. B. The ego vehicle is slightly steering to the left. The ego vehicle is driving with normal speed. C. The ego vehicle is steering to the left. The ego vehicle is driving slowly. D. The ego vehicle is going straight. The ego vehicle is driving with normal speed. |
| GT Answer | D |
| InternVL2-2B | Based on the image, the ego vehicle is driving straight. The image shows the ego vehicle in the center of the road with no visible signs of steering to the left or driving slowly. The ego vehicle is also driving at a normal speed, as indicated by the absence of any motion blur or other signs of speed. |
| Mini-InternVL2-2B-DA-DriveLM | D |
| llama_adapter_v2_multimodal7b | The ego vehicle is steering to the left. |
| InternVL2-2b-LoRA-25k-drivelm | D |
| InternVL2-2b-LoRA-25k-drivelm-offline-redcircle-ctag-bkgd | D |
| InternVL2-2b-LoRA-25k_plus_DL-PL-10pct | D |
| InternVL2-2b-LoRA-300k-drivelm | D. The ego vehicle is going straight. The ego vehicle is driving with normal speed. |
| llava-v1.6-mistral-7b-hf | D. The ego vehicle is going straight. The ego vehicle is driving with normal speed. |
