FALL2023 - Issues and Improvements

[DavidGoedicke]

Open Design Questions

• What do we want to change about the QN?
• Limit top speed (More signage? GPS warnings?)
• What scenarios do we replicate?
• Do we want to use the new environment?

General ToDos:

• Update SOP See: https://www.overleaf.com/read/nckntwdpwwdx
• Start A wiki!
  • Wrote Scenario Design Guidelines see here!
• Scene Update
  • Less depressing houses => Integrate @lees846 (https://github.com/FAR-Lab/XC_AV_NPC)
  • Fix Z-fighting in lees846 new Unity model
  • More variety in trees and objects
  • More variety in curvy road leading to the scenario
• ReRun
  • Recording and Playback Traffic Light Integration
  • (ReRun) Recording Vehicle sound ( Missing engine sounds)
  • Additions from from @leo-c1 found in Rerun Annotation Tool

Performance

• Use 1 shader for all materials.The performance is low even on a gaming laptop without any rendered geometry see [1]. And [2] for more references on this subject.
• Full Performance assessment (2+participants) (Quest)
• Full Performance assessment (2+participants) (Server)
• disable VR for windows builds

Attempts/ideas at fixing Simulator/motion Sickness

• Add motion blur
• Increase “caging”: emphasize the car interior and reduce the outlook to the moving world
• Increase visual fidelity

New Features

• Add turn indicator sound (blinker)
• Reverse Option R for Driving (We will not implement this)

NPC vehicle

• Naive approache (Playback one specific file)
  • Implementation
  • Testing
• Scenario Hyperspace (Finding the closest matching scenario (time and position) to play the other perspective
  • Implementation
  • Testing
• Modelling vehicle control inputs, base on vehicle speed, distance etc.
  • Implementation
  • Testing
• Waypoint (Deisigend behavors)
  • Implementation
  • Testing

Pedestraian implementatonion

• Details to come from @MarioYangNYU

Future Work

• Interwoven streets that allow for longer drivers in which interactions

ROS implementation

• Have planning meeting with @FrankBu0616 and @jankolkmeier

Testing

• Come up with test cases/scenes that can be used to ensure
  • FrameRate
  • Network Latency
  • Visual Fildeity/consitency
  • Mirrors (position)
  • Mirrors (FrameRate/rendering)
  • Questionnaire

Old Bugs

Participant Experience

• Engine sound hear-able without any distance attenuation ( i need help with testing. trouble replicating it ) (*)
• VR/real button positioning should be aligned after scenario (does not rotate back)

Technical Issues

• Align virtual and physical steering wheel rotation (during drive and QN)

Scenario Details

These issues can be fixed inside the unity editor and do not requiree code changes.)

• Option straight is missing from QN CP8
• NSI3 (Q4) add a picture
• NSI3 (Q5) picture wrong for participant A (approaching merging road from wrong side)
• NSI3 A said I was not on the main road, it does not give me the proper option
• Refine QN: CP5, Q5 the car is always pointing straight at an intersection (whats the purpose of question)
• Alternative lane markers, in US usually a yellow line shows opposing traffic
• Alternative markers for scenario start and end than normal traffic signs
• Lower car drop height when loading scenario (can make people nauseous)
• In NI1 the auto-stop can confuse people, let them finish the scenario (pass by the car)
• NSI1 check if conditional questions for A and B are correct
• Speed limit signs
• More interaction and repair provoking scenarios i.e. Scenarios that are leading to repairing interactions (gestures)

Future Work

• 4 Player setup?

Student Projects:

• Different HardWare for turn indicator
• Software interface/api/examle for other nterfaces like bikes

---

References:

[1] low performance even with a gaming Laptop:

[2] https://skarredghost.com/2016/11/28/how-a-developer-can-reduce-motion-sickness/
https://virtualspeech.com/blog/motion-sickness-vr
https://www.researchgate.net/publication/342661085_Virtual_Reality_Sickness_A_Review_of_Causes_and_Measurements
Factors Associated With Virtual Reality Sickness in Head-Mounted Displays: A Systematic Review and Meta-Analysis
https://www.researchgate.net/publication/321661932_Cyber_Sickness_in_Virtual_Reality_-_Literature_Review
Getting Rid of Cybersickness Book
Meta analysis impact of fidelity on simulator sickbess