QAC Automotive and Robotics (QAaR) Quality Assurance
This monthly newsletter will focus on QAC’s activities regarding Automotive and Robotics Quality Assurance Services.
FOCUSED ON THE FUTURE
Leading the way
Welcome to the third edition of the QAaR newsletter. In this edition, we’ll focus on sharing more information about automotive technology and current projects the QAC team is working on. The QAC team has been working on creating new testing solutions for robotics, small vehicles, autonomous and connected vehicles system integration testing, and ISO-26262 compliance verification.
Welcome to our January edition of Automotive and Robotics Quality Assurance Newsletter!
Keeping you informed
Our automotive and robotics quality assurance workstreams
Research and Grant Projects
Grant budgets allow for research and development of new technologies that position QAC to become a world leader in quality assurance services.
AQS (Automotive Quality Services)
Testing and Quality Assurance services exclusively developed for Automotive and Autonomous Road vehicles.
RQS (Robotic Quality Services)
Testing and Quality Assurance services exclusively developed for Robotics and Autonomous small vehicles.
Safety and Cybersecurity
Focus on developing services that adhere to ISO’s compliance verification testing automation Cybersecurity, and Connectivity standards.
Automotive system integration testing (sit) framework
A few years ago, collision and lane change avoidance technology was primitive. Nowadays, the technology has been updated with advanced drive assistance systems (ADAS). These new systems introduced new design and test challenges. Modern ADAS architecture combines complex sensing, processing, and algorithmic technologies into what will ultimately become the guts of autonomous vehicles. As ADAS evolve from simple collision-avoidance systems to fully autonomous vehicles, they demand sensing and computing technologies that are complex. This need creates demand for quality assurance and testing techniques. In particular, hardware-in-the-loop (HIL) test methods have been adapted to ADAS setups, with the purpose of using real sensors to emulate ECMs and generate actuator control signals.
HIL methods verify and validate the software in the physical target ECUs. HIL test benches can provide the ECU with realistic real-time stimuli and simulated loads. Besides actual sensor data, ADAS application needs supplementary vehicle data from other ECUs, which is usually transmitted via the CAN bus. This data includes details like gear rate, acceleration, engine speed, steering angle, or GPS data. ADAS requires such information to check the plausibility of the situation analysis. The ADAS makes safety-critical interventions only if all this information is consistent. One advantage of using physical sensors in HIL testing is that there’s no need to modify the unit under test (UUT) for testing purposes. Assuring the quality of injected signals is just one of many looming challenges.
OCE 29920 project
OCE is funding this research project. A dedicated QAC team has been developing new technologies to make possible SIT in automotive industry.
QAC is preparing for the future of automated and connected vehicles through research and testing. Advanced systems like autonomous vehicles are quickly rewriting the rules for how test and measurement equipment vendors must design instrumentation. In the past, test software was merely a mechanism to communicate a gauged result or measure voltage levels. Now, test software is the technology that allows engineers to construct increasingly complex measurement systems capable of characterizing everything from the simplest components to comprehensive autonomous vehicle simulation.
How the hardware-in-the-loop automotive system integration testing framework works
QAC Automotive System Integration Testing Framework
The QAaR team has developed new technologies for performing automotive SIT using HIL methods. A set of components, and their relationship in a vehicle representation (meta-model), has been developed; based on that model, test cases are generated and executed. A central controller manages and monitors each component of the test bench. Said controller executes each test scenario by comparing the initial state of all components with their final state after stimulations activator component stimulation. Activators are components that impact other connected applications when changing their state. For example, changing gears from Parking to Reverse. This action might affect several components such as the Back Camera, Back Sensor, or Multimedia Volume, etc. The team also developed a different approach for detecting the current state of each component. Listeners are methods able to, through analog, digital and CAN bus messages, identify and interpret which state, without necessarily have access to the source-code of devices or drivers. This Blackbox-HIL-SIT approach has advantages, described below.
- Independent of infotainment operating System architecture and versions (independent of AGL, QNX or any other OS)
- Automotive HIL test framework focused on system integration testing across vehicle architecture pillars (infotainment, instrument cluster, heads-up display, telematics, and AUTOSAR)
- Verification of all devices and components, part of the automotive ecosystem and test scenario being validated, ensuring they work together properly
- Connectivity testing for head units, IoT components, and devices in a vehicle
- An automated process to prioritize automotive test cases according to ISO 26262 guidelines, based on ASIL levels, and focus on high risk test execution scenarios
- Easy to edit and maintain test case adaptability while adding components and creating new listeners for specific products and vehicles
Robotics and small autonomous and connected (a/c) vehicles automation testing
WHAT
Development of test services for robotics and small A/C vehicles focusing on automation, machine learning, and execution on simulation environments.
- Test Framework for robotic and small vehicles testing
It’s crucial to develop reliable systems that allow robots to be instrumental to users. Robots and small A/C vehicles require quality assurance testing to validate system functionality. Such testing provides confidence that a system will perform as expected. It also allows for a tester to understand the weaknesses, problems, and user constraints. Testing robotic systems differs from many other applications due to the complexity of hardware, software, and the fact that robots and small A/C vehicles have many degrees of motion. These robots are made of delicate moving components, dynamic affects, and multiple sensors. Unlike humans, robots can work in extreme and inhospitable environments and be exposed to extreme temperature, physical shocks, radiation, and hostile people.
-
Robot Operating System – ROS
ROS is an open-source, meta-operating system that controls a robot and provides the services similar to an operating system, including hardware abstraction, low-level device control, implementation of commonly-used functionality, message-passing between processes, and package management. -
Gazebo
Gazebo is a well-designed robot simulator that makes possible to rapidly test algorithms, design robots, perform regression testing, and train AI system using realistic scenarios. It can simulate populations of robots in complex indoor and outdoor environments.
Robots and small A/C vehicles need to be tested in as many different scenarios as possible since their workspace is vast and possibly infinite. Field robotics and small A/C vehicles face safety concerns. They can be large and move quickly, becoming a potential lethal combination to humans.
Our robotics and small A/C vehicles testing solution
QAC has developed an exclusive automated scalable model-based test framework to design and execute robotics and small A/C vehicles testing. This cloud based test automation framework is built using ROS and Gazebo technologies.
-
Automated Test Case Design
Using Model-Based testing, all test cases are generated automatically by the framework. With this approach, it’s possible to measure test case coverage. This model allows for easy updates and maintenance and even handles high variability of requirements to prioritize test cases. -
Test Case Execution
In the Gazebo simulator, the generated test cases are automatically parsed to spawn the required models. Test termination (both success and failure) are identified automatically and the results are logged. Since test configurations are recorded, failure cases can be easily rerun and analyzed further.
Picture shows an example of indoor testing environment with humans and inanimate obstacles
-
Test Case Scenarios Coverage and Capabilities
It’s possible to set multiple goal points to test the pathplanner such as static and dynamic obstacles to check obstacle avoidance. Obstacles are placed on the robot’s path to ensure an encounter with the robot and test obstacle avoidance and detection. This type of test includes human-like obstacles with closed-loop human-like trajectories. The test also challenges the robot’s capabilities testing sensor disturbances due to external or internal interferences. This is done by modifying each sensor, simulating electromagnetic interference and the sensors’ field-of-view, cameras, 2D/3D lidars, and many environmental situations. -
ISO 26262 for small road vehicles
QA Consultants has developed an automated process that can prioritize small road vehicles test cases according to ISO 26262 guidelines. This process represents high safety risks based on ASIL levels and focused test execution scenarios. -
Cloud Based Simulation Server
The generated test cases are automatically parsed to spawn the required models in the Gazebo simulator. Test termination (both success and failure) are identified automatically and the results are logged. Since test configurations are recorded, failure cases can be easily rerun and analyzed further.
STAY TUNED
Coming next month
In our next edition, we will present techniques developed by the QAaR team for automating the applicability of ISO-26262 standards for road vehicles testing and our automotive cybersecurity testing plan. Also, we will plan demos for an upcoming L&L session.
Our partners:
Recent thought leadership
[qac-carousel id=”20158″]