NIST Aerial Test Method Level 3 Open Area Vehicle Scenario Set
The Open Vehicle Identification Scenario is a standardized test and training configuration designed to evaluate small unmanned aircraft systems (sUAS) and remote pilot proficiency during vehicle-based inspection missions. This scenario is derived from NIST Standard Test Methods and ASTM E54.09 guidelines and is suitable for Level 1 through Level 3 operations in open environments. The scenario supports repeatable, objective scoring and comparable results across aircraft, payloads, and pilots.
A test method consists of: (1) an apparatus, that can be reproducible by others; (2) a procedure, that is repeatable to conduct test trials; and (3) performance metrics, which are quantitative and can be compared over time.
Scenario Concept and Flight Path
Pilots perform designated orbital flight paths around a single vehicle equipped with a rooftop omni bucket stand. The Open Vehicle Scenario transitions pilots from safe hover altitudes above surrounding obstacles into a controlled orbit selected based on operational needs, obstacle heights, aircraft capabilities, and sensor zoom performance.
The orbit is configured with a constant radius and altitude aligned to four 45-degree angled omni-directional bucket targets mounted on the vehicle roof (A1 – front, B1 – passenger side, C1 – rear, D1 – driver side). Any orbit may be used; however, only trials flown with similar orbit parameters and trial times should be compared.
Target Layout
Each side of the vehicle includes five visual and/or thermal targets visible from the orbit and designated perch positions, for a total of 20 exterior targets per scenario. Every target contains five increasingly smaller visual acuity gap features, allowing up to 100 points per trial.
Targets are placed exclusively on the exterior of the vehicle and surrounding ground. This eliminates variability related to window glare, tinting, and interior obstructions and ensures consistent scoring conditions across trials.
Perch Positions
Two designated perch positions are located on the roadway directly beneath the front and rear orbit locations. These landing tasks evaluate precision landing accuracy along with pan-tilt-zoom (PTZ) camera performance while the aircraft is on the ground.
Perch targets are buckets positioned under the vehicle (A5 – front underbody, C5 – rear underbody), representing operationally significant objects concealed in shadow. Perching demonstrates persistent surveillance capability while conserving battery.
Task Execution and Data Capture
During each alignment with an omni bucket, pilots control zoom and exposure to capture a single image of the inscribed ring and identify targets inside the bucket or in view nearby. Additional objects of interest within the scenario may be identified simultaneously.
The trial timer starts at launch and ends after the final task is completed. Typical trial time limits are 5 minutes, but organizations may define their own limits and passing thresholds.
Scoring Methodology
Alignment Points:
• Unbroken ring visible in captured image – 5 points
• Broken ring visible – 1 point
Acuity Points:
• Identification of each of the five visual acuity gap features – 1 point each
Perch / Landing Accuracy:
• Centered landing (aircraft center inside 60 cm / 24 in circle) – 5 points
• Offset landing (any motor inside the circle) – 1 point
All scenarios include 20 targets, allowing a maximum score of 100 points per trial.
Safety and Trial Termination
Extreme deviations from the intended flight path, loss of control, or contact with any object result in immediate termination of the trial to ensure operational safety.
Bonus Identifications
Interior targets visible through windows may be documented as bonus identifications. These are not included in standard scoring due to variability in lighting conditions and are intended for training and familiarization rather than benchmarking.
Operational Skills Evaluated
• Aircraft positional control and stability
• Orbit consistency and situational awareness
• Camera zoom, exposure, and acuity management
• Precision landing and perching accuracy
• Battery management and persistent surveillance
Use Cases
• Public safety and law enforcement vehicle inspections
• Search, overwatch, and reconnaissance training
• Aircraft and sensor performance benchmarking
• Day and night operations training
• Standards-based remote pilot proficiency assessment
Standards Reference
This scenario aligns with NIST Standard Test Methods for Small Unmanned Aircraft Systems and ASTM International Committee E54.09 (Homeland Security Applications: Response Robots). It is suitable for formal testing, training programs, and operational readiness evaluations.
For additional information call Influential Drones or visit any of the following resources below:
See also:
