Synthetic-aperture imaging (SAI) removes foreground occluders such as foliage by integrating many views of a scene captured along a camera path. The technique has typically relied on frame cameras. In a new simulation study, researchers asked whether an event camera, which records per-pixel brightness changes asynchronously, could offer advantages over conventional frame capture.
The authors rendered a densely sampled Blender sequence and converted it into frames using an EMVA 1288 noise model of an industrial global-shutter camera, and into an event stream using the v2e simulator parameterized to match a Sony IMX636. Frame integration used an existing airborne optical sectioning renderer. For the event stream, they added a new integration path that projects every single event onto the focal plane at its own interpolated pose, so no events had to be binned into frames.
In a bright scene at 25 m/s, the frame camera recorded only three images along the path and could not remove the occluder, while the event camera reconstructed the target even after an event-rate controller dropped most of its events to fit the camera link. At the same speed in a 5 lux scene, the event camera no longer resolved the target. In a 5 lux scene at 5 m/s, both sensors reconstructed the target at similar quality.
At high speed, the capped event stream showed the target at the same data volume as the three frames. At 1 m/s, the researchers compared both cameras at two matched data budgets and found the event camera had no advantage in reconstruction quality. The data rate of the event camera depends on the scene and is highest exactly in the fast bright scenes where it is needed most. The authors conclude that event cameras can be beneficial for high-speed SAI, but the benefit diminishes under low light and at slower speeds. The results are based entirely on simulation, with both sensors seeing exactly the same scene and camera movement. They note the event camera's data rate is scene-dependent and peaks in the fast bright conditions where it is most useful.