You can probably make that work, just have to be careful deleting from S3, make sure to only delete those emails you imported and not accidentally delete an email that arrived during the import process.
My personal setup makes heavy use of rclone so I used that instead of awscli: