[DAR-4308][External] Allow fetch_remote_files to return files that have not yet finished processing

[DAR-4308][External] Allow fetch_remote_files to return files that have not yet finished processing #849