File picking rule on FILE FTP Solution [Mydd3]

[francescobianco]

On file.php solution the one used to connect over sFTP we have problem related to file picking?

Sometime, depends on the file presents on the watched directory some files are ignored in the readData process.
The only way act for discover the ignored file is to DELETE (manually) from the directory (watched) the last processed file.

What's is the right way to use FTP solution to work without ignoring files?

@simonetravaglini

[Myddleware]

Hi @francescobianco ,
Myddleware check if a new file exists or if an existing files has been modified. The reference date is used for that.
For information, the command used to browse the directory is : find . -newermt "'.$date_ref.'" -type f | sort | head -n 1
I see a bug when I try this command. Files could be ignored if several files have a modification date after the reference date. The issue is on the sort command because sort is done on file name instead of modification date.
We will fix this issue.

[Myddleware]

@AlexMyddleware @CamillePMyddleware
We need to change the call here

myddleware/src/Solutions/file.php

Line 579 in 891e9e1

$stream = ssh2_exec($this->sshconnection, 'cd '.$directory.';find . -newermt "'.$date_ref.'" -type f | sort | head -n 1');

The command to be executed is find . -newermt "2023-05-04 00:00:00" -type f -printf "%T+ %p\n" | sort | head -n 1
The $file variable will contains the modification date of the file, you will have to remove to get the filename here :

myddleware/src/Solutions/file.php

Line 148 in 891e9e1

$file = $this->get_last_file($this->paramConnexion['directory'].'/'.$module, '1970-01-01 00:00:00');

and

myddleware/src/Solutions/file.php

Line 282 in 891e9e1

$file = $this->get_last_file($this->paramConnexion['directory'].'/'.$param['module'], (!empty($param['query']) ? '1970-01-01 00:00:00' : $param['date_ref']));

Thanks.