Waouuuh !!!
First ...thanks at all for your answers, it's that ...the PB familly
@JASSING
I don't know this "Fast Text Search" added to Sqlite
If i have the choice, i prefer not use SQLITE for this project
It's really a very simple function i need, the line is or not in the other TXT
And I do not feel really comfortable with SQL
But thanks for your tips, it's when even a good solution to remember
@Little John
I had learned from an old project that Stringfield was not fast, which is why I expected it to drag.
But the worst is that I tried without it in a simple loop and it still drags when even
@DEMIVEC
I have actually 1823952 lines, but that increases every day
The two TXT file is the list of file in a external HD 4TO, but that can be a day more, i have until 16TO on other HD
For the moment, the PB recursive enumeration takes 41 minute(s) 53 seconde(s) for scan all a disk
This time is good for me
, but the problem is to analyse the two files after
Global NewMap MapElements(nbLines)
I don't know it's possible to give the size of the MAP
Thanks for this tips
@MK-SOFT
Mk-Soft wrote:I do not know the structure of the text file.
The structure of the text file is simple
NumberLine|
FullPath\NameFile.Extension|SizeFile|DateCreated|DateAccessed|DateModified
NumberLine|NameFile.Extension|SizeFile|DateCreated|DateAccessed|DateModified
.....
NumberLine|
FullPath\NameFile.Extension|SizeFile|DateCreated|DateAccessed|DateModified
NumberLine|NameFile.Extension|SizeFile|DateCreated|DateAccessed|DateModified
I wrote the FullPath only if it change, for win numerous size of the file
Mk-Soft wrote:But why a map and not a list?
What do you want to achieve with the map?
At the begining, i believe it's simple
1/ I create my too huges files (Master.txt/Slave.txt) enumeration of 4TO hard drive ~41 minute(s) 53 seconde(s)
2/ I load the "Slave" file in a MAP
3/ I read line by line the Master file and ask if the line exist in the MAP slave disk
Mk-Soft wrote:Maybe there is another better way
Surely
And again more sure after the first try and all the day that i took to turn around my machine for wait the end of the loop
@Marc56US
Where you find all your tips ?????
I don't know this internal DOS tool exist after more than 30 years of use WINDOWS
At the begining, i say to me : "This is the solution !!" when i see the rapidity of the answer
But, I put it back in my panties when i have read the "Diff.txt"
FC wrote:Comparaison des fichiers C:\MyHgeFileMaster.txt et C:\MyHugeFileSlave.TXT
échec de la resynchronisation. Les fichiers sont trop différents.
Thanks when even, that could have been the right solution
I have try several software specialized for do that BeyoundCompare, etc ...
But there are always a day where the software have problems with the huge size of the 4TO, and that crash often my machine because an enormous memory is used.
But also several another problems, and i can't do anything, other that wait, wait again, behind my screen
And worst...sometime after wait sometime a full day, the soft is locked and i not have real explications
Then i say to me....PB can surely do something for me, after all, it's just a line by line comparison, no ?
Then i say to me, first.. i create 2 files, like this i have always the 2 lists of enumeration files in my HD, even if that crash
And i "just" need to compare this two monstruous files, with all the methods i can found with PB
It looked simple
"On paper"