Search for string Advice?

[collectordave]

Hi All

I have a large series of strings, 750,000 of them and I need to search these for a single string.

They are downloaded from the internet.

What is the quickest method to carry out a search? Either put them all in a database then search or use lists or maps.

Regards

CD

[falsam]

They are downloaded from the internet.

How are your data stored on the server ?
The data received is formatted? JSON ?
Do you have a loop to receive data in your code?

[wilbert]

What kind of search ?
An exact match of the entire string, a substring search, case (in)sensitive ?
Do you always need to search for the same string ?

[collectordave]

Hi

The strings come from several different places with no defined format they may also contain unicode characters.

I have a loop that reads all the strings from the various locations working no bother. My problem is that when a new string is entered or downloaded I have to check all the strings for an exact match, whitespace can be thrown away.

CD

[wilbert]

If your only goal is to built a list of strings without adding duplicates, the easiest way is to use AddMapElement. The default behaviour is already to avoid duplicate keys so you wouldn’t need a search. This should also be pretty fast.