strtok is part of the C library and what it does is splitting a C null-delimited string into tokens separated by any delimiter you specify. The first call to strtok must pass the C string to tokenize, and subsequent calls must specify NULL as the first argument, which tells the function to continue tokenizing the … Read more
One major difference between strtok() and strsep() is that strtok() is standardized (by the C standard, and hence also by POSIX) but strsep() is not standardized (by C or POSIX; it is available in the GNU C Library, and originated on BSD). Thus, portable code is more likely to use strtok() than strsep(). Another difference … Read more
According with the strtok_s section of this document: 6.7.3.1 The strtok_s function The strtok_s function fixes two problems in the strtok function: A new parameter, s1max, prevents strtok_s from storing outside of the string being tokenized. (The string being divided into tokens is both an input and output of the function since strtok_s stores null … Read more
The documentation for strtok_r is quite clear. The strtok_r() function is a reentrant version strtok(). The saveptr argument is a pointer to a char * variable that is used internally by strtok_r() in order to maintain context between successive calls that parse the same string. On the first call to strtok_r(), str should point to … Read more
the strtok runtime function works like this the first time you call strtok you provide a string that you want to tokenize char s[] = “this is a string”; in the above string space seems to be a good delimiter between words so lets use that: char* p = strtok(s, ” “); what happens now … Read more
#include <stdio.h> #include <string.h> int main () { char buf[] =”abc/qwe/ccd”; int i = 0; char *p = strtok (buf, “https://stackoverflow.com/”); char *array[3]; while (p != NULL) { array[i++] = p; p = strtok (NULL, “https://stackoverflow.com/”); } for (i = 0; i < 3; ++i) printf(“%s\n”, array[i]); return 0; }
#include <string.h> char *token; char line[] = “SEVERAL WORDS”; char *search = ” “; // Token will point to “SEVERAL”. token = strtok(line, search); // Token will point to “WORDS”. token = strtok(NULL, search); Update Note that on some operating systems, strtok man page mentions: This interface is obsoleted by strsep(3). An example with strsep … Read more
#include <iostream> #include <string> #include <sstream> int main(){ std::string myText(“some-text-to-tokenize”); std::istringstream iss(myText); std::string token; while (std::getline(iss, token, ‘-‘)) { std::cout << token << std::endl; } return 0; } Or, as mentioned, use boost for more flexibility.