Martha is using a special process of splitting a text documents into smaller units. These units can represent words, numbers phrases, symbols, or any element in text that a program can work with. Martha tells co-workers that using this method will make the most sense out of unstructured data without processing the entire text as a single string. Which method is Martha using? Pattern Recognition Turning Test Cognitive Computing Tokenization

Question

Martha is using a special process of splitting a text documents into smaller units. These units can represent words, numbers phrases, symbols, or any element in text that a program can work with. Martha tells co-workers that using this method will make the most sense out of unstructured data without processing the entire text as a single string. Which method is Martha using? Pattern Recognition Turning Test Cognitive Computing Tokenization

Answer 1

Martha is using the method of **Tokenization**. Tokenization is the process of breaking down text into smaller units, such as words, phrases, or symbols, which can be analyzed and processed by a program. This method helps in making sense out of unstructured data by handling each unit individually rather than processing the entire text as a single string.

Problemas

Roztwór

Respuesta